Jul 15 04:06:06.361416 ip-10-0-128-222 systemd[1]: Starting Kubernetes Kubelet... Jul 15 04:06:06.735751 ip-10-0-128-222 kubenswrapper[2581]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 15 04:06:06.735751 ip-10-0-128-222 kubenswrapper[2581]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 15 04:06:06.735751 ip-10-0-128-222 kubenswrapper[2581]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 15 04:06:06.735751 ip-10-0-128-222 kubenswrapper[2581]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 15 04:06:06.735751 ip-10-0-128-222 kubenswrapper[2581]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 15 04:06:06.737531 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:06.737437 2581 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 15 04:06:06.743007 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:06:06.742979 2581 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 15 04:06:06.743007 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:06:06.743002 2581 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 15 04:06:06.743007 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:06:06.743007 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 15 04:06:06.743007 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:06:06.743012 2581 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 15 04:06:06.743007 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:06:06.743016 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 15 04:06:06.743335 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:06:06.743020 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 15 04:06:06.743335 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:06:06.743025 2581 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 15 04:06:06.743335 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:06:06.743029 2581 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 15 04:06:06.743335 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:06:06.743033 2581 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 15 04:06:06.743335 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:06:06.743037 2581 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 15 04:06:06.743335 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:06:06.743040 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 15 04:06:06.743335 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:06:06.743044 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 15 04:06:06.743335 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:06:06.743048 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 15 04:06:06.743335 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:06:06.743051 2581 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 15 04:06:06.743335 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:06:06.743055 2581 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 15 04:06:06.743335 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:06:06.743058 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 15 04:06:06.743335 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:06:06.743063 2581 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 15 04:06:06.743335 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:06:06.743067 2581 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 15 04:06:06.743335 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:06:06.743071 2581 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 15 04:06:06.743335 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:06:06.743074 2581 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 15 04:06:06.743335 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:06:06.743078 2581 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 15 04:06:06.743335 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:06:06.743082 2581 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 15 04:06:06.743335 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:06:06.743086 2581 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 15 04:06:06.743335 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:06:06.743090 2581 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 15 04:06:06.743335 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:06:06.743093 2581 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 15 04:06:06.744136 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:06:06.743098 2581 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 15 04:06:06.744136 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:06:06.743102 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 15 04:06:06.744136 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:06:06.743105 2581 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 15 04:06:06.744136 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:06:06.743110 2581 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 15 04:06:06.744136 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:06:06.743114 2581 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 15 04:06:06.744136 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:06:06.743118 2581 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 15 04:06:06.744136 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:06:06.743141 2581 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 15 04:06:06.744136 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:06:06.743148 2581 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 15 04:06:06.744136 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:06:06.743154 2581 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 15 04:06:06.744136 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:06:06.743158 2581 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 15 04:06:06.744136 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:06:06.743162 2581 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 15 04:06:06.744136 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:06:06.743165 2581 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 15 04:06:06.744136 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:06:06.743169 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 15 04:06:06.744136 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:06:06.743174 2581 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 15 04:06:06.744136 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:06:06.743178 2581 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 15 04:06:06.744136 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:06:06.743182 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 15 04:06:06.744136 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:06:06.743187 2581 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 15 04:06:06.744136 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:06:06.743192 2581 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 15 04:06:06.744136 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:06:06.743196 2581 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 15 04:06:06.744916 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:06:06.743200 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 15 04:06:06.744916 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:06:06.743205 2581 feature_gate.go:328] unrecognized feature gate: Example Jul 15 04:06:06.744916 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:06:06.743211 2581 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 15 04:06:06.744916 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:06:06.743215 2581 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 15 04:06:06.744916 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:06:06.743219 2581 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 15 04:06:06.744916 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:06:06.743223 2581 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 15 04:06:06.744916 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:06:06.743227 2581 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 15 04:06:06.744916 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:06:06.743232 2581 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 15 04:06:06.744916 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:06:06.743236 2581 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 15 04:06:06.744916 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:06:06.743240 2581 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 15 04:06:06.744916 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:06:06.743244 2581 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 15 04:06:06.744916 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:06:06.743249 2581 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 15 04:06:06.744916 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:06:06.743253 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 15 04:06:06.744916 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:06:06.743257 2581 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 15 04:06:06.744916 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:06:06.743262 2581 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 15 04:06:06.744916 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:06:06.743266 2581 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 15 04:06:06.744916 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:06:06.743270 2581 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 15 04:06:06.744916 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:06:06.743274 2581 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 15 04:06:06.744916 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:06:06.743279 2581 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 15 04:06:06.744916 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:06:06.743284 2581 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 15 04:06:06.745743 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:06:06.743288 2581 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 15 04:06:06.745743 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:06:06.743292 2581 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 15 04:06:06.745743 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:06:06.743298 2581 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 15 04:06:06.745743 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:06:06.743304 2581 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 15 04:06:06.745743 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:06:06.743310 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 15 04:06:06.745743 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:06:06.743315 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 15 04:06:06.745743 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:06:06.743320 2581 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 15 04:06:06.745743 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:06:06.743324 2581 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 15 04:06:06.745743 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:06:06.743329 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 15 04:06:06.745743 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:06:06.743333 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 15 04:06:06.745743 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:06:06.743339 2581 feature_gate.go:328] unrecognized feature gate: Example2 Jul 15 04:06:06.745743 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:06:06.743344 2581 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 15 04:06:06.745743 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:06:06.743348 2581 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 15 04:06:06.745743 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:06:06.743352 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 15 04:06:06.745743 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:06:06.743357 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 15 04:06:06.745743 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:06:06.743362 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 15 04:06:06.745743 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:06:06.743366 2581 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 15 04:06:06.745743 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:06:06.743370 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 15 04:06:06.745743 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:06:06.743374 2581 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 15 04:06:06.746551 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:06:06.743380 2581 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 15 04:06:06.746551 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:06:06.743384 2581 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 15 04:06:06.746551 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:06:06.743388 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 15 04:06:06.746551 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:06:06.743392 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 15 04:06:06.746551 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:06:06.743397 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 15 04:06:06.746551 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:06:06.743401 2581 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 15 04:06:06.746551 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:06:06.743406 2581 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 15 04:06:06.746551 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:06:06.743410 2581 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 15 04:06:06.746551 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:06:06.743414 2581 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 15 04:06:06.746551 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:06:06.743418 2581 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 15 04:06:06.746551 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:06:06.743422 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 15 04:06:06.746551 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:06:06.743427 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 15 04:06:06.746551 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:06:06.743431 2581 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 15 04:06:06.746551 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:06:06.743435 2581 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 15 04:06:06.746551 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:06:06.743439 2581 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 15 04:06:06.746551 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:06:06.743444 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 15 04:06:06.746551 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:06:06.744692 2581 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 15 04:06:06.746551 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:06:06.744704 2581 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 15 04:06:06.746551 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:06:06.744709 2581 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 15 04:06:06.746551 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:06:06.744717 2581 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 15 04:06:06.747381 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:06:06.744722 2581 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 15 04:06:06.747381 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:06:06.744726 2581 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 15 04:06:06.747381 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:06:06.744731 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 15 04:06:06.747381 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:06:06.744735 2581 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 15 04:06:06.747381 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:06:06.744739 2581 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 15 04:06:06.747381 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:06:06.744743 2581 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 15 04:06:06.747381 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:06:06.744747 2581 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 15 04:06:06.747381 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:06:06.744751 2581 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 15 04:06:06.747381 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:06:06.744756 2581 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 15 04:06:06.747381 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:06:06.744760 2581 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 15 04:06:06.747381 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:06:06.744764 2581 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 15 04:06:06.747381 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:06:06.744769 2581 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 15 04:06:06.747381 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:06:06.744773 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 15 04:06:06.747381 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:06:06.744778 2581 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 15 04:06:06.747381 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:06:06.744782 2581 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 15 04:06:06.747381 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:06:06.744787 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 15 04:06:06.747381 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:06:06.744791 2581 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 15 04:06:06.747381 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:06:06.744796 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 15 04:06:06.747381 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:06:06.744800 2581 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 15 04:06:06.747381 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:06:06.744804 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 15 04:06:06.748097 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:06:06.744809 2581 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 15 04:06:06.748097 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:06:06.744813 2581 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 15 04:06:06.748097 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:06:06.744817 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 15 04:06:06.748097 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:06:06.744821 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 15 04:06:06.748097 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:06:06.744826 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 15 04:06:06.748097 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:06:06.744830 2581 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 15 04:06:06.748097 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:06:06.744834 2581 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 15 04:06:06.748097 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:06:06.744838 2581 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 15 04:06:06.748097 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:06:06.744842 2581 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 15 04:06:06.748097 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:06:06.744847 2581 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 15 04:06:06.748097 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:06:06.744854 2581 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 15 04:06:06.748097 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:06:06.744860 2581 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 15 04:06:06.748097 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:06:06.744865 2581 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 15 04:06:06.748097 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:06:06.744870 2581 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 15 04:06:06.748097 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:06:06.744875 2581 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 15 04:06:06.748097 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:06:06.744879 2581 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 15 04:06:06.748097 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:06:06.744887 2581 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 15 04:06:06.748097 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:06:06.744892 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 15 04:06:06.748097 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:06:06.744897 2581 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 15 04:06:06.748638 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:06:06.744901 2581 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 15 04:06:06.748638 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:06:06.744907 2581 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 15 04:06:06.748638 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:06:06.744912 2581 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 15 04:06:06.748638 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:06:06.744917 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 15 04:06:06.748638 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:06:06.744921 2581 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 15 04:06:06.748638 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:06:06.744925 2581 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 15 04:06:06.748638 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:06:06.744930 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 15 04:06:06.748638 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:06:06.744936 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 15 04:06:06.748638 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:06:06.744941 2581 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 15 04:06:06.748638 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:06:06.744945 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 15 04:06:06.748638 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:06:06.744949 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 15 04:06:06.748638 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:06:06.744954 2581 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 15 04:06:06.748638 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:06:06.744958 2581 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 15 04:06:06.748638 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:06:06.744963 2581 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 15 04:06:06.748638 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:06:06.744967 2581 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 15 04:06:06.748638 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:06:06.744971 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 15 04:06:06.748638 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:06:06.744975 2581 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 15 04:06:06.748638 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:06:06.744980 2581 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 15 04:06:06.748638 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:06:06.744987 2581 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 15 04:06:06.749137 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:06:06.744992 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 15 04:06:06.749137 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:06:06.744996 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 15 04:06:06.749137 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:06:06.745000 2581 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 15 04:06:06.749137 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:06:06.745005 2581 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 15 04:06:06.749137 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:06:06.745009 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 15 04:06:06.749137 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:06:06.745014 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 15 04:06:06.749137 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:06:06.745019 2581 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 15 04:06:06.749137 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:06:06.745022 2581 feature_gate.go:328] unrecognized feature gate: Example2 Jul 15 04:06:06.749137 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:06:06.745027 2581 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 15 04:06:06.749137 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:06:06.745031 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 15 04:06:06.749137 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:06:06.745035 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 15 04:06:06.749137 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:06:06.745039 2581 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 15 04:06:06.749137 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:06:06.745044 2581 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 15 04:06:06.749137 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:06:06.745048 2581 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 15 04:06:06.749137 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:06:06.745052 2581 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 15 04:06:06.749137 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:06:06.745056 2581 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 15 04:06:06.749137 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:06:06.745060 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 15 04:06:06.749137 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:06:06.745064 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 15 04:06:06.749137 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:06:06.745069 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 15 04:06:06.749137 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:06:06.745073 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 15 04:06:06.749760 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:06:06.745077 2581 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 15 04:06:06.749760 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:06:06.745082 2581 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 15 04:06:06.749760 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:06:06.745086 2581 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 15 04:06:06.749760 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:06:06.745091 2581 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 15 04:06:06.749760 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:06:06.745094 2581 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 15 04:06:06.749760 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:06:06.745098 2581 feature_gate.go:328] unrecognized feature gate: Example Jul 15 04:06:06.749760 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:06:06.745103 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 15 04:06:06.749760 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:06:06.745107 2581 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 15 04:06:06.749760 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:06:06.745112 2581 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 15 04:06:06.749760 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:06:06.745116 2581 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 15 04:06:06.749760 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:06:06.745136 2581 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 15 04:06:06.749760 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:06:06.745141 2581 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 15 04:06:06.749760 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:06:06.745146 2581 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 15 04:06:06.749760 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:06:06.745150 2581 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 15 04:06:06.749760 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:06:06.745154 2581 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 15 04:06:06.749760 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:06:06.745159 2581 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 15 04:06:06.749760 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:06:06.745163 2581 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 15 04:06:06.749760 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:06:06.745833 2581 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 15 04:06:06.749760 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:06:06.745842 2581 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 15 04:06:06.749760 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:06:06.745846 2581 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 15 04:06:06.750379 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:06:06.745853 2581 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 15 04:06:06.750379 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:06:06.745860 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 15 04:06:06.750379 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:06:06.745865 2581 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 15 04:06:06.750379 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:06:06.745870 2581 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 15 04:06:06.750379 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:06:06.745874 2581 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 15 04:06:06.750379 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:06:06.745878 2581 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 15 04:06:06.750379 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:06:06.745883 2581 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 15 04:06:06.750379 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:06:06.745887 2581 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 15 04:06:06.750379 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:06:06.745891 2581 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 15 04:06:06.750379 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:06:06.745895 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 15 04:06:06.750379 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:06:06.745900 2581 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 15 04:06:06.750379 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:06:06.745904 2581 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 15 04:06:06.750379 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:06:06.745910 2581 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 15 04:06:06.750379 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:06:06.745925 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 15 04:06:06.750379 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:06:06.745930 2581 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 15 04:06:06.750379 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:06:06.745937 2581 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 15 04:06:06.750379 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:06:06.745942 2581 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 15 04:06:06.750379 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:06:06.745946 2581 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 15 04:06:06.750379 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:06:06.745950 2581 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 15 04:06:06.750852 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:06:06.745954 2581 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 15 04:06:06.750852 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:06:06.745958 2581 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 15 04:06:06.750852 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:06:06.745963 2581 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 15 04:06:06.750852 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:06:06.745967 2581 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 15 04:06:06.750852 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:06:06.745971 2581 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 15 04:06:06.750852 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:06:06.745976 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 15 04:06:06.750852 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:06:06.745980 2581 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 15 04:06:06.750852 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:06:06.745984 2581 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 15 04:06:06.750852 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:06:06.745989 2581 feature_gate.go:328] unrecognized feature gate: Example Jul 15 04:06:06.750852 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:06:06.745993 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 15 04:06:06.750852 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:06:06.745998 2581 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 15 04:06:06.750852 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:06:06.746002 2581 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 15 04:06:06.750852 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:06:06.746006 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 15 04:06:06.750852 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:06:06.746010 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 15 04:06:06.750852 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:06:06.746014 2581 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 15 04:06:06.750852 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:06:06.746019 2581 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 15 04:06:06.750852 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:06:06.746023 2581 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 15 04:06:06.750852 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:06:06.746027 2581 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 15 04:06:06.750852 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:06:06.746031 2581 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 15 04:06:06.751410 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:06:06.746035 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 15 04:06:06.751410 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:06:06.746039 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 15 04:06:06.751410 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:06:06.746043 2581 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 15 04:06:06.751410 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:06:06.746047 2581 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 15 04:06:06.751410 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:06:06.746051 2581 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 15 04:06:06.751410 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:06:06.746056 2581 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 15 04:06:06.751410 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:06:06.746060 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 15 04:06:06.751410 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:06:06.746064 2581 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 15 04:06:06.751410 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:06:06.746069 2581 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 15 04:06:06.751410 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:06:06.746076 2581 feature_gate.go:328] unrecognized feature gate: Example2 Jul 15 04:06:06.751410 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:06:06.746080 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 15 04:06:06.751410 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:06:06.746084 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 15 04:06:06.751410 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:06:06.746088 2581 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 15 04:06:06.751410 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:06:06.746093 2581 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 15 04:06:06.751410 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:06:06.746097 2581 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 15 04:06:06.751410 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:06:06.746101 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 15 04:06:06.751410 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:06:06.746107 2581 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 15 04:06:06.751410 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:06:06.746111 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 15 04:06:06.751410 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:06:06.746115 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 15 04:06:06.751410 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:06:06.746141 2581 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 15 04:06:06.751891 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:06:06.746146 2581 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 15 04:06:06.751891 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:06:06.746150 2581 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 15 04:06:06.751891 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:06:06.746154 2581 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 15 04:06:06.751891 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:06:06.746158 2581 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 15 04:06:06.751891 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:06:06.746163 2581 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 15 04:06:06.751891 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:06:06.746166 2581 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 15 04:06:06.751891 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:06:06.746171 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 15 04:06:06.751891 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:06:06.746175 2581 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 15 04:06:06.751891 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:06:06.746179 2581 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 15 04:06:06.751891 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:06:06.746184 2581 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 15 04:06:06.751891 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:06:06.746188 2581 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 15 04:06:06.751891 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:06:06.746193 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 15 04:06:06.751891 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:06:06.746197 2581 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 15 04:06:06.751891 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:06:06.746201 2581 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 15 04:06:06.751891 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:06:06.746207 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 15 04:06:06.751891 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:06:06.746212 2581 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 15 04:06:06.751891 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:06:06.746216 2581 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 15 04:06:06.751891 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:06:06.746220 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 15 04:06:06.751891 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:06:06.746227 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 15 04:06:06.751891 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:06:06.746231 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 15 04:06:06.752415 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:06:06.746235 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 15 04:06:06.752415 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:06:06.746242 2581 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 15 04:06:06.752415 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:06:06.746246 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 15 04:06:06.752415 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:06:06.746251 2581 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 15 04:06:06.752415 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:06:06.746255 2581 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 15 04:06:06.752415 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:06:06.746259 2581 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 15 04:06:06.752415 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:06:06.746263 2581 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 15 04:06:06.752415 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:06:06.746267 2581 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 15 04:06:06.752415 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:06:06.746271 2581 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 15 04:06:06.752415 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:06:06.746276 2581 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 15 04:06:06.752415 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:06:06.746280 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 15 04:06:06.752415 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:06:06.746283 2581 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 15 04:06:06.752415 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:06:06.746288 2581 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 15 04:06:06.752415 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:06:06.746294 2581 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 15 04:06:06.752415 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:06:06.746300 2581 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 15 04:06:06.752415 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:06:06.746305 2581 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 15 04:06:06.752415 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:06:06.746309 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 15 04:06:06.752415 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:06:06.746314 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 15 04:06:06.752415 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:06.746418 2581 flags.go:64] FLAG: --address="0.0.0.0" Jul 15 04:06:06.752415 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:06.746429 2581 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 15 04:06:06.752880 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:06.746440 2581 flags.go:64] FLAG: --anonymous-auth="true" Jul 15 04:06:06.752880 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:06.746447 2581 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 15 04:06:06.752880 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:06.746453 2581 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 15 04:06:06.752880 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:06.746458 2581 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 15 04:06:06.752880 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:06.746465 2581 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 15 04:06:06.752880 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:06.746472 2581 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 15 04:06:06.752880 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:06.746479 2581 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 15 04:06:06.752880 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:06.746484 2581 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 15 04:06:06.752880 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:06.746490 2581 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 15 04:06:06.752880 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:06.746495 2581 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 15 04:06:06.752880 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:06.746500 2581 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 15 04:06:06.752880 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:06.746505 2581 flags.go:64] FLAG: --cgroup-root="" Jul 15 04:06:06.752880 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:06.746509 2581 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 15 04:06:06.752880 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:06.746517 2581 flags.go:64] FLAG: --client-ca-file="" Jul 15 04:06:06.752880 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:06.746522 2581 flags.go:64] FLAG: --cloud-provider="external" Jul 15 04:06:06.752880 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:06.746528 2581 flags.go:64] FLAG: --cluster-dns="[]" Jul 15 04:06:06.752880 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:06.746534 2581 flags.go:64] FLAG: --cluster-domain="" Jul 15 04:06:06.752880 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:06.746539 2581 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 15 04:06:06.752880 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:06.746544 2581 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 15 04:06:06.752880 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:06.746548 2581 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 15 04:06:06.752880 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:06.746553 2581 flags.go:64] FLAG: --container-log-max-files="5" Jul 15 04:06:06.752880 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:06.746559 2581 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 15 04:06:06.752880 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:06.746564 2581 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 15 04:06:06.753463 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:06.746569 2581 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 15 04:06:06.753463 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:06.746575 2581 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 15 04:06:06.753463 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:06.746580 2581 flags.go:64] FLAG: --contention-profiling="false" Jul 15 04:06:06.753463 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:06.746585 2581 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 15 04:06:06.753463 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:06.746590 2581 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 15 04:06:06.753463 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:06.746595 2581 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 15 04:06:06.753463 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:06.746599 2581 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 15 04:06:06.753463 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:06.746606 2581 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 15 04:06:06.753463 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:06.746611 2581 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 15 04:06:06.753463 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:06.746615 2581 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 15 04:06:06.753463 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:06.746620 2581 flags.go:64] FLAG: --enable-load-reader="false" Jul 15 04:06:06.753463 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:06.746625 2581 flags.go:64] FLAG: --enable-server="true" Jul 15 04:06:06.753463 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:06.746630 2581 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 15 04:06:06.753463 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:06.746638 2581 flags.go:64] FLAG: --event-burst="100" Jul 15 04:06:06.753463 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:06.746643 2581 flags.go:64] FLAG: --event-qps="50" Jul 15 04:06:06.753463 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:06.746649 2581 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 15 04:06:06.753463 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:06.746654 2581 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 15 04:06:06.753463 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:06.746659 2581 flags.go:64] FLAG: --eviction-hard="" Jul 15 04:06:06.753463 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:06.746665 2581 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 15 04:06:06.753463 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:06.746671 2581 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 15 04:06:06.753463 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:06.746675 2581 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 15 04:06:06.753463 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:06.746680 2581 flags.go:64] FLAG: --eviction-soft="" Jul 15 04:06:06.753463 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:06.746685 2581 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 15 04:06:06.753463 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:06.746690 2581 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 15 04:06:06.753463 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:06.746695 2581 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 15 04:06:06.754099 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:06.746700 2581 flags.go:64] FLAG: --experimental-mounter-path="" Jul 15 04:06:06.754099 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:06.746704 2581 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 15 04:06:06.754099 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:06.746709 2581 flags.go:64] FLAG: --fail-swap-on="true" Jul 15 04:06:06.754099 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:06.746714 2581 flags.go:64] FLAG: --feature-gates="" Jul 15 04:06:06.754099 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:06.746720 2581 flags.go:64] FLAG: --file-check-frequency="20s" Jul 15 04:06:06.754099 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:06.746725 2581 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 15 04:06:06.754099 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:06.746730 2581 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 15 04:06:06.754099 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:06.746735 2581 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 15 04:06:06.754099 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:06.746739 2581 flags.go:64] FLAG: --healthz-port="10248" Jul 15 04:06:06.754099 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:06.746744 2581 flags.go:64] FLAG: --help="false" Jul 15 04:06:06.754099 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:06.746749 2581 flags.go:64] FLAG: --hostname-override="ip-10-0-128-222.ec2.internal" Jul 15 04:06:06.754099 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:06.746754 2581 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 15 04:06:06.754099 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:06.746759 2581 flags.go:64] FLAG: --http-check-frequency="20s" Jul 15 04:06:06.754099 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:06.746763 2581 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 15 04:06:06.754099 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:06.746769 2581 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 15 04:06:06.754099 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:06.746774 2581 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 15 04:06:06.754099 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:06.746779 2581 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 15 04:06:06.754099 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:06.746783 2581 flags.go:64] FLAG: --image-service-endpoint="" Jul 15 04:06:06.754099 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:06.746787 2581 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 15 04:06:06.754099 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:06.746792 2581 flags.go:64] FLAG: --kube-api-burst="100" Jul 15 04:06:06.754099 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:06.746797 2581 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 15 04:06:06.754099 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:06.746802 2581 flags.go:64] FLAG: --kube-api-qps="50" Jul 15 04:06:06.754099 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:06.746809 2581 flags.go:64] FLAG: --kube-reserved="" Jul 15 04:06:06.754099 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:06.746814 2581 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 15 04:06:06.754848 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:06.746818 2581 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 15 04:06:06.754848 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:06.746823 2581 flags.go:64] FLAG: --kubelet-cgroups="" Jul 15 04:06:06.754848 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:06.746829 2581 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 15 04:06:06.754848 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:06.746833 2581 flags.go:64] FLAG: --lock-file="" Jul 15 04:06:06.754848 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:06.746837 2581 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 15 04:06:06.754848 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:06.746843 2581 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 15 04:06:06.754848 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:06.746848 2581 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 15 04:06:06.754848 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:06.746856 2581 flags.go:64] FLAG: --log-json-split-stream="false" Jul 15 04:06:06.754848 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:06.746862 2581 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 15 04:06:06.754848 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:06.746867 2581 flags.go:64] FLAG: --log-text-split-stream="false" Jul 15 04:06:06.754848 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:06.746872 2581 flags.go:64] FLAG: --logging-format="text" Jul 15 04:06:06.754848 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:06.746877 2581 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 15 04:06:06.754848 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:06.746882 2581 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 15 04:06:06.754848 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:06.746887 2581 flags.go:64] FLAG: --manifest-url="" Jul 15 04:06:06.754848 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:06.746891 2581 flags.go:64] FLAG: --manifest-url-header="" Jul 15 04:06:06.754848 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:06.746899 2581 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 15 04:06:06.754848 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:06.746904 2581 flags.go:64] FLAG: --max-open-files="1000000" Jul 15 04:06:06.754848 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:06.746910 2581 flags.go:64] FLAG: --max-pods="110" Jul 15 04:06:06.754848 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:06.746915 2581 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 15 04:06:06.754848 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:06.746920 2581 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 15 04:06:06.754848 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:06.746924 2581 flags.go:64] FLAG: --memory-manager-policy="None" Jul 15 04:06:06.754848 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:06.746929 2581 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 15 04:06:06.754848 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:06.746934 2581 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 15 04:06:06.754848 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:06.746939 2581 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 15 04:06:06.754848 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:06.746943 2581 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 15 04:06:06.755887 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:06.746955 2581 flags.go:64] FLAG: --node-status-max-images="50" Jul 15 04:06:06.755887 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:06.746960 2581 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 15 04:06:06.755887 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:06.746964 2581 flags.go:64] FLAG: --oom-score-adj="-999" Jul 15 04:06:06.755887 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:06.746969 2581 flags.go:64] FLAG: --pod-cidr="" Jul 15 04:06:06.755887 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:06.746974 2581 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b04c0b1f73af4d021dd8f0b51bfeb302c24482c093de5f2c43654ab56c506926" Jul 15 04:06:06.755887 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:06.746984 2581 flags.go:64] FLAG: --pod-manifest-path="" Jul 15 04:06:06.755887 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:06.746989 2581 flags.go:64] FLAG: --pod-max-pids="-1" Jul 15 04:06:06.755887 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:06.746993 2581 flags.go:64] FLAG: --pods-per-core="0" Jul 15 04:06:06.755887 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:06.746998 2581 flags.go:64] FLAG: --port="10250" Jul 15 04:06:06.755887 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:06.747002 2581 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 15 04:06:06.755887 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:06.747007 2581 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-088a5885377b63663" Jul 15 04:06:06.755887 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:06.747013 2581 flags.go:64] FLAG: --qos-reserved="" Jul 15 04:06:06.755887 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:06.747017 2581 flags.go:64] FLAG: --read-only-port="10255" Jul 15 04:06:06.755887 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:06.747022 2581 flags.go:64] FLAG: --register-node="true" Jul 15 04:06:06.755887 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:06.747027 2581 flags.go:64] FLAG: --register-with-taints="" Jul 15 04:06:06.755887 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:06.747033 2581 flags.go:64] FLAG: --registry-burst="10" Jul 15 04:06:06.755887 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:06.747039 2581 flags.go:64] FLAG: --registry-qps="5" Jul 15 04:06:06.755887 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:06.747043 2581 flags.go:64] FLAG: --reserved-cpus="" Jul 15 04:06:06.755887 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:06.747048 2581 flags.go:64] FLAG: --reserved-memory="" Jul 15 04:06:06.755887 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:06.747054 2581 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 15 04:06:06.755887 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:06.747059 2581 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 15 04:06:06.755887 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:06.747064 2581 flags.go:64] FLAG: --rotate-certificates="false" Jul 15 04:06:06.755887 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:06.747068 2581 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 15 04:06:06.755887 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:06.747073 2581 flags.go:64] FLAG: --runonce="false" Jul 15 04:06:06.755887 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:06.747078 2581 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 15 04:06:06.756691 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:06.747083 2581 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 15 04:06:06.756691 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:06.747088 2581 flags.go:64] FLAG: --seccomp-default="false" Jul 15 04:06:06.756691 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:06.747093 2581 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 15 04:06:06.756691 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:06.747098 2581 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 15 04:06:06.756691 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:06.747103 2581 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 15 04:06:06.756691 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:06.747107 2581 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 15 04:06:06.756691 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:06.747112 2581 flags.go:64] FLAG: --storage-driver-password="root" Jul 15 04:06:06.756691 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:06.747117 2581 flags.go:64] FLAG: --storage-driver-secure="false" Jul 15 04:06:06.756691 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:06.747139 2581 flags.go:64] FLAG: --storage-driver-table="stats" Jul 15 04:06:06.756691 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:06.747143 2581 flags.go:64] FLAG: --storage-driver-user="root" Jul 15 04:06:06.756691 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:06.747148 2581 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 15 04:06:06.756691 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:06.747153 2581 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 15 04:06:06.756691 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:06.747160 2581 flags.go:64] FLAG: --system-cgroups="" Jul 15 04:06:06.756691 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:06.747164 2581 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 15 04:06:06.756691 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:06.747173 2581 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 15 04:06:06.756691 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:06.747177 2581 flags.go:64] FLAG: --tls-cert-file="" Jul 15 04:06:06.756691 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:06.747182 2581 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 15 04:06:06.756691 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:06.747188 2581 flags.go:64] FLAG: --tls-min-version="" Jul 15 04:06:06.756691 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:06.747192 2581 flags.go:64] FLAG: --tls-private-key-file="" Jul 15 04:06:06.756691 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:06.747197 2581 flags.go:64] FLAG: --topology-manager-policy="none" Jul 15 04:06:06.756691 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:06.747202 2581 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 15 04:06:06.756691 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:06.747207 2581 flags.go:64] FLAG: --topology-manager-scope="container" Jul 15 04:06:06.756691 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:06.747211 2581 flags.go:64] FLAG: --v="2" Jul 15 04:06:06.756691 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:06.747218 2581 flags.go:64] FLAG: --version="false" Jul 15 04:06:06.756691 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:06.747225 2581 flags.go:64] FLAG: --vmodule="" Jul 15 04:06:06.757445 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:06.747231 2581 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 15 04:06:06.757445 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:06.747236 2581 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 15 04:06:06.757445 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:06:06.747417 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 15 04:06:06.757445 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:06:06.747425 2581 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 15 04:06:06.757445 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:06:06.747430 2581 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 15 04:06:06.757445 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:06:06.747434 2581 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 15 04:06:06.757445 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:06:06.747439 2581 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 15 04:06:06.757445 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:06:06.747444 2581 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 15 04:06:06.757445 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:06:06.747448 2581 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 15 04:06:06.757445 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:06:06.747453 2581 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 15 04:06:06.757445 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:06:06.747457 2581 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 15 04:06:06.757445 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:06:06.747461 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 15 04:06:06.757445 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:06:06.747466 2581 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 15 04:06:06.757445 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:06:06.747470 2581 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 15 04:06:06.757445 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:06:06.747474 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 15 04:06:06.757445 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:06:06.747479 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 15 04:06:06.757445 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:06:06.747483 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 15 04:06:06.757445 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:06:06.747487 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 15 04:06:06.757445 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:06:06.747491 2581 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 15 04:06:06.757445 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:06:06.747499 2581 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 15 04:06:06.758082 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:06:06.747503 2581 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 15 04:06:06.758082 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:06:06.747507 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 15 04:06:06.758082 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:06:06.747512 2581 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 15 04:06:06.758082 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:06:06.747516 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 15 04:06:06.758082 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:06:06.747520 2581 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 15 04:06:06.758082 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:06:06.747524 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 15 04:06:06.758082 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:06:06.747528 2581 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 15 04:06:06.758082 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:06:06.747536 2581 feature_gate.go:328] unrecognized feature gate: Example2 Jul 15 04:06:06.758082 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:06:06.747541 2581 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 15 04:06:06.758082 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:06:06.747545 2581 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 15 04:06:06.758082 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:06:06.747549 2581 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 15 04:06:06.758082 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:06:06.747554 2581 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 15 04:06:06.758082 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:06:06.747559 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 15 04:06:06.758082 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:06:06.747563 2581 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 15 04:06:06.758082 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:06:06.747568 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 15 04:06:06.758082 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:06:06.747572 2581 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 15 04:06:06.758082 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:06:06.747576 2581 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 15 04:06:06.758082 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:06:06.747580 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 15 04:06:06.758082 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:06:06.747584 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 15 04:06:06.758082 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:06:06.747589 2581 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 15 04:06:06.758651 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:06:06.747593 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 15 04:06:06.758651 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:06:06.747597 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 15 04:06:06.758651 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:06:06.747601 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 15 04:06:06.758651 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:06:06.747606 2581 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 15 04:06:06.758651 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:06:06.747610 2581 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 15 04:06:06.758651 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:06:06.747614 2581 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 15 04:06:06.758651 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:06:06.747618 2581 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 15 04:06:06.758651 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:06:06.747622 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 15 04:06:06.758651 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:06:06.747626 2581 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 15 04:06:06.758651 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:06:06.747631 2581 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 15 04:06:06.758651 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:06:06.747635 2581 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 15 04:06:06.758651 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:06:06.747641 2581 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 15 04:06:06.758651 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:06:06.747645 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 15 04:06:06.758651 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:06:06.747649 2581 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 15 04:06:06.758651 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:06:06.747653 2581 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 15 04:06:06.758651 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:06:06.747658 2581 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 15 04:06:06.758651 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:06:06.747662 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 15 04:06:06.758651 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:06:06.747666 2581 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 15 04:06:06.758651 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:06:06.747670 2581 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 15 04:06:06.758651 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:06:06.747676 2581 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 15 04:06:06.759231 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:06:06.747680 2581 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 15 04:06:06.759231 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:06:06.747684 2581 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 15 04:06:06.759231 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:06:06.747689 2581 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 15 04:06:06.759231 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:06:06.747695 2581 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 15 04:06:06.759231 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:06:06.747701 2581 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 15 04:06:06.759231 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:06:06.747706 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 15 04:06:06.759231 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:06:06.747711 2581 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 15 04:06:06.759231 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:06:06.747715 2581 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 15 04:06:06.759231 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:06:06.747719 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 15 04:06:06.759231 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:06:06.747723 2581 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 15 04:06:06.759231 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:06:06.747727 2581 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 15 04:06:06.759231 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:06:06.747731 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 15 04:06:06.759231 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:06:06.747736 2581 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 15 04:06:06.759231 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:06:06.747740 2581 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 15 04:06:06.759231 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:06:06.747744 2581 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 15 04:06:06.759231 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:06:06.747748 2581 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 15 04:06:06.759231 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:06:06.747752 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 15 04:06:06.759231 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:06:06.747757 2581 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 15 04:06:06.759231 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:06:06.747761 2581 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 15 04:06:06.759231 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:06:06.747765 2581 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 15 04:06:06.759748 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:06:06.747769 2581 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 15 04:06:06.759748 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:06:06.747773 2581 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 15 04:06:06.759748 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:06:06.747778 2581 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 15 04:06:06.759748 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:06:06.747784 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 15 04:06:06.759748 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:06:06.747788 2581 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 15 04:06:06.759748 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:06:06.747792 2581 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 15 04:06:06.759748 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:06:06.747797 2581 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 15 04:06:06.759748 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:06:06.747801 2581 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 15 04:06:06.759748 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:06:06.747806 2581 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 15 04:06:06.759748 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:06:06.747810 2581 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 15 04:06:06.759748 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:06:06.747814 2581 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 15 04:06:06.759748 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:06:06.747820 2581 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 15 04:06:06.759748 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:06:06.747824 2581 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 15 04:06:06.759748 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:06:06.747828 2581 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 15 04:06:06.759748 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:06:06.747832 2581 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 15 04:06:06.759748 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:06:06.747836 2581 feature_gate.go:328] unrecognized feature gate: Example Jul 15 04:06:06.759748 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:06:06.747843 2581 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 15 04:06:06.759748 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:06:06.747850 2581 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 15 04:06:06.759748 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:06:06.747862 2581 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 15 04:06:06.760292 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:06:06.747867 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 15 04:06:06.760292 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:06:06.747872 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 15 04:06:06.760292 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:06.748527 2581 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 15 04:06:06.760292 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:06.756314 2581 server.go:529] "Kubelet version" kubeletVersion="v1.34.9" Jul 15 04:06:06.760292 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:06.756333 2581 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 15 04:06:06.760292 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:06.757370 2581 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 15 04:06:06.760292 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:06.757380 2581 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 15 04:06:06.760292 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:06:06.757452 2581 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 15 04:06:06.760292 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:06:06.757459 2581 feature_gate.go:328] unrecognized feature gate: Example Jul 15 04:06:06.760292 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:06:06.757463 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 15 04:06:06.760292 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:06:06.757467 2581 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 15 04:06:06.760292 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:06:06.757470 2581 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 15 04:06:06.760292 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:06:06.757473 2581 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 15 04:06:06.760292 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:06:06.757476 2581 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 15 04:06:06.760292 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:06:06.757479 2581 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 15 04:06:06.760701 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:06:06.757482 2581 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 15 04:06:06.760701 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:06:06.757485 2581 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 15 04:06:06.760701 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:06:06.757488 2581 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 15 04:06:06.760701 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:06:06.757490 2581 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 15 04:06:06.760701 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:06:06.757493 2581 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 15 04:06:06.760701 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:06:06.757496 2581 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 15 04:06:06.760701 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:06:06.757499 2581 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 15 04:06:06.760701 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:06:06.757504 2581 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 15 04:06:06.760701 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:06:06.757509 2581 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 15 04:06:06.760701 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:06:06.757514 2581 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 15 04:06:06.760701 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:06:06.757526 2581 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 15 04:06:06.760701 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:06:06.757532 2581 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 15 04:06:06.760701 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:06:06.757536 2581 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 15 04:06:06.760701 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:06:06.757540 2581 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 15 04:06:06.760701 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:06:06.757543 2581 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 15 04:06:06.760701 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:06:06.757546 2581 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 15 04:06:06.760701 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:06:06.757550 2581 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 15 04:06:06.760701 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:06:06.757553 2581 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 15 04:06:06.760701 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:06:06.757556 2581 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 15 04:06:06.761206 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:06:06.757559 2581 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 15 04:06:06.761206 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:06:06.757561 2581 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 15 04:06:06.761206 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:06:06.757566 2581 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 15 04:06:06.761206 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:06:06.757571 2581 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 15 04:06:06.761206 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:06:06.757574 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 15 04:06:06.761206 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:06:06.757577 2581 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 15 04:06:06.761206 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:06:06.757580 2581 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 15 04:06:06.761206 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:06:06.757583 2581 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 15 04:06:06.761206 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:06:06.757585 2581 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 15 04:06:06.761206 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:06:06.757588 2581 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 15 04:06:06.761206 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:06:06.757591 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 15 04:06:06.761206 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:06:06.757594 2581 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 15 04:06:06.761206 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:06:06.757596 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 15 04:06:06.761206 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:06:06.757599 2581 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 15 04:06:06.761206 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:06:06.757602 2581 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 15 04:06:06.761206 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:06:06.757605 2581 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 15 04:06:06.761206 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:06:06.757608 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 15 04:06:06.761206 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:06:06.757611 2581 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 15 04:06:06.761206 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:06:06.757613 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 15 04:06:06.761206 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:06:06.757617 2581 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 15 04:06:06.761725 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:06:06.757620 2581 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 15 04:06:06.761725 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:06:06.757623 2581 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 15 04:06:06.761725 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:06:06.757625 2581 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 15 04:06:06.761725 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:06:06.757628 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 15 04:06:06.761725 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:06:06.757631 2581 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 15 04:06:06.761725 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:06:06.757634 2581 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 15 04:06:06.761725 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:06:06.757636 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 15 04:06:06.761725 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:06:06.757639 2581 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 15 04:06:06.761725 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:06:06.757642 2581 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 15 04:06:06.761725 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:06:06.757645 2581 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 15 04:06:06.761725 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:06:06.757649 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 15 04:06:06.761725 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:06:06.757652 2581 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 15 04:06:06.761725 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:06:06.757654 2581 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 15 04:06:06.761725 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:06:06.757657 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 15 04:06:06.761725 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:06:06.757660 2581 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 15 04:06:06.761725 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:06:06.757663 2581 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 15 04:06:06.761725 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:06:06.757666 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 15 04:06:06.761725 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:06:06.757669 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 15 04:06:06.761725 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:06:06.757672 2581 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 15 04:06:06.761725 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:06:06.757674 2581 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 15 04:06:06.762272 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:06:06.757677 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 15 04:06:06.762272 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:06:06.757680 2581 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 15 04:06:06.762272 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:06:06.757683 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 15 04:06:06.762272 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:06:06.757685 2581 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 15 04:06:06.762272 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:06:06.757688 2581 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 15 04:06:06.762272 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:06:06.757690 2581 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 15 04:06:06.762272 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:06:06.757693 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 15 04:06:06.762272 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:06:06.757696 2581 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 15 04:06:06.762272 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:06:06.757699 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 15 04:06:06.762272 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:06:06.757701 2581 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 15 04:06:06.762272 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:06:06.757704 2581 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 15 04:06:06.762272 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:06:06.757707 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 15 04:06:06.762272 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:06:06.757711 2581 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 15 04:06:06.762272 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:06:06.757715 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 15 04:06:06.762272 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:06:06.757718 2581 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 15 04:06:06.762272 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:06:06.757722 2581 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 15 04:06:06.762272 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:06:06.757725 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 15 04:06:06.762272 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:06:06.757728 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 15 04:06:06.762272 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:06:06.757731 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 15 04:06:06.762776 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:06:06.757734 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 15 04:06:06.762776 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:06:06.757737 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 15 04:06:06.762776 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:06:06.757740 2581 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 15 04:06:06.762776 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:06:06.757743 2581 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 15 04:06:06.762776 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:06:06.757747 2581 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 15 04:06:06.762776 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:06:06.757749 2581 feature_gate.go:328] unrecognized feature gate: Example2 Jul 15 04:06:06.762776 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:06:06.757752 2581 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 15 04:06:06.762776 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:06:06.757755 2581 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 15 04:06:06.762776 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:06:06.757758 2581 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 15 04:06:06.762776 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:06:06.757762 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 15 04:06:06.762776 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:06:06.757764 2581 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 15 04:06:06.762776 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:06:06.757767 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 15 04:06:06.762776 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:06:06.757770 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 15 04:06:06.762776 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:06.757776 2581 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 15 04:06:06.762776 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:06:06.757958 2581 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 15 04:06:06.763164 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:06:06.757965 2581 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 15 04:06:06.763164 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:06:06.757969 2581 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 15 04:06:06.763164 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:06:06.757972 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 15 04:06:06.763164 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:06:06.757975 2581 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 15 04:06:06.763164 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:06:06.757978 2581 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 15 04:06:06.763164 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:06:06.757981 2581 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 15 04:06:06.763164 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:06:06.757984 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 15 04:06:06.763164 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:06:06.757987 2581 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 15 04:06:06.763164 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:06:06.757990 2581 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 15 04:06:06.763164 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:06:06.757992 2581 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 15 04:06:06.763164 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:06:06.757995 2581 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 15 04:06:06.763164 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:06:06.757998 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 15 04:06:06.763164 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:06:06.758001 2581 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 15 04:06:06.763164 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:06:06.758003 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 15 04:06:06.763164 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:06:06.758006 2581 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 15 04:06:06.763164 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:06:06.758009 2581 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 15 04:06:06.763164 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:06:06.758012 2581 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 15 04:06:06.763164 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:06:06.758015 2581 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 15 04:06:06.763164 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:06:06.758017 2581 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 15 04:06:06.763777 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:06:06.758021 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 15 04:06:06.763777 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:06:06.758024 2581 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 15 04:06:06.763777 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:06:06.758026 2581 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 15 04:06:06.763777 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:06:06.758029 2581 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 15 04:06:06.763777 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:06:06.758032 2581 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 15 04:06:06.763777 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:06:06.758035 2581 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 15 04:06:06.763777 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:06:06.758038 2581 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 15 04:06:06.763777 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:06:06.758040 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 15 04:06:06.763777 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:06:06.758051 2581 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 15 04:06:06.763777 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:06:06.758054 2581 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 15 04:06:06.763777 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:06:06.758056 2581 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 15 04:06:06.763777 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:06:06.758059 2581 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 15 04:06:06.763777 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:06:06.758062 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 15 04:06:06.763777 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:06:06.758064 2581 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 15 04:06:06.763777 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:06:06.758067 2581 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 15 04:06:06.763777 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:06:06.758070 2581 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 15 04:06:06.763777 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:06:06.758072 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 15 04:06:06.763777 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:06:06.758076 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 15 04:06:06.763777 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:06:06.758078 2581 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 15 04:06:06.763777 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:06:06.758081 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 15 04:06:06.764345 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:06:06.758084 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 15 04:06:06.764345 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:06:06.758087 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 15 04:06:06.764345 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:06:06.758090 2581 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 15 04:06:06.764345 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:06:06.758093 2581 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 15 04:06:06.764345 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:06:06.758096 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 15 04:06:06.764345 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:06:06.758099 2581 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 15 04:06:06.764345 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:06:06.758101 2581 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 15 04:06:06.764345 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:06:06.758104 2581 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 15 04:06:06.764345 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:06:06.758107 2581 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 15 04:06:06.764345 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:06:06.758110 2581 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 15 04:06:06.764345 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:06:06.758113 2581 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 15 04:06:06.764345 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:06:06.758115 2581 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 15 04:06:06.764345 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:06:06.758118 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 15 04:06:06.764345 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:06:06.758120 2581 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 15 04:06:06.764345 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:06:06.758123 2581 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 15 04:06:06.764345 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:06:06.758126 2581 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 15 04:06:06.764345 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:06:06.758129 2581 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 15 04:06:06.764345 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:06:06.758133 2581 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 15 04:06:06.764345 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:06:06.758139 2581 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 15 04:06:06.764850 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:06:06.758142 2581 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 15 04:06:06.764850 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:06:06.758145 2581 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 15 04:06:06.764850 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:06:06.758155 2581 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 15 04:06:06.764850 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:06:06.758158 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 15 04:06:06.764850 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:06:06.758161 2581 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 15 04:06:06.764850 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:06:06.758164 2581 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 15 04:06:06.764850 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:06:06.758168 2581 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 15 04:06:06.764850 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:06:06.758170 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 15 04:06:06.764850 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:06:06.758173 2581 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 15 04:06:06.764850 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:06:06.758176 2581 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 15 04:06:06.764850 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:06:06.758179 2581 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 15 04:06:06.764850 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:06:06.758201 2581 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 15 04:06:06.764850 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:06:06.758206 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 15 04:06:06.764850 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:06:06.758211 2581 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 15 04:06:06.764850 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:06:06.758214 2581 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 15 04:06:06.764850 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:06:06.758217 2581 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 15 04:06:06.764850 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:06:06.758220 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 15 04:06:06.764850 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:06:06.758223 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 15 04:06:06.764850 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:06:06.758226 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 15 04:06:06.764850 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:06:06.758228 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 15 04:06:06.765387 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:06:06.758231 2581 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 15 04:06:06.765387 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:06:06.758234 2581 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 15 04:06:06.765387 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:06:06.758237 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 15 04:06:06.765387 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:06:06.758239 2581 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 15 04:06:06.765387 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:06:06.758242 2581 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 15 04:06:06.765387 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:06:06.758245 2581 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 15 04:06:06.765387 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:06:06.758248 2581 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 15 04:06:06.765387 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:06:06.758250 2581 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 15 04:06:06.765387 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:06:06.758253 2581 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 15 04:06:06.765387 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:06:06.758256 2581 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 15 04:06:06.765387 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:06:06.758259 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 15 04:06:06.765387 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:06:06.758262 2581 feature_gate.go:328] unrecognized feature gate: Example Jul 15 04:06:06.765387 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:06:06.758264 2581 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 15 04:06:06.765387 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:06:06.758267 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 15 04:06:06.765387 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:06:06.758269 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 15 04:06:06.765387 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:06:06.758279 2581 feature_gate.go:328] unrecognized feature gate: Example2 Jul 15 04:06:06.765387 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:06:06.758282 2581 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 15 04:06:06.765387 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:06:06.758285 2581 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 15 04:06:06.765387 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:06:06.758288 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 15 04:06:06.765387 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:06:06.758290 2581 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 15 04:06:06.765899 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:06.758296 2581 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 15 04:06:06.765899 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:06.758453 2581 server.go:962] "Client rotation is on, will bootstrap in background" Jul 15 04:06:06.765899 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:06.761089 2581 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 15 04:06:06.765899 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:06.762641 2581 server.go:1019] "Starting client certificate rotation" Jul 15 04:06:06.765899 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:06.762759 2581 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 15 04:06:06.765899 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:06.762795 2581 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 15 04:06:06.765899 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:06.765215 2581 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 15 04:06:06.771420 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:06.771388 2581 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 15 04:06:06.782183 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:06.782153 2581 log.go:25] "Validated CRI v1 runtime API" Jul 15 04:06:06.784691 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:06.784675 2581 log.go:25] "Validated CRI v1 image API" Jul 15 04:06:06.785578 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:06.785556 2581 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 15 04:06:06.787970 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:06.787945 2581 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 9cd03045-40c2-4753-b55e-d92c31db350d:/dev/nvme0n1p3 b0707e43-5eb3-45ad-b0cb-68208e697a29:/dev/nvme0n1p4] Jul 15 04:06:06.788051 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:06.787967 2581 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 15 04:06:06.793660 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:06.793532 2581 manager.go:216] Machine: {Timestamp:2026-07-15 04:06:06.79204369 +0000 UTC m=+0.318844699 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3100277 MemoryCapacity:33164496896 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec26f10359f56c18a2ec29632361ffeb SystemUUID:ec26f103-59f5-6c18-a2ec-29632361ffeb BootID:ba6345c6-69e0-4efe-a952-ef45770c5dce Filesystems:[{Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:1b:e0:2e:12:f1 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:1b:e0:2e:12:f1 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:72:ff:b0:e2:1d:ad Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164496896 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 15 04:06:06.793660 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:06.793651 2581 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 15 04:06:06.793830 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:06.793743 2581 manager.go:232] Version: {KernelVersion:5.14.0-570.126.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260702-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 15 04:06:06.793932 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:06.793918 2581 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 15 04:06:06.797378 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:06.797348 2581 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 15 04:06:06.797538 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:06.797382 2581 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-128-222.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 15 04:06:06.798077 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:06.798067 2581 topology_manager.go:138] "Creating topology manager with none policy" Jul 15 04:06:06.798117 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:06.798081 2581 container_manager_linux.go:309] "Creating device plugin manager" Jul 15 04:06:06.798117 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:06.798089 2581 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 15 04:06:06.798787 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:06.798775 2581 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 15 04:06:06.800598 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:06.800586 2581 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 15 04:06:06.805336 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:06.805319 2581 state_mem.go:36] "Initialized new in-memory state store" Jul 15 04:06:06.805473 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:06.805463 2581 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 15 04:06:06.805519 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:06.805496 2581 kubelet.go:486] "Attempting to sync node with API server" Jul 15 04:06:06.805519 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:06.805506 2581 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 15 04:06:06.805592 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:06.805523 2581 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 15 04:06:06.805592 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:06.805536 2581 kubelet.go:398] "Adding apiserver pod source" Jul 15 04:06:06.805592 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:06.805545 2581 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 15 04:06:06.805977 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:06.805963 2581 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 15 04:06:06.806019 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:06.805990 2581 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 15 04:06:06.808328 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:06.808311 2581 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1" Jul 15 04:06:06.810109 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:06.810092 2581 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 15 04:06:06.810178 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:06.810131 2581 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 15 04:06:06.811073 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:06.811061 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 15 04:06:06.811125 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:06.811077 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 15 04:06:06.811125 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:06.811084 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 15 04:06:06.811125 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:06.811091 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 15 04:06:06.811125 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:06.811101 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 15 04:06:06.811125 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:06.811109 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 15 04:06:06.811125 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:06.811119 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 15 04:06:06.811125 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:06.811125 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 15 04:06:06.811375 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:06.811132 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 15 04:06:06.811375 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:06.811138 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 15 04:06:06.811375 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:06.811155 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 15 04:06:06.811375 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:06.811161 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 15 04:06:06.812137 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:06.812124 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 15 04:06:06.812171 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:06.812140 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 15 04:06:06.817086 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:06.816265 2581 server.go:1268] "Started kubelet" Jul 15 04:06:06.817086 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:06.817039 2581 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 15 04:06:06.817266 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:06.817153 2581 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 15 04:06:06.817324 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:06.817233 2581 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 15 04:06:06.817489 ip-10-0-128-222 systemd[1]: Started Kubernetes Kubelet. Jul 15 04:06:06.818459 ip-10-0-128-222 kubenswrapper[2581]: E0715 04:06:06.818208 2581 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-128-222.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 15 04:06:06.818459 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:06.818227 2581 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-128-222.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 15 04:06:06.818459 ip-10-0-128-222 kubenswrapper[2581]: E0715 04:06:06.818432 2581 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 15 04:06:06.818981 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:06.818963 2581 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 15 04:06:06.820031 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:06.820014 2581 server.go:310] "Adding debug handlers to kubelet server" Jul 15 04:06:06.824266 ip-10-0-128-222 kubenswrapper[2581]: E0715 04:06:06.824246 2581 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 15 04:06:06.826317 ip-10-0-128-222 kubenswrapper[2581]: E0715 04:06:06.825201 2581 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-128-222.ec2.internal.18c25aeac7fc5f57 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-128-222.ec2.internal,UID:ip-10-0-128-222.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-128-222.ec2.internal,},FirstTimestamp:2026-07-15 04:06:06.816190295 +0000 UTC m=+0.342991312,LastTimestamp:2026-07-15 04:06:06.816190295 +0000 UTC m=+0.342991312,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-128-222.ec2.internal,}" Jul 15 04:06:06.828310 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:06.828285 2581 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 15 04:06:06.828310 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:06.828291 2581 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 15 04:06:06.828574 ip-10-0-128-222 kubenswrapper[2581]: E0715 04:06:06.828535 2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-222.ec2.internal\" not found" Jul 15 04:06:06.829084 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:06.829067 2581 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 15 04:06:06.829084 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:06.829061 2581 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 15 04:06:06.829236 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:06.829092 2581 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 15 04:06:06.829236 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:06.829176 2581 factory.go:55] Registering systemd factory Jul 15 04:06:06.829236 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:06.829197 2581 factory.go:223] Registration of the systemd container factory successfully Jul 15 04:06:06.829442 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:06.829254 2581 reconstruct.go:97] "Volume reconstruction finished" Jul 15 04:06:06.829442 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:06.829263 2581 reconciler.go:29] "Reconciler: start to sync state" Jul 15 04:06:06.829533 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:06.829497 2581 factory.go:153] Registering CRI-O factory Jul 15 04:06:06.829533 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:06.829526 2581 factory.go:223] Registration of the crio container factory successfully Jul 15 04:06:06.829634 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:06.829597 2581 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 15 04:06:06.829634 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:06.829626 2581 factory.go:103] Registering Raw factory Jul 15 04:06:06.829723 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:06.829646 2581 manager.go:1196] Started watching for new ooms in manager Jul 15 04:06:06.830381 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:06.830359 2581 manager.go:349] Starting recovery of all containers Jul 15 04:06:06.841150 ip-10-0-128-222 kubenswrapper[2581]: E0715 04:06:06.840411 2581 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-128-222.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jul 15 04:06:06.841150 ip-10-0-128-222 kubenswrapper[2581]: E0715 04:06:06.840574 2581 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jul 15 04:06:06.841150 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:06.840967 2581 manager.go:354] Recovery completed Jul 15 04:06:06.845715 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:06.845691 2581 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-k24d9" Jul 15 04:06:06.846292 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:06.846275 2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 15 04:06:06.848431 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:06.848413 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-222.ec2.internal" event="NodeHasSufficientMemory" Jul 15 04:06:06.848534 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:06.848452 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-222.ec2.internal" event="NodeHasNoDiskPressure" Jul 15 04:06:06.848534 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:06.848469 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-222.ec2.internal" event="NodeHasSufficientPID" Jul 15 04:06:06.849057 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:06.849041 2581 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 15 04:06:06.849057 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:06.849057 2581 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 15 04:06:06.849215 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:06.849078 2581 state_mem.go:36] "Initialized new in-memory state store" Jul 15 04:06:06.849215 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:06.849098 2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 15 04:06:06.849881 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:06.849864 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-222.ec2.internal" event="NodeHasSufficientMemory" Jul 15 04:06:06.849928 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:06.849888 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-222.ec2.internal" event="NodeHasNoDiskPressure" Jul 15 04:06:06.849928 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:06.849898 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-222.ec2.internal" event="NodeHasSufficientPID" Jul 15 04:06:06.851445 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:06.851432 2581 policy_none.go:49] "None policy: Start" Jul 15 04:06:06.851521 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:06.851448 2581 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 15 04:06:06.851521 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:06.851460 2581 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 15 04:06:06.851821 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:06.851807 2581 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-k24d9" Jul 15 04:06:06.853653 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:06.853639 2581 policy_none.go:47] "Start" Jul 15 04:06:06.890934 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:06.890902 2581 manager.go:337] "Starting Device Plugin manager" Jul 15 04:06:06.891092 ip-10-0-128-222 kubenswrapper[2581]: E0715 04:06:06.890954 2581 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 15 04:06:06.891092 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:06.890968 2581 server.go:87] "Starting device plugin registration server" Jul 15 04:06:06.891342 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:06.891326 2581 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 15 04:06:06.891431 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:06.891346 2581 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 15 04:06:06.891480 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:06.891431 2581 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 15 04:06:06.891554 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:06.891529 2581 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 15 04:06:06.891554 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:06.891547 2581 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 15 04:06:06.892224 ip-10-0-128-222 kubenswrapper[2581]: E0715 04:06:06.892200 2581 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 15 04:06:06.892319 ip-10-0-128-222 kubenswrapper[2581]: E0715 04:06:06.892254 2581 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-128-222.ec2.internal\" not found" Jul 15 04:06:06.981963 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:06.981916 2581 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 15 04:06:06.984393 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:06.983178 2581 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 15 04:06:06.984393 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:06.983229 2581 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 15 04:06:06.984393 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:06.983259 2581 kubelet.go:2448] "Starting kubelet main sync loop" Jul 15 04:06:06.984393 ip-10-0-128-222 kubenswrapper[2581]: E0715 04:06:06.983304 2581 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jul 15 04:06:06.985991 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:06.985928 2581 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 15 04:06:06.992056 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:06.992039 2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 15 04:06:06.993313 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:06.993296 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-222.ec2.internal" event="NodeHasSufficientMemory" Jul 15 04:06:06.993367 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:06.993329 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-222.ec2.internal" event="NodeHasNoDiskPressure" Jul 15 04:06:06.993367 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:06.993340 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-222.ec2.internal" event="NodeHasSufficientPID" Jul 15 04:06:06.993430 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:06.993370 2581 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-128-222.ec2.internal" Jul 15 04:06:07.003562 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:07.003544 2581 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-128-222.ec2.internal" Jul 15 04:06:07.003657 ip-10-0-128-222 kubenswrapper[2581]: E0715 04:06:07.003571 2581 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-128-222.ec2.internal\": node \"ip-10-0-128-222.ec2.internal\" not found" Jul 15 04:06:07.044245 ip-10-0-128-222 kubenswrapper[2581]: E0715 04:06:07.044217 2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-222.ec2.internal\" not found" Jul 15 04:06:07.084753 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:07.084704 2581 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["kube-system/kube-apiserver-proxy-ip-10-0-128-222.ec2.internal","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-222.ec2.internal"] Jul 15 04:06:07.084855 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:07.084798 2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 15 04:06:07.086629 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:07.086607 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-222.ec2.internal" event="NodeHasSufficientMemory" Jul 15 04:06:07.086694 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:07.086651 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-222.ec2.internal" event="NodeHasNoDiskPressure" Jul 15 04:06:07.086694 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:07.086663 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-222.ec2.internal" event="NodeHasSufficientPID" Jul 15 04:06:07.089207 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:07.089188 2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 15 04:06:07.089300 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:07.089282 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-222.ec2.internal" Jul 15 04:06:07.089355 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:07.089321 2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 15 04:06:07.090008 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:07.089986 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-222.ec2.internal" event="NodeHasSufficientMemory" Jul 15 04:06:07.090108 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:07.090014 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-222.ec2.internal" event="NodeHasNoDiskPressure" Jul 15 04:06:07.090108 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:07.090024 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-222.ec2.internal" event="NodeHasSufficientPID" Jul 15 04:06:07.090108 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:07.089991 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-222.ec2.internal" event="NodeHasSufficientMemory" Jul 15 04:06:07.090108 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:07.090103 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-222.ec2.internal" event="NodeHasNoDiskPressure" Jul 15 04:06:07.090313 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:07.090116 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-222.ec2.internal" event="NodeHasSufficientPID" Jul 15 04:06:07.092588 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:07.092569 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-222.ec2.internal" Jul 15 04:06:07.092670 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:07.092602 2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 15 04:06:07.093345 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:07.093327 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-222.ec2.internal" event="NodeHasSufficientMemory" Jul 15 04:06:07.093433 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:07.093356 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-222.ec2.internal" event="NodeHasNoDiskPressure" Jul 15 04:06:07.093433 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:07.093367 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-222.ec2.internal" event="NodeHasSufficientPID" Jul 15 04:06:07.117096 ip-10-0-128-222 kubenswrapper[2581]: E0715 04:06:07.117070 2581 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-128-222.ec2.internal\" not found" node="ip-10-0-128-222.ec2.internal" Jul 15 04:06:07.121878 ip-10-0-128-222 kubenswrapper[2581]: E0715 04:06:07.121860 2581 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-128-222.ec2.internal\" not found" node="ip-10-0-128-222.ec2.internal" Jul 15 04:06:07.144626 ip-10-0-128-222 kubenswrapper[2581]: E0715 04:06:07.144594 2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-222.ec2.internal\" not found" Jul 15 04:06:07.231302 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:07.231252 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/843258bd2137f5699fadd3ee328bb5bf-config\") pod \"kube-apiserver-proxy-ip-10-0-128-222.ec2.internal\" (UID: \"843258bd2137f5699fadd3ee328bb5bf\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-128-222.ec2.internal" Jul 15 04:06:07.231302 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:07.231306 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/b9bbc5f25726cd5de9e0584f4c940785-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-128-222.ec2.internal\" (UID: \"b9bbc5f25726cd5de9e0584f4c940785\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-222.ec2.internal" Jul 15 04:06:07.231464 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:07.231347 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b9bbc5f25726cd5de9e0584f4c940785-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-128-222.ec2.internal\" (UID: \"b9bbc5f25726cd5de9e0584f4c940785\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-222.ec2.internal" Jul 15 04:06:07.244984 ip-10-0-128-222 kubenswrapper[2581]: E0715 04:06:07.244916 2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-222.ec2.internal\" not found" Jul 15 04:06:07.331960 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:07.331913 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/843258bd2137f5699fadd3ee328bb5bf-config\") pod \"kube-apiserver-proxy-ip-10-0-128-222.ec2.internal\" (UID: \"843258bd2137f5699fadd3ee328bb5bf\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-128-222.ec2.internal" Jul 15 04:06:07.331960 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:07.331958 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/b9bbc5f25726cd5de9e0584f4c940785-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-128-222.ec2.internal\" (UID: \"b9bbc5f25726cd5de9e0584f4c940785\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-222.ec2.internal" Jul 15 04:06:07.331960 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:07.331975 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b9bbc5f25726cd5de9e0584f4c940785-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-128-222.ec2.internal\" (UID: \"b9bbc5f25726cd5de9e0584f4c940785\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-222.ec2.internal" Jul 15 04:06:07.332249 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:07.332038 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/b9bbc5f25726cd5de9e0584f4c940785-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-128-222.ec2.internal\" (UID: \"b9bbc5f25726cd5de9e0584f4c940785\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-222.ec2.internal" Jul 15 04:06:07.332249 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:07.332038 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/843258bd2137f5699fadd3ee328bb5bf-config\") pod \"kube-apiserver-proxy-ip-10-0-128-222.ec2.internal\" (UID: \"843258bd2137f5699fadd3ee328bb5bf\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-128-222.ec2.internal" Jul 15 04:06:07.332249 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:07.332081 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b9bbc5f25726cd5de9e0584f4c940785-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-128-222.ec2.internal\" (UID: \"b9bbc5f25726cd5de9e0584f4c940785\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-222.ec2.internal" Jul 15 04:06:07.346100 ip-10-0-128-222 kubenswrapper[2581]: E0715 04:06:07.346068 2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-222.ec2.internal\" not found" Jul 15 04:06:07.424287 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:07.424244 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-222.ec2.internal" Jul 15 04:06:07.426525 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:07.426509 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-222.ec2.internal" Jul 15 04:06:07.447311 ip-10-0-128-222 kubenswrapper[2581]: E0715 04:06:07.447276 2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-222.ec2.internal\" not found" Jul 15 04:06:07.548100 ip-10-0-128-222 kubenswrapper[2581]: E0715 04:06:07.547991 2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-222.ec2.internal\" not found" Jul 15 04:06:07.631913 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:07.631881 2581 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 15 04:06:07.728667 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:07.728626 2581 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-222.ec2.internal" Jul 15 04:06:07.738878 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:07.738852 2581 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 15 04:06:07.740808 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:07.740793 2581 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-222.ec2.internal" Jul 15 04:06:07.754026 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:07.754002 2581 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 15 04:06:07.761690 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:07.761661 2581 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 15 04:06:07.761821 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:07.761800 2581 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 15 04:06:07.761911 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:07.761853 2581 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 15 04:06:07.806656 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:07.806562 2581 apiserver.go:52] "Watching apiserver" Jul 15 04:06:07.824454 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:07.824421 2581 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 15 04:06:07.824801 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:07.824778 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-target-4n42z","openshift-network-operator/iptables-alerter-8jqrr","openshift-ovn-kubernetes/ovnkube-node-x6lg7","kube-system/global-pull-secret-syncer-kz7p2","kube-system/konnectivity-agent-cvjv6","kube-system/kube-apiserver-proxy-ip-10-0-128-222.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lzsbl","openshift-cluster-node-tuning-operator/tuned-sj6mk","openshift-dns/node-resolver-lf5rb","openshift-image-registry/node-ca-9kvf6","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-222.ec2.internal","openshift-multus/multus-additional-cni-plugins-pzrtj","openshift-multus/multus-tskl2","openshift-multus/network-metrics-daemon-2jvh6"] Jul 15 04:06:07.827452 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:07.827431 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-9kvf6" Jul 15 04:06:07.828426 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:07.828405 2581 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 15 04:06:07.829571 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:07.829550 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 15 04:06:07.829672 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:07.829638 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 15 04:06:07.829672 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:07.829645 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-xj2s8\"" Jul 15 04:06:07.829820 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:07.829803 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 15 04:06:07.829927 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:07.829912 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4n42z" Jul 15 04:06:07.829989 ip-10-0-128-222 kubenswrapper[2581]: E0715 04:06:07.829971 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4n42z" podUID="5ac0aab6-1358-45d2-b257-eda461fc95da" Jul 15 04:06:07.832234 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:07.832215 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2jvh6" Jul 15 04:06:07.832313 ip-10-0-128-222 kubenswrapper[2581]: E0715 04:06:07.832295 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2jvh6" podUID="5b46708f-6444-44fc-8274-3921be1c13c7" Jul 15 04:06:07.833298 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:07.833278 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/be62ee25-74cc-4b6d-83ed-7639d75d9e0b-host\") pod \"node-ca-9kvf6\" (UID: \"be62ee25-74cc-4b6d-83ed-7639d75d9e0b\") " pod="openshift-image-registry/node-ca-9kvf6" Jul 15 04:06:07.833356 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:07.833307 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/be62ee25-74cc-4b6d-83ed-7639d75d9e0b-serviceca\") pod \"node-ca-9kvf6\" (UID: \"be62ee25-74cc-4b6d-83ed-7639d75d9e0b\") " pod="openshift-image-registry/node-ca-9kvf6" Jul 15 04:06:07.833356 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:07.833324 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2472z\" (UniqueName: \"kubernetes.io/projected/be62ee25-74cc-4b6d-83ed-7639d75d9e0b-kube-api-access-2472z\") pod \"node-ca-9kvf6\" (UID: \"be62ee25-74cc-4b6d-83ed-7639d75d9e0b\") " pod="openshift-image-registry/node-ca-9kvf6" Jul 15 04:06:07.833356 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:07.833343 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sxbbk\" (UniqueName: \"kubernetes.io/projected/5ac0aab6-1358-45d2-b257-eda461fc95da-kube-api-access-sxbbk\") pod \"network-check-target-4n42z\" (UID: \"5ac0aab6-1358-45d2-b257-eda461fc95da\") " pod="openshift-network-diagnostics/network-check-target-4n42z" Jul 15 04:06:07.834526 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:07.834511 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-sj6mk" Jul 15 04:06:07.836779 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:07.836759 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-cvjv6" Jul 15 04:06:07.836896 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:07.836805 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 15 04:06:07.836896 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:07.836815 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-pmzrf\"" Jul 15 04:06:07.836896 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:07.836864 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 15 04:06:07.839059 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:07.839040 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-bj2d7\"" Jul 15 04:06:07.839165 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:07.839068 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 15 04:06:07.839234 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:07.839177 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 15 04:06:07.839234 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:07.839219 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-pzrtj" Jul 15 04:06:07.839513 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:07.839496 2581 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 15 04:06:07.841297 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:07.841280 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 15 04:06:07.841361 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:07.841314 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-rlgld\"" Jul 15 04:06:07.841413 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:07.841364 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 15 04:06:07.841462 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:07.841422 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 15 04:06:07.841641 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:07.841626 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 15 04:06:07.841641 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:07.841638 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-lf5rb" Jul 15 04:06:07.841773 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:07.841676 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 15 04:06:07.844008 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:07.843991 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lzsbl" Jul 15 04:06:07.844209 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:07.844175 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-vh6qr\"" Jul 15 04:06:07.844298 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:07.844221 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 15 04:06:07.844368 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:07.844302 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 15 04:06:07.846483 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:07.846467 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-8jqrr" Jul 15 04:06:07.848972 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:07.848955 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-tskl2" Jul 15 04:06:07.851790 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:07.851773 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 15 04:06:07.851876 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:07.851780 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kz7p2" Jul 15 04:06:07.852263 ip-10-0-128-222 kubenswrapper[2581]: E0715 04:06:07.852231 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kz7p2" podUID="6616446d-4bdb-4867-a2f8-c39ed74908b9" Jul 15 04:06:07.852350 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:07.852318 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 15 04:06:07.852559 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:07.852539 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 15 04:06:07.852743 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:07.852724 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-7klc2\"" Jul 15 04:06:07.853309 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:07.853287 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-cz6wv\"" Jul 15 04:06:07.853442 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:07.853403 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 15 04:06:07.853772 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:07.853751 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 15 04:06:07.853946 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:07.853927 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-mw75n\"" Jul 15 04:06:07.854053 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:07.854031 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 15 04:06:07.854285 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:07.854264 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 15 04:06:07.854824 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:07.854800 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-x6lg7" Jul 15 04:06:07.857009 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:07.856970 2581 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-14 04:01:07 +0000 UTC" deadline="2028-01-05 06:10:53.151189753 +0000 UTC" Jul 15 04:06:07.857009 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:07.857006 2581 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="12938h4m45.294186154s" Jul 15 04:06:07.857170 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:07.857018 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 15 04:06:07.857170 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:07.857103 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 15 04:06:07.857615 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:07.857600 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 15 04:06:07.857615 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:07.857608 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 15 04:06:07.857721 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:07.857688 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 15 04:06:07.857857 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:07.857841 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-c5xv5\"" Jul 15 04:06:07.857955 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:07.857938 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 15 04:06:07.863993 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:07.863973 2581 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-2wlj9" Jul 15 04:06:07.872983 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:07.872961 2581 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-2wlj9" Jul 15 04:06:07.917117 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:07.917092 2581 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 15 04:06:07.930401 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:07.930376 2581 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 15 04:06:07.933595 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:07.933557 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/3eddd8b4-e14d-4f98-8830-0a2f487d85e8-host-var-lib-cni-bin\") pod \"multus-tskl2\" (UID: \"3eddd8b4-e14d-4f98-8830-0a2f487d85e8\") " pod="openshift-multus/multus-tskl2" Jul 15 04:06:07.933595 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:07.933591 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/26457908-4466-41d1-b908-507b13774dea-etc-sysctl-d\") pod \"tuned-sj6mk\" (UID: \"26457908-4466-41d1-b908-507b13774dea\") " pod="openshift-cluster-node-tuning-operator/tuned-sj6mk" Jul 15 04:06:07.933771 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:07.933609 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/26457908-4466-41d1-b908-507b13774dea-sys\") pod \"tuned-sj6mk\" (UID: \"26457908-4466-41d1-b908-507b13774dea\") " pod="openshift-cluster-node-tuning-operator/tuned-sj6mk" Jul 15 04:06:07.933771 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:07.933625 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/26457908-4466-41d1-b908-507b13774dea-host\") pod \"tuned-sj6mk\" (UID: \"26457908-4466-41d1-b908-507b13774dea\") " pod="openshift-cluster-node-tuning-operator/tuned-sj6mk" Jul 15 04:06:07.933771 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:07.933691 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/7cab18b8-43fd-46d1-a75d-6de40cbcd09a-host-kubelet\") pod \"ovnkube-node-x6lg7\" (UID: \"7cab18b8-43fd-46d1-a75d-6de40cbcd09a\") " pod="openshift-ovn-kubernetes/ovnkube-node-x6lg7" Jul 15 04:06:07.933771 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:07.933715 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7cab18b8-43fd-46d1-a75d-6de40cbcd09a-run-openvswitch\") pod \"ovnkube-node-x6lg7\" (UID: \"7cab18b8-43fd-46d1-a75d-6de40cbcd09a\") " pod="openshift-ovn-kubernetes/ovnkube-node-x6lg7" Jul 15 04:06:07.933771 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:07.933737 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qg87j\" (UniqueName: \"kubernetes.io/projected/7cab18b8-43fd-46d1-a75d-6de40cbcd09a-kube-api-access-qg87j\") pod \"ovnkube-node-x6lg7\" (UID: \"7cab18b8-43fd-46d1-a75d-6de40cbcd09a\") " pod="openshift-ovn-kubernetes/ovnkube-node-x6lg7" Jul 15 04:06:07.934013 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:07.933784 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be-agent-certs\") pod \"konnectivity-agent-cvjv6\" (UID: \"cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be\") " pod="kube-system/konnectivity-agent-cvjv6" Jul 15 04:06:07.934013 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:07.933816 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/26457908-4466-41d1-b908-507b13774dea-etc-modprobe-d\") pod \"tuned-sj6mk\" (UID: \"26457908-4466-41d1-b908-507b13774dea\") " pod="openshift-cluster-node-tuning-operator/tuned-sj6mk" Jul 15 04:06:07.934013 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:07.933869 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/937573bb-cbf0-410b-a1b3-1d082b5f3fbd-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-pzrtj\" (UID: \"937573bb-cbf0-410b-a1b3-1d082b5f3fbd\") " pod="openshift-multus/multus-additional-cni-plugins-pzrtj" Jul 15 04:06:07.934013 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:07.933893 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/7cab18b8-43fd-46d1-a75d-6de40cbcd09a-systemd-units\") pod \"ovnkube-node-x6lg7\" (UID: \"7cab18b8-43fd-46d1-a75d-6de40cbcd09a\") " pod="openshift-ovn-kubernetes/ovnkube-node-x6lg7" Jul 15 04:06:07.934013 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:07.933910 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/7cab18b8-43fd-46d1-a75d-6de40cbcd09a-run-systemd\") pod \"ovnkube-node-x6lg7\" (UID: \"7cab18b8-43fd-46d1-a75d-6de40cbcd09a\") " pod="openshift-ovn-kubernetes/ovnkube-node-x6lg7" Jul 15 04:06:07.934013 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:07.933926 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/7cab18b8-43fd-46d1-a75d-6de40cbcd09a-node-log\") pod \"ovnkube-node-x6lg7\" (UID: \"7cab18b8-43fd-46d1-a75d-6de40cbcd09a\") " pod="openshift-ovn-kubernetes/ovnkube-node-x6lg7" Jul 15 04:06:07.934013 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:07.933949 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/26457908-4466-41d1-b908-507b13774dea-run\") pod \"tuned-sj6mk\" (UID: \"26457908-4466-41d1-b908-507b13774dea\") " pod="openshift-cluster-node-tuning-operator/tuned-sj6mk" Jul 15 04:06:07.934013 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:07.933981 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2472z\" (UniqueName: \"kubernetes.io/projected/be62ee25-74cc-4b6d-83ed-7639d75d9e0b-kube-api-access-2472z\") pod \"node-ca-9kvf6\" (UID: \"be62ee25-74cc-4b6d-83ed-7639d75d9e0b\") " pod="openshift-image-registry/node-ca-9kvf6" Jul 15 04:06:07.934013 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:07.934008 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7cab18b8-43fd-46d1-a75d-6de40cbcd09a-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-x6lg7\" (UID: \"7cab18b8-43fd-46d1-a75d-6de40cbcd09a\") " pod="openshift-ovn-kubernetes/ovnkube-node-x6lg7" Jul 15 04:06:07.934468 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:07.934064 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/3eddd8b4-e14d-4f98-8830-0a2f487d85e8-host-run-netns\") pod \"multus-tskl2\" (UID: \"3eddd8b4-e14d-4f98-8830-0a2f487d85e8\") " pod="openshift-multus/multus-tskl2" Jul 15 04:06:07.934468 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:07.934102 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/937573bb-cbf0-410b-a1b3-1d082b5f3fbd-cnibin\") pod \"multus-additional-cni-plugins-pzrtj\" (UID: \"937573bb-cbf0-410b-a1b3-1d082b5f3fbd\") " pod="openshift-multus/multus-additional-cni-plugins-pzrtj" Jul 15 04:06:07.934468 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:07.934137 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/937573bb-cbf0-410b-a1b3-1d082b5f3fbd-cni-binary-copy\") pod \"multus-additional-cni-plugins-pzrtj\" (UID: \"937573bb-cbf0-410b-a1b3-1d082b5f3fbd\") " pod="openshift-multus/multus-additional-cni-plugins-pzrtj" Jul 15 04:06:07.934468 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:07.934166 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nhjx4\" (UniqueName: \"kubernetes.io/projected/937573bb-cbf0-410b-a1b3-1d082b5f3fbd-kube-api-access-nhjx4\") pod \"multus-additional-cni-plugins-pzrtj\" (UID: \"937573bb-cbf0-410b-a1b3-1d082b5f3fbd\") " pod="openshift-multus/multus-additional-cni-plugins-pzrtj" Jul 15 04:06:07.934468 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:07.934212 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/7cab18b8-43fd-46d1-a75d-6de40cbcd09a-log-socket\") pod \"ovnkube-node-x6lg7\" (UID: \"7cab18b8-43fd-46d1-a75d-6de40cbcd09a\") " pod="openshift-ovn-kubernetes/ovnkube-node-x6lg7" Jul 15 04:06:07.934468 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:07.934237 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/7cab18b8-43fd-46d1-a75d-6de40cbcd09a-host-cni-netd\") pod \"ovnkube-node-x6lg7\" (UID: \"7cab18b8-43fd-46d1-a75d-6de40cbcd09a\") " pod="openshift-ovn-kubernetes/ovnkube-node-x6lg7" Jul 15 04:06:07.934468 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:07.934269 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/3eddd8b4-e14d-4f98-8830-0a2f487d85e8-host-run-k8s-cni-cncf-io\") pod \"multus-tskl2\" (UID: \"3eddd8b4-e14d-4f98-8830-0a2f487d85e8\") " pod="openshift-multus/multus-tskl2" Jul 15 04:06:07.934468 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:07.934290 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/26457908-4466-41d1-b908-507b13774dea-etc-sysctl-conf\") pod \"tuned-sj6mk\" (UID: \"26457908-4466-41d1-b908-507b13774dea\") " pod="openshift-cluster-node-tuning-operator/tuned-sj6mk" Jul 15 04:06:07.934468 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:07.934313 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/937573bb-cbf0-410b-a1b3-1d082b5f3fbd-os-release\") pod \"multus-additional-cni-plugins-pzrtj\" (UID: \"937573bb-cbf0-410b-a1b3-1d082b5f3fbd\") " pod="openshift-multus/multus-additional-cni-plugins-pzrtj" Jul 15 04:06:07.934468 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:07.934354 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pqsx8\" (UniqueName: \"kubernetes.io/projected/9b5b5ded-e119-4d0d-8780-38c93fc5b17c-kube-api-access-pqsx8\") pod \"aws-ebs-csi-driver-node-lzsbl\" (UID: \"9b5b5ded-e119-4d0d-8780-38c93fc5b17c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lzsbl" Jul 15 04:06:07.934468 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:07.934378 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6616446d-4bdb-4867-a2f8-c39ed74908b9-original-pull-secret\") pod \"global-pull-secret-syncer-kz7p2\" (UID: \"6616446d-4bdb-4867-a2f8-c39ed74908b9\") " pod="kube-system/global-pull-secret-syncer-kz7p2" Jul 15 04:06:07.934468 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:07.934403 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/7cab18b8-43fd-46d1-a75d-6de40cbcd09a-host-cni-bin\") pod \"ovnkube-node-x6lg7\" (UID: \"7cab18b8-43fd-46d1-a75d-6de40cbcd09a\") " pod="openshift-ovn-kubernetes/ovnkube-node-x6lg7" Jul 15 04:06:07.934468 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:07.934427 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3eddd8b4-e14d-4f98-8830-0a2f487d85e8-multus-cni-dir\") pod \"multus-tskl2\" (UID: \"3eddd8b4-e14d-4f98-8830-0a2f487d85e8\") " pod="openshift-multus/multus-tskl2" Jul 15 04:06:07.934468 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:07.934459 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/7cab18b8-43fd-46d1-a75d-6de40cbcd09a-env-overrides\") pod \"ovnkube-node-x6lg7\" (UID: \"7cab18b8-43fd-46d1-a75d-6de40cbcd09a\") " pod="openshift-ovn-kubernetes/ovnkube-node-x6lg7" Jul 15 04:06:07.935170 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:07.934495 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/7cab18b8-43fd-46d1-a75d-6de40cbcd09a-ovn-node-metrics-cert\") pod \"ovnkube-node-x6lg7\" (UID: \"7cab18b8-43fd-46d1-a75d-6de40cbcd09a\") " pod="openshift-ovn-kubernetes/ovnkube-node-x6lg7" Jul 15 04:06:07.935170 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:07.934535 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/3eddd8b4-e14d-4f98-8830-0a2f487d85e8-cni-binary-copy\") pod \"multus-tskl2\" (UID: \"3eddd8b4-e14d-4f98-8830-0a2f487d85e8\") " pod="openshift-multus/multus-tskl2" Jul 15 04:06:07.935170 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:07.934568 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/3eddd8b4-e14d-4f98-8830-0a2f487d85e8-host-run-multus-certs\") pod \"multus-tskl2\" (UID: \"3eddd8b4-e14d-4f98-8830-0a2f487d85e8\") " pod="openshift-multus/multus-tskl2" Jul 15 04:06:07.935170 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:07.934595 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/937573bb-cbf0-410b-a1b3-1d082b5f3fbd-system-cni-dir\") pod \"multus-additional-cni-plugins-pzrtj\" (UID: \"937573bb-cbf0-410b-a1b3-1d082b5f3fbd\") " pod="openshift-multus/multus-additional-cni-plugins-pzrtj" Jul 15 04:06:07.935170 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:07.934617 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/937573bb-cbf0-410b-a1b3-1d082b5f3fbd-tuning-conf-dir\") pod \"multus-additional-cni-plugins-pzrtj\" (UID: \"937573bb-cbf0-410b-a1b3-1d082b5f3fbd\") " pod="openshift-multus/multus-additional-cni-plugins-pzrtj" Jul 15 04:06:07.935170 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:07.934656 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/937573bb-cbf0-410b-a1b3-1d082b5f3fbd-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-pzrtj\" (UID: \"937573bb-cbf0-410b-a1b3-1d082b5f3fbd\") " pod="openshift-multus/multus-additional-cni-plugins-pzrtj" Jul 15 04:06:07.935170 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:07.934680 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/7cab18b8-43fd-46d1-a75d-6de40cbcd09a-ovnkube-script-lib\") pod \"ovnkube-node-x6lg7\" (UID: \"7cab18b8-43fd-46d1-a75d-6de40cbcd09a\") " pod="openshift-ovn-kubernetes/ovnkube-node-x6lg7" Jul 15 04:06:07.935170 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:07.934696 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/e302da62-33bc-44ff-a188-8d409325e38f-hosts-file\") pod \"node-resolver-lf5rb\" (UID: \"e302da62-33bc-44ff-a188-8d409325e38f\") " pod="openshift-dns/node-resolver-lf5rb" Jul 15 04:06:07.935170 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:07.934714 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/d73a22ce-26a0-48d7-a3f2-e0a5f50c78b0-iptables-alerter-script\") pod \"iptables-alerter-8jqrr\" (UID: \"d73a22ce-26a0-48d7-a3f2-e0a5f50c78b0\") " pod="openshift-network-operator/iptables-alerter-8jqrr" Jul 15 04:06:07.935170 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:07.934738 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8v5cj\" (UniqueName: \"kubernetes.io/projected/d73a22ce-26a0-48d7-a3f2-e0a5f50c78b0-kube-api-access-8v5cj\") pod \"iptables-alerter-8jqrr\" (UID: \"d73a22ce-26a0-48d7-a3f2-e0a5f50c78b0\") " pod="openshift-network-operator/iptables-alerter-8jqrr" Jul 15 04:06:07.935170 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:07.934761 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3eddd8b4-e14d-4f98-8830-0a2f487d85e8-system-cni-dir\") pod \"multus-tskl2\" (UID: \"3eddd8b4-e14d-4f98-8830-0a2f487d85e8\") " pod="openshift-multus/multus-tskl2" Jul 15 04:06:07.935170 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:07.934783 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/3eddd8b4-e14d-4f98-8830-0a2f487d85e8-hostroot\") pod \"multus-tskl2\" (UID: \"3eddd8b4-e14d-4f98-8830-0a2f487d85e8\") " pod="openshift-multus/multus-tskl2" Jul 15 04:06:07.935170 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:07.934800 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/3eddd8b4-e14d-4f98-8830-0a2f487d85e8-multus-conf-dir\") pod \"multus-tskl2\" (UID: \"3eddd8b4-e14d-4f98-8830-0a2f487d85e8\") " pod="openshift-multus/multus-tskl2" Jul 15 04:06:07.935170 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:07.934834 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/9b5b5ded-e119-4d0d-8780-38c93fc5b17c-kubelet-dir\") pod \"aws-ebs-csi-driver-node-lzsbl\" (UID: \"9b5b5ded-e119-4d0d-8780-38c93fc5b17c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lzsbl" Jul 15 04:06:07.935170 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:07.934854 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/6616446d-4bdb-4867-a2f8-c39ed74908b9-kubelet-config\") pod \"global-pull-secret-syncer-kz7p2\" (UID: \"6616446d-4bdb-4867-a2f8-c39ed74908b9\") " pod="kube-system/global-pull-secret-syncer-kz7p2" Jul 15 04:06:07.935170 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:07.934881 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/7cab18b8-43fd-46d1-a75d-6de40cbcd09a-host-slash\") pod \"ovnkube-node-x6lg7\" (UID: \"7cab18b8-43fd-46d1-a75d-6de40cbcd09a\") " pod="openshift-ovn-kubernetes/ovnkube-node-x6lg7" Jul 15 04:06:07.935984 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:07.934906 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/3eddd8b4-e14d-4f98-8830-0a2f487d85e8-os-release\") pod \"multus-tskl2\" (UID: \"3eddd8b4-e14d-4f98-8830-0a2f487d85e8\") " pod="openshift-multus/multus-tskl2" Jul 15 04:06:07.935984 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:07.934965 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/3eddd8b4-e14d-4f98-8830-0a2f487d85e8-multus-daemon-config\") pod \"multus-tskl2\" (UID: \"3eddd8b4-e14d-4f98-8830-0a2f487d85e8\") " pod="openshift-multus/multus-tskl2" Jul 15 04:06:07.935984 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:07.934994 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/9b5b5ded-e119-4d0d-8780-38c93fc5b17c-etc-selinux\") pod \"aws-ebs-csi-driver-node-lzsbl\" (UID: \"9b5b5ded-e119-4d0d-8780-38c93fc5b17c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lzsbl" Jul 15 04:06:07.935984 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:07.935011 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7cab18b8-43fd-46d1-a75d-6de40cbcd09a-etc-openvswitch\") pod \"ovnkube-node-x6lg7\" (UID: \"7cab18b8-43fd-46d1-a75d-6de40cbcd09a\") " pod="openshift-ovn-kubernetes/ovnkube-node-x6lg7" Jul 15 04:06:07.935984 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:07.935028 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e302da62-33bc-44ff-a188-8d409325e38f-tmp-dir\") pod \"node-resolver-lf5rb\" (UID: \"e302da62-33bc-44ff-a188-8d409325e38f\") " pod="openshift-dns/node-resolver-lf5rb" Jul 15 04:06:07.935984 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:07.935044 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d73a22ce-26a0-48d7-a3f2-e0a5f50c78b0-host-slash\") pod \"iptables-alerter-8jqrr\" (UID: \"d73a22ce-26a0-48d7-a3f2-e0a5f50c78b0\") " pod="openshift-network-operator/iptables-alerter-8jqrr" Jul 15 04:06:07.935984 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:07.935061 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/26457908-4466-41d1-b908-507b13774dea-etc-systemd\") pod \"tuned-sj6mk\" (UID: \"26457908-4466-41d1-b908-507b13774dea\") " pod="openshift-cluster-node-tuning-operator/tuned-sj6mk" Jul 15 04:06:07.935984 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:07.935102 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/26457908-4466-41d1-b908-507b13774dea-tmp\") pod \"tuned-sj6mk\" (UID: \"26457908-4466-41d1-b908-507b13774dea\") " pod="openshift-cluster-node-tuning-operator/tuned-sj6mk" Jul 15 04:06:07.935984 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:07.935193 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/9b5b5ded-e119-4d0d-8780-38c93fc5b17c-registration-dir\") pod \"aws-ebs-csi-driver-node-lzsbl\" (UID: \"9b5b5ded-e119-4d0d-8780-38c93fc5b17c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lzsbl" Jul 15 04:06:07.935984 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:07.935220 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vh92c\" (UniqueName: \"kubernetes.io/projected/5b46708f-6444-44fc-8274-3921be1c13c7-kube-api-access-vh92c\") pod \"network-metrics-daemon-2jvh6\" (UID: \"5b46708f-6444-44fc-8274-3921be1c13c7\") " pod="openshift-multus/network-metrics-daemon-2jvh6" Jul 15 04:06:07.935984 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:07.935236 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/9b5b5ded-e119-4d0d-8780-38c93fc5b17c-socket-dir\") pod \"aws-ebs-csi-driver-node-lzsbl\" (UID: \"9b5b5ded-e119-4d0d-8780-38c93fc5b17c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lzsbl" Jul 15 04:06:07.935984 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:07.935261 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/9b5b5ded-e119-4d0d-8780-38c93fc5b17c-device-dir\") pod \"aws-ebs-csi-driver-node-lzsbl\" (UID: \"9b5b5ded-e119-4d0d-8780-38c93fc5b17c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lzsbl" Jul 15 04:06:07.935984 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:07.935291 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3eddd8b4-e14d-4f98-8830-0a2f487d85e8-host-var-lib-kubelet\") pod \"multus-tskl2\" (UID: \"3eddd8b4-e14d-4f98-8830-0a2f487d85e8\") " pod="openshift-multus/multus-tskl2" Jul 15 04:06:07.935984 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:07.935308 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/26457908-4466-41d1-b908-507b13774dea-etc-kubernetes\") pod \"tuned-sj6mk\" (UID: \"26457908-4466-41d1-b908-507b13774dea\") " pod="openshift-cluster-node-tuning-operator/tuned-sj6mk" Jul 15 04:06:07.935984 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:07.935323 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2sqwr\" (UniqueName: \"kubernetes.io/projected/26457908-4466-41d1-b908-507b13774dea-kube-api-access-2sqwr\") pod \"tuned-sj6mk\" (UID: \"26457908-4466-41d1-b908-507b13774dea\") " pod="openshift-cluster-node-tuning-operator/tuned-sj6mk" Jul 15 04:06:07.935984 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:07.935341 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/6616446d-4bdb-4867-a2f8-c39ed74908b9-dbus\") pod \"global-pull-secret-syncer-kz7p2\" (UID: \"6616446d-4bdb-4867-a2f8-c39ed74908b9\") " pod="kube-system/global-pull-secret-syncer-kz7p2" Jul 15 04:06:07.936800 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:07.935365 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7cab18b8-43fd-46d1-a75d-6de40cbcd09a-host-run-ovn-kubernetes\") pod \"ovnkube-node-x6lg7\" (UID: \"7cab18b8-43fd-46d1-a75d-6de40cbcd09a\") " pod="openshift-ovn-kubernetes/ovnkube-node-x6lg7" Jul 15 04:06:07.936800 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:07.935384 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/3eddd8b4-e14d-4f98-8830-0a2f487d85e8-multus-socket-dir-parent\") pod \"multus-tskl2\" (UID: \"3eddd8b4-e14d-4f98-8830-0a2f487d85e8\") " pod="openshift-multus/multus-tskl2" Jul 15 04:06:07.936800 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:07.935401 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/3eddd8b4-e14d-4f98-8830-0a2f487d85e8-host-var-lib-cni-multus\") pod \"multus-tskl2\" (UID: \"3eddd8b4-e14d-4f98-8830-0a2f487d85e8\") " pod="openshift-multus/multus-tskl2" Jul 15 04:06:07.936800 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:07.935415 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/26457908-4466-41d1-b908-507b13774dea-etc-sysconfig\") pod \"tuned-sj6mk\" (UID: \"26457908-4466-41d1-b908-507b13774dea\") " pod="openshift-cluster-node-tuning-operator/tuned-sj6mk" Jul 15 04:06:07.936800 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:07.935439 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/9b5b5ded-e119-4d0d-8780-38c93fc5b17c-sys-fs\") pod \"aws-ebs-csi-driver-node-lzsbl\" (UID: \"9b5b5ded-e119-4d0d-8780-38c93fc5b17c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lzsbl" Jul 15 04:06:07.936800 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:07.935454 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7cab18b8-43fd-46d1-a75d-6de40cbcd09a-var-lib-openvswitch\") pod \"ovnkube-node-x6lg7\" (UID: \"7cab18b8-43fd-46d1-a75d-6de40cbcd09a\") " pod="openshift-ovn-kubernetes/ovnkube-node-x6lg7" Jul 15 04:06:07.936800 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:07.935484 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be-konnectivity-ca\") pod \"konnectivity-agent-cvjv6\" (UID: \"cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be\") " pod="kube-system/konnectivity-agent-cvjv6" Jul 15 04:06:07.936800 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:07.935509 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dsn95\" (UniqueName: \"kubernetes.io/projected/e302da62-33bc-44ff-a188-8d409325e38f-kube-api-access-dsn95\") pod \"node-resolver-lf5rb\" (UID: \"e302da62-33bc-44ff-a188-8d409325e38f\") " pod="openshift-dns/node-resolver-lf5rb" Jul 15 04:06:07.936800 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:07.935529 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/3eddd8b4-e14d-4f98-8830-0a2f487d85e8-cnibin\") pod \"multus-tskl2\" (UID: \"3eddd8b4-e14d-4f98-8830-0a2f487d85e8\") " pod="openshift-multus/multus-tskl2" Jul 15 04:06:07.936800 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:07.935549 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3eddd8b4-e14d-4f98-8830-0a2f487d85e8-etc-kubernetes\") pod \"multus-tskl2\" (UID: \"3eddd8b4-e14d-4f98-8830-0a2f487d85e8\") " pod="openshift-multus/multus-tskl2" Jul 15 04:06:07.936800 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:07.935571 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/7cab18b8-43fd-46d1-a75d-6de40cbcd09a-host-run-netns\") pod \"ovnkube-node-x6lg7\" (UID: \"7cab18b8-43fd-46d1-a75d-6de40cbcd09a\") " pod="openshift-ovn-kubernetes/ovnkube-node-x6lg7" Jul 15 04:06:07.936800 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:07.935597 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/be62ee25-74cc-4b6d-83ed-7639d75d9e0b-host\") pod \"node-ca-9kvf6\" (UID: \"be62ee25-74cc-4b6d-83ed-7639d75d9e0b\") " pod="openshift-image-registry/node-ca-9kvf6" Jul 15 04:06:07.936800 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:07.935646 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sxbbk\" (UniqueName: \"kubernetes.io/projected/5ac0aab6-1358-45d2-b257-eda461fc95da-kube-api-access-sxbbk\") pod \"network-check-target-4n42z\" (UID: \"5ac0aab6-1358-45d2-b257-eda461fc95da\") " pod="openshift-network-diagnostics/network-check-target-4n42z" Jul 15 04:06:07.936800 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:07.935680 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/7cab18b8-43fd-46d1-a75d-6de40cbcd09a-run-ovn\") pod \"ovnkube-node-x6lg7\" (UID: \"7cab18b8-43fd-46d1-a75d-6de40cbcd09a\") " pod="openshift-ovn-kubernetes/ovnkube-node-x6lg7" Jul 15 04:06:07.936800 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:07.935682 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/be62ee25-74cc-4b6d-83ed-7639d75d9e0b-host\") pod \"node-ca-9kvf6\" (UID: \"be62ee25-74cc-4b6d-83ed-7639d75d9e0b\") " pod="openshift-image-registry/node-ca-9kvf6" Jul 15 04:06:07.936800 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:07.935718 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/7cab18b8-43fd-46d1-a75d-6de40cbcd09a-ovnkube-config\") pod \"ovnkube-node-x6lg7\" (UID: \"7cab18b8-43fd-46d1-a75d-6de40cbcd09a\") " pod="openshift-ovn-kubernetes/ovnkube-node-x6lg7" Jul 15 04:06:07.936800 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:07.935757 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/26457908-4466-41d1-b908-507b13774dea-var-lib-kubelet\") pod \"tuned-sj6mk\" (UID: \"26457908-4466-41d1-b908-507b13774dea\") " pod="openshift-cluster-node-tuning-operator/tuned-sj6mk" Jul 15 04:06:07.937831 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:07.935787 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/26457908-4466-41d1-b908-507b13774dea-etc-tuned\") pod \"tuned-sj6mk\" (UID: \"26457908-4466-41d1-b908-507b13774dea\") " pod="openshift-cluster-node-tuning-operator/tuned-sj6mk" Jul 15 04:06:07.937831 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:07.935816 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/be62ee25-74cc-4b6d-83ed-7639d75d9e0b-serviceca\") pod \"node-ca-9kvf6\" (UID: \"be62ee25-74cc-4b6d-83ed-7639d75d9e0b\") " pod="openshift-image-registry/node-ca-9kvf6" Jul 15 04:06:07.937831 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:07.935834 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tnfhn\" (UniqueName: \"kubernetes.io/projected/3eddd8b4-e14d-4f98-8830-0a2f487d85e8-kube-api-access-tnfhn\") pod \"multus-tskl2\" (UID: \"3eddd8b4-e14d-4f98-8830-0a2f487d85e8\") " pod="openshift-multus/multus-tskl2" Jul 15 04:06:07.937831 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:07.935851 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/26457908-4466-41d1-b908-507b13774dea-lib-modules\") pod \"tuned-sj6mk\" (UID: \"26457908-4466-41d1-b908-507b13774dea\") " pod="openshift-cluster-node-tuning-operator/tuned-sj6mk" Jul 15 04:06:07.937831 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:07.935898 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5b46708f-6444-44fc-8274-3921be1c13c7-metrics-certs\") pod \"network-metrics-daemon-2jvh6\" (UID: \"5b46708f-6444-44fc-8274-3921be1c13c7\") " pod="openshift-multus/network-metrics-daemon-2jvh6" Jul 15 04:06:07.937831 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:07.936990 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/be62ee25-74cc-4b6d-83ed-7639d75d9e0b-serviceca\") pod \"node-ca-9kvf6\" (UID: \"be62ee25-74cc-4b6d-83ed-7639d75d9e0b\") " pod="openshift-image-registry/node-ca-9kvf6" Jul 15 04:06:07.947458 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:07.947432 2581 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 15 04:06:07.948545 ip-10-0-128-222 kubenswrapper[2581]: E0715 04:06:07.948528 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 15 04:06:07.948605 ip-10-0-128-222 kubenswrapper[2581]: E0715 04:06:07.948551 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 15 04:06:07.948605 ip-10-0-128-222 kubenswrapper[2581]: E0715 04:06:07.948562 2581 projected.go:196] Error preparing data for projected volume kube-api-access-sxbbk for pod openshift-network-diagnostics/network-check-target-4n42z: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 15 04:06:07.948679 ip-10-0-128-222 kubenswrapper[2581]: E0715 04:06:07.948635 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5ac0aab6-1358-45d2-b257-eda461fc95da-kube-api-access-sxbbk podName:5ac0aab6-1358-45d2-b257-eda461fc95da nodeName:}" failed. No retries permitted until 2026-07-15 04:06:08.448607593 +0000 UTC m=+1.975408587 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-sxbbk" (UniqueName: "kubernetes.io/projected/5ac0aab6-1358-45d2-b257-eda461fc95da-kube-api-access-sxbbk") pod "network-check-target-4n42z" (UID: "5ac0aab6-1358-45d2-b257-eda461fc95da") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 15 04:06:07.950863 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:07.950843 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2472z\" (UniqueName: \"kubernetes.io/projected/be62ee25-74cc-4b6d-83ed-7639d75d9e0b-kube-api-access-2472z\") pod \"node-ca-9kvf6\" (UID: \"be62ee25-74cc-4b6d-83ed-7639d75d9e0b\") " pod="openshift-image-registry/node-ca-9kvf6" Jul 15 04:06:08.036224 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:08.036186 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/7cab18b8-43fd-46d1-a75d-6de40cbcd09a-systemd-units\") pod \"ovnkube-node-x6lg7\" (UID: \"7cab18b8-43fd-46d1-a75d-6de40cbcd09a\") " pod="openshift-ovn-kubernetes/ovnkube-node-x6lg7" Jul 15 04:06:08.036475 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:08.036235 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/7cab18b8-43fd-46d1-a75d-6de40cbcd09a-run-systemd\") pod \"ovnkube-node-x6lg7\" (UID: \"7cab18b8-43fd-46d1-a75d-6de40cbcd09a\") " pod="openshift-ovn-kubernetes/ovnkube-node-x6lg7" Jul 15 04:06:08.036475 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:08.036264 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/7cab18b8-43fd-46d1-a75d-6de40cbcd09a-node-log\") pod \"ovnkube-node-x6lg7\" (UID: \"7cab18b8-43fd-46d1-a75d-6de40cbcd09a\") " pod="openshift-ovn-kubernetes/ovnkube-node-x6lg7" Jul 15 04:06:08.036475 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:08.036259 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/7cab18b8-43fd-46d1-a75d-6de40cbcd09a-systemd-units\") pod \"ovnkube-node-x6lg7\" (UID: \"7cab18b8-43fd-46d1-a75d-6de40cbcd09a\") " pod="openshift-ovn-kubernetes/ovnkube-node-x6lg7" Jul 15 04:06:08.036475 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:08.036308 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/26457908-4466-41d1-b908-507b13774dea-run\") pod \"tuned-sj6mk\" (UID: \"26457908-4466-41d1-b908-507b13774dea\") " pod="openshift-cluster-node-tuning-operator/tuned-sj6mk" Jul 15 04:06:08.036475 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:08.036329 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/7cab18b8-43fd-46d1-a75d-6de40cbcd09a-run-systemd\") pod \"ovnkube-node-x6lg7\" (UID: \"7cab18b8-43fd-46d1-a75d-6de40cbcd09a\") " pod="openshift-ovn-kubernetes/ovnkube-node-x6lg7" Jul 15 04:06:08.036475 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:08.036325 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/7cab18b8-43fd-46d1-a75d-6de40cbcd09a-node-log\") pod \"ovnkube-node-x6lg7\" (UID: \"7cab18b8-43fd-46d1-a75d-6de40cbcd09a\") " pod="openshift-ovn-kubernetes/ovnkube-node-x6lg7" Jul 15 04:06:08.036475 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:08.036347 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7cab18b8-43fd-46d1-a75d-6de40cbcd09a-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-x6lg7\" (UID: \"7cab18b8-43fd-46d1-a75d-6de40cbcd09a\") " pod="openshift-ovn-kubernetes/ovnkube-node-x6lg7" Jul 15 04:06:08.036475 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:08.036381 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/26457908-4466-41d1-b908-507b13774dea-run\") pod \"tuned-sj6mk\" (UID: \"26457908-4466-41d1-b908-507b13774dea\") " pod="openshift-cluster-node-tuning-operator/tuned-sj6mk" Jul 15 04:06:08.036475 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:08.036386 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/3eddd8b4-e14d-4f98-8830-0a2f487d85e8-host-run-netns\") pod \"multus-tskl2\" (UID: \"3eddd8b4-e14d-4f98-8830-0a2f487d85e8\") " pod="openshift-multus/multus-tskl2" Jul 15 04:06:08.036475 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:08.036416 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/937573bb-cbf0-410b-a1b3-1d082b5f3fbd-cnibin\") pod \"multus-additional-cni-plugins-pzrtj\" (UID: \"937573bb-cbf0-410b-a1b3-1d082b5f3fbd\") " pod="openshift-multus/multus-additional-cni-plugins-pzrtj" Jul 15 04:06:08.036475 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:08.036422 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/3eddd8b4-e14d-4f98-8830-0a2f487d85e8-host-run-netns\") pod \"multus-tskl2\" (UID: \"3eddd8b4-e14d-4f98-8830-0a2f487d85e8\") " pod="openshift-multus/multus-tskl2" Jul 15 04:06:08.036475 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:08.036454 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/937573bb-cbf0-410b-a1b3-1d082b5f3fbd-cni-binary-copy\") pod \"multus-additional-cni-plugins-pzrtj\" (UID: \"937573bb-cbf0-410b-a1b3-1d082b5f3fbd\") " pod="openshift-multus/multus-additional-cni-plugins-pzrtj" Jul 15 04:06:08.036475 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:08.036461 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/937573bb-cbf0-410b-a1b3-1d082b5f3fbd-cnibin\") pod \"multus-additional-cni-plugins-pzrtj\" (UID: \"937573bb-cbf0-410b-a1b3-1d082b5f3fbd\") " pod="openshift-multus/multus-additional-cni-plugins-pzrtj" Jul 15 04:06:08.036475 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:08.036388 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7cab18b8-43fd-46d1-a75d-6de40cbcd09a-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-x6lg7\" (UID: \"7cab18b8-43fd-46d1-a75d-6de40cbcd09a\") " pod="openshift-ovn-kubernetes/ovnkube-node-x6lg7" Jul 15 04:06:08.037279 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:08.036501 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nhjx4\" (UniqueName: \"kubernetes.io/projected/937573bb-cbf0-410b-a1b3-1d082b5f3fbd-kube-api-access-nhjx4\") pod \"multus-additional-cni-plugins-pzrtj\" (UID: \"937573bb-cbf0-410b-a1b3-1d082b5f3fbd\") " pod="openshift-multus/multus-additional-cni-plugins-pzrtj" Jul 15 04:06:08.037279 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:08.036530 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/7cab18b8-43fd-46d1-a75d-6de40cbcd09a-log-socket\") pod \"ovnkube-node-x6lg7\" (UID: \"7cab18b8-43fd-46d1-a75d-6de40cbcd09a\") " pod="openshift-ovn-kubernetes/ovnkube-node-x6lg7" Jul 15 04:06:08.037279 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:08.036574 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/7cab18b8-43fd-46d1-a75d-6de40cbcd09a-host-cni-netd\") pod \"ovnkube-node-x6lg7\" (UID: \"7cab18b8-43fd-46d1-a75d-6de40cbcd09a\") " pod="openshift-ovn-kubernetes/ovnkube-node-x6lg7" Jul 15 04:06:08.037279 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:08.036604 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/3eddd8b4-e14d-4f98-8830-0a2f487d85e8-host-run-k8s-cni-cncf-io\") pod \"multus-tskl2\" (UID: \"3eddd8b4-e14d-4f98-8830-0a2f487d85e8\") " pod="openshift-multus/multus-tskl2" Jul 15 04:06:08.037279 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:08.036631 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/26457908-4466-41d1-b908-507b13774dea-etc-sysctl-conf\") pod \"tuned-sj6mk\" (UID: \"26457908-4466-41d1-b908-507b13774dea\") " pod="openshift-cluster-node-tuning-operator/tuned-sj6mk" Jul 15 04:06:08.037279 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:08.036654 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/7cab18b8-43fd-46d1-a75d-6de40cbcd09a-log-socket\") pod \"ovnkube-node-x6lg7\" (UID: \"7cab18b8-43fd-46d1-a75d-6de40cbcd09a\") " pod="openshift-ovn-kubernetes/ovnkube-node-x6lg7" Jul 15 04:06:08.037279 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:08.036666 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/7cab18b8-43fd-46d1-a75d-6de40cbcd09a-host-cni-netd\") pod \"ovnkube-node-x6lg7\" (UID: \"7cab18b8-43fd-46d1-a75d-6de40cbcd09a\") " pod="openshift-ovn-kubernetes/ovnkube-node-x6lg7" Jul 15 04:06:08.037279 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:08.036658 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/937573bb-cbf0-410b-a1b3-1d082b5f3fbd-os-release\") pod \"multus-additional-cni-plugins-pzrtj\" (UID: \"937573bb-cbf0-410b-a1b3-1d082b5f3fbd\") " pod="openshift-multus/multus-additional-cni-plugins-pzrtj" Jul 15 04:06:08.037279 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:08.036707 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pqsx8\" (UniqueName: \"kubernetes.io/projected/9b5b5ded-e119-4d0d-8780-38c93fc5b17c-kube-api-access-pqsx8\") pod \"aws-ebs-csi-driver-node-lzsbl\" (UID: \"9b5b5ded-e119-4d0d-8780-38c93fc5b17c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lzsbl" Jul 15 04:06:08.037279 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:08.036704 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/3eddd8b4-e14d-4f98-8830-0a2f487d85e8-host-run-k8s-cni-cncf-io\") pod \"multus-tskl2\" (UID: \"3eddd8b4-e14d-4f98-8830-0a2f487d85e8\") " pod="openshift-multus/multus-tskl2" Jul 15 04:06:08.037279 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:08.036734 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6616446d-4bdb-4867-a2f8-c39ed74908b9-original-pull-secret\") pod \"global-pull-secret-syncer-kz7p2\" (UID: \"6616446d-4bdb-4867-a2f8-c39ed74908b9\") " pod="kube-system/global-pull-secret-syncer-kz7p2" Jul 15 04:06:08.037279 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:08.036739 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/937573bb-cbf0-410b-a1b3-1d082b5f3fbd-os-release\") pod \"multus-additional-cni-plugins-pzrtj\" (UID: \"937573bb-cbf0-410b-a1b3-1d082b5f3fbd\") " pod="openshift-multus/multus-additional-cni-plugins-pzrtj" Jul 15 04:06:08.037279 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:08.036761 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/7cab18b8-43fd-46d1-a75d-6de40cbcd09a-host-cni-bin\") pod \"ovnkube-node-x6lg7\" (UID: \"7cab18b8-43fd-46d1-a75d-6de40cbcd09a\") " pod="openshift-ovn-kubernetes/ovnkube-node-x6lg7" Jul 15 04:06:08.037279 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:08.036807 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3eddd8b4-e14d-4f98-8830-0a2f487d85e8-multus-cni-dir\") pod \"multus-tskl2\" (UID: \"3eddd8b4-e14d-4f98-8830-0a2f487d85e8\") " pod="openshift-multus/multus-tskl2" Jul 15 04:06:08.037279 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:08.036836 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/7cab18b8-43fd-46d1-a75d-6de40cbcd09a-env-overrides\") pod \"ovnkube-node-x6lg7\" (UID: \"7cab18b8-43fd-46d1-a75d-6de40cbcd09a\") " pod="openshift-ovn-kubernetes/ovnkube-node-x6lg7" Jul 15 04:06:08.037279 ip-10-0-128-222 kubenswrapper[2581]: E0715 04:06:08.036848 2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 15 04:06:08.037279 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:08.036860 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/7cab18b8-43fd-46d1-a75d-6de40cbcd09a-ovn-node-metrics-cert\") pod \"ovnkube-node-x6lg7\" (UID: \"7cab18b8-43fd-46d1-a75d-6de40cbcd09a\") " pod="openshift-ovn-kubernetes/ovnkube-node-x6lg7" Jul 15 04:06:08.037279 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:08.036866 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/7cab18b8-43fd-46d1-a75d-6de40cbcd09a-host-cni-bin\") pod \"ovnkube-node-x6lg7\" (UID: \"7cab18b8-43fd-46d1-a75d-6de40cbcd09a\") " pod="openshift-ovn-kubernetes/ovnkube-node-x6lg7" Jul 15 04:06:08.038165 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:08.036887 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/3eddd8b4-e14d-4f98-8830-0a2f487d85e8-cni-binary-copy\") pod \"multus-tskl2\" (UID: \"3eddd8b4-e14d-4f98-8830-0a2f487d85e8\") " pod="openshift-multus/multus-tskl2" Jul 15 04:06:08.038165 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:08.036879 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/26457908-4466-41d1-b908-507b13774dea-etc-sysctl-conf\") pod \"tuned-sj6mk\" (UID: \"26457908-4466-41d1-b908-507b13774dea\") " pod="openshift-cluster-node-tuning-operator/tuned-sj6mk" Jul 15 04:06:08.038165 ip-10-0-128-222 kubenswrapper[2581]: E0715 04:06:08.036928 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6616446d-4bdb-4867-a2f8-c39ed74908b9-original-pull-secret podName:6616446d-4bdb-4867-a2f8-c39ed74908b9 nodeName:}" failed. No retries permitted until 2026-07-15 04:06:08.536907898 +0000 UTC m=+2.063708921 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/6616446d-4bdb-4867-a2f8-c39ed74908b9-original-pull-secret") pod "global-pull-secret-syncer-kz7p2" (UID: "6616446d-4bdb-4867-a2f8-c39ed74908b9") : object "kube-system"/"original-pull-secret" not registered Jul 15 04:06:08.038165 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:08.036974 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3eddd8b4-e14d-4f98-8830-0a2f487d85e8-multus-cni-dir\") pod \"multus-tskl2\" (UID: \"3eddd8b4-e14d-4f98-8830-0a2f487d85e8\") " pod="openshift-multus/multus-tskl2" Jul 15 04:06:08.038165 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:08.036982 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/3eddd8b4-e14d-4f98-8830-0a2f487d85e8-host-run-multus-certs\") pod \"multus-tskl2\" (UID: \"3eddd8b4-e14d-4f98-8830-0a2f487d85e8\") " pod="openshift-multus/multus-tskl2" Jul 15 04:06:08.038165 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:08.037015 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/937573bb-cbf0-410b-a1b3-1d082b5f3fbd-system-cni-dir\") pod \"multus-additional-cni-plugins-pzrtj\" (UID: \"937573bb-cbf0-410b-a1b3-1d082b5f3fbd\") " pod="openshift-multus/multus-additional-cni-plugins-pzrtj" Jul 15 04:06:08.038165 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:08.037040 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/937573bb-cbf0-410b-a1b3-1d082b5f3fbd-tuning-conf-dir\") pod \"multus-additional-cni-plugins-pzrtj\" (UID: \"937573bb-cbf0-410b-a1b3-1d082b5f3fbd\") " pod="openshift-multus/multus-additional-cni-plugins-pzrtj" Jul 15 04:06:08.038165 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:08.037069 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/937573bb-cbf0-410b-a1b3-1d082b5f3fbd-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-pzrtj\" (UID: \"937573bb-cbf0-410b-a1b3-1d082b5f3fbd\") " pod="openshift-multus/multus-additional-cni-plugins-pzrtj" Jul 15 04:06:08.038165 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:08.037084 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/937573bb-cbf0-410b-a1b3-1d082b5f3fbd-cni-binary-copy\") pod \"multus-additional-cni-plugins-pzrtj\" (UID: \"937573bb-cbf0-410b-a1b3-1d082b5f3fbd\") " pod="openshift-multus/multus-additional-cni-plugins-pzrtj" Jul 15 04:06:08.038165 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:08.037104 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/7cab18b8-43fd-46d1-a75d-6de40cbcd09a-ovnkube-script-lib\") pod \"ovnkube-node-x6lg7\" (UID: \"7cab18b8-43fd-46d1-a75d-6de40cbcd09a\") " pod="openshift-ovn-kubernetes/ovnkube-node-x6lg7" Jul 15 04:06:08.038165 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:08.037138 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/937573bb-cbf0-410b-a1b3-1d082b5f3fbd-system-cni-dir\") pod \"multus-additional-cni-plugins-pzrtj\" (UID: \"937573bb-cbf0-410b-a1b3-1d082b5f3fbd\") " pod="openshift-multus/multus-additional-cni-plugins-pzrtj" Jul 15 04:06:08.038165 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:08.037180 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/3eddd8b4-e14d-4f98-8830-0a2f487d85e8-host-run-multus-certs\") pod \"multus-tskl2\" (UID: \"3eddd8b4-e14d-4f98-8830-0a2f487d85e8\") " pod="openshift-multus/multus-tskl2" Jul 15 04:06:08.038165 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:08.037251 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/e302da62-33bc-44ff-a188-8d409325e38f-hosts-file\") pod \"node-resolver-lf5rb\" (UID: \"e302da62-33bc-44ff-a188-8d409325e38f\") " pod="openshift-dns/node-resolver-lf5rb" Jul 15 04:06:08.038165 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:08.037313 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/937573bb-cbf0-410b-a1b3-1d082b5f3fbd-tuning-conf-dir\") pod \"multus-additional-cni-plugins-pzrtj\" (UID: \"937573bb-cbf0-410b-a1b3-1d082b5f3fbd\") " pod="openshift-multus/multus-additional-cni-plugins-pzrtj" Jul 15 04:06:08.038165 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:08.037308 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/e302da62-33bc-44ff-a188-8d409325e38f-hosts-file\") pod \"node-resolver-lf5rb\" (UID: \"e302da62-33bc-44ff-a188-8d409325e38f\") " pod="openshift-dns/node-resolver-lf5rb" Jul 15 04:06:08.038165 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:08.037352 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/d73a22ce-26a0-48d7-a3f2-e0a5f50c78b0-iptables-alerter-script\") pod \"iptables-alerter-8jqrr\" (UID: \"d73a22ce-26a0-48d7-a3f2-e0a5f50c78b0\") " pod="openshift-network-operator/iptables-alerter-8jqrr" Jul 15 04:06:08.039213 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:08.037383 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8v5cj\" (UniqueName: \"kubernetes.io/projected/d73a22ce-26a0-48d7-a3f2-e0a5f50c78b0-kube-api-access-8v5cj\") pod \"iptables-alerter-8jqrr\" (UID: \"d73a22ce-26a0-48d7-a3f2-e0a5f50c78b0\") " pod="openshift-network-operator/iptables-alerter-8jqrr" Jul 15 04:06:08.039213 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:08.037409 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3eddd8b4-e14d-4f98-8830-0a2f487d85e8-system-cni-dir\") pod \"multus-tskl2\" (UID: \"3eddd8b4-e14d-4f98-8830-0a2f487d85e8\") " pod="openshift-multus/multus-tskl2" Jul 15 04:06:08.039213 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:08.037435 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/3eddd8b4-e14d-4f98-8830-0a2f487d85e8-hostroot\") pod \"multus-tskl2\" (UID: \"3eddd8b4-e14d-4f98-8830-0a2f487d85e8\") " pod="openshift-multus/multus-tskl2" Jul 15 04:06:08.039213 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:08.037488 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/3eddd8b4-e14d-4f98-8830-0a2f487d85e8-multus-conf-dir\") pod \"multus-tskl2\" (UID: \"3eddd8b4-e14d-4f98-8830-0a2f487d85e8\") " pod="openshift-multus/multus-tskl2" Jul 15 04:06:08.039213 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:08.037513 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/9b5b5ded-e119-4d0d-8780-38c93fc5b17c-kubelet-dir\") pod \"aws-ebs-csi-driver-node-lzsbl\" (UID: \"9b5b5ded-e119-4d0d-8780-38c93fc5b17c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lzsbl" Jul 15 04:06:08.039213 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:08.037542 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/6616446d-4bdb-4867-a2f8-c39ed74908b9-kubelet-config\") pod \"global-pull-secret-syncer-kz7p2\" (UID: \"6616446d-4bdb-4867-a2f8-c39ed74908b9\") " pod="kube-system/global-pull-secret-syncer-kz7p2" Jul 15 04:06:08.039213 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:08.037582 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/7cab18b8-43fd-46d1-a75d-6de40cbcd09a-host-slash\") pod \"ovnkube-node-x6lg7\" (UID: \"7cab18b8-43fd-46d1-a75d-6de40cbcd09a\") " pod="openshift-ovn-kubernetes/ovnkube-node-x6lg7" Jul 15 04:06:08.039213 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:08.037607 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/3eddd8b4-e14d-4f98-8830-0a2f487d85e8-os-release\") pod \"multus-tskl2\" (UID: \"3eddd8b4-e14d-4f98-8830-0a2f487d85e8\") " pod="openshift-multus/multus-tskl2" Jul 15 04:06:08.039213 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:08.037631 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/3eddd8b4-e14d-4f98-8830-0a2f487d85e8-multus-daemon-config\") pod \"multus-tskl2\" (UID: \"3eddd8b4-e14d-4f98-8830-0a2f487d85e8\") " pod="openshift-multus/multus-tskl2" Jul 15 04:06:08.039213 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:08.037655 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/9b5b5ded-e119-4d0d-8780-38c93fc5b17c-etc-selinux\") pod \"aws-ebs-csi-driver-node-lzsbl\" (UID: \"9b5b5ded-e119-4d0d-8780-38c93fc5b17c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lzsbl" Jul 15 04:06:08.039213 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:08.037701 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7cab18b8-43fd-46d1-a75d-6de40cbcd09a-etc-openvswitch\") pod \"ovnkube-node-x6lg7\" (UID: \"7cab18b8-43fd-46d1-a75d-6de40cbcd09a\") " pod="openshift-ovn-kubernetes/ovnkube-node-x6lg7" Jul 15 04:06:08.039213 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:08.037728 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e302da62-33bc-44ff-a188-8d409325e38f-tmp-dir\") pod \"node-resolver-lf5rb\" (UID: \"e302da62-33bc-44ff-a188-8d409325e38f\") " pod="openshift-dns/node-resolver-lf5rb" Jul 15 04:06:08.039213 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:08.037743 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/6616446d-4bdb-4867-a2f8-c39ed74908b9-kubelet-config\") pod \"global-pull-secret-syncer-kz7p2\" (UID: \"6616446d-4bdb-4867-a2f8-c39ed74908b9\") " pod="kube-system/global-pull-secret-syncer-kz7p2" Jul 15 04:06:08.039213 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:08.037755 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d73a22ce-26a0-48d7-a3f2-e0a5f50c78b0-host-slash\") pod \"iptables-alerter-8jqrr\" (UID: \"d73a22ce-26a0-48d7-a3f2-e0a5f50c78b0\") " pod="openshift-network-operator/iptables-alerter-8jqrr" Jul 15 04:06:08.039213 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:08.037779 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/26457908-4466-41d1-b908-507b13774dea-etc-systemd\") pod \"tuned-sj6mk\" (UID: \"26457908-4466-41d1-b908-507b13774dea\") " pod="openshift-cluster-node-tuning-operator/tuned-sj6mk" Jul 15 04:06:08.039213 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:08.037777 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/3eddd8b4-e14d-4f98-8830-0a2f487d85e8-cni-binary-copy\") pod \"multus-tskl2\" (UID: \"3eddd8b4-e14d-4f98-8830-0a2f487d85e8\") " pod="openshift-multus/multus-tskl2" Jul 15 04:06:08.039213 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:08.037816 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3eddd8b4-e14d-4f98-8830-0a2f487d85e8-system-cni-dir\") pod \"multus-tskl2\" (UID: \"3eddd8b4-e14d-4f98-8830-0a2f487d85e8\") " pod="openshift-multus/multus-tskl2" Jul 15 04:06:08.039213 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:08.037839 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7cab18b8-43fd-46d1-a75d-6de40cbcd09a-etc-openvswitch\") pod \"ovnkube-node-x6lg7\" (UID: \"7cab18b8-43fd-46d1-a75d-6de40cbcd09a\") " pod="openshift-ovn-kubernetes/ovnkube-node-x6lg7" Jul 15 04:06:08.040136 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:08.037861 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/3eddd8b4-e14d-4f98-8830-0a2f487d85e8-hostroot\") pod \"multus-tskl2\" (UID: \"3eddd8b4-e14d-4f98-8830-0a2f487d85e8\") " pod="openshift-multus/multus-tskl2" Jul 15 04:06:08.040136 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:08.037883 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/7cab18b8-43fd-46d1-a75d-6de40cbcd09a-ovnkube-script-lib\") pod \"ovnkube-node-x6lg7\" (UID: \"7cab18b8-43fd-46d1-a75d-6de40cbcd09a\") " pod="openshift-ovn-kubernetes/ovnkube-node-x6lg7" Jul 15 04:06:08.040136 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:08.037900 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/3eddd8b4-e14d-4f98-8830-0a2f487d85e8-multus-conf-dir\") pod \"multus-tskl2\" (UID: \"3eddd8b4-e14d-4f98-8830-0a2f487d85e8\") " pod="openshift-multus/multus-tskl2" Jul 15 04:06:08.040136 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:08.037910 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/26457908-4466-41d1-b908-507b13774dea-tmp\") pod \"tuned-sj6mk\" (UID: \"26457908-4466-41d1-b908-507b13774dea\") " pod="openshift-cluster-node-tuning-operator/tuned-sj6mk" Jul 15 04:06:08.040136 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:08.037884 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/9b5b5ded-e119-4d0d-8780-38c93fc5b17c-etc-selinux\") pod \"aws-ebs-csi-driver-node-lzsbl\" (UID: \"9b5b5ded-e119-4d0d-8780-38c93fc5b17c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lzsbl" Jul 15 04:06:08.040136 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:08.037933 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/937573bb-cbf0-410b-a1b3-1d082b5f3fbd-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-pzrtj\" (UID: \"937573bb-cbf0-410b-a1b3-1d082b5f3fbd\") " pod="openshift-multus/multus-additional-cni-plugins-pzrtj" Jul 15 04:06:08.040136 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:08.037951 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/9b5b5ded-e119-4d0d-8780-38c93fc5b17c-registration-dir\") pod \"aws-ebs-csi-driver-node-lzsbl\" (UID: \"9b5b5ded-e119-4d0d-8780-38c93fc5b17c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lzsbl" Jul 15 04:06:08.040136 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:08.037944 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/9b5b5ded-e119-4d0d-8780-38c93fc5b17c-kubelet-dir\") pod \"aws-ebs-csi-driver-node-lzsbl\" (UID: \"9b5b5ded-e119-4d0d-8780-38c93fc5b17c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lzsbl" Jul 15 04:06:08.040136 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:08.037991 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/3eddd8b4-e14d-4f98-8830-0a2f487d85e8-os-release\") pod \"multus-tskl2\" (UID: \"3eddd8b4-e14d-4f98-8830-0a2f487d85e8\") " pod="openshift-multus/multus-tskl2" Jul 15 04:06:08.040136 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:08.038010 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d73a22ce-26a0-48d7-a3f2-e0a5f50c78b0-host-slash\") pod \"iptables-alerter-8jqrr\" (UID: \"d73a22ce-26a0-48d7-a3f2-e0a5f50c78b0\") " pod="openshift-network-operator/iptables-alerter-8jqrr" Jul 15 04:06:08.040136 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:08.038034 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/9b5b5ded-e119-4d0d-8780-38c93fc5b17c-registration-dir\") pod \"aws-ebs-csi-driver-node-lzsbl\" (UID: \"9b5b5ded-e119-4d0d-8780-38c93fc5b17c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lzsbl" Jul 15 04:06:08.040136 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:08.038035 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/d73a22ce-26a0-48d7-a3f2-e0a5f50c78b0-iptables-alerter-script\") pod \"iptables-alerter-8jqrr\" (UID: \"d73a22ce-26a0-48d7-a3f2-e0a5f50c78b0\") " pod="openshift-network-operator/iptables-alerter-8jqrr" Jul 15 04:06:08.040136 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:08.038059 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/7cab18b8-43fd-46d1-a75d-6de40cbcd09a-host-slash\") pod \"ovnkube-node-x6lg7\" (UID: \"7cab18b8-43fd-46d1-a75d-6de40cbcd09a\") " pod="openshift-ovn-kubernetes/ovnkube-node-x6lg7" Jul 15 04:06:08.040136 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:08.038076 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vh92c\" (UniqueName: \"kubernetes.io/projected/5b46708f-6444-44fc-8274-3921be1c13c7-kube-api-access-vh92c\") pod \"network-metrics-daemon-2jvh6\" (UID: \"5b46708f-6444-44fc-8274-3921be1c13c7\") " pod="openshift-multus/network-metrics-daemon-2jvh6" Jul 15 04:06:08.040136 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:08.038083 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/26457908-4466-41d1-b908-507b13774dea-etc-systemd\") pod \"tuned-sj6mk\" (UID: \"26457908-4466-41d1-b908-507b13774dea\") " pod="openshift-cluster-node-tuning-operator/tuned-sj6mk" Jul 15 04:06:08.040136 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:08.038129 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/7cab18b8-43fd-46d1-a75d-6de40cbcd09a-env-overrides\") pod \"ovnkube-node-x6lg7\" (UID: \"7cab18b8-43fd-46d1-a75d-6de40cbcd09a\") " pod="openshift-ovn-kubernetes/ovnkube-node-x6lg7" Jul 15 04:06:08.040136 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:08.038130 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/9b5b5ded-e119-4d0d-8780-38c93fc5b17c-socket-dir\") pod \"aws-ebs-csi-driver-node-lzsbl\" (UID: \"9b5b5ded-e119-4d0d-8780-38c93fc5b17c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lzsbl" Jul 15 04:06:08.040756 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:08.038168 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e302da62-33bc-44ff-a188-8d409325e38f-tmp-dir\") pod \"node-resolver-lf5rb\" (UID: \"e302da62-33bc-44ff-a188-8d409325e38f\") " pod="openshift-dns/node-resolver-lf5rb" Jul 15 04:06:08.040756 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:08.038197 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/9b5b5ded-e119-4d0d-8780-38c93fc5b17c-device-dir\") pod \"aws-ebs-csi-driver-node-lzsbl\" (UID: \"9b5b5ded-e119-4d0d-8780-38c93fc5b17c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lzsbl" Jul 15 04:06:08.040756 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:08.038227 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3eddd8b4-e14d-4f98-8830-0a2f487d85e8-host-var-lib-kubelet\") pod \"multus-tskl2\" (UID: \"3eddd8b4-e14d-4f98-8830-0a2f487d85e8\") " pod="openshift-multus/multus-tskl2" Jul 15 04:06:08.040756 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:08.038251 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/26457908-4466-41d1-b908-507b13774dea-etc-kubernetes\") pod \"tuned-sj6mk\" (UID: \"26457908-4466-41d1-b908-507b13774dea\") " pod="openshift-cluster-node-tuning-operator/tuned-sj6mk" Jul 15 04:06:08.040756 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:08.038257 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/9b5b5ded-e119-4d0d-8780-38c93fc5b17c-socket-dir\") pod \"aws-ebs-csi-driver-node-lzsbl\" (UID: \"9b5b5ded-e119-4d0d-8780-38c93fc5b17c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lzsbl" Jul 15 04:06:08.040756 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:08.038279 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/9b5b5ded-e119-4d0d-8780-38c93fc5b17c-device-dir\") pod \"aws-ebs-csi-driver-node-lzsbl\" (UID: \"9b5b5ded-e119-4d0d-8780-38c93fc5b17c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lzsbl" Jul 15 04:06:08.040756 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:08.038303 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3eddd8b4-e14d-4f98-8830-0a2f487d85e8-host-var-lib-kubelet\") pod \"multus-tskl2\" (UID: \"3eddd8b4-e14d-4f98-8830-0a2f487d85e8\") " pod="openshift-multus/multus-tskl2" Jul 15 04:06:08.040756 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:08.038278 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2sqwr\" (UniqueName: \"kubernetes.io/projected/26457908-4466-41d1-b908-507b13774dea-kube-api-access-2sqwr\") pod \"tuned-sj6mk\" (UID: \"26457908-4466-41d1-b908-507b13774dea\") " pod="openshift-cluster-node-tuning-operator/tuned-sj6mk" Jul 15 04:06:08.040756 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:08.038325 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/26457908-4466-41d1-b908-507b13774dea-etc-kubernetes\") pod \"tuned-sj6mk\" (UID: \"26457908-4466-41d1-b908-507b13774dea\") " pod="openshift-cluster-node-tuning-operator/tuned-sj6mk" Jul 15 04:06:08.040756 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:08.038343 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/6616446d-4bdb-4867-a2f8-c39ed74908b9-dbus\") pod \"global-pull-secret-syncer-kz7p2\" (UID: \"6616446d-4bdb-4867-a2f8-c39ed74908b9\") " pod="kube-system/global-pull-secret-syncer-kz7p2" Jul 15 04:06:08.040756 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:08.038370 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7cab18b8-43fd-46d1-a75d-6de40cbcd09a-host-run-ovn-kubernetes\") pod \"ovnkube-node-x6lg7\" (UID: \"7cab18b8-43fd-46d1-a75d-6de40cbcd09a\") " pod="openshift-ovn-kubernetes/ovnkube-node-x6lg7" Jul 15 04:06:08.040756 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:08.038405 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/3eddd8b4-e14d-4f98-8830-0a2f487d85e8-multus-socket-dir-parent\") pod \"multus-tskl2\" (UID: \"3eddd8b4-e14d-4f98-8830-0a2f487d85e8\") " pod="openshift-multus/multus-tskl2" Jul 15 04:06:08.040756 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:08.038456 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/3eddd8b4-e14d-4f98-8830-0a2f487d85e8-host-var-lib-cni-multus\") pod \"multus-tskl2\" (UID: \"3eddd8b4-e14d-4f98-8830-0a2f487d85e8\") " pod="openshift-multus/multus-tskl2" Jul 15 04:06:08.040756 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:08.038465 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7cab18b8-43fd-46d1-a75d-6de40cbcd09a-host-run-ovn-kubernetes\") pod \"ovnkube-node-x6lg7\" (UID: \"7cab18b8-43fd-46d1-a75d-6de40cbcd09a\") " pod="openshift-ovn-kubernetes/ovnkube-node-x6lg7" Jul 15 04:06:08.040756 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:08.038482 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/26457908-4466-41d1-b908-507b13774dea-etc-sysconfig\") pod \"tuned-sj6mk\" (UID: \"26457908-4466-41d1-b908-507b13774dea\") " pod="openshift-cluster-node-tuning-operator/tuned-sj6mk" Jul 15 04:06:08.040756 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:08.038493 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/3eddd8b4-e14d-4f98-8830-0a2f487d85e8-multus-daemon-config\") pod \"multus-tskl2\" (UID: \"3eddd8b4-e14d-4f98-8830-0a2f487d85e8\") " pod="openshift-multus/multus-tskl2" Jul 15 04:06:08.040756 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:08.038507 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/3eddd8b4-e14d-4f98-8830-0a2f487d85e8-multus-socket-dir-parent\") pod \"multus-tskl2\" (UID: \"3eddd8b4-e14d-4f98-8830-0a2f487d85e8\") " pod="openshift-multus/multus-tskl2" Jul 15 04:06:08.041421 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:08.038521 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/9b5b5ded-e119-4d0d-8780-38c93fc5b17c-sys-fs\") pod \"aws-ebs-csi-driver-node-lzsbl\" (UID: \"9b5b5ded-e119-4d0d-8780-38c93fc5b17c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lzsbl" Jul 15 04:06:08.041421 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:08.038539 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/26457908-4466-41d1-b908-507b13774dea-etc-sysconfig\") pod \"tuned-sj6mk\" (UID: \"26457908-4466-41d1-b908-507b13774dea\") " pod="openshift-cluster-node-tuning-operator/tuned-sj6mk" Jul 15 04:06:08.041421 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:08.038519 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/6616446d-4bdb-4867-a2f8-c39ed74908b9-dbus\") pod \"global-pull-secret-syncer-kz7p2\" (UID: \"6616446d-4bdb-4867-a2f8-c39ed74908b9\") " pod="kube-system/global-pull-secret-syncer-kz7p2" Jul 15 04:06:08.041421 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:08.038556 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7cab18b8-43fd-46d1-a75d-6de40cbcd09a-var-lib-openvswitch\") pod \"ovnkube-node-x6lg7\" (UID: \"7cab18b8-43fd-46d1-a75d-6de40cbcd09a\") " pod="openshift-ovn-kubernetes/ovnkube-node-x6lg7" Jul 15 04:06:08.041421 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:08.038570 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/3eddd8b4-e14d-4f98-8830-0a2f487d85e8-host-var-lib-cni-multus\") pod \"multus-tskl2\" (UID: \"3eddd8b4-e14d-4f98-8830-0a2f487d85e8\") " pod="openshift-multus/multus-tskl2" Jul 15 04:06:08.041421 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:08.038584 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be-konnectivity-ca\") pod \"konnectivity-agent-cvjv6\" (UID: \"cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be\") " pod="kube-system/konnectivity-agent-cvjv6" Jul 15 04:06:08.041421 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:08.038602 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/9b5b5ded-e119-4d0d-8780-38c93fc5b17c-sys-fs\") pod \"aws-ebs-csi-driver-node-lzsbl\" (UID: \"9b5b5ded-e119-4d0d-8780-38c93fc5b17c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lzsbl" Jul 15 04:06:08.041421 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:08.038610 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7cab18b8-43fd-46d1-a75d-6de40cbcd09a-var-lib-openvswitch\") pod \"ovnkube-node-x6lg7\" (UID: \"7cab18b8-43fd-46d1-a75d-6de40cbcd09a\") " pod="openshift-ovn-kubernetes/ovnkube-node-x6lg7" Jul 15 04:06:08.041421 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:08.038611 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dsn95\" (UniqueName: \"kubernetes.io/projected/e302da62-33bc-44ff-a188-8d409325e38f-kube-api-access-dsn95\") pod \"node-resolver-lf5rb\" (UID: \"e302da62-33bc-44ff-a188-8d409325e38f\") " pod="openshift-dns/node-resolver-lf5rb" Jul 15 04:06:08.041421 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:08.038650 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/3eddd8b4-e14d-4f98-8830-0a2f487d85e8-cnibin\") pod \"multus-tskl2\" (UID: \"3eddd8b4-e14d-4f98-8830-0a2f487d85e8\") " pod="openshift-multus/multus-tskl2" Jul 15 04:06:08.041421 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:08.038675 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3eddd8b4-e14d-4f98-8830-0a2f487d85e8-etc-kubernetes\") pod \"multus-tskl2\" (UID: \"3eddd8b4-e14d-4f98-8830-0a2f487d85e8\") " pod="openshift-multus/multus-tskl2" Jul 15 04:06:08.041421 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:08.038714 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/7cab18b8-43fd-46d1-a75d-6de40cbcd09a-host-run-netns\") pod \"ovnkube-node-x6lg7\" (UID: \"7cab18b8-43fd-46d1-a75d-6de40cbcd09a\") " pod="openshift-ovn-kubernetes/ovnkube-node-x6lg7" Jul 15 04:06:08.041421 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:08.038720 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/3eddd8b4-e14d-4f98-8830-0a2f487d85e8-cnibin\") pod \"multus-tskl2\" (UID: \"3eddd8b4-e14d-4f98-8830-0a2f487d85e8\") " pod="openshift-multus/multus-tskl2" Jul 15 04:06:08.041421 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:08.038766 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/7cab18b8-43fd-46d1-a75d-6de40cbcd09a-host-run-netns\") pod \"ovnkube-node-x6lg7\" (UID: \"7cab18b8-43fd-46d1-a75d-6de40cbcd09a\") " pod="openshift-ovn-kubernetes/ovnkube-node-x6lg7" Jul 15 04:06:08.041421 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:08.038769 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/7cab18b8-43fd-46d1-a75d-6de40cbcd09a-run-ovn\") pod \"ovnkube-node-x6lg7\" (UID: \"7cab18b8-43fd-46d1-a75d-6de40cbcd09a\") " pod="openshift-ovn-kubernetes/ovnkube-node-x6lg7" Jul 15 04:06:08.041421 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:08.038792 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3eddd8b4-e14d-4f98-8830-0a2f487d85e8-etc-kubernetes\") pod \"multus-tskl2\" (UID: \"3eddd8b4-e14d-4f98-8830-0a2f487d85e8\") " pod="openshift-multus/multus-tskl2" Jul 15 04:06:08.041421 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:08.038803 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/7cab18b8-43fd-46d1-a75d-6de40cbcd09a-run-ovn\") pod \"ovnkube-node-x6lg7\" (UID: \"7cab18b8-43fd-46d1-a75d-6de40cbcd09a\") " pod="openshift-ovn-kubernetes/ovnkube-node-x6lg7" Jul 15 04:06:08.041421 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:08.038807 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/7cab18b8-43fd-46d1-a75d-6de40cbcd09a-ovnkube-config\") pod \"ovnkube-node-x6lg7\" (UID: \"7cab18b8-43fd-46d1-a75d-6de40cbcd09a\") " pod="openshift-ovn-kubernetes/ovnkube-node-x6lg7" Jul 15 04:06:08.042072 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:08.038834 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/26457908-4466-41d1-b908-507b13774dea-var-lib-kubelet\") pod \"tuned-sj6mk\" (UID: \"26457908-4466-41d1-b908-507b13774dea\") " pod="openshift-cluster-node-tuning-operator/tuned-sj6mk" Jul 15 04:06:08.042072 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:08.038862 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/26457908-4466-41d1-b908-507b13774dea-etc-tuned\") pod \"tuned-sj6mk\" (UID: \"26457908-4466-41d1-b908-507b13774dea\") " pod="openshift-cluster-node-tuning-operator/tuned-sj6mk" Jul 15 04:06:08.042072 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:08.038894 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tnfhn\" (UniqueName: \"kubernetes.io/projected/3eddd8b4-e14d-4f98-8830-0a2f487d85e8-kube-api-access-tnfhn\") pod \"multus-tskl2\" (UID: \"3eddd8b4-e14d-4f98-8830-0a2f487d85e8\") " pod="openshift-multus/multus-tskl2" Jul 15 04:06:08.042072 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:08.038921 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/26457908-4466-41d1-b908-507b13774dea-lib-modules\") pod \"tuned-sj6mk\" (UID: \"26457908-4466-41d1-b908-507b13774dea\") " pod="openshift-cluster-node-tuning-operator/tuned-sj6mk" Jul 15 04:06:08.042072 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:08.038926 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/26457908-4466-41d1-b908-507b13774dea-var-lib-kubelet\") pod \"tuned-sj6mk\" (UID: \"26457908-4466-41d1-b908-507b13774dea\") " pod="openshift-cluster-node-tuning-operator/tuned-sj6mk" Jul 15 04:06:08.042072 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:08.038961 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5b46708f-6444-44fc-8274-3921be1c13c7-metrics-certs\") pod \"network-metrics-daemon-2jvh6\" (UID: \"5b46708f-6444-44fc-8274-3921be1c13c7\") " pod="openshift-multus/network-metrics-daemon-2jvh6" Jul 15 04:06:08.042072 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:08.038993 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/3eddd8b4-e14d-4f98-8830-0a2f487d85e8-host-var-lib-cni-bin\") pod \"multus-tskl2\" (UID: \"3eddd8b4-e14d-4f98-8830-0a2f487d85e8\") " pod="openshift-multus/multus-tskl2" Jul 15 04:06:08.042072 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:08.039040 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/26457908-4466-41d1-b908-507b13774dea-etc-sysctl-d\") pod \"tuned-sj6mk\" (UID: \"26457908-4466-41d1-b908-507b13774dea\") " pod="openshift-cluster-node-tuning-operator/tuned-sj6mk" Jul 15 04:06:08.042072 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:08.039071 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/26457908-4466-41d1-b908-507b13774dea-sys\") pod \"tuned-sj6mk\" (UID: \"26457908-4466-41d1-b908-507b13774dea\") " pod="openshift-cluster-node-tuning-operator/tuned-sj6mk" Jul 15 04:06:08.042072 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:08.039094 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/26457908-4466-41d1-b908-507b13774dea-host\") pod \"tuned-sj6mk\" (UID: \"26457908-4466-41d1-b908-507b13774dea\") " pod="openshift-cluster-node-tuning-operator/tuned-sj6mk" Jul 15 04:06:08.042072 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:08.039118 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/7cab18b8-43fd-46d1-a75d-6de40cbcd09a-host-kubelet\") pod \"ovnkube-node-x6lg7\" (UID: \"7cab18b8-43fd-46d1-a75d-6de40cbcd09a\") " pod="openshift-ovn-kubernetes/ovnkube-node-x6lg7" Jul 15 04:06:08.042072 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:08.039161 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7cab18b8-43fd-46d1-a75d-6de40cbcd09a-run-openvswitch\") pod \"ovnkube-node-x6lg7\" (UID: \"7cab18b8-43fd-46d1-a75d-6de40cbcd09a\") " pod="openshift-ovn-kubernetes/ovnkube-node-x6lg7" Jul 15 04:06:08.042072 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:08.039158 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be-konnectivity-ca\") pod \"konnectivity-agent-cvjv6\" (UID: \"cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be\") " pod="kube-system/konnectivity-agent-cvjv6" Jul 15 04:06:08.042072 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:08.039191 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qg87j\" (UniqueName: \"kubernetes.io/projected/7cab18b8-43fd-46d1-a75d-6de40cbcd09a-kube-api-access-qg87j\") pod \"ovnkube-node-x6lg7\" (UID: \"7cab18b8-43fd-46d1-a75d-6de40cbcd09a\") " pod="openshift-ovn-kubernetes/ovnkube-node-x6lg7" Jul 15 04:06:08.042072 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:08.039216 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be-agent-certs\") pod \"konnectivity-agent-cvjv6\" (UID: \"cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be\") " pod="kube-system/konnectivity-agent-cvjv6" Jul 15 04:06:08.042072 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:08.039241 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/26457908-4466-41d1-b908-507b13774dea-etc-modprobe-d\") pod \"tuned-sj6mk\" (UID: \"26457908-4466-41d1-b908-507b13774dea\") " pod="openshift-cluster-node-tuning-operator/tuned-sj6mk" Jul 15 04:06:08.042072 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:08.039250 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/26457908-4466-41d1-b908-507b13774dea-sys\") pod \"tuned-sj6mk\" (UID: \"26457908-4466-41d1-b908-507b13774dea\") " pod="openshift-cluster-node-tuning-operator/tuned-sj6mk" Jul 15 04:06:08.042072 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:08.039268 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/937573bb-cbf0-410b-a1b3-1d082b5f3fbd-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-pzrtj\" (UID: \"937573bb-cbf0-410b-a1b3-1d082b5f3fbd\") " pod="openshift-multus/multus-additional-cni-plugins-pzrtj" Jul 15 04:06:08.042763 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:08.039366 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/26457908-4466-41d1-b908-507b13774dea-lib-modules\") pod \"tuned-sj6mk\" (UID: \"26457908-4466-41d1-b908-507b13774dea\") " pod="openshift-cluster-node-tuning-operator/tuned-sj6mk" Jul 15 04:06:08.042763 ip-10-0-128-222 kubenswrapper[2581]: E0715 04:06:08.039451 2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 15 04:06:08.042763 ip-10-0-128-222 kubenswrapper[2581]: E0715 04:06:08.039515 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5b46708f-6444-44fc-8274-3921be1c13c7-metrics-certs podName:5b46708f-6444-44fc-8274-3921be1c13c7 nodeName:}" failed. No retries permitted until 2026-07-15 04:06:08.539498498 +0000 UTC m=+2.066299493 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5b46708f-6444-44fc-8274-3921be1c13c7-metrics-certs") pod "network-metrics-daemon-2jvh6" (UID: "5b46708f-6444-44fc-8274-3921be1c13c7") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 15 04:06:08.042763 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:08.039517 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/7cab18b8-43fd-46d1-a75d-6de40cbcd09a-ovnkube-config\") pod \"ovnkube-node-x6lg7\" (UID: \"7cab18b8-43fd-46d1-a75d-6de40cbcd09a\") " pod="openshift-ovn-kubernetes/ovnkube-node-x6lg7" Jul 15 04:06:08.042763 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:08.039580 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/3eddd8b4-e14d-4f98-8830-0a2f487d85e8-host-var-lib-cni-bin\") pod \"multus-tskl2\" (UID: \"3eddd8b4-e14d-4f98-8830-0a2f487d85e8\") " pod="openshift-multus/multus-tskl2" Jul 15 04:06:08.042763 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:08.039624 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7cab18b8-43fd-46d1-a75d-6de40cbcd09a-run-openvswitch\") pod \"ovnkube-node-x6lg7\" (UID: \"7cab18b8-43fd-46d1-a75d-6de40cbcd09a\") " pod="openshift-ovn-kubernetes/ovnkube-node-x6lg7" Jul 15 04:06:08.042763 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:08.039652 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/26457908-4466-41d1-b908-507b13774dea-etc-sysctl-d\") pod \"tuned-sj6mk\" (UID: \"26457908-4466-41d1-b908-507b13774dea\") " pod="openshift-cluster-node-tuning-operator/tuned-sj6mk" Jul 15 04:06:08.042763 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:08.039668 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/26457908-4466-41d1-b908-507b13774dea-host\") pod \"tuned-sj6mk\" (UID: \"26457908-4466-41d1-b908-507b13774dea\") " pod="openshift-cluster-node-tuning-operator/tuned-sj6mk" Jul 15 04:06:08.042763 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:08.039704 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/7cab18b8-43fd-46d1-a75d-6de40cbcd09a-host-kubelet\") pod \"ovnkube-node-x6lg7\" (UID: \"7cab18b8-43fd-46d1-a75d-6de40cbcd09a\") " pod="openshift-ovn-kubernetes/ovnkube-node-x6lg7" Jul 15 04:06:08.042763 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:08.039828 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/937573bb-cbf0-410b-a1b3-1d082b5f3fbd-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-pzrtj\" (UID: \"937573bb-cbf0-410b-a1b3-1d082b5f3fbd\") " pod="openshift-multus/multus-additional-cni-plugins-pzrtj" Jul 15 04:06:08.042763 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:08.039948 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/26457908-4466-41d1-b908-507b13774dea-etc-modprobe-d\") pod \"tuned-sj6mk\" (UID: \"26457908-4466-41d1-b908-507b13774dea\") " pod="openshift-cluster-node-tuning-operator/tuned-sj6mk" Jul 15 04:06:08.042763 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:08.040061 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/7cab18b8-43fd-46d1-a75d-6de40cbcd09a-ovn-node-metrics-cert\") pod \"ovnkube-node-x6lg7\" (UID: \"7cab18b8-43fd-46d1-a75d-6de40cbcd09a\") " pod="openshift-ovn-kubernetes/ovnkube-node-x6lg7" Jul 15 04:06:08.042763 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:08.041175 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/26457908-4466-41d1-b908-507b13774dea-tmp\") pod \"tuned-sj6mk\" (UID: \"26457908-4466-41d1-b908-507b13774dea\") " pod="openshift-cluster-node-tuning-operator/tuned-sj6mk" Jul 15 04:06:08.042763 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:08.041361 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/26457908-4466-41d1-b908-507b13774dea-etc-tuned\") pod \"tuned-sj6mk\" (UID: \"26457908-4466-41d1-b908-507b13774dea\") " pod="openshift-cluster-node-tuning-operator/tuned-sj6mk" Jul 15 04:06:08.042763 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:08.042169 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be-agent-certs\") pod \"konnectivity-agent-cvjv6\" (UID: \"cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be\") " pod="kube-system/konnectivity-agent-cvjv6" Jul 15 04:06:08.046045 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:08.046011 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pqsx8\" (UniqueName: \"kubernetes.io/projected/9b5b5ded-e119-4d0d-8780-38c93fc5b17c-kube-api-access-pqsx8\") pod \"aws-ebs-csi-driver-node-lzsbl\" (UID: \"9b5b5ded-e119-4d0d-8780-38c93fc5b17c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lzsbl" Jul 15 04:06:08.046713 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:08.046688 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nhjx4\" (UniqueName: \"kubernetes.io/projected/937573bb-cbf0-410b-a1b3-1d082b5f3fbd-kube-api-access-nhjx4\") pod \"multus-additional-cni-plugins-pzrtj\" (UID: \"937573bb-cbf0-410b-a1b3-1d082b5f3fbd\") " pod="openshift-multus/multus-additional-cni-plugins-pzrtj" Jul 15 04:06:08.047029 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:08.047010 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dsn95\" (UniqueName: \"kubernetes.io/projected/e302da62-33bc-44ff-a188-8d409325e38f-kube-api-access-dsn95\") pod \"node-resolver-lf5rb\" (UID: \"e302da62-33bc-44ff-a188-8d409325e38f\") " pod="openshift-dns/node-resolver-lf5rb" Jul 15 04:06:08.047312 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:08.047291 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tnfhn\" (UniqueName: \"kubernetes.io/projected/3eddd8b4-e14d-4f98-8830-0a2f487d85e8-kube-api-access-tnfhn\") pod \"multus-tskl2\" (UID: \"3eddd8b4-e14d-4f98-8830-0a2f487d85e8\") " pod="openshift-multus/multus-tskl2" Jul 15 04:06:08.047599 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:08.047563 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vh92c\" (UniqueName: \"kubernetes.io/projected/5b46708f-6444-44fc-8274-3921be1c13c7-kube-api-access-vh92c\") pod \"network-metrics-daemon-2jvh6\" (UID: \"5b46708f-6444-44fc-8274-3921be1c13c7\") " pod="openshift-multus/network-metrics-daemon-2jvh6" Jul 15 04:06:08.048102 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:08.048077 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2sqwr\" (UniqueName: \"kubernetes.io/projected/26457908-4466-41d1-b908-507b13774dea-kube-api-access-2sqwr\") pod \"tuned-sj6mk\" (UID: \"26457908-4466-41d1-b908-507b13774dea\") " pod="openshift-cluster-node-tuning-operator/tuned-sj6mk" Jul 15 04:06:08.048321 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:08.048301 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8v5cj\" (UniqueName: \"kubernetes.io/projected/d73a22ce-26a0-48d7-a3f2-e0a5f50c78b0-kube-api-access-8v5cj\") pod \"iptables-alerter-8jqrr\" (UID: \"d73a22ce-26a0-48d7-a3f2-e0a5f50c78b0\") " pod="openshift-network-operator/iptables-alerter-8jqrr" Jul 15 04:06:08.049376 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:08.049354 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qg87j\" (UniqueName: \"kubernetes.io/projected/7cab18b8-43fd-46d1-a75d-6de40cbcd09a-kube-api-access-qg87j\") pod \"ovnkube-node-x6lg7\" (UID: \"7cab18b8-43fd-46d1-a75d-6de40cbcd09a\") " pod="openshift-ovn-kubernetes/ovnkube-node-x6lg7" Jul 15 04:06:08.120572 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:06:08.120526 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb9bbc5f25726cd5de9e0584f4c940785.slice/crio-10e35894395c5ee1c1ceefa3150e5a868ebfef4b7d8521f1a0a08066075b2804 WatchSource:0}: Error finding container 10e35894395c5ee1c1ceefa3150e5a868ebfef4b7d8521f1a0a08066075b2804: Status 404 returned error can't find the container with id 10e35894395c5ee1c1ceefa3150e5a868ebfef4b7d8521f1a0a08066075b2804 Jul 15 04:06:08.120910 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:06:08.120883 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod843258bd2137f5699fadd3ee328bb5bf.slice/crio-979eb9b676e65325b67ffb78b1c4611e96adbd1d04adbfd0982a5ab6658bbe19 WatchSource:0}: Error finding container 979eb9b676e65325b67ffb78b1c4611e96adbd1d04adbfd0982a5ab6658bbe19: Status 404 returned error can't find the container with id 979eb9b676e65325b67ffb78b1c4611e96adbd1d04adbfd0982a5ab6658bbe19 Jul 15 04:06:08.125456 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:08.125437 2581 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 15 04:06:08.165225 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:08.165189 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-9kvf6" Jul 15 04:06:08.165420 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:08.165295 2581 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 15 04:06:08.175749 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:06:08.175715 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbe62ee25_74cc_4b6d_83ed_7639d75d9e0b.slice/crio-44a331d43c75299fa82440e81ad4ee38c05dd1d9e5e3390bff21becc94e26843 WatchSource:0}: Error finding container 44a331d43c75299fa82440e81ad4ee38c05dd1d9e5e3390bff21becc94e26843: Status 404 returned error can't find the container with id 44a331d43c75299fa82440e81ad4ee38c05dd1d9e5e3390bff21becc94e26843 Jul 15 04:06:08.180263 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:08.180241 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-sj6mk" Jul 15 04:06:08.185885 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:08.185867 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-cvjv6" Jul 15 04:06:08.189393 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:06:08.189366 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod26457908_4466_41d1_b908_507b13774dea.slice/crio-41185a769687b3d15cdcc509dc92d7c8c1996de9028b7b1bb2608737e55d2f2b WatchSource:0}: Error finding container 41185a769687b3d15cdcc509dc92d7c8c1996de9028b7b1bb2608737e55d2f2b: Status 404 returned error can't find the container with id 41185a769687b3d15cdcc509dc92d7c8c1996de9028b7b1bb2608737e55d2f2b Jul 15 04:06:08.195139 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:06:08.195115 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcd97c7ca_8e2d_4d45_86cb_1006fcc3f6be.slice/crio-e773890146ea57bf801a2b6632e47ab42bee5b97961fda305b13726f524b0bf0 WatchSource:0}: Error finding container e773890146ea57bf801a2b6632e47ab42bee5b97961fda305b13726f524b0bf0: Status 404 returned error can't find the container with id e773890146ea57bf801a2b6632e47ab42bee5b97961fda305b13726f524b0bf0 Jul 15 04:06:08.217417 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:08.217384 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-pzrtj" Jul 15 04:06:08.227266 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:06:08.227234 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod937573bb_cbf0_410b_a1b3_1d082b5f3fbd.slice/crio-1891c77024b829a12ec5c73cbe2633e9681b1b0b172c78e620f1a00fac336b94 WatchSource:0}: Error finding container 1891c77024b829a12ec5c73cbe2633e9681b1b0b172c78e620f1a00fac336b94: Status 404 returned error can't find the container with id 1891c77024b829a12ec5c73cbe2633e9681b1b0b172c78e620f1a00fac336b94 Jul 15 04:06:08.236219 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:08.236184 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-lf5rb" Jul 15 04:06:08.245662 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:06:08.245636 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode302da62_33bc_44ff_a188_8d409325e38f.slice/crio-0bc23a963ddd015b804ecfdbbc0a984019fab6a17cf945510f16df8fec286ba1 WatchSource:0}: Error finding container 0bc23a963ddd015b804ecfdbbc0a984019fab6a17cf945510f16df8fec286ba1: Status 404 returned error can't find the container with id 0bc23a963ddd015b804ecfdbbc0a984019fab6a17cf945510f16df8fec286ba1 Jul 15 04:06:08.259598 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:08.259561 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lzsbl" Jul 15 04:06:08.268363 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:06:08.268336 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9b5b5ded_e119_4d0d_8780_38c93fc5b17c.slice/crio-04cfb36473446708d1476c55407a99609f829fa6655208bb9bbf6df9e5dc315f WatchSource:0}: Error finding container 04cfb36473446708d1476c55407a99609f829fa6655208bb9bbf6df9e5dc315f: Status 404 returned error can't find the container with id 04cfb36473446708d1476c55407a99609f829fa6655208bb9bbf6df9e5dc315f Jul 15 04:06:08.277379 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:08.277354 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-8jqrr" Jul 15 04:06:08.286433 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:06:08.286407 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd73a22ce_26a0_48d7_a3f2_e0a5f50c78b0.slice/crio-8d660f6b6e82b5f4bbf62b083f1949d1a02d3a19804d7143051d78bc13334563 WatchSource:0}: Error finding container 8d660f6b6e82b5f4bbf62b083f1949d1a02d3a19804d7143051d78bc13334563: Status 404 returned error can't find the container with id 8d660f6b6e82b5f4bbf62b083f1949d1a02d3a19804d7143051d78bc13334563 Jul 15 04:06:08.293823 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:08.293803 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-tskl2" Jul 15 04:06:08.299241 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:08.299215 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-x6lg7" Jul 15 04:06:08.304171 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:06:08.304141 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3eddd8b4_e14d_4f98_8830_0a2f487d85e8.slice/crio-3550aa53941727cb4006419addecb8ea72ebf1f8384d904a1062705d0354c935 WatchSource:0}: Error finding container 3550aa53941727cb4006419addecb8ea72ebf1f8384d904a1062705d0354c935: Status 404 returned error can't find the container with id 3550aa53941727cb4006419addecb8ea72ebf1f8384d904a1062705d0354c935 Jul 15 04:06:08.309369 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:06:08.309346 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7cab18b8_43fd_46d1_a75d_6de40cbcd09a.slice/crio-a7a29edf593196c994db46c7fadbb44413d4c45f03ae1ce374f3712b6209e72a WatchSource:0}: Error finding container a7a29edf593196c994db46c7fadbb44413d4c45f03ae1ce374f3712b6209e72a: Status 404 returned error can't find the container with id a7a29edf593196c994db46c7fadbb44413d4c45f03ae1ce374f3712b6209e72a Jul 15 04:06:08.311321 ip-10-0-128-222 kubenswrapper[2581]: E0715 04:06:08.311300 2581 kuberuntime_manager.go:1459] "Unhandled Error" err="container ovn-controller start failed in pod ovnkube-node-x6lg7_openshift-ovn-kubernetes(7cab18b8-43fd-46d1-a75d-6de40cbcd09a): ErrImagePull: pull QPS exceeded" logger="UnhandledError" Jul 15 04:06:08.312783 ip-10-0-128-222 kubenswrapper[2581]: E0715 04:06:08.312763 2581 kuberuntime_manager.go:1459] "Unhandled Error" err="container kube-rbac-proxy-node start failed in pod ovnkube-node-x6lg7_openshift-ovn-kubernetes(7cab18b8-43fd-46d1-a75d-6de40cbcd09a): ErrImagePull: pull QPS exceeded" logger="UnhandledError" Jul 15 04:06:08.315965 ip-10-0-128-222 kubenswrapper[2581]: E0715 04:06:08.315917 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="[failed to \"StartContainer\" for \"ovn-controller\" with ErrImagePull: \"pull QPS exceeded\", failed to \"StartContainer\" for \"ovn-acl-logging\" with ImagePullBackOff: \"Back-off pulling image \\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:fc4c36822d1ce0f4acab78208d171b757bca1285f69c9653d5a959fa853d8470\\\": ErrImagePull: pull QPS exceeded\", failed to \"StartContainer\" for \"kube-rbac-proxy-node\" with ErrImagePull: \"pull QPS exceeded\", failed to \"StartContainer\" for \"kube-rbac-proxy-ovn-metrics\" with ImagePullBackOff: \"Back-off pulling image \\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:9d1573db16143027c8ffaf46a01ce12f2bcd89c15410c42ca54be4b3b1ddfdd6\\\": ErrImagePull: pull QPS exceeded\", failed to \"StartContainer\" for \"northd\" with ImagePullBackOff: \"Back-off pulling image \\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:fc4c36822d1ce0f4acab78208d171b757bca1285f69c9653d5a959fa853d8470\\\": ErrImagePull: pull QPS exceeded\", failed to \"StartContainer\" for \"nbdb\" with ImagePullBackOff: \"Back-off pulling image \\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:fc4c36822d1ce0f4acab78208d171b757bca1285f69c9653d5a959fa853d8470\\\": ErrImagePull: pull QPS exceeded\", failed to \"StartContainer\" for \"sbdb\" with ImagePullBackOff: \"Back-off pulling image \\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:fc4c36822d1ce0f4acab78208d171b757bca1285f69c9653d5a959fa853d8470\\\": ErrImagePull: pull QPS exceeded\", failed to \"StartContainer\" for \"ovnkube-controller\" with ImagePullBackOff: \"Back-off pulling image \\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:fc4c36822d1ce0f4acab78208d171b757bca1285f69c9653d5a959fa853d8470\\\": ErrImagePull: pull QPS exceeded\"]" pod="openshift-ovn-kubernetes/ovnkube-node-x6lg7" podUID="7cab18b8-43fd-46d1-a75d-6de40cbcd09a" Jul 15 04:06:08.544317 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:08.544225 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6616446d-4bdb-4867-a2f8-c39ed74908b9-original-pull-secret\") pod \"global-pull-secret-syncer-kz7p2\" (UID: \"6616446d-4bdb-4867-a2f8-c39ed74908b9\") " pod="kube-system/global-pull-secret-syncer-kz7p2" Jul 15 04:06:08.544317 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:08.544289 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sxbbk\" (UniqueName: \"kubernetes.io/projected/5ac0aab6-1358-45d2-b257-eda461fc95da-kube-api-access-sxbbk\") pod \"network-check-target-4n42z\" (UID: \"5ac0aab6-1358-45d2-b257-eda461fc95da\") " pod="openshift-network-diagnostics/network-check-target-4n42z" Jul 15 04:06:08.544317 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:08.544314 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5b46708f-6444-44fc-8274-3921be1c13c7-metrics-certs\") pod \"network-metrics-daemon-2jvh6\" (UID: \"5b46708f-6444-44fc-8274-3921be1c13c7\") " pod="openshift-multus/network-metrics-daemon-2jvh6" Jul 15 04:06:08.544528 ip-10-0-128-222 kubenswrapper[2581]: E0715 04:06:08.544385 2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 15 04:06:08.544528 ip-10-0-128-222 kubenswrapper[2581]: E0715 04:06:08.544405 2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 15 04:06:08.544528 ip-10-0-128-222 kubenswrapper[2581]: E0715 04:06:08.544454 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 15 04:06:08.544528 ip-10-0-128-222 kubenswrapper[2581]: E0715 04:06:08.544474 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 15 04:06:08.544528 ip-10-0-128-222 kubenswrapper[2581]: E0715 04:06:08.544485 2581 projected.go:196] Error preparing data for projected volume kube-api-access-sxbbk for pod openshift-network-diagnostics/network-check-target-4n42z: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 15 04:06:08.544528 ip-10-0-128-222 kubenswrapper[2581]: E0715 04:06:08.544462 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6616446d-4bdb-4867-a2f8-c39ed74908b9-original-pull-secret podName:6616446d-4bdb-4867-a2f8-c39ed74908b9 nodeName:}" failed. No retries permitted until 2026-07-15 04:06:09.544441016 +0000 UTC m=+3.071242027 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/6616446d-4bdb-4867-a2f8-c39ed74908b9-original-pull-secret") pod "global-pull-secret-syncer-kz7p2" (UID: "6616446d-4bdb-4867-a2f8-c39ed74908b9") : object "kube-system"/"original-pull-secret" not registered Jul 15 04:06:08.544719 ip-10-0-128-222 kubenswrapper[2581]: E0715 04:06:08.544532 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5b46708f-6444-44fc-8274-3921be1c13c7-metrics-certs podName:5b46708f-6444-44fc-8274-3921be1c13c7 nodeName:}" failed. No retries permitted until 2026-07-15 04:06:09.5445205 +0000 UTC m=+3.071321496 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5b46708f-6444-44fc-8274-3921be1c13c7-metrics-certs") pod "network-metrics-daemon-2jvh6" (UID: "5b46708f-6444-44fc-8274-3921be1c13c7") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 15 04:06:08.544719 ip-10-0-128-222 kubenswrapper[2581]: E0715 04:06:08.544545 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5ac0aab6-1358-45d2-b257-eda461fc95da-kube-api-access-sxbbk podName:5ac0aab6-1358-45d2-b257-eda461fc95da nodeName:}" failed. No retries permitted until 2026-07-15 04:06:09.544538871 +0000 UTC m=+3.071339867 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-sxbbk" (UniqueName: "kubernetes.io/projected/5ac0aab6-1358-45d2-b257-eda461fc95da-kube-api-access-sxbbk") pod "network-check-target-4n42z" (UID: "5ac0aab6-1358-45d2-b257-eda461fc95da") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 15 04:06:08.875952 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:08.875883 2581 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-14 04:01:08 +0000 UTC" deadline="2027-12-08 05:10:54.165334131 +0000 UTC" Jul 15 04:06:08.875952 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:08.875950 2581 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12265h4m45.289390686s" Jul 15 04:06:08.973882 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:08.973850 2581 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 15 04:06:08.986994 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:08.986626 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kz7p2" Jul 15 04:06:08.986994 ip-10-0-128-222 kubenswrapper[2581]: E0715 04:06:08.986767 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kz7p2" podUID="6616446d-4bdb-4867-a2f8-c39ed74908b9" Jul 15 04:06:09.000597 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:09.000513 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-x6lg7" event={"ID":"7cab18b8-43fd-46d1-a75d-6de40cbcd09a","Type":"ContainerStarted","Data":"a7a29edf593196c994db46c7fadbb44413d4c45f03ae1ce374f3712b6209e72a"} Jul 15 04:06:09.004443 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:09.004378 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-8jqrr" event={"ID":"d73a22ce-26a0-48d7-a3f2-e0a5f50c78b0","Type":"ContainerStarted","Data":"8d660f6b6e82b5f4bbf62b083f1949d1a02d3a19804d7143051d78bc13334563"} Jul 15 04:06:09.010368 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:09.010341 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-lf5rb" event={"ID":"e302da62-33bc-44ff-a188-8d409325e38f","Type":"ContainerStarted","Data":"0bc23a963ddd015b804ecfdbbc0a984019fab6a17cf945510f16df8fec286ba1"} Jul 15 04:06:09.014347 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:09.014212 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-pzrtj" event={"ID":"937573bb-cbf0-410b-a1b3-1d082b5f3fbd","Type":"ContainerStarted","Data":"1891c77024b829a12ec5c73cbe2633e9681b1b0b172c78e620f1a00fac336b94"} Jul 15 04:06:09.019401 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:09.019347 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-cvjv6" event={"ID":"cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be","Type":"ContainerStarted","Data":"e773890146ea57bf801a2b6632e47ab42bee5b97961fda305b13726f524b0bf0"} Jul 15 04:06:09.022412 ip-10-0-128-222 kubenswrapper[2581]: E0715 04:06:09.022310 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="[failed to \"StartContainer\" for \"ovn-controller\" with ImagePullBackOff: \"Back-off pulling image \\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:fc4c36822d1ce0f4acab78208d171b757bca1285f69c9653d5a959fa853d8470\\\": ErrImagePull: pull QPS exceeded\", failed to \"StartContainer\" for \"ovn-acl-logging\" with ImagePullBackOff: \"Back-off pulling image \\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:fc4c36822d1ce0f4acab78208d171b757bca1285f69c9653d5a959fa853d8470\\\": ErrImagePull: pull QPS exceeded\", failed to \"StartContainer\" for \"kube-rbac-proxy-node\" with ImagePullBackOff: \"Back-off pulling image \\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:9d1573db16143027c8ffaf46a01ce12f2bcd89c15410c42ca54be4b3b1ddfdd6\\\": ErrImagePull: pull QPS exceeded\", failed to \"StartContainer\" for \"kube-rbac-proxy-ovn-metrics\" with ImagePullBackOff: \"Back-off pulling image \\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:9d1573db16143027c8ffaf46a01ce12f2bcd89c15410c42ca54be4b3b1ddfdd6\\\": ErrImagePull: pull QPS exceeded\", failed to \"StartContainer\" for \"northd\" with ImagePullBackOff: \"Back-off pulling image \\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:fc4c36822d1ce0f4acab78208d171b757bca1285f69c9653d5a959fa853d8470\\\": ErrImagePull: pull QPS exceeded\", failed to \"StartContainer\" for \"nbdb\" with ImagePullBackOff: \"Back-off pulling image \\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:fc4c36822d1ce0f4acab78208d171b757bca1285f69c9653d5a959fa853d8470\\\": ErrImagePull: pull QPS exceeded\", failed to \"StartContainer\" for \"sbdb\" with ImagePullBackOff: \"Back-off pulling image \\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:fc4c36822d1ce0f4acab78208d171b757bca1285f69c9653d5a959fa853d8470\\\": ErrImagePull: pull QPS exceeded\", failed to \"StartContainer\" for \"ovnkube-controller\" with ImagePullBackOff: \"Back-off pulling image \\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:fc4c36822d1ce0f4acab78208d171b757bca1285f69c9653d5a959fa853d8470\\\": ErrImagePull: pull QPS exceeded\"]" pod="openshift-ovn-kubernetes/ovnkube-node-x6lg7" podUID="7cab18b8-43fd-46d1-a75d-6de40cbcd09a" Jul 15 04:06:09.023868 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:09.023786 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-tskl2" event={"ID":"3eddd8b4-e14d-4f98-8830-0a2f487d85e8","Type":"ContainerStarted","Data":"3550aa53941727cb4006419addecb8ea72ebf1f8384d904a1062705d0354c935"} Jul 15 04:06:09.033143 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:09.033106 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lzsbl" event={"ID":"9b5b5ded-e119-4d0d-8780-38c93fc5b17c","Type":"ContainerStarted","Data":"04cfb36473446708d1476c55407a99609f829fa6655208bb9bbf6df9e5dc315f"} Jul 15 04:06:09.045277 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:09.045238 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-sj6mk" event={"ID":"26457908-4466-41d1-b908-507b13774dea","Type":"ContainerStarted","Data":"41185a769687b3d15cdcc509dc92d7c8c1996de9028b7b1bb2608737e55d2f2b"} Jul 15 04:06:09.055812 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:09.055767 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-9kvf6" event={"ID":"be62ee25-74cc-4b6d-83ed-7639d75d9e0b","Type":"ContainerStarted","Data":"44a331d43c75299fa82440e81ad4ee38c05dd1d9e5e3390bff21becc94e26843"} Jul 15 04:06:09.061644 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:09.061609 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-222.ec2.internal" event={"ID":"b9bbc5f25726cd5de9e0584f4c940785","Type":"ContainerStarted","Data":"10e35894395c5ee1c1ceefa3150e5a868ebfef4b7d8521f1a0a08066075b2804"} Jul 15 04:06:09.067530 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:09.067494 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-222.ec2.internal" event={"ID":"843258bd2137f5699fadd3ee328bb5bf","Type":"ContainerStarted","Data":"979eb9b676e65325b67ffb78b1c4611e96adbd1d04adbfd0982a5ab6658bbe19"} Jul 15 04:06:09.552530 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:09.552468 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sxbbk\" (UniqueName: \"kubernetes.io/projected/5ac0aab6-1358-45d2-b257-eda461fc95da-kube-api-access-sxbbk\") pod \"network-check-target-4n42z\" (UID: \"5ac0aab6-1358-45d2-b257-eda461fc95da\") " pod="openshift-network-diagnostics/network-check-target-4n42z" Jul 15 04:06:09.552823 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:09.552554 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5b46708f-6444-44fc-8274-3921be1c13c7-metrics-certs\") pod \"network-metrics-daemon-2jvh6\" (UID: \"5b46708f-6444-44fc-8274-3921be1c13c7\") " pod="openshift-multus/network-metrics-daemon-2jvh6" Jul 15 04:06:09.552823 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:09.552597 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6616446d-4bdb-4867-a2f8-c39ed74908b9-original-pull-secret\") pod \"global-pull-secret-syncer-kz7p2\" (UID: \"6616446d-4bdb-4867-a2f8-c39ed74908b9\") " pod="kube-system/global-pull-secret-syncer-kz7p2" Jul 15 04:06:09.552823 ip-10-0-128-222 kubenswrapper[2581]: E0715 04:06:09.552750 2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 15 04:06:09.552823 ip-10-0-128-222 kubenswrapper[2581]: E0715 04:06:09.552815 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6616446d-4bdb-4867-a2f8-c39ed74908b9-original-pull-secret podName:6616446d-4bdb-4867-a2f8-c39ed74908b9 nodeName:}" failed. No retries permitted until 2026-07-15 04:06:11.552795799 +0000 UTC m=+5.079596794 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/6616446d-4bdb-4867-a2f8-c39ed74908b9-original-pull-secret") pod "global-pull-secret-syncer-kz7p2" (UID: "6616446d-4bdb-4867-a2f8-c39ed74908b9") : object "kube-system"/"original-pull-secret" not registered Jul 15 04:06:09.553069 ip-10-0-128-222 kubenswrapper[2581]: E0715 04:06:09.552914 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 15 04:06:09.553069 ip-10-0-128-222 kubenswrapper[2581]: E0715 04:06:09.552930 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 15 04:06:09.553069 ip-10-0-128-222 kubenswrapper[2581]: E0715 04:06:09.552955 2581 projected.go:196] Error preparing data for projected volume kube-api-access-sxbbk for pod openshift-network-diagnostics/network-check-target-4n42z: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 15 04:06:09.553069 ip-10-0-128-222 kubenswrapper[2581]: E0715 04:06:09.553005 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5ac0aab6-1358-45d2-b257-eda461fc95da-kube-api-access-sxbbk podName:5ac0aab6-1358-45d2-b257-eda461fc95da nodeName:}" failed. No retries permitted until 2026-07-15 04:06:11.552984406 +0000 UTC m=+5.079785419 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-sxbbk" (UniqueName: "kubernetes.io/projected/5ac0aab6-1358-45d2-b257-eda461fc95da-kube-api-access-sxbbk") pod "network-check-target-4n42z" (UID: "5ac0aab6-1358-45d2-b257-eda461fc95da") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 15 04:06:09.553391 ip-10-0-128-222 kubenswrapper[2581]: E0715 04:06:09.553077 2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 15 04:06:09.553391 ip-10-0-128-222 kubenswrapper[2581]: E0715 04:06:09.553113 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5b46708f-6444-44fc-8274-3921be1c13c7-metrics-certs podName:5b46708f-6444-44fc-8274-3921be1c13c7 nodeName:}" failed. No retries permitted until 2026-07-15 04:06:11.553101059 +0000 UTC m=+5.079902059 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5b46708f-6444-44fc-8274-3921be1c13c7-metrics-certs") pod "network-metrics-daemon-2jvh6" (UID: "5b46708f-6444-44fc-8274-3921be1c13c7") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 15 04:06:09.881726 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:09.878479 2581 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-14 04:01:08 +0000 UTC" deadline="2028-04-17 23:41:27.447133774 +0000 UTC" Jul 15 04:06:09.881726 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:09.878547 2581 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15427h35m17.568591013s" Jul 15 04:06:09.984461 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:09.984357 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2jvh6" Jul 15 04:06:09.984461 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:09.984405 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4n42z" Jul 15 04:06:09.984720 ip-10-0-128-222 kubenswrapper[2581]: E0715 04:06:09.984511 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2jvh6" podUID="5b46708f-6444-44fc-8274-3921be1c13c7" Jul 15 04:06:09.984977 ip-10-0-128-222 kubenswrapper[2581]: E0715 04:06:09.984888 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4n42z" podUID="5ac0aab6-1358-45d2-b257-eda461fc95da" Jul 15 04:06:10.725852 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:10.725571 2581 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 15 04:06:10.987232 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:10.986884 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kz7p2" Jul 15 04:06:10.987725 ip-10-0-128-222 kubenswrapper[2581]: E0715 04:06:10.987312 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kz7p2" podUID="6616446d-4bdb-4867-a2f8-c39ed74908b9" Jul 15 04:06:11.569007 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:11.568967 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5b46708f-6444-44fc-8274-3921be1c13c7-metrics-certs\") pod \"network-metrics-daemon-2jvh6\" (UID: \"5b46708f-6444-44fc-8274-3921be1c13c7\") " pod="openshift-multus/network-metrics-daemon-2jvh6" Jul 15 04:06:11.569226 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:11.569038 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6616446d-4bdb-4867-a2f8-c39ed74908b9-original-pull-secret\") pod \"global-pull-secret-syncer-kz7p2\" (UID: \"6616446d-4bdb-4867-a2f8-c39ed74908b9\") " pod="kube-system/global-pull-secret-syncer-kz7p2" Jul 15 04:06:11.569226 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:11.569096 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sxbbk\" (UniqueName: \"kubernetes.io/projected/5ac0aab6-1358-45d2-b257-eda461fc95da-kube-api-access-sxbbk\") pod \"network-check-target-4n42z\" (UID: \"5ac0aab6-1358-45d2-b257-eda461fc95da\") " pod="openshift-network-diagnostics/network-check-target-4n42z" Jul 15 04:06:11.569370 ip-10-0-128-222 kubenswrapper[2581]: E0715 04:06:11.569262 2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 15 04:06:11.569370 ip-10-0-128-222 kubenswrapper[2581]: E0715 04:06:11.569276 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 15 04:06:11.569370 ip-10-0-128-222 kubenswrapper[2581]: E0715 04:06:11.569294 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 15 04:06:11.569370 ip-10-0-128-222 kubenswrapper[2581]: E0715 04:06:11.569308 2581 projected.go:196] Error preparing data for projected volume kube-api-access-sxbbk for pod openshift-network-diagnostics/network-check-target-4n42z: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 15 04:06:11.569370 ip-10-0-128-222 kubenswrapper[2581]: E0715 04:06:11.569332 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5b46708f-6444-44fc-8274-3921be1c13c7-metrics-certs podName:5b46708f-6444-44fc-8274-3921be1c13c7 nodeName:}" failed. No retries permitted until 2026-07-15 04:06:15.569312708 +0000 UTC m=+9.096113724 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5b46708f-6444-44fc-8274-3921be1c13c7-metrics-certs") pod "network-metrics-daemon-2jvh6" (UID: "5b46708f-6444-44fc-8274-3921be1c13c7") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 15 04:06:11.569370 ip-10-0-128-222 kubenswrapper[2581]: E0715 04:06:11.569352 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5ac0aab6-1358-45d2-b257-eda461fc95da-kube-api-access-sxbbk podName:5ac0aab6-1358-45d2-b257-eda461fc95da nodeName:}" failed. No retries permitted until 2026-07-15 04:06:15.569341699 +0000 UTC m=+9.096142695 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-sxbbk" (UniqueName: "kubernetes.io/projected/5ac0aab6-1358-45d2-b257-eda461fc95da-kube-api-access-sxbbk") pod "network-check-target-4n42z" (UID: "5ac0aab6-1358-45d2-b257-eda461fc95da") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 15 04:06:11.569702 ip-10-0-128-222 kubenswrapper[2581]: E0715 04:06:11.569386 2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 15 04:06:11.569702 ip-10-0-128-222 kubenswrapper[2581]: E0715 04:06:11.569417 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6616446d-4bdb-4867-a2f8-c39ed74908b9-original-pull-secret podName:6616446d-4bdb-4867-a2f8-c39ed74908b9 nodeName:}" failed. No retries permitted until 2026-07-15 04:06:15.56940673 +0000 UTC m=+9.096207740 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/6616446d-4bdb-4867-a2f8-c39ed74908b9-original-pull-secret") pod "global-pull-secret-syncer-kz7p2" (UID: "6616446d-4bdb-4867-a2f8-c39ed74908b9") : object "kube-system"/"original-pull-secret" not registered Jul 15 04:06:11.983865 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:11.983825 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2jvh6" Jul 15 04:06:11.984033 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:11.983880 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4n42z" Jul 15 04:06:11.984033 ip-10-0-128-222 kubenswrapper[2581]: E0715 04:06:11.984004 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2jvh6" podUID="5b46708f-6444-44fc-8274-3921be1c13c7" Jul 15 04:06:11.984214 ip-10-0-128-222 kubenswrapper[2581]: E0715 04:06:11.984173 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4n42z" podUID="5ac0aab6-1358-45d2-b257-eda461fc95da" Jul 15 04:06:12.983713 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:12.983668 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kz7p2" Jul 15 04:06:12.984236 ip-10-0-128-222 kubenswrapper[2581]: E0715 04:06:12.983817 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kz7p2" podUID="6616446d-4bdb-4867-a2f8-c39ed74908b9" Jul 15 04:06:13.984034 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:13.984000 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4n42z" Jul 15 04:06:13.984452 ip-10-0-128-222 kubenswrapper[2581]: E0715 04:06:13.984123 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4n42z" podUID="5ac0aab6-1358-45d2-b257-eda461fc95da" Jul 15 04:06:13.984452 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:13.984155 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2jvh6" Jul 15 04:06:13.984452 ip-10-0-128-222 kubenswrapper[2581]: E0715 04:06:13.984258 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2jvh6" podUID="5b46708f-6444-44fc-8274-3921be1c13c7" Jul 15 04:06:14.984476 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:14.984432 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kz7p2" Jul 15 04:06:14.984948 ip-10-0-128-222 kubenswrapper[2581]: E0715 04:06:14.984596 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kz7p2" podUID="6616446d-4bdb-4867-a2f8-c39ed74908b9" Jul 15 04:06:15.607776 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:15.607720 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6616446d-4bdb-4867-a2f8-c39ed74908b9-original-pull-secret\") pod \"global-pull-secret-syncer-kz7p2\" (UID: \"6616446d-4bdb-4867-a2f8-c39ed74908b9\") " pod="kube-system/global-pull-secret-syncer-kz7p2" Jul 15 04:06:15.607989 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:15.607888 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sxbbk\" (UniqueName: \"kubernetes.io/projected/5ac0aab6-1358-45d2-b257-eda461fc95da-kube-api-access-sxbbk\") pod \"network-check-target-4n42z\" (UID: \"5ac0aab6-1358-45d2-b257-eda461fc95da\") " pod="openshift-network-diagnostics/network-check-target-4n42z" Jul 15 04:06:15.607989 ip-10-0-128-222 kubenswrapper[2581]: E0715 04:06:15.607905 2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 15 04:06:15.607989 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:15.607926 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5b46708f-6444-44fc-8274-3921be1c13c7-metrics-certs\") pod \"network-metrics-daemon-2jvh6\" (UID: \"5b46708f-6444-44fc-8274-3921be1c13c7\") " pod="openshift-multus/network-metrics-daemon-2jvh6" Jul 15 04:06:15.607989 ip-10-0-128-222 kubenswrapper[2581]: E0715 04:06:15.607987 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6616446d-4bdb-4867-a2f8-c39ed74908b9-original-pull-secret podName:6616446d-4bdb-4867-a2f8-c39ed74908b9 nodeName:}" failed. No retries permitted until 2026-07-15 04:06:23.607963297 +0000 UTC m=+17.134764299 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/6616446d-4bdb-4867-a2f8-c39ed74908b9-original-pull-secret") pod "global-pull-secret-syncer-kz7p2" (UID: "6616446d-4bdb-4867-a2f8-c39ed74908b9") : object "kube-system"/"original-pull-secret" not registered Jul 15 04:06:15.608274 ip-10-0-128-222 kubenswrapper[2581]: E0715 04:06:15.608078 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 15 04:06:15.608274 ip-10-0-128-222 kubenswrapper[2581]: E0715 04:06:15.608098 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 15 04:06:15.608274 ip-10-0-128-222 kubenswrapper[2581]: E0715 04:06:15.608108 2581 projected.go:196] Error preparing data for projected volume kube-api-access-sxbbk for pod openshift-network-diagnostics/network-check-target-4n42z: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 15 04:06:15.608274 ip-10-0-128-222 kubenswrapper[2581]: E0715 04:06:15.608150 2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 15 04:06:15.608274 ip-10-0-128-222 kubenswrapper[2581]: E0715 04:06:15.608172 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5ac0aab6-1358-45d2-b257-eda461fc95da-kube-api-access-sxbbk podName:5ac0aab6-1358-45d2-b257-eda461fc95da nodeName:}" failed. No retries permitted until 2026-07-15 04:06:23.608159382 +0000 UTC m=+17.134960376 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-sxbbk" (UniqueName: "kubernetes.io/projected/5ac0aab6-1358-45d2-b257-eda461fc95da-kube-api-access-sxbbk") pod "network-check-target-4n42z" (UID: "5ac0aab6-1358-45d2-b257-eda461fc95da") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 15 04:06:15.608274 ip-10-0-128-222 kubenswrapper[2581]: E0715 04:06:15.608199 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5b46708f-6444-44fc-8274-3921be1c13c7-metrics-certs podName:5b46708f-6444-44fc-8274-3921be1c13c7 nodeName:}" failed. No retries permitted until 2026-07-15 04:06:23.6081835 +0000 UTC m=+17.134984509 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5b46708f-6444-44fc-8274-3921be1c13c7-metrics-certs") pod "network-metrics-daemon-2jvh6" (UID: "5b46708f-6444-44fc-8274-3921be1c13c7") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 15 04:06:15.984004 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:15.983973 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2jvh6" Jul 15 04:06:15.984220 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:15.984010 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4n42z" Jul 15 04:06:15.984220 ip-10-0-128-222 kubenswrapper[2581]: E0715 04:06:15.984111 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2jvh6" podUID="5b46708f-6444-44fc-8274-3921be1c13c7" Jul 15 04:06:15.984745 ip-10-0-128-222 kubenswrapper[2581]: E0715 04:06:15.984242 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4n42z" podUID="5ac0aab6-1358-45d2-b257-eda461fc95da" Jul 15 04:06:16.984800 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:16.984761 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kz7p2" Jul 15 04:06:16.985302 ip-10-0-128-222 kubenswrapper[2581]: E0715 04:06:16.984896 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kz7p2" podUID="6616446d-4bdb-4867-a2f8-c39ed74908b9" Jul 15 04:06:17.984419 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:17.984384 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2jvh6" Jul 15 04:06:17.984581 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:17.984435 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4n42z" Jul 15 04:06:17.984581 ip-10-0-128-222 kubenswrapper[2581]: E0715 04:06:17.984545 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2jvh6" podUID="5b46708f-6444-44fc-8274-3921be1c13c7" Jul 15 04:06:17.984680 ip-10-0-128-222 kubenswrapper[2581]: E0715 04:06:17.984661 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4n42z" podUID="5ac0aab6-1358-45d2-b257-eda461fc95da" Jul 15 04:06:18.984257 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:18.984224 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kz7p2" Jul 15 04:06:18.984717 ip-10-0-128-222 kubenswrapper[2581]: E0715 04:06:18.984374 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kz7p2" podUID="6616446d-4bdb-4867-a2f8-c39ed74908b9" Jul 15 04:06:19.983854 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:19.983817 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4n42z" Jul 15 04:06:19.984026 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:19.983826 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2jvh6" Jul 15 04:06:19.984225 ip-10-0-128-222 kubenswrapper[2581]: E0715 04:06:19.984186 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4n42z" podUID="5ac0aab6-1358-45d2-b257-eda461fc95da" Jul 15 04:06:19.984312 ip-10-0-128-222 kubenswrapper[2581]: E0715 04:06:19.984259 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2jvh6" podUID="5b46708f-6444-44fc-8274-3921be1c13c7" Jul 15 04:06:20.983786 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:20.983751 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kz7p2" Jul 15 04:06:20.983984 ip-10-0-128-222 kubenswrapper[2581]: E0715 04:06:20.983890 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kz7p2" podUID="6616446d-4bdb-4867-a2f8-c39ed74908b9" Jul 15 04:06:21.983916 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:21.983883 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4n42z" Jul 15 04:06:21.983916 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:21.983910 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2jvh6" Jul 15 04:06:21.984377 ip-10-0-128-222 kubenswrapper[2581]: E0715 04:06:21.984004 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4n42z" podUID="5ac0aab6-1358-45d2-b257-eda461fc95da" Jul 15 04:06:21.984377 ip-10-0-128-222 kubenswrapper[2581]: E0715 04:06:21.984183 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2jvh6" podUID="5b46708f-6444-44fc-8274-3921be1c13c7" Jul 15 04:06:22.984537 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:22.984433 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kz7p2" Jul 15 04:06:22.985093 ip-10-0-128-222 kubenswrapper[2581]: E0715 04:06:22.984580 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kz7p2" podUID="6616446d-4bdb-4867-a2f8-c39ed74908b9" Jul 15 04:06:23.106384 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:23.106298 2581 generic.go:356] "Generic (PLEG): container finished" podID="b9bbc5f25726cd5de9e0584f4c940785" containerID="7953c4383a5a42cc46324b9215409807e2a6bb54d2a9df5be25bcb1709457026" exitCode=0 Jul 15 04:06:23.106562 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:23.106399 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-222.ec2.internal" event={"ID":"b9bbc5f25726cd5de9e0584f4c940785","Type":"ContainerDied","Data":"7953c4383a5a42cc46324b9215409807e2a6bb54d2a9df5be25bcb1709457026"} Jul 15 04:06:23.108520 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:23.108490 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-222.ec2.internal" event={"ID":"843258bd2137f5699fadd3ee328bb5bf","Type":"ContainerStarted","Data":"4d91f404138d52e889b2317dcff2b3c9d73c29e3cb9ccf149b841c50ec6e0eee"} Jul 15 04:06:23.110582 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:23.110550 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-lf5rb" event={"ID":"e302da62-33bc-44ff-a188-8d409325e38f","Type":"ContainerStarted","Data":"acab1374086734d9e59175576a497340a8f06c3d19e39626b7e14a38dfa30973"} Jul 15 04:06:23.112351 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:23.112320 2581 generic.go:356] "Generic (PLEG): container finished" podID="937573bb-cbf0-410b-a1b3-1d082b5f3fbd" containerID="d0e534f75287b4377f892f1161b6b089e479163a066e132abd3448afd2f7f1f0" exitCode=0 Jul 15 04:06:23.112432 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:23.112393 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-pzrtj" event={"ID":"937573bb-cbf0-410b-a1b3-1d082b5f3fbd","Type":"ContainerDied","Data":"d0e534f75287b4377f892f1161b6b089e479163a066e132abd3448afd2f7f1f0"} Jul 15 04:06:23.114545 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:23.114373 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-cvjv6" event={"ID":"cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be","Type":"ContainerStarted","Data":"435b3dada5269ee6857af24c8c8220f73d30256a4c6a808b24a3bfb9ecd75f8a"} Jul 15 04:06:23.116250 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:23.116225 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-tskl2" event={"ID":"3eddd8b4-e14d-4f98-8830-0a2f487d85e8","Type":"ContainerStarted","Data":"f03f8bfbbd911a26bcc048b6651444917223f8c0d8e1d71a14ad72a27bcf333d"} Jul 15 04:06:23.118141 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:23.118062 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lzsbl" event={"ID":"9b5b5ded-e119-4d0d-8780-38c93fc5b17c","Type":"ContainerStarted","Data":"996288bd664be348aa0a0915f6c7a3336e32f45811768427bcd5d206ae20b96a"} Jul 15 04:06:23.119980 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:23.119955 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-sj6mk" event={"ID":"26457908-4466-41d1-b908-507b13774dea","Type":"ContainerStarted","Data":"99468494ad1bcdb019ac3295d550593829a8c15d4570f50970c81d1400ce573a"} Jul 15 04:06:23.121644 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:23.121617 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-9kvf6" event={"ID":"be62ee25-74cc-4b6d-83ed-7639d75d9e0b","Type":"ContainerStarted","Data":"128ce1e47a155b6bc6ab454b0278a3df47a6fdd6124ca4111c679ea9306513ac"} Jul 15 04:06:23.152930 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:23.152874 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-222.ec2.internal" podStartSLOduration=15.152856647 podStartE2EDuration="15.152856647s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 04:06:08 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 04:06:23.152485346 +0000 UTC m=+16.679286360" watchObservedRunningTime="2026-07-15 04:06:23.152856647 +0000 UTC m=+16.679657662" Jul 15 04:06:23.185011 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:23.184957 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-sj6mk" podStartSLOduration=2.116924337 podStartE2EDuration="16.184939363s" totalImagesPullingTime="14.068015026s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 04:06:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 04:06:23.167534801 +0000 UTC m=+16.694335838" watchObservedRunningTime="2026-07-15 04:06:23.184939363 +0000 UTC m=+16.711740383" Jul 15 04:06:23.185383 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:23.185333 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-tskl2" podStartSLOduration=1.174931955 podStartE2EDuration="15.185321631s" totalImagesPullingTime="14.010389676s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 04:06:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 04:06:23.184661482 +0000 UTC m=+16.711462518" watchObservedRunningTime="2026-07-15 04:06:23.185321631 +0000 UTC m=+16.712122647" Jul 15 04:06:23.203054 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:23.202999 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-9kvf6" podStartSLOduration=2.151891659 podStartE2EDuration="16.202989023s" totalImagesPullingTime="14.051097364s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 04:06:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 04:06:23.202678212 +0000 UTC m=+16.729479244" watchObservedRunningTime="2026-07-15 04:06:23.202989023 +0000 UTC m=+16.729790098" Jul 15 04:06:23.251330 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:23.251274 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-cvjv6" podStartSLOduration=2.219628948 podStartE2EDuration="16.251252538s" totalImagesPullingTime="14.03162359s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 04:06:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 04:06:23.2261105 +0000 UTC m=+16.752911515" watchObservedRunningTime="2026-07-15 04:06:23.251252538 +0000 UTC m=+16.778053559" Jul 15 04:06:23.265056 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:23.264987 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-lf5rb" podStartSLOduration=2.281286806 podStartE2EDuration="16.264964662s" totalImagesPullingTime="13.983677856s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 04:06:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 04:06:23.264422586 +0000 UTC m=+16.791223629" watchObservedRunningTime="2026-07-15 04:06:23.264964662 +0000 UTC m=+16.791765704" Jul 15 04:06:23.669542 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:23.669502 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sxbbk\" (UniqueName: \"kubernetes.io/projected/5ac0aab6-1358-45d2-b257-eda461fc95da-kube-api-access-sxbbk\") pod \"network-check-target-4n42z\" (UID: \"5ac0aab6-1358-45d2-b257-eda461fc95da\") " pod="openshift-network-diagnostics/network-check-target-4n42z" Jul 15 04:06:23.669542 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:23.669561 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5b46708f-6444-44fc-8274-3921be1c13c7-metrics-certs\") pod \"network-metrics-daemon-2jvh6\" (UID: \"5b46708f-6444-44fc-8274-3921be1c13c7\") " pod="openshift-multus/network-metrics-daemon-2jvh6" Jul 15 04:06:23.669897 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:23.669604 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6616446d-4bdb-4867-a2f8-c39ed74908b9-original-pull-secret\") pod \"global-pull-secret-syncer-kz7p2\" (UID: \"6616446d-4bdb-4867-a2f8-c39ed74908b9\") " pod="kube-system/global-pull-secret-syncer-kz7p2" Jul 15 04:06:23.669897 ip-10-0-128-222 kubenswrapper[2581]: E0715 04:06:23.669659 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 15 04:06:23.669897 ip-10-0-128-222 kubenswrapper[2581]: E0715 04:06:23.669680 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 15 04:06:23.669897 ip-10-0-128-222 kubenswrapper[2581]: E0715 04:06:23.669693 2581 projected.go:196] Error preparing data for projected volume kube-api-access-sxbbk for pod openshift-network-diagnostics/network-check-target-4n42z: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 15 04:06:23.669897 ip-10-0-128-222 kubenswrapper[2581]: E0715 04:06:23.669708 2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 15 04:06:23.669897 ip-10-0-128-222 kubenswrapper[2581]: E0715 04:06:23.669712 2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 15 04:06:23.669897 ip-10-0-128-222 kubenswrapper[2581]: E0715 04:06:23.669753 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6616446d-4bdb-4867-a2f8-c39ed74908b9-original-pull-secret podName:6616446d-4bdb-4867-a2f8-c39ed74908b9 nodeName:}" failed. No retries permitted until 2026-07-15 04:06:39.669735062 +0000 UTC m=+33.196536055 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/6616446d-4bdb-4867-a2f8-c39ed74908b9-original-pull-secret") pod "global-pull-secret-syncer-kz7p2" (UID: "6616446d-4bdb-4867-a2f8-c39ed74908b9") : object "kube-system"/"original-pull-secret" not registered Jul 15 04:06:23.669897 ip-10-0-128-222 kubenswrapper[2581]: E0715 04:06:23.669781 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5b46708f-6444-44fc-8274-3921be1c13c7-metrics-certs podName:5b46708f-6444-44fc-8274-3921be1c13c7 nodeName:}" failed. No retries permitted until 2026-07-15 04:06:39.66976015 +0000 UTC m=+33.196561150 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5b46708f-6444-44fc-8274-3921be1c13c7-metrics-certs") pod "network-metrics-daemon-2jvh6" (UID: "5b46708f-6444-44fc-8274-3921be1c13c7") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 15 04:06:23.669897 ip-10-0-128-222 kubenswrapper[2581]: E0715 04:06:23.669802 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5ac0aab6-1358-45d2-b257-eda461fc95da-kube-api-access-sxbbk podName:5ac0aab6-1358-45d2-b257-eda461fc95da nodeName:}" failed. No retries permitted until 2026-07-15 04:06:39.669790705 +0000 UTC m=+33.196591706 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-sxbbk" (UniqueName: "kubernetes.io/projected/5ac0aab6-1358-45d2-b257-eda461fc95da-kube-api-access-sxbbk") pod "network-check-target-4n42z" (UID: "5ac0aab6-1358-45d2-b257-eda461fc95da") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 15 04:06:23.738046 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:23.737988 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-cvjv6" Jul 15 04:06:23.739039 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:23.739013 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-cvjv6" Jul 15 04:06:23.983878 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:23.983685 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2jvh6" Jul 15 04:06:23.983878 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:23.983699 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4n42z" Jul 15 04:06:23.983878 ip-10-0-128-222 kubenswrapper[2581]: E0715 04:06:23.983835 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4n42z" podUID="5ac0aab6-1358-45d2-b257-eda461fc95da" Jul 15 04:06:23.984068 ip-10-0-128-222 kubenswrapper[2581]: E0715 04:06:23.983951 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2jvh6" podUID="5b46708f-6444-44fc-8274-3921be1c13c7" Jul 15 04:06:24.127726 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:24.127689 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-222.ec2.internal" event={"ID":"b9bbc5f25726cd5de9e0584f4c940785","Type":"ContainerStarted","Data":"51bb5a1224df415ce28db196ab1a3c028e08a7cf840c64409b874936177d23d1"} Jul 15 04:06:24.131232 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:24.130941 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-8jqrr" event={"ID":"d73a22ce-26a0-48d7-a3f2-e0a5f50c78b0","Type":"ContainerStarted","Data":"1677c1e7e80443eda71afc1fccd5fec8421edb754d2f5721f54a6ca619e101c1"} Jul 15 04:06:24.143000 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:24.142236 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-222.ec2.internal" podStartSLOduration=16.142216092 podStartE2EDuration="16.142216092s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 04:06:08 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 04:06:24.141685945 +0000 UTC m=+17.668486964" watchObservedRunningTime="2026-07-15 04:06:24.142216092 +0000 UTC m=+17.669017108" Jul 15 04:06:24.571769 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:24.571738 2581 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 15 04:06:24.899264 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:24.899111 2581 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-15T04:06:24.571765854Z","UUID":"cb6bf6b3-38aa-402f-a7ac-ed41375c8ec8","Handler":null,"Name":"","Endpoint":""} Jul 15 04:06:24.901152 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:24.900957 2581 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 15 04:06:24.901152 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:24.901001 2581 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 15 04:06:24.984857 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:24.984490 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kz7p2" Jul 15 04:06:24.984857 ip-10-0-128-222 kubenswrapper[2581]: E0715 04:06:24.984626 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kz7p2" podUID="6616446d-4bdb-4867-a2f8-c39ed74908b9" Jul 15 04:06:25.137185 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:25.137143 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lzsbl" event={"ID":"9b5b5ded-e119-4d0d-8780-38c93fc5b17c","Type":"ContainerStarted","Data":"0bb9d83668593a8ec09d37fe6cb879c6758c1d042ab1d09db1881b8a9ae43cb4"} Jul 15 04:06:25.137622 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:25.137422 2581 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Jul 15 04:06:25.984094 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:25.983853 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2jvh6" Jul 15 04:06:25.984310 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:25.983874 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4n42z" Jul 15 04:06:25.984310 ip-10-0-128-222 kubenswrapper[2581]: E0715 04:06:25.984237 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2jvh6" podUID="5b46708f-6444-44fc-8274-3921be1c13c7" Jul 15 04:06:25.984463 ip-10-0-128-222 kubenswrapper[2581]: E0715 04:06:25.984386 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4n42z" podUID="5ac0aab6-1358-45d2-b257-eda461fc95da" Jul 15 04:06:26.142185 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:26.142138 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lzsbl" event={"ID":"9b5b5ded-e119-4d0d-8780-38c93fc5b17c","Type":"ContainerStarted","Data":"4c2c84f0baba82793d9c7cfe640374d2c6744c482498a50a44ca9d455ef23c7d"} Jul 15 04:06:26.158983 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:26.158925 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-8jqrr" podStartSLOduration=5.216167645 podStartE2EDuration="19.158903928s" totalImagesPullingTime="13.942736283s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 04:06:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 04:06:24.15714166 +0000 UTC m=+17.683942671" watchObservedRunningTime="2026-07-15 04:06:26.158903928 +0000 UTC m=+19.685704947" Jul 15 04:06:26.159385 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:26.159350 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lzsbl" podStartSLOduration=2.531994906 podStartE2EDuration="19.15933867s" totalImagesPullingTime="16.627343764s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 04:06:07 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 04:06:26.158325505 +0000 UTC m=+19.685126523" watchObservedRunningTime="2026-07-15 04:06:26.15933867 +0000 UTC m=+19.686139685" Jul 15 04:06:26.403083 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:26.403032 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-cvjv6" Jul 15 04:06:26.403295 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:26.403186 2581 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Jul 15 04:06:26.403856 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:26.403780 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-cvjv6" Jul 15 04:06:26.985092 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:26.985051 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kz7p2" Jul 15 04:06:26.985344 ip-10-0-128-222 kubenswrapper[2581]: E0715 04:06:26.985189 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kz7p2" podUID="6616446d-4bdb-4867-a2f8-c39ed74908b9" Jul 15 04:06:27.983881 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:27.983811 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2jvh6" Jul 15 04:06:27.984384 ip-10-0-128-222 kubenswrapper[2581]: E0715 04:06:27.983946 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2jvh6" podUID="5b46708f-6444-44fc-8274-3921be1c13c7" Jul 15 04:06:27.984384 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:27.983988 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4n42z" Jul 15 04:06:27.984384 ip-10-0-128-222 kubenswrapper[2581]: E0715 04:06:27.984106 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4n42z" podUID="5ac0aab6-1358-45d2-b257-eda461fc95da" Jul 15 04:06:28.984260 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:28.984226 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kz7p2" Jul 15 04:06:28.984750 ip-10-0-128-222 kubenswrapper[2581]: E0715 04:06:28.984351 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kz7p2" podUID="6616446d-4bdb-4867-a2f8-c39ed74908b9" Jul 15 04:06:29.151166 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:29.151100 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-pzrtj" event={"ID":"937573bb-cbf0-410b-a1b3-1d082b5f3fbd","Type":"ContainerStarted","Data":"da9baae828a6092d5bdda9cf325b91af70a7e7780a10d7c4a780a800847c37bf"} Jul 15 04:06:29.984176 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:29.984136 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2jvh6" Jul 15 04:06:29.984176 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:29.984170 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4n42z" Jul 15 04:06:29.984797 ip-10-0-128-222 kubenswrapper[2581]: E0715 04:06:29.984263 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2jvh6" podUID="5b46708f-6444-44fc-8274-3921be1c13c7" Jul 15 04:06:29.984797 ip-10-0-128-222 kubenswrapper[2581]: E0715 04:06:29.984351 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4n42z" podUID="5ac0aab6-1358-45d2-b257-eda461fc95da" Jul 15 04:06:30.984026 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:30.983990 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kz7p2" Jul 15 04:06:30.984240 ip-10-0-128-222 kubenswrapper[2581]: E0715 04:06:30.984161 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kz7p2" podUID="6616446d-4bdb-4867-a2f8-c39ed74908b9" Jul 15 04:06:31.984236 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:31.984198 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2jvh6" Jul 15 04:06:31.984669 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:31.984202 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4n42z" Jul 15 04:06:31.984669 ip-10-0-128-222 kubenswrapper[2581]: E0715 04:06:31.984339 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2jvh6" podUID="5b46708f-6444-44fc-8274-3921be1c13c7" Jul 15 04:06:31.984669 ip-10-0-128-222 kubenswrapper[2581]: E0715 04:06:31.984369 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4n42z" podUID="5ac0aab6-1358-45d2-b257-eda461fc95da" Jul 15 04:06:32.984583 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:32.984544 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kz7p2" Jul 15 04:06:32.984941 ip-10-0-128-222 kubenswrapper[2581]: E0715 04:06:32.984662 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kz7p2" podUID="6616446d-4bdb-4867-a2f8-c39ed74908b9" Jul 15 04:06:33.161171 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:33.161134 2581 generic.go:356] "Generic (PLEG): container finished" podID="937573bb-cbf0-410b-a1b3-1d082b5f3fbd" containerID="da9baae828a6092d5bdda9cf325b91af70a7e7780a10d7c4a780a800847c37bf" exitCode=0 Jul 15 04:06:33.161321 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:33.161193 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-pzrtj" event={"ID":"937573bb-cbf0-410b-a1b3-1d082b5f3fbd","Type":"ContainerDied","Data":"da9baae828a6092d5bdda9cf325b91af70a7e7780a10d7c4a780a800847c37bf"} Jul 15 04:06:33.984094 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:33.983918 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4n42z" Jul 15 04:06:33.984317 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:33.983966 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2jvh6" Jul 15 04:06:33.984317 ip-10-0-128-222 kubenswrapper[2581]: E0715 04:06:33.984212 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4n42z" podUID="5ac0aab6-1358-45d2-b257-eda461fc95da" Jul 15 04:06:33.984317 ip-10-0-128-222 kubenswrapper[2581]: E0715 04:06:33.984268 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2jvh6" podUID="5b46708f-6444-44fc-8274-3921be1c13c7" Jul 15 04:06:34.165683 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:34.165661 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-x6lg7_7cab18b8-43fd-46d1-a75d-6de40cbcd09a/ovn-acl-logging/0.log" Jul 15 04:06:34.166232 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:34.165992 2581 generic.go:356] "Generic (PLEG): container finished" podID="7cab18b8-43fd-46d1-a75d-6de40cbcd09a" containerID="2f18a87538381f0ae420e01d89d01d393eb5b637a839bcd17c2aec43d27f613b" exitCode=1 Jul 15 04:06:34.166232 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:34.166029 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-x6lg7" event={"ID":"7cab18b8-43fd-46d1-a75d-6de40cbcd09a","Type":"ContainerStarted","Data":"bbc97b310731cfb977f235a178244f2d81f42aeb8fdfad8d9aab2d26556b4bb3"} Jul 15 04:06:34.166232 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:34.166086 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-x6lg7" event={"ID":"7cab18b8-43fd-46d1-a75d-6de40cbcd09a","Type":"ContainerStarted","Data":"58be47d5ba9d9dd6d47956815a161b0a80b32c39c0c11e16c167ec67bf12425f"} Jul 15 04:06:34.166232 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:34.166134 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-x6lg7" event={"ID":"7cab18b8-43fd-46d1-a75d-6de40cbcd09a","Type":"ContainerStarted","Data":"a1db085ab66400d7436c89dd19dfcf3a7d62b08d045078862b2c3994ce7334ef"} Jul 15 04:06:34.166232 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:34.166166 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-x6lg7" event={"ID":"7cab18b8-43fd-46d1-a75d-6de40cbcd09a","Type":"ContainerDied","Data":"2f18a87538381f0ae420e01d89d01d393eb5b637a839bcd17c2aec43d27f613b"} Jul 15 04:06:34.166232 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:34.166196 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-x6lg7" event={"ID":"7cab18b8-43fd-46d1-a75d-6de40cbcd09a","Type":"ContainerStarted","Data":"70ddf5e38366d899d8d69a5b0f825d36ea2c58ccc6b64a4c9bc77d570e0bd194"} Jul 15 04:06:34.984243 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:34.984157 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kz7p2" Jul 15 04:06:34.984442 ip-10-0-128-222 kubenswrapper[2581]: E0715 04:06:34.984267 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kz7p2" podUID="6616446d-4bdb-4867-a2f8-c39ed74908b9" Jul 15 04:06:35.171162 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:35.171135 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-x6lg7_7cab18b8-43fd-46d1-a75d-6de40cbcd09a/ovn-acl-logging/0.log" Jul 15 04:06:35.171594 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:35.171485 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-x6lg7" event={"ID":"7cab18b8-43fd-46d1-a75d-6de40cbcd09a","Type":"ContainerStarted","Data":"62f44ee62c6a3d2eb9a8d2bb46f5329f53daabd6c15e28e6c0ec5412ca69a929"} Jul 15 04:06:35.173402 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:35.173378 2581 generic.go:356] "Generic (PLEG): container finished" podID="937573bb-cbf0-410b-a1b3-1d082b5f3fbd" containerID="aef39be8699b858071f91ef2254c374ca9593f0008194fe2a85b776a5243f06e" exitCode=0 Jul 15 04:06:35.173518 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:35.173423 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-pzrtj" event={"ID":"937573bb-cbf0-410b-a1b3-1d082b5f3fbd","Type":"ContainerDied","Data":"aef39be8699b858071f91ef2254c374ca9593f0008194fe2a85b776a5243f06e"} Jul 15 04:06:35.983800 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:35.983766 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2jvh6" Jul 15 04:06:35.983994 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:35.983767 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4n42z" Jul 15 04:06:35.983994 ip-10-0-128-222 kubenswrapper[2581]: E0715 04:06:35.983900 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2jvh6" podUID="5b46708f-6444-44fc-8274-3921be1c13c7" Jul 15 04:06:35.983994 ip-10-0-128-222 kubenswrapper[2581]: E0715 04:06:35.983950 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4n42z" podUID="5ac0aab6-1358-45d2-b257-eda461fc95da" Jul 15 04:06:36.985033 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:36.984996 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kz7p2" Jul 15 04:06:36.985521 ip-10-0-128-222 kubenswrapper[2581]: E0715 04:06:36.985093 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kz7p2" podUID="6616446d-4bdb-4867-a2f8-c39ed74908b9" Jul 15 04:06:37.180255 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:37.180220 2581 generic.go:356] "Generic (PLEG): container finished" podID="937573bb-cbf0-410b-a1b3-1d082b5f3fbd" containerID="ae04b4ee127709571bdb69263c9c1878f794aa0a09f2ae8aed88fd1ce63c8499" exitCode=0 Jul 15 04:06:37.180424 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:37.180290 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-pzrtj" event={"ID":"937573bb-cbf0-410b-a1b3-1d082b5f3fbd","Type":"ContainerDied","Data":"ae04b4ee127709571bdb69263c9c1878f794aa0a09f2ae8aed88fd1ce63c8499"} Jul 15 04:06:37.183439 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:37.183424 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-x6lg7_7cab18b8-43fd-46d1-a75d-6de40cbcd09a/ovn-acl-logging/0.log" Jul 15 04:06:37.183766 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:37.183748 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-x6lg7" event={"ID":"7cab18b8-43fd-46d1-a75d-6de40cbcd09a","Type":"ContainerStarted","Data":"0d9e99f0352d7944971af0dbb325a9cd853800c5731bc8b30cd5cee463468ebe"} Jul 15 04:06:37.983584 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:37.983545 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2jvh6" Jul 15 04:06:37.983775 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:37.983562 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4n42z" Jul 15 04:06:37.983775 ip-10-0-128-222 kubenswrapper[2581]: E0715 04:06:37.983665 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2jvh6" podUID="5b46708f-6444-44fc-8274-3921be1c13c7" Jul 15 04:06:37.983775 ip-10-0-128-222 kubenswrapper[2581]: E0715 04:06:37.983728 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4n42z" podUID="5ac0aab6-1358-45d2-b257-eda461fc95da" Jul 15 04:06:38.984597 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:38.984318 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kz7p2" Jul 15 04:06:38.985032 ip-10-0-128-222 kubenswrapper[2581]: E0715 04:06:38.984619 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kz7p2" podUID="6616446d-4bdb-4867-a2f8-c39ed74908b9" Jul 15 04:06:39.192079 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:39.192046 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-x6lg7_7cab18b8-43fd-46d1-a75d-6de40cbcd09a/ovn-acl-logging/0.log" Jul 15 04:06:39.192471 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:39.192434 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-x6lg7" event={"ID":"7cab18b8-43fd-46d1-a75d-6de40cbcd09a","Type":"ContainerStarted","Data":"23fdc83c0543de0861e67e7551d9349fb92e3b8277420067a5932692c7e7270e"} Jul 15 04:06:39.192749 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:39.192730 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-x6lg7" Jul 15 04:06:39.192937 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:39.192918 2581 scope.go:117] "RemoveContainer" containerID="2f18a87538381f0ae420e01d89d01d393eb5b637a839bcd17c2aec43d27f613b" Jul 15 04:06:39.213265 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:39.213241 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-x6lg7" Jul 15 04:06:39.681616 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:39.681578 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5b46708f-6444-44fc-8274-3921be1c13c7-metrics-certs\") pod \"network-metrics-daemon-2jvh6\" (UID: \"5b46708f-6444-44fc-8274-3921be1c13c7\") " pod="openshift-multus/network-metrics-daemon-2jvh6" Jul 15 04:06:39.681616 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:39.681631 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6616446d-4bdb-4867-a2f8-c39ed74908b9-original-pull-secret\") pod \"global-pull-secret-syncer-kz7p2\" (UID: \"6616446d-4bdb-4867-a2f8-c39ed74908b9\") " pod="kube-system/global-pull-secret-syncer-kz7p2" Jul 15 04:06:39.681872 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:39.681678 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sxbbk\" (UniqueName: \"kubernetes.io/projected/5ac0aab6-1358-45d2-b257-eda461fc95da-kube-api-access-sxbbk\") pod \"network-check-target-4n42z\" (UID: \"5ac0aab6-1358-45d2-b257-eda461fc95da\") " pod="openshift-network-diagnostics/network-check-target-4n42z" Jul 15 04:06:39.681872 ip-10-0-128-222 kubenswrapper[2581]: E0715 04:06:39.681771 2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 15 04:06:39.681872 ip-10-0-128-222 kubenswrapper[2581]: E0715 04:06:39.681787 2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 15 04:06:39.681872 ip-10-0-128-222 kubenswrapper[2581]: E0715 04:06:39.681790 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 15 04:06:39.681872 ip-10-0-128-222 kubenswrapper[2581]: E0715 04:06:39.681841 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6616446d-4bdb-4867-a2f8-c39ed74908b9-original-pull-secret podName:6616446d-4bdb-4867-a2f8-c39ed74908b9 nodeName:}" failed. No retries permitted until 2026-07-15 04:07:11.681827636 +0000 UTC m=+65.208628633 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/6616446d-4bdb-4867-a2f8-c39ed74908b9-original-pull-secret") pod "global-pull-secret-syncer-kz7p2" (UID: "6616446d-4bdb-4867-a2f8-c39ed74908b9") : object "kube-system"/"original-pull-secret" not registered Jul 15 04:06:39.681872 ip-10-0-128-222 kubenswrapper[2581]: E0715 04:06:39.681853 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 15 04:06:39.681872 ip-10-0-128-222 kubenswrapper[2581]: E0715 04:06:39.681858 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5b46708f-6444-44fc-8274-3921be1c13c7-metrics-certs podName:5b46708f-6444-44fc-8274-3921be1c13c7 nodeName:}" failed. No retries permitted until 2026-07-15 04:07:11.681850294 +0000 UTC m=+65.208651287 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5b46708f-6444-44fc-8274-3921be1c13c7-metrics-certs") pod "network-metrics-daemon-2jvh6" (UID: "5b46708f-6444-44fc-8274-3921be1c13c7") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 15 04:06:39.681872 ip-10-0-128-222 kubenswrapper[2581]: E0715 04:06:39.681867 2581 projected.go:196] Error preparing data for projected volume kube-api-access-sxbbk for pod openshift-network-diagnostics/network-check-target-4n42z: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 15 04:06:39.682140 ip-10-0-128-222 kubenswrapper[2581]: E0715 04:06:39.681912 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5ac0aab6-1358-45d2-b257-eda461fc95da-kube-api-access-sxbbk podName:5ac0aab6-1358-45d2-b257-eda461fc95da nodeName:}" failed. No retries permitted until 2026-07-15 04:07:11.681894975 +0000 UTC m=+65.208695974 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-sxbbk" (UniqueName: "kubernetes.io/projected/5ac0aab6-1358-45d2-b257-eda461fc95da-kube-api-access-sxbbk") pod "network-check-target-4n42z" (UID: "5ac0aab6-1358-45d2-b257-eda461fc95da") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 15 04:06:39.984083 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:39.983992 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2jvh6" Jul 15 04:06:39.984083 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:39.984025 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4n42z" Jul 15 04:06:39.984309 ip-10-0-128-222 kubenswrapper[2581]: E0715 04:06:39.984110 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2jvh6" podUID="5b46708f-6444-44fc-8274-3921be1c13c7" Jul 15 04:06:39.984309 ip-10-0-128-222 kubenswrapper[2581]: E0715 04:06:39.984214 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4n42z" podUID="5ac0aab6-1358-45d2-b257-eda461fc95da" Jul 15 04:06:40.199938 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:40.199908 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-x6lg7_7cab18b8-43fd-46d1-a75d-6de40cbcd09a/ovn-acl-logging/0.log" Jul 15 04:06:40.200436 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:40.200361 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-x6lg7" event={"ID":"7cab18b8-43fd-46d1-a75d-6de40cbcd09a","Type":"ContainerStarted","Data":"bab06da8c69ff67f66a7c3a8b94218b683fe37189cf1375364803eb0f871b35d"} Jul 15 04:06:40.200677 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:40.200659 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-x6lg7" Jul 15 04:06:40.200784 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:40.200755 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-x6lg7" Jul 15 04:06:40.217704 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:40.217676 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-x6lg7" Jul 15 04:06:40.225825 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:40.225757 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-x6lg7" podStartSLOduration=7.02124982 podStartE2EDuration="32.225735889s" totalImagesPullingTime="25.204486069s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 04:06:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=2 observedRunningTime="2026-07-15 04:06:40.225541183 +0000 UTC m=+33.752342199" watchObservedRunningTime="2026-07-15 04:06:40.225735889 +0000 UTC m=+33.752536888" Jul 15 04:06:40.925648 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:40.925603 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-2jvh6"] Jul 15 04:06:40.926549 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:40.925751 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2jvh6" Jul 15 04:06:40.926549 ip-10-0-128-222 kubenswrapper[2581]: E0715 04:06:40.925879 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2jvh6" podUID="5b46708f-6444-44fc-8274-3921be1c13c7" Jul 15 04:06:40.926549 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:40.926354 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-4n42z"] Jul 15 04:06:40.926549 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:40.926455 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4n42z" Jul 15 04:06:40.926742 ip-10-0-128-222 kubenswrapper[2581]: E0715 04:06:40.926553 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4n42z" podUID="5ac0aab6-1358-45d2-b257-eda461fc95da" Jul 15 04:06:40.932624 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:40.932594 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-kz7p2"] Jul 15 04:06:40.932771 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:40.932703 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kz7p2" Jul 15 04:06:40.932836 ip-10-0-128-222 kubenswrapper[2581]: E0715 04:06:40.932805 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kz7p2" podUID="6616446d-4bdb-4867-a2f8-c39ed74908b9" Jul 15 04:06:42.208775 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:42.208531 2581 generic.go:356] "Generic (PLEG): container finished" podID="937573bb-cbf0-410b-a1b3-1d082b5f3fbd" containerID="7d37072322eb5d2459fd5e32b60333ccaf3f0f66a19276e656f5bafecc446955" exitCode=0 Jul 15 04:06:42.209161 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:42.208597 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-pzrtj" event={"ID":"937573bb-cbf0-410b-a1b3-1d082b5f3fbd","Type":"ContainerDied","Data":"7d37072322eb5d2459fd5e32b60333ccaf3f0f66a19276e656f5bafecc446955"} Jul 15 04:06:42.983668 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:42.983571 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4n42z" Jul 15 04:06:42.983839 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:42.983571 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2jvh6" Jul 15 04:06:42.983839 ip-10-0-128-222 kubenswrapper[2581]: E0715 04:06:42.983700 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4n42z" podUID="5ac0aab6-1358-45d2-b257-eda461fc95da" Jul 15 04:06:42.983839 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:42.983572 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kz7p2" Jul 15 04:06:42.983839 ip-10-0-128-222 kubenswrapper[2581]: E0715 04:06:42.983806 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2jvh6" podUID="5b46708f-6444-44fc-8274-3921be1c13c7" Jul 15 04:06:42.984005 ip-10-0-128-222 kubenswrapper[2581]: E0715 04:06:42.983862 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kz7p2" podUID="6616446d-4bdb-4867-a2f8-c39ed74908b9" Jul 15 04:06:43.214889 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:43.214858 2581 generic.go:356] "Generic (PLEG): container finished" podID="937573bb-cbf0-410b-a1b3-1d082b5f3fbd" containerID="d10d5642a04ff9921f0f74af7f94c557e0e06aee880372c71ed3a5acb1c99a83" exitCode=0 Jul 15 04:06:43.215334 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:43.214904 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-pzrtj" event={"ID":"937573bb-cbf0-410b-a1b3-1d082b5f3fbd","Type":"ContainerDied","Data":"d10d5642a04ff9921f0f74af7f94c557e0e06aee880372c71ed3a5acb1c99a83"} Jul 15 04:06:44.220905 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:44.220867 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-pzrtj" event={"ID":"937573bb-cbf0-410b-a1b3-1d082b5f3fbd","Type":"ContainerStarted","Data":"80c9506784fe850646faba9abeeb8e2703f04355e7d81ea52e4781f213e404ef"} Jul 15 04:06:44.241347 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:44.241295 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-pzrtj" podStartSLOduration=10.79612542 podStartE2EDuration="37.241278482s" totalImagesPullingTime="26.445153062s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 04:06:07 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 04:06:44.239952338 +0000 UTC m=+37.766753354" watchObservedRunningTime="2026-07-15 04:06:44.241278482 +0000 UTC m=+37.768079496" Jul 15 04:06:44.984297 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:44.984213 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kz7p2" Jul 15 04:06:44.984297 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:44.984267 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2jvh6" Jul 15 04:06:44.984477 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:44.984213 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4n42z" Jul 15 04:06:44.984477 ip-10-0-128-222 kubenswrapper[2581]: E0715 04:06:44.984330 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kz7p2" podUID="6616446d-4bdb-4867-a2f8-c39ed74908b9" Jul 15 04:06:44.984477 ip-10-0-128-222 kubenswrapper[2581]: E0715 04:06:44.984405 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4n42z" podUID="5ac0aab6-1358-45d2-b257-eda461fc95da" Jul 15 04:06:44.984575 ip-10-0-128-222 kubenswrapper[2581]: E0715 04:06:44.984473 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2jvh6" podUID="5b46708f-6444-44fc-8274-3921be1c13c7" Jul 15 04:06:46.333141 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:46.333035 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-222.ec2.internal" event="NodeReady" Jul 15 04:06:46.333492 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:46.333187 2581 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 15 04:06:46.371200 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:46.371165 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-64997dd578-n79tf"] Jul 15 04:06:46.397654 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:46.397603 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-86bc794d9-k6v97"] Jul 15 04:06:46.397838 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:46.397740 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-64997dd578-n79tf" Jul 15 04:06:46.400145 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:46.400100 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-tbr5d\"" Jul 15 04:06:46.400421 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:46.400397 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jul 15 04:06:46.401043 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:46.400834 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\"" Jul 15 04:06:46.401179 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:46.401059 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jul 15 04:06:46.401179 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:46.401170 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\"" Jul 15 04:06:46.401339 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:46.401226 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\"" Jul 15 04:06:46.401668 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:46.401486 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\"" Jul 15 04:06:46.424066 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:46.424038 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-65db858894-tmhmf"] Jul 15 04:06:46.424213 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:46.424171 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-86bc794d9-k6v97" Jul 15 04:06:46.426891 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:46.426846 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jul 15 04:06:46.426891 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:46.426859 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jul 15 04:06:46.427462 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:46.427440 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jul 15 04:06:46.427462 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:46.427450 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-r7tdt\"" Jul 15 04:06:46.431886 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:46.431868 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jul 15 04:06:46.448205 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:46.448173 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-7695fc6c8c-8zm4v"] Jul 15 04:06:46.448360 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:46.448279 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-tmhmf" Jul 15 04:06:46.450272 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:46.450253 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\"" Jul 15 04:06:46.450515 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:46.450489 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\"" Jul 15 04:06:46.450515 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:46.450511 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\"" Jul 15 04:06:46.450682 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:46.450521 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-vvc6p\"" Jul 15 04:06:46.464207 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:46.464178 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-n29ck"] Jul 15 04:06:46.464358 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:46.464305 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-8zm4v" Jul 15 04:06:46.466511 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:46.466490 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\"" Jul 15 04:06:46.466881 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:46.466867 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\"" Jul 15 04:06:46.467035 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:46.467015 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\"" Jul 15 04:06:46.467158 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:46.467018 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-cxc6r\"" Jul 15 04:06:46.467332 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:46.467317 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\"" Jul 15 04:06:46.478282 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:46.478260 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-k6gt6"] Jul 15 04:06:46.478431 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:46.478402 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-n29ck" Jul 15 04:06:46.480432 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:46.480404 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\"" Jul 15 04:06:46.480432 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:46.480417 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 15 04:06:46.480721 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:46.480704 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 15 04:06:46.480844 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:46.480797 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-w46z7\"" Jul 15 04:06:46.481192 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:46.481175 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\"" Jul 15 04:06:46.492450 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:46.492427 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-68d9dd94cf-tr2rw"] Jul 15 04:06:46.492581 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:46.492564 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-k6gt6" Jul 15 04:06:46.494923 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:46.494900 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\"" Jul 15 04:06:46.495069 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:46.495056 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\"" Jul 15 04:06:46.495154 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:46.495105 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-25vhn\"" Jul 15 04:06:46.508324 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:46.508301 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-xgz4r"] Jul 15 04:06:46.508445 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:46.508413 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-68d9dd94cf-tr2rw" Jul 15 04:06:46.510567 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:46.510541 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\"" Jul 15 04:06:46.510769 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:46.510748 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\"" Jul 15 04:06:46.510769 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:46.510760 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 15 04:06:46.510920 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:46.510793 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 15 04:06:46.510920 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:46.510807 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-dhgvl\"" Jul 15 04:06:46.515023 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:46.515005 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\"" Jul 15 04:06:46.522426 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:46.522403 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-6cf856758c-cvvj2"] Jul 15 04:06:46.522549 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:46.522530 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-xgz4r" Jul 15 04:06:46.524660 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:46.524638 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\"" Jul 15 04:06:46.524747 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:46.524723 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\"" Jul 15 04:06:46.525086 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:46.525069 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\"" Jul 15 04:06:46.525202 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:46.525162 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\"" Jul 15 04:06:46.525248 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:46.525164 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-68tgz\"" Jul 15 04:06:46.528035 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:46.528006 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/07b2020a-a077-46ee-abe8-44454ada45a4-serving-cert\") pod \"service-ca-operator-7695fc6c8c-8zm4v\" (UID: \"07b2020a-a077-46ee-abe8-44454ada45a4\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-8zm4v" Jul 15 04:06:46.528347 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:46.528054 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7tzwk\" (UniqueName: \"kubernetes.io/projected/a0a40e9b-cf54-4ae2-a584-ca5cadf85733-kube-api-access-7tzwk\") pod \"router-default-64997dd578-n79tf\" (UID: \"a0a40e9b-cf54-4ae2-a584-ca5cadf85733\") " pod="openshift-ingress/router-default-64997dd578-n79tf" Jul 15 04:06:46.528347 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:46.528089 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vzgw2\" (UniqueName: \"kubernetes.io/projected/07b2020a-a077-46ee-abe8-44454ada45a4-kube-api-access-vzgw2\") pod \"service-ca-operator-7695fc6c8c-8zm4v\" (UID: \"07b2020a-a077-46ee-abe8-44454ada45a4\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-8zm4v" Jul 15 04:06:46.528347 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:46.528158 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/bb386795-c0e9-4236-9b60-73ccf95c95e6-image-registry-private-configuration\") pod \"image-registry-86bc794d9-k6v97\" (UID: \"bb386795-c0e9-4236-9b60-73ccf95c95e6\") " pod="openshift-image-registry/image-registry-86bc794d9-k6v97" Jul 15 04:06:46.528347 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:46.528192 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/bb386795-c0e9-4236-9b60-73ccf95c95e6-registry-certificates\") pod \"image-registry-86bc794d9-k6v97\" (UID: \"bb386795-c0e9-4236-9b60-73ccf95c95e6\") " pod="openshift-image-registry/image-registry-86bc794d9-k6v97" Jul 15 04:06:46.528347 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:46.528217 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/bb386795-c0e9-4236-9b60-73ccf95c95e6-trusted-ca\") pod \"image-registry-86bc794d9-k6v97\" (UID: \"bb386795-c0e9-4236-9b60-73ccf95c95e6\") " pod="openshift-image-registry/image-registry-86bc794d9-k6v97" Jul 15 04:06:46.528568 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:46.528359 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-59rmx\" (UniqueName: \"kubernetes.io/projected/bb386795-c0e9-4236-9b60-73ccf95c95e6-kube-api-access-59rmx\") pod \"image-registry-86bc794d9-k6v97\" (UID: \"bb386795-c0e9-4236-9b60-73ccf95c95e6\") " pod="openshift-image-registry/image-registry-86bc794d9-k6v97" Jul 15 04:06:46.528568 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:46.528402 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a0a40e9b-cf54-4ae2-a584-ca5cadf85733-metrics-certs\") pod \"router-default-64997dd578-n79tf\" (UID: \"a0a40e9b-cf54-4ae2-a584-ca5cadf85733\") " pod="openshift-ingress/router-default-64997dd578-n79tf" Jul 15 04:06:46.528568 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:46.528426 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/bb386795-c0e9-4236-9b60-73ccf95c95e6-ca-trust-extracted\") pod \"image-registry-86bc794d9-k6v97\" (UID: \"bb386795-c0e9-4236-9b60-73ccf95c95e6\") " pod="openshift-image-registry/image-registry-86bc794d9-k6v97" Jul 15 04:06:46.528568 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:46.528449 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/bb386795-c0e9-4236-9b60-73ccf95c95e6-bound-sa-token\") pod \"image-registry-86bc794d9-k6v97\" (UID: \"bb386795-c0e9-4236-9b60-73ccf95c95e6\") " pod="openshift-image-registry/image-registry-86bc794d9-k6v97" Jul 15 04:06:46.528568 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:46.528489 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/4eaa0aee-36ae-4223-b552-73a6797c1ec1-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-tmhmf\" (UID: \"4eaa0aee-36ae-4223-b552-73a6797c1ec1\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-tmhmf" Jul 15 04:06:46.528568 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:46.528523 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xg7tg\" (UniqueName: \"kubernetes.io/projected/4eaa0aee-36ae-4223-b552-73a6797c1ec1-kube-api-access-xg7tg\") pod \"cluster-samples-operator-65db858894-tmhmf\" (UID: \"4eaa0aee-36ae-4223-b552-73a6797c1ec1\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-tmhmf" Jul 15 04:06:46.528568 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:46.528561 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/bb386795-c0e9-4236-9b60-73ccf95c95e6-registry-tls\") pod \"image-registry-86bc794d9-k6v97\" (UID: \"bb386795-c0e9-4236-9b60-73ccf95c95e6\") " pod="openshift-image-registry/image-registry-86bc794d9-k6v97" Jul 15 04:06:46.528857 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:46.528586 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/a0a40e9b-cf54-4ae2-a584-ca5cadf85733-stats-auth\") pod \"router-default-64997dd578-n79tf\" (UID: \"a0a40e9b-cf54-4ae2-a584-ca5cadf85733\") " pod="openshift-ingress/router-default-64997dd578-n79tf" Jul 15 04:06:46.528857 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:46.528644 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/07b2020a-a077-46ee-abe8-44454ada45a4-config\") pod \"service-ca-operator-7695fc6c8c-8zm4v\" (UID: \"07b2020a-a077-46ee-abe8-44454ada45a4\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-8zm4v" Jul 15 04:06:46.528857 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:46.528673 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/a0a40e9b-cf54-4ae2-a584-ca5cadf85733-default-certificate\") pod \"router-default-64997dd578-n79tf\" (UID: \"a0a40e9b-cf54-4ae2-a584-ca5cadf85733\") " pod="openshift-ingress/router-default-64997dd578-n79tf" Jul 15 04:06:46.528857 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:46.528718 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a0a40e9b-cf54-4ae2-a584-ca5cadf85733-service-ca-bundle\") pod \"router-default-64997dd578-n79tf\" (UID: \"a0a40e9b-cf54-4ae2-a584-ca5cadf85733\") " pod="openshift-ingress/router-default-64997dd578-n79tf" Jul 15 04:06:46.528857 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:46.528761 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/bb386795-c0e9-4236-9b60-73ccf95c95e6-installation-pull-secrets\") pod \"image-registry-86bc794d9-k6v97\" (UID: \"bb386795-c0e9-4236-9b60-73ccf95c95e6\") " pod="openshift-image-registry/image-registry-86bc794d9-k6v97" Jul 15 04:06:46.542607 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:46.542574 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-7866497494-8kt5p"] Jul 15 04:06:46.542742 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:46.542679 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6cf856758c-cvvj2" Jul 15 04:06:46.544733 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:46.544710 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\"" Jul 15 04:06:46.544733 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:46.544724 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\"" Jul 15 04:06:46.545003 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:46.544986 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-kg9jl\"" Jul 15 04:06:46.560629 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:46.560604 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-869dcfcdcd-vm2mz"] Jul 15 04:06:46.560777 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:46.560745 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-7866497494-8kt5p" Jul 15 04:06:46.562810 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:46.562791 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\"" Jul 15 04:06:46.562934 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:46.562903 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\"" Jul 15 04:06:46.562934 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:46.562903 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\"" Jul 15 04:06:46.563111 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:46.563093 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-ljllh\"" Jul 15 04:06:46.563251 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:46.563235 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\"" Jul 15 04:06:46.568881 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:46.568862 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\"" Jul 15 04:06:46.574638 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:46.574620 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-7695fc6c8c-8zm4v"] Jul 15 04:06:46.574695 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:46.574651 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-65db858894-tmhmf"] Jul 15 04:06:46.574695 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:46.574669 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-k6gt6"] Jul 15 04:06:46.574695 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:46.574682 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-n29ck"] Jul 15 04:06:46.574695 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:46.574693 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-86bc794d9-k6v97"] Jul 15 04:06:46.574807 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:46.574706 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-64997dd578-n79tf"] Jul 15 04:06:46.574807 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:46.574722 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-mptrm"] Jul 15 04:06:46.574807 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:46.574726 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-vm2mz" Jul 15 04:06:46.577885 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:46.577862 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-ntk9k\"" Jul 15 04:06:46.578018 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:46.577996 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 15 04:06:46.578214 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:46.577898 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 15 04:06:46.596852 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:46.596776 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-hvcwt"] Jul 15 04:06:46.596973 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:46.596902 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-mptrm" Jul 15 04:06:46.600563 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:46.600543 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 15 04:06:46.600840 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:46.600826 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 15 04:06:46.601062 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:46.601045 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-j29sx\"" Jul 15 04:06:46.601396 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:46.601376 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 15 04:06:46.621383 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:46.621356 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-xgz4r"] Jul 15 04:06:46.621383 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:46.621388 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-6cf856758c-cvvj2"] Jul 15 04:06:46.621552 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:46.621403 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-7866497494-8kt5p"] Jul 15 04:06:46.621552 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:46.621418 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-68d9dd94cf-tr2rw"] Jul 15 04:06:46.621552 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:46.621430 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-hvcwt"] Jul 15 04:06:46.621552 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:46.621445 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-mptrm"] Jul 15 04:06:46.621552 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:46.621451 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-hvcwt" Jul 15 04:06:46.621764 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:46.621458 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-869dcfcdcd-vm2mz"] Jul 15 04:06:46.623446 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:46.623428 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 15 04:06:46.623569 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:46.623480 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-2wv7r\"" Jul 15 04:06:46.623569 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:46.623486 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 15 04:06:46.629114 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:46.629092 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/bb386795-c0e9-4236-9b60-73ccf95c95e6-bound-sa-token\") pod \"image-registry-86bc794d9-k6v97\" (UID: \"bb386795-c0e9-4236-9b60-73ccf95c95e6\") " pod="openshift-image-registry/image-registry-86bc794d9-k6v97" Jul 15 04:06:46.629234 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:46.629146 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/4eaa0aee-36ae-4223-b552-73a6797c1ec1-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-tmhmf\" (UID: \"4eaa0aee-36ae-4223-b552-73a6797c1ec1\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-tmhmf" Jul 15 04:06:46.629234 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:46.629181 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pk87s\" (UniqueName: \"kubernetes.io/projected/b46dec59-62a8-45be-a415-049fa148fcdd-kube-api-access-pk87s\") pod \"cluster-monitoring-operator-5f7f494dd4-n29ck\" (UID: \"b46dec59-62a8-45be-a415-049fa148fcdd\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-n29ck" Jul 15 04:06:46.629234 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:46.629211 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7tzwk\" (UniqueName: \"kubernetes.io/projected/a0a40e9b-cf54-4ae2-a584-ca5cadf85733-kube-api-access-7tzwk\") pod \"router-default-64997dd578-n79tf\" (UID: \"a0a40e9b-cf54-4ae2-a584-ca5cadf85733\") " pod="openshift-ingress/router-default-64997dd578-n79tf" Jul 15 04:06:46.629349 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:46.629239 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/bb386795-c0e9-4236-9b60-73ccf95c95e6-registry-certificates\") pod \"image-registry-86bc794d9-k6v97\" (UID: \"bb386795-c0e9-4236-9b60-73ccf95c95e6\") " pod="openshift-image-registry/image-registry-86bc794d9-k6v97" Jul 15 04:06:46.629349 ip-10-0-128-222 kubenswrapper[2581]: E0715 04:06:46.629300 2581 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 15 04:06:46.629349 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:46.629338 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/aa52afbe-abd9-45ea-9f98-6a66b50b07b7-serving-cert\") pod \"kube-storage-version-migrator-operator-799cb7f958-xgz4r\" (UID: \"aa52afbe-abd9-45ea-9f98-6a66b50b07b7\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-xgz4r" Jul 15 04:06:46.629487 ip-10-0-128-222 kubenswrapper[2581]: E0715 04:06:46.629366 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4eaa0aee-36ae-4223-b552-73a6797c1ec1-samples-operator-tls podName:4eaa0aee-36ae-4223-b552-73a6797c1ec1 nodeName:}" failed. No retries permitted until 2026-07-15 04:06:47.12934292 +0000 UTC m=+40.656143927 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/4eaa0aee-36ae-4223-b552-73a6797c1ec1-samples-operator-tls") pod "cluster-samples-operator-65db858894-tmhmf" (UID: "4eaa0aee-36ae-4223-b552-73a6797c1ec1") : secret "samples-operator-tls" not found Jul 15 04:06:46.629487 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:46.629417 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/bb386795-c0e9-4236-9b60-73ccf95c95e6-ca-trust-extracted\") pod \"image-registry-86bc794d9-k6v97\" (UID: \"bb386795-c0e9-4236-9b60-73ccf95c95e6\") " pod="openshift-image-registry/image-registry-86bc794d9-k6v97" Jul 15 04:06:46.629598 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:46.629503 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/d8a85153-9c3e-4ef3-934d-d69f03973e3d-nginx-conf\") pod \"networking-console-plugin-6cf856758c-cvvj2\" (UID: \"d8a85153-9c3e-4ef3-934d-d69f03973e3d\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-cvvj2" Jul 15 04:06:46.629598 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:46.629531 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/bb386795-c0e9-4236-9b60-73ccf95c95e6-image-registry-private-configuration\") pod \"image-registry-86bc794d9-k6v97\" (UID: \"bb386795-c0e9-4236-9b60-73ccf95c95e6\") " pod="openshift-image-registry/image-registry-86bc794d9-k6v97" Jul 15 04:06:46.629598 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:46.629569 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/81a32cdd-cc66-4a2b-9d86-08b37f285ca2-tmp\") pod \"insights-operator-68d9dd94cf-tr2rw\" (UID: \"81a32cdd-cc66-4a2b-9d86-08b37f285ca2\") " pod="openshift-insights/insights-operator-68d9dd94cf-tr2rw" Jul 15 04:06:46.629744 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:46.629636 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-trf2b\" (UniqueName: \"kubernetes.io/projected/2db78c13-2384-4015-a886-14377224f4cd-kube-api-access-trf2b\") pod \"console-operator-7866497494-8kt5p\" (UID: \"2db78c13-2384-4015-a886-14377224f4cd\") " pod="openshift-console-operator/console-operator-7866497494-8kt5p" Jul 15 04:06:46.629744 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:46.629707 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4kfv9\" (UniqueName: \"kubernetes.io/projected/51a3888c-8a01-4735-a6c8-fff84102b6fc-kube-api-access-4kfv9\") pod \"volume-data-source-validator-78495597f6-k6gt6\" (UID: \"51a3888c-8a01-4735-a6c8-fff84102b6fc\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-k6gt6" Jul 15 04:06:46.629744 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:46.629737 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xg7tg\" (UniqueName: \"kubernetes.io/projected/4eaa0aee-36ae-4223-b552-73a6797c1ec1-kube-api-access-xg7tg\") pod \"cluster-samples-operator-65db858894-tmhmf\" (UID: \"4eaa0aee-36ae-4223-b552-73a6797c1ec1\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-tmhmf" Jul 15 04:06:46.629881 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:46.629766 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/d8a85153-9c3e-4ef3-934d-d69f03973e3d-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-cvvj2\" (UID: \"d8a85153-9c3e-4ef3-934d-d69f03973e3d\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-cvvj2" Jul 15 04:06:46.629881 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:46.629793 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/b46dec59-62a8-45be-a415-049fa148fcdd-telemetry-config\") pod \"cluster-monitoring-operator-5f7f494dd4-n29ck\" (UID: \"b46dec59-62a8-45be-a415-049fa148fcdd\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-n29ck" Jul 15 04:06:46.629881 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:46.629818 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/81a32cdd-cc66-4a2b-9d86-08b37f285ca2-serving-cert\") pod \"insights-operator-68d9dd94cf-tr2rw\" (UID: \"81a32cdd-cc66-4a2b-9d86-08b37f285ca2\") " pod="openshift-insights/insights-operator-68d9dd94cf-tr2rw" Jul 15 04:06:46.629881 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:46.629859 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/a0a40e9b-cf54-4ae2-a584-ca5cadf85733-stats-auth\") pod \"router-default-64997dd578-n79tf\" (UID: \"a0a40e9b-cf54-4ae2-a584-ca5cadf85733\") " pod="openshift-ingress/router-default-64997dd578-n79tf" Jul 15 04:06:46.629881 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:46.629870 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/bb386795-c0e9-4236-9b60-73ccf95c95e6-ca-trust-extracted\") pod \"image-registry-86bc794d9-k6v97\" (UID: \"bb386795-c0e9-4236-9b60-73ccf95c95e6\") " pod="openshift-image-registry/image-registry-86bc794d9-k6v97" Jul 15 04:06:46.630098 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:46.629917 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/aa52afbe-abd9-45ea-9f98-6a66b50b07b7-config\") pod \"kube-storage-version-migrator-operator-799cb7f958-xgz4r\" (UID: \"aa52afbe-abd9-45ea-9f98-6a66b50b07b7\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-xgz4r" Jul 15 04:06:46.630098 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:46.629968 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/07b2020a-a077-46ee-abe8-44454ada45a4-config\") pod \"service-ca-operator-7695fc6c8c-8zm4v\" (UID: \"07b2020a-a077-46ee-abe8-44454ada45a4\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-8zm4v" Jul 15 04:06:46.630098 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:46.630075 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/bb386795-c0e9-4236-9b60-73ccf95c95e6-registry-certificates\") pod \"image-registry-86bc794d9-k6v97\" (UID: \"bb386795-c0e9-4236-9b60-73ccf95c95e6\") " pod="openshift-image-registry/image-registry-86bc794d9-k6v97" Jul 15 04:06:46.630273 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:46.630255 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/a0a40e9b-cf54-4ae2-a584-ca5cadf85733-default-certificate\") pod \"router-default-64997dd578-n79tf\" (UID: \"a0a40e9b-cf54-4ae2-a584-ca5cadf85733\") " pod="openshift-ingress/router-default-64997dd578-n79tf" Jul 15 04:06:46.630325 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:46.630284 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/81a32cdd-cc66-4a2b-9d86-08b37f285ca2-service-ca-bundle\") pod \"insights-operator-68d9dd94cf-tr2rw\" (UID: \"81a32cdd-cc66-4a2b-9d86-08b37f285ca2\") " pod="openshift-insights/insights-operator-68d9dd94cf-tr2rw" Jul 15 04:06:46.631262 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:46.630324 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vblhp\" (UniqueName: \"kubernetes.io/projected/aa52afbe-abd9-45ea-9f98-6a66b50b07b7-kube-api-access-vblhp\") pod \"kube-storage-version-migrator-operator-799cb7f958-xgz4r\" (UID: \"aa52afbe-abd9-45ea-9f98-6a66b50b07b7\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-xgz4r" Jul 15 04:06:46.631262 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:46.630358 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a0a40e9b-cf54-4ae2-a584-ca5cadf85733-service-ca-bundle\") pod \"router-default-64997dd578-n79tf\" (UID: \"a0a40e9b-cf54-4ae2-a584-ca5cadf85733\") " pod="openshift-ingress/router-default-64997dd578-n79tf" Jul 15 04:06:46.631262 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:46.630486 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/2db78c13-2384-4015-a886-14377224f4cd-trusted-ca\") pod \"console-operator-7866497494-8kt5p\" (UID: \"2db78c13-2384-4015-a886-14377224f4cd\") " pod="openshift-console-operator/console-operator-7866497494-8kt5p" Jul 15 04:06:46.631262 ip-10-0-128-222 kubenswrapper[2581]: E0715 04:06:46.630588 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/a0a40e9b-cf54-4ae2-a584-ca5cadf85733-service-ca-bundle podName:a0a40e9b-cf54-4ae2-a584-ca5cadf85733 nodeName:}" failed. No retries permitted until 2026-07-15 04:06:47.130572739 +0000 UTC m=+40.657373750 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/a0a40e9b-cf54-4ae2-a584-ca5cadf85733-service-ca-bundle") pod "router-default-64997dd578-n79tf" (UID: "a0a40e9b-cf54-4ae2-a584-ca5cadf85733") : configmap references non-existent config key: service-ca.crt Jul 15 04:06:46.631262 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:46.630654 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r77wx\" (UniqueName: \"kubernetes.io/projected/81a32cdd-cc66-4a2b-9d86-08b37f285ca2-kube-api-access-r77wx\") pod \"insights-operator-68d9dd94cf-tr2rw\" (UID: \"81a32cdd-cc66-4a2b-9d86-08b37f285ca2\") " pod="openshift-insights/insights-operator-68d9dd94cf-tr2rw" Jul 15 04:06:46.631262 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:46.630675 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/bb386795-c0e9-4236-9b60-73ccf95c95e6-trusted-ca\") pod \"image-registry-86bc794d9-k6v97\" (UID: \"bb386795-c0e9-4236-9b60-73ccf95c95e6\") " pod="openshift-image-registry/image-registry-86bc794d9-k6v97" Jul 15 04:06:46.631262 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:46.630702 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/07b2020a-a077-46ee-abe8-44454ada45a4-serving-cert\") pod \"service-ca-operator-7695fc6c8c-8zm4v\" (UID: \"07b2020a-a077-46ee-abe8-44454ada45a4\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-8zm4v" Jul 15 04:06:46.631262 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:46.630732 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vzgw2\" (UniqueName: \"kubernetes.io/projected/07b2020a-a077-46ee-abe8-44454ada45a4-kube-api-access-vzgw2\") pod \"service-ca-operator-7695fc6c8c-8zm4v\" (UID: \"07b2020a-a077-46ee-abe8-44454ada45a4\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-8zm4v" Jul 15 04:06:46.631262 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:46.630764 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/2db78c13-2384-4015-a886-14377224f4cd-serving-cert\") pod \"console-operator-7866497494-8kt5p\" (UID: \"2db78c13-2384-4015-a886-14377224f4cd\") " pod="openshift-console-operator/console-operator-7866497494-8kt5p" Jul 15 04:06:46.631262 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:46.630792 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-59rmx\" (UniqueName: \"kubernetes.io/projected/bb386795-c0e9-4236-9b60-73ccf95c95e6-kube-api-access-59rmx\") pod \"image-registry-86bc794d9-k6v97\" (UID: \"bb386795-c0e9-4236-9b60-73ccf95c95e6\") " pod="openshift-image-registry/image-registry-86bc794d9-k6v97" Jul 15 04:06:46.631262 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:46.630816 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/81a32cdd-cc66-4a2b-9d86-08b37f285ca2-trusted-ca-bundle\") pod \"insights-operator-68d9dd94cf-tr2rw\" (UID: \"81a32cdd-cc66-4a2b-9d86-08b37f285ca2\") " pod="openshift-insights/insights-operator-68d9dd94cf-tr2rw" Jul 15 04:06:46.631262 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:46.630842 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a0a40e9b-cf54-4ae2-a584-ca5cadf85733-metrics-certs\") pod \"router-default-64997dd578-n79tf\" (UID: \"a0a40e9b-cf54-4ae2-a584-ca5cadf85733\") " pod="openshift-ingress/router-default-64997dd578-n79tf" Jul 15 04:06:46.631262 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:46.630854 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/07b2020a-a077-46ee-abe8-44454ada45a4-config\") pod \"service-ca-operator-7695fc6c8c-8zm4v\" (UID: \"07b2020a-a077-46ee-abe8-44454ada45a4\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-8zm4v" Jul 15 04:06:46.631262 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:46.630875 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/2db78c13-2384-4015-a886-14377224f4cd-config\") pod \"console-operator-7866497494-8kt5p\" (UID: \"2db78c13-2384-4015-a886-14377224f4cd\") " pod="openshift-console-operator/console-operator-7866497494-8kt5p" Jul 15 04:06:46.631262 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:46.630922 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/bb386795-c0e9-4236-9b60-73ccf95c95e6-registry-tls\") pod \"image-registry-86bc794d9-k6v97\" (UID: \"bb386795-c0e9-4236-9b60-73ccf95c95e6\") " pod="openshift-image-registry/image-registry-86bc794d9-k6v97" Jul 15 04:06:46.631965 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:46.630951 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/b46dec59-62a8-45be-a415-049fa148fcdd-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-n29ck\" (UID: \"b46dec59-62a8-45be-a415-049fa148fcdd\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-n29ck" Jul 15 04:06:46.631965 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:46.630991 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/bb386795-c0e9-4236-9b60-73ccf95c95e6-installation-pull-secrets\") pod \"image-registry-86bc794d9-k6v97\" (UID: \"bb386795-c0e9-4236-9b60-73ccf95c95e6\") " pod="openshift-image-registry/image-registry-86bc794d9-k6v97" Jul 15 04:06:46.631965 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:46.631028 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/81a32cdd-cc66-4a2b-9d86-08b37f285ca2-snapshots\") pod \"insights-operator-68d9dd94cf-tr2rw\" (UID: \"81a32cdd-cc66-4a2b-9d86-08b37f285ca2\") " pod="openshift-insights/insights-operator-68d9dd94cf-tr2rw" Jul 15 04:06:46.631965 ip-10-0-128-222 kubenswrapper[2581]: E0715 04:06:46.631395 2581 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 15 04:06:46.631965 ip-10-0-128-222 kubenswrapper[2581]: E0715 04:06:46.631449 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a0a40e9b-cf54-4ae2-a584-ca5cadf85733-metrics-certs podName:a0a40e9b-cf54-4ae2-a584-ca5cadf85733 nodeName:}" failed. No retries permitted until 2026-07-15 04:06:47.131430905 +0000 UTC m=+40.658231901 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a0a40e9b-cf54-4ae2-a584-ca5cadf85733-metrics-certs") pod "router-default-64997dd578-n79tf" (UID: "a0a40e9b-cf54-4ae2-a584-ca5cadf85733") : secret "router-metrics-certs-default" not found Jul 15 04:06:46.631965 ip-10-0-128-222 kubenswrapper[2581]: E0715 04:06:46.631531 2581 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 15 04:06:46.631965 ip-10-0-128-222 kubenswrapper[2581]: E0715 04:06:46.631542 2581 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-86bc794d9-k6v97: secret "image-registry-tls" not found Jul 15 04:06:46.631965 ip-10-0-128-222 kubenswrapper[2581]: E0715 04:06:46.631574 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/bb386795-c0e9-4236-9b60-73ccf95c95e6-registry-tls podName:bb386795-c0e9-4236-9b60-73ccf95c95e6 nodeName:}" failed. No retries permitted until 2026-07-15 04:06:47.131563077 +0000 UTC m=+40.658364072 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/bb386795-c0e9-4236-9b60-73ccf95c95e6-registry-tls") pod "image-registry-86bc794d9-k6v97" (UID: "bb386795-c0e9-4236-9b60-73ccf95c95e6") : secret "image-registry-tls" not found Jul 15 04:06:46.631965 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:46.631655 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/bb386795-c0e9-4236-9b60-73ccf95c95e6-trusted-ca\") pod \"image-registry-86bc794d9-k6v97\" (UID: \"bb386795-c0e9-4236-9b60-73ccf95c95e6\") " pod="openshift-image-registry/image-registry-86bc794d9-k6v97" Jul 15 04:06:46.634329 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:46.634309 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/07b2020a-a077-46ee-abe8-44454ada45a4-serving-cert\") pod \"service-ca-operator-7695fc6c8c-8zm4v\" (UID: \"07b2020a-a077-46ee-abe8-44454ada45a4\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-8zm4v" Jul 15 04:06:46.634406 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:46.634359 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/bb386795-c0e9-4236-9b60-73ccf95c95e6-image-registry-private-configuration\") pod \"image-registry-86bc794d9-k6v97\" (UID: \"bb386795-c0e9-4236-9b60-73ccf95c95e6\") " pod="openshift-image-registry/image-registry-86bc794d9-k6v97" Jul 15 04:06:46.634406 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:46.634381 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/bb386795-c0e9-4236-9b60-73ccf95c95e6-installation-pull-secrets\") pod \"image-registry-86bc794d9-k6v97\" (UID: \"bb386795-c0e9-4236-9b60-73ccf95c95e6\") " pod="openshift-image-registry/image-registry-86bc794d9-k6v97" Jul 15 04:06:46.634560 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:46.634541 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/a0a40e9b-cf54-4ae2-a584-ca5cadf85733-stats-auth\") pod \"router-default-64997dd578-n79tf\" (UID: \"a0a40e9b-cf54-4ae2-a584-ca5cadf85733\") " pod="openshift-ingress/router-default-64997dd578-n79tf" Jul 15 04:06:46.634598 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:46.634544 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/a0a40e9b-cf54-4ae2-a584-ca5cadf85733-default-certificate\") pod \"router-default-64997dd578-n79tf\" (UID: \"a0a40e9b-cf54-4ae2-a584-ca5cadf85733\") " pod="openshift-ingress/router-default-64997dd578-n79tf" Jul 15 04:06:46.638804 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:46.638782 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7tzwk\" (UniqueName: \"kubernetes.io/projected/a0a40e9b-cf54-4ae2-a584-ca5cadf85733-kube-api-access-7tzwk\") pod \"router-default-64997dd578-n79tf\" (UID: \"a0a40e9b-cf54-4ae2-a584-ca5cadf85733\") " pod="openshift-ingress/router-default-64997dd578-n79tf" Jul 15 04:06:46.639215 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:46.639196 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/bb386795-c0e9-4236-9b60-73ccf95c95e6-bound-sa-token\") pod \"image-registry-86bc794d9-k6v97\" (UID: \"bb386795-c0e9-4236-9b60-73ccf95c95e6\") " pod="openshift-image-registry/image-registry-86bc794d9-k6v97" Jul 15 04:06:46.640006 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:46.639986 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xg7tg\" (UniqueName: \"kubernetes.io/projected/4eaa0aee-36ae-4223-b552-73a6797c1ec1-kube-api-access-xg7tg\") pod \"cluster-samples-operator-65db858894-tmhmf\" (UID: \"4eaa0aee-36ae-4223-b552-73a6797c1ec1\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-tmhmf" Jul 15 04:06:46.640172 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:46.640157 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-59rmx\" (UniqueName: \"kubernetes.io/projected/bb386795-c0e9-4236-9b60-73ccf95c95e6-kube-api-access-59rmx\") pod \"image-registry-86bc794d9-k6v97\" (UID: \"bb386795-c0e9-4236-9b60-73ccf95c95e6\") " pod="openshift-image-registry/image-registry-86bc794d9-k6v97" Jul 15 04:06:46.640259 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:46.640240 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vzgw2\" (UniqueName: \"kubernetes.io/projected/07b2020a-a077-46ee-abe8-44454ada45a4-kube-api-access-vzgw2\") pod \"service-ca-operator-7695fc6c8c-8zm4v\" (UID: \"07b2020a-a077-46ee-abe8-44454ada45a4\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-8zm4v" Jul 15 04:06:46.731899 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:46.731859 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cg8d8\" (UniqueName: \"kubernetes.io/projected/36aa2987-b207-4dd7-9a95-a67b6b306485-kube-api-access-cg8d8\") pod \"network-check-source-869dcfcdcd-vm2mz\" (UID: \"36aa2987-b207-4dd7-9a95-a67b6b306485\") " pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-vm2mz" Jul 15 04:06:46.732075 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:46.731929 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/81a32cdd-cc66-4a2b-9d86-08b37f285ca2-snapshots\") pod \"insights-operator-68d9dd94cf-tr2rw\" (UID: \"81a32cdd-cc66-4a2b-9d86-08b37f285ca2\") " pod="openshift-insights/insights-operator-68d9dd94cf-tr2rw" Jul 15 04:06:46.732075 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:46.731959 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pk87s\" (UniqueName: \"kubernetes.io/projected/b46dec59-62a8-45be-a415-049fa148fcdd-kube-api-access-pk87s\") pod \"cluster-monitoring-operator-5f7f494dd4-n29ck\" (UID: \"b46dec59-62a8-45be-a415-049fa148fcdd\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-n29ck" Jul 15 04:06:46.732075 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:46.731987 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/aa52afbe-abd9-45ea-9f98-6a66b50b07b7-serving-cert\") pod \"kube-storage-version-migrator-operator-799cb7f958-xgz4r\" (UID: \"aa52afbe-abd9-45ea-9f98-6a66b50b07b7\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-xgz4r" Jul 15 04:06:46.732075 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:46.732014 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/d8a85153-9c3e-4ef3-934d-d69f03973e3d-nginx-conf\") pod \"networking-console-plugin-6cf856758c-cvvj2\" (UID: \"d8a85153-9c3e-4ef3-934d-d69f03973e3d\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-cvvj2" Jul 15 04:06:46.732239 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:46.732183 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/81a32cdd-cc66-4a2b-9d86-08b37f285ca2-tmp\") pod \"insights-operator-68d9dd94cf-tr2rw\" (UID: \"81a32cdd-cc66-4a2b-9d86-08b37f285ca2\") " pod="openshift-insights/insights-operator-68d9dd94cf-tr2rw" Jul 15 04:06:46.732239 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:46.732214 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-trf2b\" (UniqueName: \"kubernetes.io/projected/2db78c13-2384-4015-a886-14377224f4cd-kube-api-access-trf2b\") pod \"console-operator-7866497494-8kt5p\" (UID: \"2db78c13-2384-4015-a886-14377224f4cd\") " pod="openshift-console-operator/console-operator-7866497494-8kt5p" Jul 15 04:06:46.732239 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:46.732234 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4kfv9\" (UniqueName: \"kubernetes.io/projected/51a3888c-8a01-4735-a6c8-fff84102b6fc-kube-api-access-4kfv9\") pod \"volume-data-source-validator-78495597f6-k6gt6\" (UID: \"51a3888c-8a01-4735-a6c8-fff84102b6fc\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-k6gt6" Jul 15 04:06:46.732379 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:46.732271 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/d8a85153-9c3e-4ef3-934d-d69f03973e3d-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-cvvj2\" (UID: \"d8a85153-9c3e-4ef3-934d-d69f03973e3d\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-cvvj2" Jul 15 04:06:46.732379 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:46.732299 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/b46dec59-62a8-45be-a415-049fa148fcdd-telemetry-config\") pod \"cluster-monitoring-operator-5f7f494dd4-n29ck\" (UID: \"b46dec59-62a8-45be-a415-049fa148fcdd\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-n29ck" Jul 15 04:06:46.732379 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:46.732324 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/81a32cdd-cc66-4a2b-9d86-08b37f285ca2-serving-cert\") pod \"insights-operator-68d9dd94cf-tr2rw\" (UID: \"81a32cdd-cc66-4a2b-9d86-08b37f285ca2\") " pod="openshift-insights/insights-operator-68d9dd94cf-tr2rw" Jul 15 04:06:46.732379 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:46.732368 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d1ca6cbf-d937-4892-bc3b-ec5bb57a6734-tmp-dir\") pod \"dns-default-hvcwt\" (UID: \"d1ca6cbf-d937-4892-bc3b-ec5bb57a6734\") " pod="openshift-dns/dns-default-hvcwt" Jul 15 04:06:46.732555 ip-10-0-128-222 kubenswrapper[2581]: E0715 04:06:46.732395 2581 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 15 04:06:46.732555 ip-10-0-128-222 kubenswrapper[2581]: E0715 04:06:46.732462 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d8a85153-9c3e-4ef3-934d-d69f03973e3d-networking-console-plugin-cert podName:d8a85153-9c3e-4ef3-934d-d69f03973e3d nodeName:}" failed. No retries permitted until 2026-07-15 04:06:47.232439297 +0000 UTC m=+40.759240296 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/d8a85153-9c3e-4ef3-934d-d69f03973e3d-networking-console-plugin-cert") pod "networking-console-plugin-6cf856758c-cvvj2" (UID: "d8a85153-9c3e-4ef3-934d-d69f03973e3d") : secret "networking-console-plugin-cert" not found Jul 15 04:06:46.732555 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:46.732396 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/aa52afbe-abd9-45ea-9f98-6a66b50b07b7-config\") pod \"kube-storage-version-migrator-operator-799cb7f958-xgz4r\" (UID: \"aa52afbe-abd9-45ea-9f98-6a66b50b07b7\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-xgz4r" Jul 15 04:06:46.732708 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:46.732578 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/81a32cdd-cc66-4a2b-9d86-08b37f285ca2-service-ca-bundle\") pod \"insights-operator-68d9dd94cf-tr2rw\" (UID: \"81a32cdd-cc66-4a2b-9d86-08b37f285ca2\") " pod="openshift-insights/insights-operator-68d9dd94cf-tr2rw" Jul 15 04:06:46.732708 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:46.732606 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vblhp\" (UniqueName: \"kubernetes.io/projected/aa52afbe-abd9-45ea-9f98-6a66b50b07b7-kube-api-access-vblhp\") pod \"kube-storage-version-migrator-operator-799cb7f958-xgz4r\" (UID: \"aa52afbe-abd9-45ea-9f98-6a66b50b07b7\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-xgz4r" Jul 15 04:06:46.732708 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:46.732643 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/2db78c13-2384-4015-a886-14377224f4cd-trusted-ca\") pod \"console-operator-7866497494-8kt5p\" (UID: \"2db78c13-2384-4015-a886-14377224f4cd\") " pod="openshift-console-operator/console-operator-7866497494-8kt5p" Jul 15 04:06:46.732708 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:46.732685 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r77wx\" (UniqueName: \"kubernetes.io/projected/81a32cdd-cc66-4a2b-9d86-08b37f285ca2-kube-api-access-r77wx\") pod \"insights-operator-68d9dd94cf-tr2rw\" (UID: \"81a32cdd-cc66-4a2b-9d86-08b37f285ca2\") " pod="openshift-insights/insights-operator-68d9dd94cf-tr2rw" Jul 15 04:06:46.732708 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:46.732697 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/81a32cdd-cc66-4a2b-9d86-08b37f285ca2-tmp\") pod \"insights-operator-68d9dd94cf-tr2rw\" (UID: \"81a32cdd-cc66-4a2b-9d86-08b37f285ca2\") " pod="openshift-insights/insights-operator-68d9dd94cf-tr2rw" Jul 15 04:06:46.732948 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:46.732715 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/419f1d13-f9de-4b4a-ad52-a977ee3b7ef2-cert\") pod \"ingress-canary-mptrm\" (UID: \"419f1d13-f9de-4b4a-ad52-a977ee3b7ef2\") " pod="openshift-ingress-canary/ingress-canary-mptrm" Jul 15 04:06:46.732948 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:46.732772 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2qfzq\" (UniqueName: \"kubernetes.io/projected/d1ca6cbf-d937-4892-bc3b-ec5bb57a6734-kube-api-access-2qfzq\") pod \"dns-default-hvcwt\" (UID: \"d1ca6cbf-d937-4892-bc3b-ec5bb57a6734\") " pod="openshift-dns/dns-default-hvcwt" Jul 15 04:06:46.732948 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:46.732805 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/2db78c13-2384-4015-a886-14377224f4cd-serving-cert\") pod \"console-operator-7866497494-8kt5p\" (UID: \"2db78c13-2384-4015-a886-14377224f4cd\") " pod="openshift-console-operator/console-operator-7866497494-8kt5p" Jul 15 04:06:46.732948 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:46.732834 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/81a32cdd-cc66-4a2b-9d86-08b37f285ca2-trusted-ca-bundle\") pod \"insights-operator-68d9dd94cf-tr2rw\" (UID: \"81a32cdd-cc66-4a2b-9d86-08b37f285ca2\") " pod="openshift-insights/insights-operator-68d9dd94cf-tr2rw" Jul 15 04:06:46.732948 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:46.732844 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/d8a85153-9c3e-4ef3-934d-d69f03973e3d-nginx-conf\") pod \"networking-console-plugin-6cf856758c-cvvj2\" (UID: \"d8a85153-9c3e-4ef3-934d-d69f03973e3d\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-cvvj2" Jul 15 04:06:46.732948 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:46.732872 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/2db78c13-2384-4015-a886-14377224f4cd-config\") pod \"console-operator-7866497494-8kt5p\" (UID: \"2db78c13-2384-4015-a886-14377224f4cd\") " pod="openshift-console-operator/console-operator-7866497494-8kt5p" Jul 15 04:06:46.732948 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:46.732898 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d1ca6cbf-d937-4892-bc3b-ec5bb57a6734-metrics-tls\") pod \"dns-default-hvcwt\" (UID: \"d1ca6cbf-d937-4892-bc3b-ec5bb57a6734\") " pod="openshift-dns/dns-default-hvcwt" Jul 15 04:06:46.732948 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:46.732934 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fdg4z\" (UniqueName: \"kubernetes.io/projected/419f1d13-f9de-4b4a-ad52-a977ee3b7ef2-kube-api-access-fdg4z\") pod \"ingress-canary-mptrm\" (UID: \"419f1d13-f9de-4b4a-ad52-a977ee3b7ef2\") " pod="openshift-ingress-canary/ingress-canary-mptrm" Jul 15 04:06:46.733482 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:46.732960 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/d1ca6cbf-d937-4892-bc3b-ec5bb57a6734-config-volume\") pod \"dns-default-hvcwt\" (UID: \"d1ca6cbf-d937-4892-bc3b-ec5bb57a6734\") " pod="openshift-dns/dns-default-hvcwt" Jul 15 04:06:46.733482 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:46.732979 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/aa52afbe-abd9-45ea-9f98-6a66b50b07b7-config\") pod \"kube-storage-version-migrator-operator-799cb7f958-xgz4r\" (UID: \"aa52afbe-abd9-45ea-9f98-6a66b50b07b7\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-xgz4r" Jul 15 04:06:46.733482 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:46.733202 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/81a32cdd-cc66-4a2b-9d86-08b37f285ca2-service-ca-bundle\") pod \"insights-operator-68d9dd94cf-tr2rw\" (UID: \"81a32cdd-cc66-4a2b-9d86-08b37f285ca2\") " pod="openshift-insights/insights-operator-68d9dd94cf-tr2rw" Jul 15 04:06:46.733482 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:46.733349 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/b46dec59-62a8-45be-a415-049fa148fcdd-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-n29ck\" (UID: \"b46dec59-62a8-45be-a415-049fa148fcdd\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-n29ck" Jul 15 04:06:46.733482 ip-10-0-128-222 kubenswrapper[2581]: E0715 04:06:46.733472 2581 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 15 04:06:46.733727 ip-10-0-128-222 kubenswrapper[2581]: E0715 04:06:46.733537 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b46dec59-62a8-45be-a415-049fa148fcdd-cluster-monitoring-operator-tls podName:b46dec59-62a8-45be-a415-049fa148fcdd nodeName:}" failed. No retries permitted until 2026-07-15 04:06:47.233521688 +0000 UTC m=+40.760322684 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/b46dec59-62a8-45be-a415-049fa148fcdd-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-n29ck" (UID: "b46dec59-62a8-45be-a415-049fa148fcdd") : secret "cluster-monitoring-operator-tls" not found Jul 15 04:06:46.733727 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:46.733680 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/81a32cdd-cc66-4a2b-9d86-08b37f285ca2-snapshots\") pod \"insights-operator-68d9dd94cf-tr2rw\" (UID: \"81a32cdd-cc66-4a2b-9d86-08b37f285ca2\") " pod="openshift-insights/insights-operator-68d9dd94cf-tr2rw" Jul 15 04:06:46.733864 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:46.733784 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/2db78c13-2384-4015-a886-14377224f4cd-config\") pod \"console-operator-7866497494-8kt5p\" (UID: \"2db78c13-2384-4015-a886-14377224f4cd\") " pod="openshift-console-operator/console-operator-7866497494-8kt5p" Jul 15 04:06:46.733864 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:46.733857 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/b46dec59-62a8-45be-a415-049fa148fcdd-telemetry-config\") pod \"cluster-monitoring-operator-5f7f494dd4-n29ck\" (UID: \"b46dec59-62a8-45be-a415-049fa148fcdd\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-n29ck" Jul 15 04:06:46.733988 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:46.733934 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/81a32cdd-cc66-4a2b-9d86-08b37f285ca2-trusted-ca-bundle\") pod \"insights-operator-68d9dd94cf-tr2rw\" (UID: \"81a32cdd-cc66-4a2b-9d86-08b37f285ca2\") " pod="openshift-insights/insights-operator-68d9dd94cf-tr2rw" Jul 15 04:06:46.734259 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:46.734239 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/2db78c13-2384-4015-a886-14377224f4cd-trusted-ca\") pod \"console-operator-7866497494-8kt5p\" (UID: \"2db78c13-2384-4015-a886-14377224f4cd\") " pod="openshift-console-operator/console-operator-7866497494-8kt5p" Jul 15 04:06:46.735112 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:46.735088 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/aa52afbe-abd9-45ea-9f98-6a66b50b07b7-serving-cert\") pod \"kube-storage-version-migrator-operator-799cb7f958-xgz4r\" (UID: \"aa52afbe-abd9-45ea-9f98-6a66b50b07b7\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-xgz4r" Jul 15 04:06:46.735298 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:46.735283 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/2db78c13-2384-4015-a886-14377224f4cd-serving-cert\") pod \"console-operator-7866497494-8kt5p\" (UID: \"2db78c13-2384-4015-a886-14377224f4cd\") " pod="openshift-console-operator/console-operator-7866497494-8kt5p" Jul 15 04:06:46.735400 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:46.735377 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/81a32cdd-cc66-4a2b-9d86-08b37f285ca2-serving-cert\") pod \"insights-operator-68d9dd94cf-tr2rw\" (UID: \"81a32cdd-cc66-4a2b-9d86-08b37f285ca2\") " pod="openshift-insights/insights-operator-68d9dd94cf-tr2rw" Jul 15 04:06:46.741488 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:46.741463 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-trf2b\" (UniqueName: \"kubernetes.io/projected/2db78c13-2384-4015-a886-14377224f4cd-kube-api-access-trf2b\") pod \"console-operator-7866497494-8kt5p\" (UID: \"2db78c13-2384-4015-a886-14377224f4cd\") " pod="openshift-console-operator/console-operator-7866497494-8kt5p" Jul 15 04:06:46.741655 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:46.741624 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vblhp\" (UniqueName: \"kubernetes.io/projected/aa52afbe-abd9-45ea-9f98-6a66b50b07b7-kube-api-access-vblhp\") pod \"kube-storage-version-migrator-operator-799cb7f958-xgz4r\" (UID: \"aa52afbe-abd9-45ea-9f98-6a66b50b07b7\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-xgz4r" Jul 15 04:06:46.741752 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:46.741738 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4kfv9\" (UniqueName: \"kubernetes.io/projected/51a3888c-8a01-4735-a6c8-fff84102b6fc-kube-api-access-4kfv9\") pod \"volume-data-source-validator-78495597f6-k6gt6\" (UID: \"51a3888c-8a01-4735-a6c8-fff84102b6fc\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-k6gt6" Jul 15 04:06:46.742655 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:46.742634 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pk87s\" (UniqueName: \"kubernetes.io/projected/b46dec59-62a8-45be-a415-049fa148fcdd-kube-api-access-pk87s\") pod \"cluster-monitoring-operator-5f7f494dd4-n29ck\" (UID: \"b46dec59-62a8-45be-a415-049fa148fcdd\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-n29ck" Jul 15 04:06:46.742969 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:46.742951 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r77wx\" (UniqueName: \"kubernetes.io/projected/81a32cdd-cc66-4a2b-9d86-08b37f285ca2-kube-api-access-r77wx\") pod \"insights-operator-68d9dd94cf-tr2rw\" (UID: \"81a32cdd-cc66-4a2b-9d86-08b37f285ca2\") " pod="openshift-insights/insights-operator-68d9dd94cf-tr2rw" Jul 15 04:06:46.773381 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:46.773346 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-8zm4v" Jul 15 04:06:46.800958 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:46.800936 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-k6gt6" Jul 15 04:06:46.817506 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:46.817341 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-68d9dd94cf-tr2rw" Jul 15 04:06:46.830790 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:46.830752 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-xgz4r" Jul 15 04:06:46.834181 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:46.834154 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cg8d8\" (UniqueName: \"kubernetes.io/projected/36aa2987-b207-4dd7-9a95-a67b6b306485-kube-api-access-cg8d8\") pod \"network-check-source-869dcfcdcd-vm2mz\" (UID: \"36aa2987-b207-4dd7-9a95-a67b6b306485\") " pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-vm2mz" Jul 15 04:06:46.834328 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:46.834255 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d1ca6cbf-d937-4892-bc3b-ec5bb57a6734-tmp-dir\") pod \"dns-default-hvcwt\" (UID: \"d1ca6cbf-d937-4892-bc3b-ec5bb57a6734\") " pod="openshift-dns/dns-default-hvcwt" Jul 15 04:06:46.834328 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:46.834293 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/419f1d13-f9de-4b4a-ad52-a977ee3b7ef2-cert\") pod \"ingress-canary-mptrm\" (UID: \"419f1d13-f9de-4b4a-ad52-a977ee3b7ef2\") " pod="openshift-ingress-canary/ingress-canary-mptrm" Jul 15 04:06:46.834328 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:46.834312 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2qfzq\" (UniqueName: \"kubernetes.io/projected/d1ca6cbf-d937-4892-bc3b-ec5bb57a6734-kube-api-access-2qfzq\") pod \"dns-default-hvcwt\" (UID: \"d1ca6cbf-d937-4892-bc3b-ec5bb57a6734\") " pod="openshift-dns/dns-default-hvcwt" Jul 15 04:06:46.834482 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:46.834345 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d1ca6cbf-d937-4892-bc3b-ec5bb57a6734-metrics-tls\") pod \"dns-default-hvcwt\" (UID: \"d1ca6cbf-d937-4892-bc3b-ec5bb57a6734\") " pod="openshift-dns/dns-default-hvcwt" Jul 15 04:06:46.834482 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:46.834367 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fdg4z\" (UniqueName: \"kubernetes.io/projected/419f1d13-f9de-4b4a-ad52-a977ee3b7ef2-kube-api-access-fdg4z\") pod \"ingress-canary-mptrm\" (UID: \"419f1d13-f9de-4b4a-ad52-a977ee3b7ef2\") " pod="openshift-ingress-canary/ingress-canary-mptrm" Jul 15 04:06:46.834482 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:46.834390 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/d1ca6cbf-d937-4892-bc3b-ec5bb57a6734-config-volume\") pod \"dns-default-hvcwt\" (UID: \"d1ca6cbf-d937-4892-bc3b-ec5bb57a6734\") " pod="openshift-dns/dns-default-hvcwt" Jul 15 04:06:46.835212 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:46.835065 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/d1ca6cbf-d937-4892-bc3b-ec5bb57a6734-config-volume\") pod \"dns-default-hvcwt\" (UID: \"d1ca6cbf-d937-4892-bc3b-ec5bb57a6734\") " pod="openshift-dns/dns-default-hvcwt" Jul 15 04:06:46.835212 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:46.835069 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d1ca6cbf-d937-4892-bc3b-ec5bb57a6734-tmp-dir\") pod \"dns-default-hvcwt\" (UID: \"d1ca6cbf-d937-4892-bc3b-ec5bb57a6734\") " pod="openshift-dns/dns-default-hvcwt" Jul 15 04:06:46.835212 ip-10-0-128-222 kubenswrapper[2581]: E0715 04:06:46.835073 2581 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 15 04:06:46.835417 ip-10-0-128-222 kubenswrapper[2581]: E0715 04:06:46.835255 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d1ca6cbf-d937-4892-bc3b-ec5bb57a6734-metrics-tls podName:d1ca6cbf-d937-4892-bc3b-ec5bb57a6734 nodeName:}" failed. No retries permitted until 2026-07-15 04:06:47.335237564 +0000 UTC m=+40.862038557 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d1ca6cbf-d937-4892-bc3b-ec5bb57a6734-metrics-tls") pod "dns-default-hvcwt" (UID: "d1ca6cbf-d937-4892-bc3b-ec5bb57a6734") : secret "dns-default-metrics-tls" not found Jul 15 04:06:46.837604 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:46.837565 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/419f1d13-f9de-4b4a-ad52-a977ee3b7ef2-cert\") pod \"ingress-canary-mptrm\" (UID: \"419f1d13-f9de-4b4a-ad52-a977ee3b7ef2\") " pod="openshift-ingress-canary/ingress-canary-mptrm" Jul 15 04:06:46.843851 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:46.843773 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2qfzq\" (UniqueName: \"kubernetes.io/projected/d1ca6cbf-d937-4892-bc3b-ec5bb57a6734-kube-api-access-2qfzq\") pod \"dns-default-hvcwt\" (UID: \"d1ca6cbf-d937-4892-bc3b-ec5bb57a6734\") " pod="openshift-dns/dns-default-hvcwt" Jul 15 04:06:46.844459 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:46.844436 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fdg4z\" (UniqueName: \"kubernetes.io/projected/419f1d13-f9de-4b4a-ad52-a977ee3b7ef2-kube-api-access-fdg4z\") pod \"ingress-canary-mptrm\" (UID: \"419f1d13-f9de-4b4a-ad52-a977ee3b7ef2\") " pod="openshift-ingress-canary/ingress-canary-mptrm" Jul 15 04:06:46.844624 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:46.844602 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cg8d8\" (UniqueName: \"kubernetes.io/projected/36aa2987-b207-4dd7-9a95-a67b6b306485-kube-api-access-cg8d8\") pod \"network-check-source-869dcfcdcd-vm2mz\" (UID: \"36aa2987-b207-4dd7-9a95-a67b6b306485\") " pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-vm2mz" Jul 15 04:06:46.870515 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:46.870474 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-7866497494-8kt5p" Jul 15 04:06:46.885181 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:46.884667 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-vm2mz" Jul 15 04:06:46.905061 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:46.905003 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-mptrm" Jul 15 04:06:46.986554 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:46.986389 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4n42z" Jul 15 04:06:46.987931 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:46.987063 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kz7p2" Jul 15 04:06:46.987931 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:46.987111 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2jvh6" Jul 15 04:06:46.991643 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:46.989177 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-nc2gd\"" Jul 15 04:06:46.991643 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:46.989642 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 15 04:06:46.991643 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:46.989876 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 15 04:06:46.991643 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:46.991287 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-8rjwx\"" Jul 15 04:06:47.046242 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:47.046212 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-k6gt6"] Jul 15 04:06:47.052902 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:06:47.052837 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod51a3888c_8a01_4735_a6c8_fff84102b6fc.slice/crio-00fc3eda0a6df14393456ec8754b4e3f8a1cbd18f0dccc7bf7840faf97ef6366 WatchSource:0}: Error finding container 00fc3eda0a6df14393456ec8754b4e3f8a1cbd18f0dccc7bf7840faf97ef6366: Status 404 returned error can't find the container with id 00fc3eda0a6df14393456ec8754b4e3f8a1cbd18f0dccc7bf7840faf97ef6366 Jul 15 04:06:47.059022 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:47.058997 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-7695fc6c8c-8zm4v"] Jul 15 04:06:47.064914 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:47.064235 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-68d9dd94cf-tr2rw"] Jul 15 04:06:47.093175 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:47.093141 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-xgz4r"] Jul 15 04:06:47.096419 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:06:47.096377 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaa52afbe_abd9_45ea_9f98_6a66b50b07b7.slice/crio-5fb68b737aea51e088dc9775c2050ac741f4a4589fb5fc4aab5ab10e84405d02 WatchSource:0}: Error finding container 5fb68b737aea51e088dc9775c2050ac741f4a4589fb5fc4aab5ab10e84405d02: Status 404 returned error can't find the container with id 5fb68b737aea51e088dc9775c2050ac741f4a4589fb5fc4aab5ab10e84405d02 Jul 15 04:06:47.119681 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:47.119639 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-869dcfcdcd-vm2mz"] Jul 15 04:06:47.124148 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:06:47.124099 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod36aa2987_b207_4dd7_9a95_a67b6b306485.slice/crio-918615e3d791094007ad0169e9d029c9a875beee0b277e6943a7e941f57de46f WatchSource:0}: Error finding container 918615e3d791094007ad0169e9d029c9a875beee0b277e6943a7e941f57de46f: Status 404 returned error can't find the container with id 918615e3d791094007ad0169e9d029c9a875beee0b277e6943a7e941f57de46f Jul 15 04:06:47.127301 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:47.127280 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-7866497494-8kt5p"] Jul 15 04:06:47.130696 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:47.130673 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-mptrm"] Jul 15 04:06:47.131065 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:06:47.131046 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2db78c13_2384_4015_a886_14377224f4cd.slice/crio-43404246969a328359eae7086e201bd857d92d418da9682ae2852c2bc166765e WatchSource:0}: Error finding container 43404246969a328359eae7086e201bd857d92d418da9682ae2852c2bc166765e: Status 404 returned error can't find the container with id 43404246969a328359eae7086e201bd857d92d418da9682ae2852c2bc166765e Jul 15 04:06:47.133417 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:06:47.133317 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod419f1d13_f9de_4b4a_ad52_a977ee3b7ef2.slice/crio-9157cbb33fc92defa8432989764a08117ba09efe0d7eb913a13945e9423a495f WatchSource:0}: Error finding container 9157cbb33fc92defa8432989764a08117ba09efe0d7eb913a13945e9423a495f: Status 404 returned error can't find the container with id 9157cbb33fc92defa8432989764a08117ba09efe0d7eb913a13945e9423a495f Jul 15 04:06:47.141989 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:47.141968 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a0a40e9b-cf54-4ae2-a584-ca5cadf85733-service-ca-bundle\") pod \"router-default-64997dd578-n79tf\" (UID: \"a0a40e9b-cf54-4ae2-a584-ca5cadf85733\") " pod="openshift-ingress/router-default-64997dd578-n79tf" Jul 15 04:06:47.142079 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:47.142020 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a0a40e9b-cf54-4ae2-a584-ca5cadf85733-metrics-certs\") pod \"router-default-64997dd578-n79tf\" (UID: \"a0a40e9b-cf54-4ae2-a584-ca5cadf85733\") " pod="openshift-ingress/router-default-64997dd578-n79tf" Jul 15 04:06:47.142144 ip-10-0-128-222 kubenswrapper[2581]: E0715 04:06:47.142095 2581 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 15 04:06:47.142193 ip-10-0-128-222 kubenswrapper[2581]: E0715 04:06:47.142147 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a0a40e9b-cf54-4ae2-a584-ca5cadf85733-metrics-certs podName:a0a40e9b-cf54-4ae2-a584-ca5cadf85733 nodeName:}" failed. No retries permitted until 2026-07-15 04:06:48.142134894 +0000 UTC m=+41.668935900 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a0a40e9b-cf54-4ae2-a584-ca5cadf85733-metrics-certs") pod "router-default-64997dd578-n79tf" (UID: "a0a40e9b-cf54-4ae2-a584-ca5cadf85733") : secret "router-metrics-certs-default" not found Jul 15 04:06:47.142249 ip-10-0-128-222 kubenswrapper[2581]: E0715 04:06:47.142216 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/a0a40e9b-cf54-4ae2-a584-ca5cadf85733-service-ca-bundle podName:a0a40e9b-cf54-4ae2-a584-ca5cadf85733 nodeName:}" failed. No retries permitted until 2026-07-15 04:06:48.142196726 +0000 UTC m=+41.668997737 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/a0a40e9b-cf54-4ae2-a584-ca5cadf85733-service-ca-bundle") pod "router-default-64997dd578-n79tf" (UID: "a0a40e9b-cf54-4ae2-a584-ca5cadf85733") : configmap references non-existent config key: service-ca.crt Jul 15 04:06:47.142314 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:47.142294 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/bb386795-c0e9-4236-9b60-73ccf95c95e6-registry-tls\") pod \"image-registry-86bc794d9-k6v97\" (UID: \"bb386795-c0e9-4236-9b60-73ccf95c95e6\") " pod="openshift-image-registry/image-registry-86bc794d9-k6v97" Jul 15 04:06:47.142388 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:47.142374 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/4eaa0aee-36ae-4223-b552-73a6797c1ec1-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-tmhmf\" (UID: \"4eaa0aee-36ae-4223-b552-73a6797c1ec1\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-tmhmf" Jul 15 04:06:47.142444 ip-10-0-128-222 kubenswrapper[2581]: E0715 04:06:47.142428 2581 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 15 04:06:47.142489 ip-10-0-128-222 kubenswrapper[2581]: E0715 04:06:47.142448 2581 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-86bc794d9-k6v97: secret "image-registry-tls" not found Jul 15 04:06:47.142489 ip-10-0-128-222 kubenswrapper[2581]: E0715 04:06:47.142480 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/bb386795-c0e9-4236-9b60-73ccf95c95e6-registry-tls podName:bb386795-c0e9-4236-9b60-73ccf95c95e6 nodeName:}" failed. No retries permitted until 2026-07-15 04:06:48.142470943 +0000 UTC m=+41.669271940 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/bb386795-c0e9-4236-9b60-73ccf95c95e6-registry-tls") pod "image-registry-86bc794d9-k6v97" (UID: "bb386795-c0e9-4236-9b60-73ccf95c95e6") : secret "image-registry-tls" not found Jul 15 04:06:47.142558 ip-10-0-128-222 kubenswrapper[2581]: E0715 04:06:47.142525 2581 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 15 04:06:47.142589 ip-10-0-128-222 kubenswrapper[2581]: E0715 04:06:47.142569 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4eaa0aee-36ae-4223-b552-73a6797c1ec1-samples-operator-tls podName:4eaa0aee-36ae-4223-b552-73a6797c1ec1 nodeName:}" failed. No retries permitted until 2026-07-15 04:06:48.142558826 +0000 UTC m=+41.669359824 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/4eaa0aee-36ae-4223-b552-73a6797c1ec1-samples-operator-tls") pod "cluster-samples-operator-65db858894-tmhmf" (UID: "4eaa0aee-36ae-4223-b552-73a6797c1ec1") : secret "samples-operator-tls" not found Jul 15 04:06:47.229565 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:47.229523 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-68d9dd94cf-tr2rw" event={"ID":"81a32cdd-cc66-4a2b-9d86-08b37f285ca2","Type":"ContainerStarted","Data":"524656ee9a392334b98fc68aaa525cdd7fe094f20d175e76c80b0129ff60093d"} Jul 15 04:06:47.230597 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:47.230570 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-k6gt6" event={"ID":"51a3888c-8a01-4735-a6c8-fff84102b6fc","Type":"ContainerStarted","Data":"00fc3eda0a6df14393456ec8754b4e3f8a1cbd18f0dccc7bf7840faf97ef6366"} Jul 15 04:06:47.231579 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:47.231546 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-mptrm" event={"ID":"419f1d13-f9de-4b4a-ad52-a977ee3b7ef2","Type":"ContainerStarted","Data":"9157cbb33fc92defa8432989764a08117ba09efe0d7eb913a13945e9423a495f"} Jul 15 04:06:47.232536 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:47.232515 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-vm2mz" event={"ID":"36aa2987-b207-4dd7-9a95-a67b6b306485","Type":"ContainerStarted","Data":"918615e3d791094007ad0169e9d029c9a875beee0b277e6943a7e941f57de46f"} Jul 15 04:06:47.233439 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:47.233410 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7866497494-8kt5p" event={"ID":"2db78c13-2384-4015-a886-14377224f4cd","Type":"ContainerStarted","Data":"43404246969a328359eae7086e201bd857d92d418da9682ae2852c2bc166765e"} Jul 15 04:06:47.234412 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:47.234390 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-8zm4v" event={"ID":"07b2020a-a077-46ee-abe8-44454ada45a4","Type":"ContainerStarted","Data":"570a5c2ef1359547fd93ed69850e6fd4732b24504745fe0c8a9fb151e04e4bb4"} Jul 15 04:06:47.235378 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:47.235360 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-xgz4r" event={"ID":"aa52afbe-abd9-45ea-9f98-6a66b50b07b7","Type":"ContainerStarted","Data":"5fb68b737aea51e088dc9775c2050ac741f4a4589fb5fc4aab5ab10e84405d02"} Jul 15 04:06:47.243839 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:47.243818 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/d8a85153-9c3e-4ef3-934d-d69f03973e3d-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-cvvj2\" (UID: \"d8a85153-9c3e-4ef3-934d-d69f03973e3d\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-cvvj2" Jul 15 04:06:47.243955 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:47.243928 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/b46dec59-62a8-45be-a415-049fa148fcdd-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-n29ck\" (UID: \"b46dec59-62a8-45be-a415-049fa148fcdd\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-n29ck" Jul 15 04:06:47.243991 ip-10-0-128-222 kubenswrapper[2581]: E0715 04:06:47.243960 2581 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 15 04:06:47.244035 ip-10-0-128-222 kubenswrapper[2581]: E0715 04:06:47.244025 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d8a85153-9c3e-4ef3-934d-d69f03973e3d-networking-console-plugin-cert podName:d8a85153-9c3e-4ef3-934d-d69f03973e3d nodeName:}" failed. No retries permitted until 2026-07-15 04:06:48.244006251 +0000 UTC m=+41.770807248 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/d8a85153-9c3e-4ef3-934d-d69f03973e3d-networking-console-plugin-cert") pod "networking-console-plugin-6cf856758c-cvvj2" (UID: "d8a85153-9c3e-4ef3-934d-d69f03973e3d") : secret "networking-console-plugin-cert" not found Jul 15 04:06:47.244075 ip-10-0-128-222 kubenswrapper[2581]: E0715 04:06:47.244035 2581 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 15 04:06:47.244075 ip-10-0-128-222 kubenswrapper[2581]: E0715 04:06:47.244072 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b46dec59-62a8-45be-a415-049fa148fcdd-cluster-monitoring-operator-tls podName:b46dec59-62a8-45be-a415-049fa148fcdd nodeName:}" failed. No retries permitted until 2026-07-15 04:06:48.244061183 +0000 UTC m=+41.770862176 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/b46dec59-62a8-45be-a415-049fa148fcdd-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-n29ck" (UID: "b46dec59-62a8-45be-a415-049fa148fcdd") : secret "cluster-monitoring-operator-tls" not found Jul 15 04:06:47.344839 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:47.344802 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d1ca6cbf-d937-4892-bc3b-ec5bb57a6734-metrics-tls\") pod \"dns-default-hvcwt\" (UID: \"d1ca6cbf-d937-4892-bc3b-ec5bb57a6734\") " pod="openshift-dns/dns-default-hvcwt" Jul 15 04:06:47.345347 ip-10-0-128-222 kubenswrapper[2581]: E0715 04:06:47.344957 2581 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 15 04:06:47.345347 ip-10-0-128-222 kubenswrapper[2581]: E0715 04:06:47.345022 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d1ca6cbf-d937-4892-bc3b-ec5bb57a6734-metrics-tls podName:d1ca6cbf-d937-4892-bc3b-ec5bb57a6734 nodeName:}" failed. No retries permitted until 2026-07-15 04:06:48.345007273 +0000 UTC m=+41.871808278 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d1ca6cbf-d937-4892-bc3b-ec5bb57a6734-metrics-tls") pod "dns-default-hvcwt" (UID: "d1ca6cbf-d937-4892-bc3b-ec5bb57a6734") : secret "dns-default-metrics-tls" not found Jul 15 04:06:48.153268 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:48.153103 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a0a40e9b-cf54-4ae2-a584-ca5cadf85733-metrics-certs\") pod \"router-default-64997dd578-n79tf\" (UID: \"a0a40e9b-cf54-4ae2-a584-ca5cadf85733\") " pod="openshift-ingress/router-default-64997dd578-n79tf" Jul 15 04:06:48.153268 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:48.153200 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/bb386795-c0e9-4236-9b60-73ccf95c95e6-registry-tls\") pod \"image-registry-86bc794d9-k6v97\" (UID: \"bb386795-c0e9-4236-9b60-73ccf95c95e6\") " pod="openshift-image-registry/image-registry-86bc794d9-k6v97" Jul 15 04:06:48.153268 ip-10-0-128-222 kubenswrapper[2581]: E0715 04:06:48.153262 2581 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 15 04:06:48.153573 ip-10-0-128-222 kubenswrapper[2581]: E0715 04:06:48.153341 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a0a40e9b-cf54-4ae2-a584-ca5cadf85733-metrics-certs podName:a0a40e9b-cf54-4ae2-a584-ca5cadf85733 nodeName:}" failed. No retries permitted until 2026-07-15 04:06:50.153319386 +0000 UTC m=+43.680120444 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a0a40e9b-cf54-4ae2-a584-ca5cadf85733-metrics-certs") pod "router-default-64997dd578-n79tf" (UID: "a0a40e9b-cf54-4ae2-a584-ca5cadf85733") : secret "router-metrics-certs-default" not found Jul 15 04:06:48.153573 ip-10-0-128-222 kubenswrapper[2581]: E0715 04:06:48.153380 2581 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 15 04:06:48.153573 ip-10-0-128-222 kubenswrapper[2581]: E0715 04:06:48.153402 2581 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-86bc794d9-k6v97: secret "image-registry-tls" not found Jul 15 04:06:48.153573 ip-10-0-128-222 kubenswrapper[2581]: E0715 04:06:48.153458 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/bb386795-c0e9-4236-9b60-73ccf95c95e6-registry-tls podName:bb386795-c0e9-4236-9b60-73ccf95c95e6 nodeName:}" failed. No retries permitted until 2026-07-15 04:06:50.153439191 +0000 UTC m=+43.680240205 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/bb386795-c0e9-4236-9b60-73ccf95c95e6-registry-tls") pod "image-registry-86bc794d9-k6v97" (UID: "bb386795-c0e9-4236-9b60-73ccf95c95e6") : secret "image-registry-tls" not found Jul 15 04:06:48.154352 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:48.153905 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/4eaa0aee-36ae-4223-b552-73a6797c1ec1-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-tmhmf\" (UID: \"4eaa0aee-36ae-4223-b552-73a6797c1ec1\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-tmhmf" Jul 15 04:06:48.154352 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:48.154020 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a0a40e9b-cf54-4ae2-a584-ca5cadf85733-service-ca-bundle\") pod \"router-default-64997dd578-n79tf\" (UID: \"a0a40e9b-cf54-4ae2-a584-ca5cadf85733\") " pod="openshift-ingress/router-default-64997dd578-n79tf" Jul 15 04:06:48.154352 ip-10-0-128-222 kubenswrapper[2581]: E0715 04:06:48.154182 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/a0a40e9b-cf54-4ae2-a584-ca5cadf85733-service-ca-bundle podName:a0a40e9b-cf54-4ae2-a584-ca5cadf85733 nodeName:}" failed. No retries permitted until 2026-07-15 04:06:50.154167885 +0000 UTC m=+43.680968892 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/a0a40e9b-cf54-4ae2-a584-ca5cadf85733-service-ca-bundle") pod "router-default-64997dd578-n79tf" (UID: "a0a40e9b-cf54-4ae2-a584-ca5cadf85733") : configmap references non-existent config key: service-ca.crt Jul 15 04:06:48.154352 ip-10-0-128-222 kubenswrapper[2581]: E0715 04:06:48.154257 2581 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 15 04:06:48.154352 ip-10-0-128-222 kubenswrapper[2581]: E0715 04:06:48.154290 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4eaa0aee-36ae-4223-b552-73a6797c1ec1-samples-operator-tls podName:4eaa0aee-36ae-4223-b552-73a6797c1ec1 nodeName:}" failed. No retries permitted until 2026-07-15 04:06:50.154280242 +0000 UTC m=+43.681081239 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/4eaa0aee-36ae-4223-b552-73a6797c1ec1-samples-operator-tls") pod "cluster-samples-operator-65db858894-tmhmf" (UID: "4eaa0aee-36ae-4223-b552-73a6797c1ec1") : secret "samples-operator-tls" not found Jul 15 04:06:48.255851 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:48.255009 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/d8a85153-9c3e-4ef3-934d-d69f03973e3d-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-cvvj2\" (UID: \"d8a85153-9c3e-4ef3-934d-d69f03973e3d\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-cvvj2" Jul 15 04:06:48.255851 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:48.255183 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/b46dec59-62a8-45be-a415-049fa148fcdd-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-n29ck\" (UID: \"b46dec59-62a8-45be-a415-049fa148fcdd\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-n29ck" Jul 15 04:06:48.255851 ip-10-0-128-222 kubenswrapper[2581]: E0715 04:06:48.255316 2581 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 15 04:06:48.255851 ip-10-0-128-222 kubenswrapper[2581]: E0715 04:06:48.255388 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b46dec59-62a8-45be-a415-049fa148fcdd-cluster-monitoring-operator-tls podName:b46dec59-62a8-45be-a415-049fa148fcdd nodeName:}" failed. No retries permitted until 2026-07-15 04:06:50.255361744 +0000 UTC m=+43.782162739 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/b46dec59-62a8-45be-a415-049fa148fcdd-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-n29ck" (UID: "b46dec59-62a8-45be-a415-049fa148fcdd") : secret "cluster-monitoring-operator-tls" not found Jul 15 04:06:48.255851 ip-10-0-128-222 kubenswrapper[2581]: E0715 04:06:48.255454 2581 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 15 04:06:48.255851 ip-10-0-128-222 kubenswrapper[2581]: E0715 04:06:48.255489 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d8a85153-9c3e-4ef3-934d-d69f03973e3d-networking-console-plugin-cert podName:d8a85153-9c3e-4ef3-934d-d69f03973e3d nodeName:}" failed. No retries permitted until 2026-07-15 04:06:50.255478241 +0000 UTC m=+43.782279237 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/d8a85153-9c3e-4ef3-934d-d69f03973e3d-networking-console-plugin-cert") pod "networking-console-plugin-6cf856758c-cvvj2" (UID: "d8a85153-9c3e-4ef3-934d-d69f03973e3d") : secret "networking-console-plugin-cert" not found Jul 15 04:06:48.356667 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:48.356042 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d1ca6cbf-d937-4892-bc3b-ec5bb57a6734-metrics-tls\") pod \"dns-default-hvcwt\" (UID: \"d1ca6cbf-d937-4892-bc3b-ec5bb57a6734\") " pod="openshift-dns/dns-default-hvcwt" Jul 15 04:06:48.356667 ip-10-0-128-222 kubenswrapper[2581]: E0715 04:06:48.356243 2581 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 15 04:06:48.356667 ip-10-0-128-222 kubenswrapper[2581]: E0715 04:06:48.356308 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d1ca6cbf-d937-4892-bc3b-ec5bb57a6734-metrics-tls podName:d1ca6cbf-d937-4892-bc3b-ec5bb57a6734 nodeName:}" failed. No retries permitted until 2026-07-15 04:06:50.35628985 +0000 UTC m=+43.883090870 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d1ca6cbf-d937-4892-bc3b-ec5bb57a6734-metrics-tls") pod "dns-default-hvcwt" (UID: "d1ca6cbf-d937-4892-bc3b-ec5bb57a6734") : secret "dns-default-metrics-tls" not found Jul 15 04:06:50.175794 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:50.175549 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a0a40e9b-cf54-4ae2-a584-ca5cadf85733-service-ca-bundle\") pod \"router-default-64997dd578-n79tf\" (UID: \"a0a40e9b-cf54-4ae2-a584-ca5cadf85733\") " pod="openshift-ingress/router-default-64997dd578-n79tf" Jul 15 04:06:50.175794 ip-10-0-128-222 kubenswrapper[2581]: E0715 04:06:50.175736 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/a0a40e9b-cf54-4ae2-a584-ca5cadf85733-service-ca-bundle podName:a0a40e9b-cf54-4ae2-a584-ca5cadf85733 nodeName:}" failed. No retries permitted until 2026-07-15 04:06:54.1757162 +0000 UTC m=+47.702517203 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/a0a40e9b-cf54-4ae2-a584-ca5cadf85733-service-ca-bundle") pod "router-default-64997dd578-n79tf" (UID: "a0a40e9b-cf54-4ae2-a584-ca5cadf85733") : configmap references non-existent config key: service-ca.crt Jul 15 04:06:50.176345 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:50.175849 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a0a40e9b-cf54-4ae2-a584-ca5cadf85733-metrics-certs\") pod \"router-default-64997dd578-n79tf\" (UID: \"a0a40e9b-cf54-4ae2-a584-ca5cadf85733\") " pod="openshift-ingress/router-default-64997dd578-n79tf" Jul 15 04:06:50.176345 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:50.175907 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/bb386795-c0e9-4236-9b60-73ccf95c95e6-registry-tls\") pod \"image-registry-86bc794d9-k6v97\" (UID: \"bb386795-c0e9-4236-9b60-73ccf95c95e6\") " pod="openshift-image-registry/image-registry-86bc794d9-k6v97" Jul 15 04:06:50.176345 ip-10-0-128-222 kubenswrapper[2581]: E0715 04:06:50.176009 2581 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 15 04:06:50.176345 ip-10-0-128-222 kubenswrapper[2581]: E0715 04:06:50.176021 2581 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-86bc794d9-k6v97: secret "image-registry-tls" not found Jul 15 04:06:50.176345 ip-10-0-128-222 kubenswrapper[2581]: E0715 04:06:50.176018 2581 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 15 04:06:50.176345 ip-10-0-128-222 kubenswrapper[2581]: E0715 04:06:50.176083 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/bb386795-c0e9-4236-9b60-73ccf95c95e6-registry-tls podName:bb386795-c0e9-4236-9b60-73ccf95c95e6 nodeName:}" failed. No retries permitted until 2026-07-15 04:06:54.17606803 +0000 UTC m=+47.702869024 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/bb386795-c0e9-4236-9b60-73ccf95c95e6-registry-tls") pod "image-registry-86bc794d9-k6v97" (UID: "bb386795-c0e9-4236-9b60-73ccf95c95e6") : secret "image-registry-tls" not found Jul 15 04:06:50.176345 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:50.176149 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/4eaa0aee-36ae-4223-b552-73a6797c1ec1-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-tmhmf\" (UID: \"4eaa0aee-36ae-4223-b552-73a6797c1ec1\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-tmhmf" Jul 15 04:06:50.176345 ip-10-0-128-222 kubenswrapper[2581]: E0715 04:06:50.176193 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a0a40e9b-cf54-4ae2-a584-ca5cadf85733-metrics-certs podName:a0a40e9b-cf54-4ae2-a584-ca5cadf85733 nodeName:}" failed. No retries permitted until 2026-07-15 04:06:54.176175106 +0000 UTC m=+47.702976102 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a0a40e9b-cf54-4ae2-a584-ca5cadf85733-metrics-certs") pod "router-default-64997dd578-n79tf" (UID: "a0a40e9b-cf54-4ae2-a584-ca5cadf85733") : secret "router-metrics-certs-default" not found Jul 15 04:06:50.176345 ip-10-0-128-222 kubenswrapper[2581]: E0715 04:06:50.176233 2581 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 15 04:06:50.176345 ip-10-0-128-222 kubenswrapper[2581]: E0715 04:06:50.176290 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4eaa0aee-36ae-4223-b552-73a6797c1ec1-samples-operator-tls podName:4eaa0aee-36ae-4223-b552-73a6797c1ec1 nodeName:}" failed. No retries permitted until 2026-07-15 04:06:54.17627584 +0000 UTC m=+47.703076834 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/4eaa0aee-36ae-4223-b552-73a6797c1ec1-samples-operator-tls") pod "cluster-samples-operator-65db858894-tmhmf" (UID: "4eaa0aee-36ae-4223-b552-73a6797c1ec1") : secret "samples-operator-tls" not found Jul 15 04:06:50.276681 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:50.276646 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/b46dec59-62a8-45be-a415-049fa148fcdd-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-n29ck\" (UID: \"b46dec59-62a8-45be-a415-049fa148fcdd\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-n29ck" Jul 15 04:06:50.276866 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:50.276806 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/d8a85153-9c3e-4ef3-934d-d69f03973e3d-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-cvvj2\" (UID: \"d8a85153-9c3e-4ef3-934d-d69f03973e3d\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-cvvj2" Jul 15 04:06:50.276866 ip-10-0-128-222 kubenswrapper[2581]: E0715 04:06:50.276826 2581 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 15 04:06:50.276975 ip-10-0-128-222 kubenswrapper[2581]: E0715 04:06:50.276905 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b46dec59-62a8-45be-a415-049fa148fcdd-cluster-monitoring-operator-tls podName:b46dec59-62a8-45be-a415-049fa148fcdd nodeName:}" failed. No retries permitted until 2026-07-15 04:06:54.276880848 +0000 UTC m=+47.803681865 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/b46dec59-62a8-45be-a415-049fa148fcdd-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-n29ck" (UID: "b46dec59-62a8-45be-a415-049fa148fcdd") : secret "cluster-monitoring-operator-tls" not found Jul 15 04:06:50.276975 ip-10-0-128-222 kubenswrapper[2581]: E0715 04:06:50.276933 2581 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 15 04:06:50.277070 ip-10-0-128-222 kubenswrapper[2581]: E0715 04:06:50.276981 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d8a85153-9c3e-4ef3-934d-d69f03973e3d-networking-console-plugin-cert podName:d8a85153-9c3e-4ef3-934d-d69f03973e3d nodeName:}" failed. No retries permitted until 2026-07-15 04:06:54.276965718 +0000 UTC m=+47.803766720 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/d8a85153-9c3e-4ef3-934d-d69f03973e3d-networking-console-plugin-cert") pod "networking-console-plugin-6cf856758c-cvvj2" (UID: "d8a85153-9c3e-4ef3-934d-d69f03973e3d") : secret "networking-console-plugin-cert" not found Jul 15 04:06:50.378131 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:50.378092 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d1ca6cbf-d937-4892-bc3b-ec5bb57a6734-metrics-tls\") pod \"dns-default-hvcwt\" (UID: \"d1ca6cbf-d937-4892-bc3b-ec5bb57a6734\") " pod="openshift-dns/dns-default-hvcwt" Jul 15 04:06:50.378288 ip-10-0-128-222 kubenswrapper[2581]: E0715 04:06:50.378242 2581 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 15 04:06:50.378351 ip-10-0-128-222 kubenswrapper[2581]: E0715 04:06:50.378315 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d1ca6cbf-d937-4892-bc3b-ec5bb57a6734-metrics-tls podName:d1ca6cbf-d937-4892-bc3b-ec5bb57a6734 nodeName:}" failed. No retries permitted until 2026-07-15 04:06:54.37829991 +0000 UTC m=+47.905100904 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d1ca6cbf-d937-4892-bc3b-ec5bb57a6734-metrics-tls") pod "dns-default-hvcwt" (UID: "d1ca6cbf-d937-4892-bc3b-ec5bb57a6734") : secret "dns-default-metrics-tls" not found Jul 15 04:06:50.914669 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:50.914630 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:06:50.995853 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:50.995785 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:06:51.832463 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:51.832418 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:06:53.070315 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:53.070282 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:06:53.571564 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:53.571327 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:06:53.669281 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:53.669248 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:06:54.215792 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:54.215747 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/4eaa0aee-36ae-4223-b552-73a6797c1ec1-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-tmhmf\" (UID: \"4eaa0aee-36ae-4223-b552-73a6797c1ec1\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-tmhmf" Jul 15 04:06:54.216734 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:54.215861 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a0a40e9b-cf54-4ae2-a584-ca5cadf85733-service-ca-bundle\") pod \"router-default-64997dd578-n79tf\" (UID: \"a0a40e9b-cf54-4ae2-a584-ca5cadf85733\") " pod="openshift-ingress/router-default-64997dd578-n79tf" Jul 15 04:06:54.216734 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:54.215913 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a0a40e9b-cf54-4ae2-a584-ca5cadf85733-metrics-certs\") pod \"router-default-64997dd578-n79tf\" (UID: \"a0a40e9b-cf54-4ae2-a584-ca5cadf85733\") " pod="openshift-ingress/router-default-64997dd578-n79tf" Jul 15 04:06:54.216734 ip-10-0-128-222 kubenswrapper[2581]: E0715 04:06:54.215930 2581 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 15 04:06:54.216734 ip-10-0-128-222 kubenswrapper[2581]: E0715 04:06:54.216007 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4eaa0aee-36ae-4223-b552-73a6797c1ec1-samples-operator-tls podName:4eaa0aee-36ae-4223-b552-73a6797c1ec1 nodeName:}" failed. No retries permitted until 2026-07-15 04:07:02.215986932 +0000 UTC m=+55.742787931 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/4eaa0aee-36ae-4223-b552-73a6797c1ec1-samples-operator-tls") pod "cluster-samples-operator-65db858894-tmhmf" (UID: "4eaa0aee-36ae-4223-b552-73a6797c1ec1") : secret "samples-operator-tls" not found Jul 15 04:06:54.216734 ip-10-0-128-222 kubenswrapper[2581]: E0715 04:06:54.216021 2581 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 15 04:06:54.216734 ip-10-0-128-222 kubenswrapper[2581]: E0715 04:06:54.216078 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/a0a40e9b-cf54-4ae2-a584-ca5cadf85733-service-ca-bundle podName:a0a40e9b-cf54-4ae2-a584-ca5cadf85733 nodeName:}" failed. No retries permitted until 2026-07-15 04:07:02.216034129 +0000 UTC m=+55.742835134 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/a0a40e9b-cf54-4ae2-a584-ca5cadf85733-service-ca-bundle") pod "router-default-64997dd578-n79tf" (UID: "a0a40e9b-cf54-4ae2-a584-ca5cadf85733") : configmap references non-existent config key: service-ca.crt Jul 15 04:06:54.216734 ip-10-0-128-222 kubenswrapper[2581]: E0715 04:06:54.216105 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a0a40e9b-cf54-4ae2-a584-ca5cadf85733-metrics-certs podName:a0a40e9b-cf54-4ae2-a584-ca5cadf85733 nodeName:}" failed. No retries permitted until 2026-07-15 04:07:02.216093161 +0000 UTC m=+55.742894161 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a0a40e9b-cf54-4ae2-a584-ca5cadf85733-metrics-certs") pod "router-default-64997dd578-n79tf" (UID: "a0a40e9b-cf54-4ae2-a584-ca5cadf85733") : secret "router-metrics-certs-default" not found Jul 15 04:06:54.216734 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:54.216180 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/bb386795-c0e9-4236-9b60-73ccf95c95e6-registry-tls\") pod \"image-registry-86bc794d9-k6v97\" (UID: \"bb386795-c0e9-4236-9b60-73ccf95c95e6\") " pod="openshift-image-registry/image-registry-86bc794d9-k6v97" Jul 15 04:06:54.216734 ip-10-0-128-222 kubenswrapper[2581]: E0715 04:06:54.216293 2581 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 15 04:06:54.216734 ip-10-0-128-222 kubenswrapper[2581]: E0715 04:06:54.216305 2581 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-86bc794d9-k6v97: secret "image-registry-tls" not found Jul 15 04:06:54.216734 ip-10-0-128-222 kubenswrapper[2581]: E0715 04:06:54.216343 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/bb386795-c0e9-4236-9b60-73ccf95c95e6-registry-tls podName:bb386795-c0e9-4236-9b60-73ccf95c95e6 nodeName:}" failed. No retries permitted until 2026-07-15 04:07:02.216332987 +0000 UTC m=+55.743133982 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/bb386795-c0e9-4236-9b60-73ccf95c95e6-registry-tls") pod "image-registry-86bc794d9-k6v97" (UID: "bb386795-c0e9-4236-9b60-73ccf95c95e6") : secret "image-registry-tls" not found Jul 15 04:06:54.264226 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:54.263884 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-k6gt6" event={"ID":"51a3888c-8a01-4735-a6c8-fff84102b6fc","Type":"ContainerStarted","Data":"ac1cdbf47051ccee6b0ed778c82dfff3682d17ad17a9ad12733840f023297c9a"} Jul 15 04:06:54.266041 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:54.266010 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-mptrm" event={"ID":"419f1d13-f9de-4b4a-ad52-a977ee3b7ef2","Type":"ContainerStarted","Data":"51e3fb14b1aaf62e71f2cbdca979ba9259e6c167323dfc4cde70fda94fdb3aaa"} Jul 15 04:06:54.268628 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:54.268603 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-vm2mz" event={"ID":"36aa2987-b207-4dd7-9a95-a67b6b306485","Type":"ContainerStarted","Data":"24eb98b669af4dac39b4ea8790038ccb9d2e59102a7400fa1568c3db0d8d1838"} Jul 15 04:06:54.271267 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:54.271240 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-8kt5p_2db78c13-2384-4015-a886-14377224f4cd/console-operator/0.log" Jul 15 04:06:54.271357 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:54.271278 2581 generic.go:356] "Generic (PLEG): container finished" podID="2db78c13-2384-4015-a886-14377224f4cd" containerID="6b8888c031c34c3e774c4a9cf27a200fd8be7683e44d25a496e1b680438fea40" exitCode=255 Jul 15 04:06:54.271556 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:54.271536 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7866497494-8kt5p" event={"ID":"2db78c13-2384-4015-a886-14377224f4cd","Type":"ContainerDied","Data":"6b8888c031c34c3e774c4a9cf27a200fd8be7683e44d25a496e1b680438fea40"} Jul 15 04:06:54.271704 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:54.271692 2581 scope.go:117] "RemoveContainer" containerID="6b8888c031c34c3e774c4a9cf27a200fd8be7683e44d25a496e1b680438fea40" Jul 15 04:06:54.275933 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:54.275719 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-8zm4v" event={"ID":"07b2020a-a077-46ee-abe8-44454ada45a4","Type":"ContainerStarted","Data":"81935db2103bf370c4f8d1c26cf9ba8b060243b9fa1fad75ec1dff79ad6f3a3f"} Jul 15 04:06:54.281026 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:54.280983 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-k6gt6" podStartSLOduration=8.982436554 podStartE2EDuration="15.280953228s" totalImagesPullingTime="6.298516674s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 04:06:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 04:06:54.279458796 +0000 UTC m=+47.806259811" watchObservedRunningTime="2026-07-15 04:06:54.280953228 +0000 UTC m=+47.807754223" Jul 15 04:06:54.281485 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:54.281451 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-xgz4r" event={"ID":"aa52afbe-abd9-45ea-9f98-6a66b50b07b7","Type":"ContainerStarted","Data":"2b222a22a8db70f35ee5c66bd31127af3b1fef43664854058b65fbea780b1e25"} Jul 15 04:06:54.283221 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:54.283071 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-68d9dd94cf-tr2rw" event={"ID":"81a32cdd-cc66-4a2b-9d86-08b37f285ca2","Type":"ContainerStarted","Data":"9b44ecfe24af0669b7aa9aabe029e956f57f35dfab90f60fca7a8b1100eec1b2"} Jul 15 04:06:54.314314 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:54.314259 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-mptrm" podStartSLOduration=2.067173581 podStartE2EDuration="8.31424069s" totalImagesPullingTime="6.247067109s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 04:06:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 04:06:54.314157545 +0000 UTC m=+47.840958559" watchObservedRunningTime="2026-07-15 04:06:54.31424069 +0000 UTC m=+47.841041686" Jul 15 04:06:54.316709 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:54.316675 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/d8a85153-9c3e-4ef3-934d-d69f03973e3d-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-cvvj2\" (UID: \"d8a85153-9c3e-4ef3-934d-d69f03973e3d\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-cvvj2" Jul 15 04:06:54.316852 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:54.316825 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/b46dec59-62a8-45be-a415-049fa148fcdd-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-n29ck\" (UID: \"b46dec59-62a8-45be-a415-049fa148fcdd\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-n29ck" Jul 15 04:06:54.316852 ip-10-0-128-222 kubenswrapper[2581]: E0715 04:06:54.316832 2581 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 15 04:06:54.316957 ip-10-0-128-222 kubenswrapper[2581]: E0715 04:06:54.316942 2581 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 15 04:06:54.317928 ip-10-0-128-222 kubenswrapper[2581]: E0715 04:06:54.317907 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d8a85153-9c3e-4ef3-934d-d69f03973e3d-networking-console-plugin-cert podName:d8a85153-9c3e-4ef3-934d-d69f03973e3d nodeName:}" failed. No retries permitted until 2026-07-15 04:07:02.316881711 +0000 UTC m=+55.843682707 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/d8a85153-9c3e-4ef3-934d-d69f03973e3d-networking-console-plugin-cert") pod "networking-console-plugin-6cf856758c-cvvj2" (UID: "d8a85153-9c3e-4ef3-934d-d69f03973e3d") : secret "networking-console-plugin-cert" not found Jul 15 04:06:54.318061 ip-10-0-128-222 kubenswrapper[2581]: E0715 04:06:54.317942 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b46dec59-62a8-45be-a415-049fa148fcdd-cluster-monitoring-operator-tls podName:b46dec59-62a8-45be-a415-049fa148fcdd nodeName:}" failed. No retries permitted until 2026-07-15 04:07:02.317929038 +0000 UTC m=+55.844730046 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/b46dec59-62a8-45be-a415-049fa148fcdd-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-n29ck" (UID: "b46dec59-62a8-45be-a415-049fa148fcdd") : secret "cluster-monitoring-operator-tls" not found Jul 15 04:06:54.335527 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:54.335410 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-8zm4v" podStartSLOduration=9.041411907 podStartE2EDuration="15.335365417s" totalImagesPullingTime="6.29395351s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 04:06:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 04:06:54.33383239 +0000 UTC m=+47.860633409" watchObservedRunningTime="2026-07-15 04:06:54.335365417 +0000 UTC m=+47.862166433" Jul 15 04:06:54.351649 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:54.351594 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-vm2mz" podStartSLOduration=9.095676019 podStartE2EDuration="15.351571398s" totalImagesPullingTime="6.255895379s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 04:06:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 04:06:54.350541574 +0000 UTC m=+47.877342583" watchObservedRunningTime="2026-07-15 04:06:54.351571398 +0000 UTC m=+47.878372414" Jul 15 04:06:54.369583 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:54.368937 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-68d9dd94cf-tr2rw" podStartSLOduration=9.074512407 podStartE2EDuration="15.368917296s" totalImagesPullingTime="6.294404889s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 04:06:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 04:06:54.368085826 +0000 UTC m=+47.894886841" watchObservedRunningTime="2026-07-15 04:06:54.368917296 +0000 UTC m=+47.895718312" Jul 15 04:06:54.382292 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:54.380245 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:06:54.384444 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:54.384154 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-xgz4r" podStartSLOduration=9.110904255 podStartE2EDuration="15.384109513s" totalImagesPullingTime="6.273205258s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 04:06:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 04:06:54.38208209 +0000 UTC m=+47.908883106" watchObservedRunningTime="2026-07-15 04:06:54.384109513 +0000 UTC m=+47.910910529" Jul 15 04:06:54.418334 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:54.418082 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d1ca6cbf-d937-4892-bc3b-ec5bb57a6734-metrics-tls\") pod \"dns-default-hvcwt\" (UID: \"d1ca6cbf-d937-4892-bc3b-ec5bb57a6734\") " pod="openshift-dns/dns-default-hvcwt" Jul 15 04:06:54.419266 ip-10-0-128-222 kubenswrapper[2581]: E0715 04:06:54.418665 2581 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 15 04:06:54.419661 ip-10-0-128-222 kubenswrapper[2581]: E0715 04:06:54.419489 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d1ca6cbf-d937-4892-bc3b-ec5bb57a6734-metrics-tls podName:d1ca6cbf-d937-4892-bc3b-ec5bb57a6734 nodeName:}" failed. No retries permitted until 2026-07-15 04:07:02.419464287 +0000 UTC m=+55.946265288 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d1ca6cbf-d937-4892-bc3b-ec5bb57a6734-metrics-tls") pod "dns-default-hvcwt" (UID: "d1ca6cbf-d937-4892-bc3b-ec5bb57a6734") : secret "dns-default-metrics-tls" not found Jul 15 04:06:54.931636 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:54.931594 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-z49zm"] Jul 15 04:06:54.935732 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:54.935698 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-z49zm" Jul 15 04:06:54.938312 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:54.938287 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 15 04:06:54.938487 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:54.938427 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-tzsqp\"" Jul 15 04:06:54.938849 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:54.938827 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 15 04:06:54.953103 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:54.953070 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-z49zm"] Jul 15 04:06:54.999634 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:54.999601 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:06:55.073998 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:55.073951 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:06:55.129292 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:55.129254 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/7ff4b72e-814e-4fc3-bb51-80bbf1749dbf-crio-socket\") pod \"insights-runtime-extractor-z49zm\" (UID: \"7ff4b72e-814e-4fc3-bb51-80bbf1749dbf\") " pod="openshift-insights/insights-runtime-extractor-z49zm" Jul 15 04:06:55.129477 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:55.129300 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/7ff4b72e-814e-4fc3-bb51-80bbf1749dbf-data-volume\") pod \"insights-runtime-extractor-z49zm\" (UID: \"7ff4b72e-814e-4fc3-bb51-80bbf1749dbf\") " pod="openshift-insights/insights-runtime-extractor-z49zm" Jul 15 04:06:55.129477 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:55.129355 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qdzpt\" (UniqueName: \"kubernetes.io/projected/7ff4b72e-814e-4fc3-bb51-80bbf1749dbf-kube-api-access-qdzpt\") pod \"insights-runtime-extractor-z49zm\" (UID: \"7ff4b72e-814e-4fc3-bb51-80bbf1749dbf\") " pod="openshift-insights/insights-runtime-extractor-z49zm" Jul 15 04:06:55.129477 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:55.129412 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/7ff4b72e-814e-4fc3-bb51-80bbf1749dbf-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-z49zm\" (UID: \"7ff4b72e-814e-4fc3-bb51-80bbf1749dbf\") " pod="openshift-insights/insights-runtime-extractor-z49zm" Jul 15 04:06:55.129597 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:55.129495 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/7ff4b72e-814e-4fc3-bb51-80bbf1749dbf-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-z49zm\" (UID: \"7ff4b72e-814e-4fc3-bb51-80bbf1749dbf\") " pod="openshift-insights/insights-runtime-extractor-z49zm" Jul 15 04:06:55.229935 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:55.229836 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/7ff4b72e-814e-4fc3-bb51-80bbf1749dbf-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-z49zm\" (UID: \"7ff4b72e-814e-4fc3-bb51-80bbf1749dbf\") " pod="openshift-insights/insights-runtime-extractor-z49zm" Jul 15 04:06:55.229935 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:55.229918 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/7ff4b72e-814e-4fc3-bb51-80bbf1749dbf-crio-socket\") pod \"insights-runtime-extractor-z49zm\" (UID: \"7ff4b72e-814e-4fc3-bb51-80bbf1749dbf\") " pod="openshift-insights/insights-runtime-extractor-z49zm" Jul 15 04:06:55.230478 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:55.229944 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/7ff4b72e-814e-4fc3-bb51-80bbf1749dbf-data-volume\") pod \"insights-runtime-extractor-z49zm\" (UID: \"7ff4b72e-814e-4fc3-bb51-80bbf1749dbf\") " pod="openshift-insights/insights-runtime-extractor-z49zm" Jul 15 04:06:55.230478 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:55.229963 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qdzpt\" (UniqueName: \"kubernetes.io/projected/7ff4b72e-814e-4fc3-bb51-80bbf1749dbf-kube-api-access-qdzpt\") pod \"insights-runtime-extractor-z49zm\" (UID: \"7ff4b72e-814e-4fc3-bb51-80bbf1749dbf\") " pod="openshift-insights/insights-runtime-extractor-z49zm" Jul 15 04:06:55.230478 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:55.229997 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/7ff4b72e-814e-4fc3-bb51-80bbf1749dbf-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-z49zm\" (UID: \"7ff4b72e-814e-4fc3-bb51-80bbf1749dbf\") " pod="openshift-insights/insights-runtime-extractor-z49zm" Jul 15 04:06:55.230478 ip-10-0-128-222 kubenswrapper[2581]: E0715 04:06:55.230009 2581 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 15 04:06:55.230478 ip-10-0-128-222 kubenswrapper[2581]: E0715 04:06:55.230081 2581 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 15 04:06:55.230478 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:55.230204 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/7ff4b72e-814e-4fc3-bb51-80bbf1749dbf-crio-socket\") pod \"insights-runtime-extractor-z49zm\" (UID: \"7ff4b72e-814e-4fc3-bb51-80bbf1749dbf\") " pod="openshift-insights/insights-runtime-extractor-z49zm" Jul 15 04:06:55.230478 ip-10-0-128-222 kubenswrapper[2581]: E0715 04:06:55.230085 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7ff4b72e-814e-4fc3-bb51-80bbf1749dbf-insights-runtime-extractor-tls podName:7ff4b72e-814e-4fc3-bb51-80bbf1749dbf nodeName:}" failed. No retries permitted until 2026-07-15 04:06:55.730064571 +0000 UTC m=+49.256865572 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/7ff4b72e-814e-4fc3-bb51-80bbf1749dbf-insights-runtime-extractor-tls") pod "insights-runtime-extractor-z49zm" (UID: "7ff4b72e-814e-4fc3-bb51-80bbf1749dbf") : secret "insights-runtime-extractor-tls" not found Jul 15 04:06:55.230478 ip-10-0-128-222 kubenswrapper[2581]: E0715 04:06:55.230276 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/7ff4b72e-814e-4fc3-bb51-80bbf1749dbf-kube-rbac-proxy-cm podName:7ff4b72e-814e-4fc3-bb51-80bbf1749dbf nodeName:}" failed. No retries permitted until 2026-07-15 04:06:55.730257747 +0000 UTC m=+49.257058756 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/7ff4b72e-814e-4fc3-bb51-80bbf1749dbf-kube-rbac-proxy-cm") pod "insights-runtime-extractor-z49zm" (UID: "7ff4b72e-814e-4fc3-bb51-80bbf1749dbf") : configmap "kube-rbac-proxy" not found Jul 15 04:06:55.230478 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:55.230367 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/7ff4b72e-814e-4fc3-bb51-80bbf1749dbf-data-volume\") pod \"insights-runtime-extractor-z49zm\" (UID: \"7ff4b72e-814e-4fc3-bb51-80bbf1749dbf\") " pod="openshift-insights/insights-runtime-extractor-z49zm" Jul 15 04:06:55.242278 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:55.242254 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qdzpt\" (UniqueName: \"kubernetes.io/projected/7ff4b72e-814e-4fc3-bb51-80bbf1749dbf-kube-api-access-qdzpt\") pod \"insights-runtime-extractor-z49zm\" (UID: \"7ff4b72e-814e-4fc3-bb51-80bbf1749dbf\") " pod="openshift-insights/insights-runtime-extractor-z49zm" Jul 15 04:06:55.287835 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:55.287807 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-8kt5p_2db78c13-2384-4015-a886-14377224f4cd/console-operator/1.log" Jul 15 04:06:55.288286 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:55.288269 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-8kt5p_2db78c13-2384-4015-a886-14377224f4cd/console-operator/0.log" Jul 15 04:06:55.288347 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:55.288312 2581 generic.go:356] "Generic (PLEG): container finished" podID="2db78c13-2384-4015-a886-14377224f4cd" containerID="be89b6e9cdbf852e17fac6e2d53e38140ec1adff42bd6f65af9a5e86bc5e78b7" exitCode=255 Jul 15 04:06:55.288436 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:55.288416 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7866497494-8kt5p" event={"ID":"2db78c13-2384-4015-a886-14377224f4cd","Type":"ContainerDied","Data":"be89b6e9cdbf852e17fac6e2d53e38140ec1adff42bd6f65af9a5e86bc5e78b7"} Jul 15 04:06:55.288485 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:55.288473 2581 scope.go:117] "RemoveContainer" containerID="6b8888c031c34c3e774c4a9cf27a200fd8be7683e44d25a496e1b680438fea40" Jul 15 04:06:55.288813 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:55.288783 2581 scope.go:117] "RemoveContainer" containerID="be89b6e9cdbf852e17fac6e2d53e38140ec1adff42bd6f65af9a5e86bc5e78b7" Jul 15 04:06:55.288984 ip-10-0-128-222 kubenswrapper[2581]: E0715 04:06:55.288958 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-7866497494-8kt5p_openshift-console-operator(2db78c13-2384-4015-a886-14377224f4cd)\"" pod="openshift-console-operator/console-operator-7866497494-8kt5p" podUID="2db78c13-2384-4015-a886-14377224f4cd" Jul 15 04:06:55.667476 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:55.667445 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:06:55.735246 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:55.735204 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/7ff4b72e-814e-4fc3-bb51-80bbf1749dbf-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-z49zm\" (UID: \"7ff4b72e-814e-4fc3-bb51-80bbf1749dbf\") " pod="openshift-insights/insights-runtime-extractor-z49zm" Jul 15 04:06:55.736092 ip-10-0-128-222 kubenswrapper[2581]: E0715 04:06:55.735565 2581 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 15 04:06:55.736092 ip-10-0-128-222 kubenswrapper[2581]: E0715 04:06:55.735740 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7ff4b72e-814e-4fc3-bb51-80bbf1749dbf-insights-runtime-extractor-tls podName:7ff4b72e-814e-4fc3-bb51-80bbf1749dbf nodeName:}" failed. No retries permitted until 2026-07-15 04:06:56.735718846 +0000 UTC m=+50.262519843 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/7ff4b72e-814e-4fc3-bb51-80bbf1749dbf-insights-runtime-extractor-tls") pod "insights-runtime-extractor-z49zm" (UID: "7ff4b72e-814e-4fc3-bb51-80bbf1749dbf") : secret "insights-runtime-extractor-tls" not found Jul 15 04:06:55.736396 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:55.736369 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/7ff4b72e-814e-4fc3-bb51-80bbf1749dbf-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-z49zm\" (UID: \"7ff4b72e-814e-4fc3-bb51-80bbf1749dbf\") " pod="openshift-insights/insights-runtime-extractor-z49zm" Jul 15 04:06:55.736550 ip-10-0-128-222 kubenswrapper[2581]: E0715 04:06:55.736463 2581 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 15 04:06:55.736550 ip-10-0-128-222 kubenswrapper[2581]: E0715 04:06:55.736529 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/7ff4b72e-814e-4fc3-bb51-80bbf1749dbf-kube-rbac-proxy-cm podName:7ff4b72e-814e-4fc3-bb51-80bbf1749dbf nodeName:}" failed. No retries permitted until 2026-07-15 04:06:56.736512286 +0000 UTC m=+50.263313280 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/7ff4b72e-814e-4fc3-bb51-80bbf1749dbf-kube-rbac-proxy-cm") pod "insights-runtime-extractor-z49zm" (UID: "7ff4b72e-814e-4fc3-bb51-80bbf1749dbf") : configmap "kube-rbac-proxy" not found Jul 15 04:06:55.777963 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:55.777927 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:06:55.842332 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:55.842293 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:06:55.900243 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:55.900206 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:06:56.000563 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:56.000480 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:06:56.101300 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:56.101268 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:06:56.201435 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:56.201403 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:06:56.293387 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:56.293308 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-8kt5p_2db78c13-2384-4015-a886-14377224f4cd/console-operator/1.log" Jul 15 04:06:56.293746 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:56.293643 2581 scope.go:117] "RemoveContainer" containerID="be89b6e9cdbf852e17fac6e2d53e38140ec1adff42bd6f65af9a5e86bc5e78b7" Jul 15 04:06:56.293872 ip-10-0-128-222 kubenswrapper[2581]: E0715 04:06:56.293853 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-7866497494-8kt5p_openshift-console-operator(2db78c13-2384-4015-a886-14377224f4cd)\"" pod="openshift-console-operator/console-operator-7866497494-8kt5p" podUID="2db78c13-2384-4015-a886-14377224f4cd" Jul 15 04:06:56.375662 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:56.375628 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:06:56.472592 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:56.472558 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:06:56.746827 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:56.746795 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/7ff4b72e-814e-4fc3-bb51-80bbf1749dbf-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-z49zm\" (UID: \"7ff4b72e-814e-4fc3-bb51-80bbf1749dbf\") " pod="openshift-insights/insights-runtime-extractor-z49zm" Jul 15 04:06:56.746993 ip-10-0-128-222 kubenswrapper[2581]: E0715 04:06:56.746926 2581 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 15 04:06:56.746993 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:56.746975 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/7ff4b72e-814e-4fc3-bb51-80bbf1749dbf-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-z49zm\" (UID: \"7ff4b72e-814e-4fc3-bb51-80bbf1749dbf\") " pod="openshift-insights/insights-runtime-extractor-z49zm" Jul 15 04:06:56.746993 ip-10-0-128-222 kubenswrapper[2581]: E0715 04:06:56.746992 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/7ff4b72e-814e-4fc3-bb51-80bbf1749dbf-kube-rbac-proxy-cm podName:7ff4b72e-814e-4fc3-bb51-80bbf1749dbf nodeName:}" failed. No retries permitted until 2026-07-15 04:06:58.746975029 +0000 UTC m=+52.273776022 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/7ff4b72e-814e-4fc3-bb51-80bbf1749dbf-kube-rbac-proxy-cm") pod "insights-runtime-extractor-z49zm" (UID: "7ff4b72e-814e-4fc3-bb51-80bbf1749dbf") : configmap "kube-rbac-proxy" not found Jul 15 04:06:56.747116 ip-10-0-128-222 kubenswrapper[2581]: E0715 04:06:56.747062 2581 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 15 04:06:56.747116 ip-10-0-128-222 kubenswrapper[2581]: E0715 04:06:56.747111 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7ff4b72e-814e-4fc3-bb51-80bbf1749dbf-insights-runtime-extractor-tls podName:7ff4b72e-814e-4fc3-bb51-80bbf1749dbf nodeName:}" failed. No retries permitted until 2026-07-15 04:06:58.74709762 +0000 UTC m=+52.273898615 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/7ff4b72e-814e-4fc3-bb51-80bbf1749dbf-insights-runtime-extractor-tls") pod "insights-runtime-extractor-z49zm" (UID: "7ff4b72e-814e-4fc3-bb51-80bbf1749dbf") : secret "insights-runtime-extractor-tls" not found Jul 15 04:06:56.871237 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:56.871196 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-7866497494-8kt5p" Jul 15 04:06:56.871411 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:56.871291 2581 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-7866497494-8kt5p" Jul 15 04:06:57.037522 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:57.037443 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-lf5rb_e302da62-33bc-44ff-a188-8d409325e38f/dns-node-resolver/0.log" Jul 15 04:06:57.296861 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:57.296768 2581 scope.go:117] "RemoveContainer" containerID="be89b6e9cdbf852e17fac6e2d53e38140ec1adff42bd6f65af9a5e86bc5e78b7" Jul 15 04:06:57.297309 ip-10-0-128-222 kubenswrapper[2581]: E0715 04:06:57.296977 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-7866497494-8kt5p_openshift-console-operator(2db78c13-2384-4015-a886-14377224f4cd)\"" pod="openshift-console-operator/console-operator-7866497494-8kt5p" podUID="2db78c13-2384-4015-a886-14377224f4cd" Jul 15 04:06:58.008920 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:58.008882 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:06:58.039667 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:58.039638 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-9kvf6_be62ee25-74cc-4b6d-83ed-7639d75d9e0b/node-ca/0.log" Jul 15 04:06:58.551513 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:58.551480 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:06:58.650790 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:58.650759 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:06:58.766823 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:58.766779 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/7ff4b72e-814e-4fc3-bb51-80bbf1749dbf-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-z49zm\" (UID: \"7ff4b72e-814e-4fc3-bb51-80bbf1749dbf\") " pod="openshift-insights/insights-runtime-extractor-z49zm" Jul 15 04:06:58.767003 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:58.766904 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/7ff4b72e-814e-4fc3-bb51-80bbf1749dbf-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-z49zm\" (UID: \"7ff4b72e-814e-4fc3-bb51-80bbf1749dbf\") " pod="openshift-insights/insights-runtime-extractor-z49zm" Jul 15 04:06:58.767003 ip-10-0-128-222 kubenswrapper[2581]: E0715 04:06:58.766938 2581 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 15 04:06:58.767072 ip-10-0-128-222 kubenswrapper[2581]: E0715 04:06:58.767003 2581 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 15 04:06:58.767072 ip-10-0-128-222 kubenswrapper[2581]: E0715 04:06:58.767002 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7ff4b72e-814e-4fc3-bb51-80bbf1749dbf-insights-runtime-extractor-tls podName:7ff4b72e-814e-4fc3-bb51-80bbf1749dbf nodeName:}" failed. No retries permitted until 2026-07-15 04:07:02.766986894 +0000 UTC m=+56.293787888 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/7ff4b72e-814e-4fc3-bb51-80bbf1749dbf-insights-runtime-extractor-tls") pod "insights-runtime-extractor-z49zm" (UID: "7ff4b72e-814e-4fc3-bb51-80bbf1749dbf") : secret "insights-runtime-extractor-tls" not found Jul 15 04:06:58.767072 ip-10-0-128-222 kubenswrapper[2581]: E0715 04:06:58.767053 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/7ff4b72e-814e-4fc3-bb51-80bbf1749dbf-kube-rbac-proxy-cm podName:7ff4b72e-814e-4fc3-bb51-80bbf1749dbf nodeName:}" failed. No retries permitted until 2026-07-15 04:07:02.767038937 +0000 UTC m=+56.293839933 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/7ff4b72e-814e-4fc3-bb51-80bbf1749dbf-kube-rbac-proxy-cm") pod "insights-runtime-extractor-z49zm" (UID: "7ff4b72e-814e-4fc3-bb51-80bbf1749dbf") : configmap "kube-rbac-proxy" not found Jul 15 04:06:58.837682 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:58.837604 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-mptrm_419f1d13-f9de-4b4a-ad52-a977ee3b7ef2/serve-healthcheck-canary/0.log" Jul 15 04:06:58.872357 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:06:58.872325 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:07:01.417474 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:07:01.417444 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:07:02.301367 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:07:02.301325 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/4eaa0aee-36ae-4223-b552-73a6797c1ec1-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-tmhmf\" (UID: \"4eaa0aee-36ae-4223-b552-73a6797c1ec1\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-tmhmf" Jul 15 04:07:02.301557 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:07:02.301428 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a0a40e9b-cf54-4ae2-a584-ca5cadf85733-service-ca-bundle\") pod \"router-default-64997dd578-n79tf\" (UID: \"a0a40e9b-cf54-4ae2-a584-ca5cadf85733\") " pod="openshift-ingress/router-default-64997dd578-n79tf" Jul 15 04:07:02.301557 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:07:02.301467 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a0a40e9b-cf54-4ae2-a584-ca5cadf85733-metrics-certs\") pod \"router-default-64997dd578-n79tf\" (UID: \"a0a40e9b-cf54-4ae2-a584-ca5cadf85733\") " pod="openshift-ingress/router-default-64997dd578-n79tf" Jul 15 04:07:02.301557 ip-10-0-128-222 kubenswrapper[2581]: E0715 04:07:02.301472 2581 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 15 04:07:02.301557 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:07:02.301529 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/bb386795-c0e9-4236-9b60-73ccf95c95e6-registry-tls\") pod \"image-registry-86bc794d9-k6v97\" (UID: \"bb386795-c0e9-4236-9b60-73ccf95c95e6\") " pod="openshift-image-registry/image-registry-86bc794d9-k6v97" Jul 15 04:07:02.301557 ip-10-0-128-222 kubenswrapper[2581]: E0715 04:07:02.301543 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4eaa0aee-36ae-4223-b552-73a6797c1ec1-samples-operator-tls podName:4eaa0aee-36ae-4223-b552-73a6797c1ec1 nodeName:}" failed. No retries permitted until 2026-07-15 04:07:18.301527608 +0000 UTC m=+71.828328601 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/4eaa0aee-36ae-4223-b552-73a6797c1ec1-samples-operator-tls") pod "cluster-samples-operator-65db858894-tmhmf" (UID: "4eaa0aee-36ae-4223-b552-73a6797c1ec1") : secret "samples-operator-tls" not found Jul 15 04:07:02.301757 ip-10-0-128-222 kubenswrapper[2581]: E0715 04:07:02.301588 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/a0a40e9b-cf54-4ae2-a584-ca5cadf85733-service-ca-bundle podName:a0a40e9b-cf54-4ae2-a584-ca5cadf85733 nodeName:}" failed. No retries permitted until 2026-07-15 04:07:18.301571403 +0000 UTC m=+71.828372404 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/a0a40e9b-cf54-4ae2-a584-ca5cadf85733-service-ca-bundle") pod "router-default-64997dd578-n79tf" (UID: "a0a40e9b-cf54-4ae2-a584-ca5cadf85733") : configmap references non-existent config key: service-ca.crt Jul 15 04:07:02.301757 ip-10-0-128-222 kubenswrapper[2581]: E0715 04:07:02.301606 2581 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 15 04:07:02.301757 ip-10-0-128-222 kubenswrapper[2581]: E0715 04:07:02.301619 2581 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-86bc794d9-k6v97: secret "image-registry-tls" not found Jul 15 04:07:02.301757 ip-10-0-128-222 kubenswrapper[2581]: E0715 04:07:02.301639 2581 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 15 04:07:02.301757 ip-10-0-128-222 kubenswrapper[2581]: E0715 04:07:02.301658 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/bb386795-c0e9-4236-9b60-73ccf95c95e6-registry-tls podName:bb386795-c0e9-4236-9b60-73ccf95c95e6 nodeName:}" failed. No retries permitted until 2026-07-15 04:07:18.301650449 +0000 UTC m=+71.828451442 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/bb386795-c0e9-4236-9b60-73ccf95c95e6-registry-tls") pod "image-registry-86bc794d9-k6v97" (UID: "bb386795-c0e9-4236-9b60-73ccf95c95e6") : secret "image-registry-tls" not found Jul 15 04:07:02.301757 ip-10-0-128-222 kubenswrapper[2581]: E0715 04:07:02.301723 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a0a40e9b-cf54-4ae2-a584-ca5cadf85733-metrics-certs podName:a0a40e9b-cf54-4ae2-a584-ca5cadf85733 nodeName:}" failed. No retries permitted until 2026-07-15 04:07:18.301711768 +0000 UTC m=+71.828512761 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a0a40e9b-cf54-4ae2-a584-ca5cadf85733-metrics-certs") pod "router-default-64997dd578-n79tf" (UID: "a0a40e9b-cf54-4ae2-a584-ca5cadf85733") : secret "router-metrics-certs-default" not found Jul 15 04:07:02.402544 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:07:02.402504 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/d8a85153-9c3e-4ef3-934d-d69f03973e3d-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-cvvj2\" (UID: \"d8a85153-9c3e-4ef3-934d-d69f03973e3d\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-cvvj2" Jul 15 04:07:02.402758 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:07:02.402666 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/b46dec59-62a8-45be-a415-049fa148fcdd-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-n29ck\" (UID: \"b46dec59-62a8-45be-a415-049fa148fcdd\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-n29ck" Jul 15 04:07:02.402758 ip-10-0-128-222 kubenswrapper[2581]: E0715 04:07:02.402673 2581 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 15 04:07:02.402758 ip-10-0-128-222 kubenswrapper[2581]: E0715 04:07:02.402747 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d8a85153-9c3e-4ef3-934d-d69f03973e3d-networking-console-plugin-cert podName:d8a85153-9c3e-4ef3-934d-d69f03973e3d nodeName:}" failed. No retries permitted until 2026-07-15 04:07:18.402730266 +0000 UTC m=+71.929531263 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/d8a85153-9c3e-4ef3-934d-d69f03973e3d-networking-console-plugin-cert") pod "networking-console-plugin-6cf856758c-cvvj2" (UID: "d8a85153-9c3e-4ef3-934d-d69f03973e3d") : secret "networking-console-plugin-cert" not found Jul 15 04:07:02.402905 ip-10-0-128-222 kubenswrapper[2581]: E0715 04:07:02.402772 2581 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 15 04:07:02.402905 ip-10-0-128-222 kubenswrapper[2581]: E0715 04:07:02.402822 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b46dec59-62a8-45be-a415-049fa148fcdd-cluster-monitoring-operator-tls podName:b46dec59-62a8-45be-a415-049fa148fcdd nodeName:}" failed. No retries permitted until 2026-07-15 04:07:18.402806655 +0000 UTC m=+71.929607649 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/b46dec59-62a8-45be-a415-049fa148fcdd-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-n29ck" (UID: "b46dec59-62a8-45be-a415-049fa148fcdd") : secret "cluster-monitoring-operator-tls" not found Jul 15 04:07:02.454989 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:07:02.454953 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:07:02.503570 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:07:02.503529 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d1ca6cbf-d937-4892-bc3b-ec5bb57a6734-metrics-tls\") pod \"dns-default-hvcwt\" (UID: \"d1ca6cbf-d937-4892-bc3b-ec5bb57a6734\") " pod="openshift-dns/dns-default-hvcwt" Jul 15 04:07:02.503739 ip-10-0-128-222 kubenswrapper[2581]: E0715 04:07:02.503682 2581 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 15 04:07:02.503781 ip-10-0-128-222 kubenswrapper[2581]: E0715 04:07:02.503743 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d1ca6cbf-d937-4892-bc3b-ec5bb57a6734-metrics-tls podName:d1ca6cbf-d937-4892-bc3b-ec5bb57a6734 nodeName:}" failed. No retries permitted until 2026-07-15 04:07:18.503727924 +0000 UTC m=+72.030528916 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d1ca6cbf-d937-4892-bc3b-ec5bb57a6734-metrics-tls") pod "dns-default-hvcwt" (UID: "d1ca6cbf-d937-4892-bc3b-ec5bb57a6734") : secret "dns-default-metrics-tls" not found Jul 15 04:07:02.744655 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:07:02.744618 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:07:02.805938 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:07:02.805894 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/7ff4b72e-814e-4fc3-bb51-80bbf1749dbf-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-z49zm\" (UID: \"7ff4b72e-814e-4fc3-bb51-80bbf1749dbf\") " pod="openshift-insights/insights-runtime-extractor-z49zm" Jul 15 04:07:02.806116 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:07:02.806045 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/7ff4b72e-814e-4fc3-bb51-80bbf1749dbf-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-z49zm\" (UID: \"7ff4b72e-814e-4fc3-bb51-80bbf1749dbf\") " pod="openshift-insights/insights-runtime-extractor-z49zm" Jul 15 04:07:02.806116 ip-10-0-128-222 kubenswrapper[2581]: E0715 04:07:02.806051 2581 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 15 04:07:02.806272 ip-10-0-128-222 kubenswrapper[2581]: E0715 04:07:02.806150 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7ff4b72e-814e-4fc3-bb51-80bbf1749dbf-insights-runtime-extractor-tls podName:7ff4b72e-814e-4fc3-bb51-80bbf1749dbf nodeName:}" failed. No retries permitted until 2026-07-15 04:07:10.806117153 +0000 UTC m=+64.332918147 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/7ff4b72e-814e-4fc3-bb51-80bbf1749dbf-insights-runtime-extractor-tls") pod "insights-runtime-extractor-z49zm" (UID: "7ff4b72e-814e-4fc3-bb51-80bbf1749dbf") : secret "insights-runtime-extractor-tls" not found Jul 15 04:07:02.806272 ip-10-0-128-222 kubenswrapper[2581]: E0715 04:07:02.806149 2581 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 15 04:07:02.806272 ip-10-0-128-222 kubenswrapper[2581]: E0715 04:07:02.806203 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/7ff4b72e-814e-4fc3-bb51-80bbf1749dbf-kube-rbac-proxy-cm podName:7ff4b72e-814e-4fc3-bb51-80bbf1749dbf nodeName:}" failed. No retries permitted until 2026-07-15 04:07:10.806189008 +0000 UTC m=+64.332990001 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/7ff4b72e-814e-4fc3-bb51-80bbf1749dbf-kube-rbac-proxy-cm") pod "insights-runtime-extractor-z49zm" (UID: "7ff4b72e-814e-4fc3-bb51-80bbf1749dbf") : configmap "kube-rbac-proxy" not found Jul 15 04:07:02.843513 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:07:02.843480 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:07:02.945904 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:07:02.945868 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:07:03.149020 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:07:03.148984 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:07:03.945423 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:07:03.945387 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:07:04.549219 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:07:04.549186 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:07:04.747264 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:07:04.747227 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:07:04.947237 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:07:04.947209 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:07:05.143475 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:07:05.143444 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:07:05.955315 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:07:05.955280 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:07:06.145376 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:07:06.145343 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:07:06.288805 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:07:06.288728 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:07:06.559683 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:07:06.559605 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:07:06.745920 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:07:06.745889 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:07:06.944188 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:07:06.944131 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:07:07.045794 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:07:07.045764 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:07:07.350476 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:07:07.350399 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:07:07.947745 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:07:07.947715 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:07:08.048115 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:07:08.048082 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:07:08.148570 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:07:08.148541 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:07:08.249696 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:07:08.249622 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:07:08.349352 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:07:08.349324 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:07:08.549863 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:07:08.549791 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:07:08.659168 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:07:08.659102 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:07:08.944372 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:07:08.944341 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:07:09.045388 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:07:09.045358 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:07:09.098378 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:07:09.098350 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:07:09.544729 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:07:09.544698 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:07:09.984357 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:07:09.984332 2581 scope.go:117] "RemoveContainer" containerID="be89b6e9cdbf852e17fac6e2d53e38140ec1adff42bd6f65af9a5e86bc5e78b7" Jul 15 04:07:10.144094 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:07:10.144064 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:07:10.338551 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:07:10.338475 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-8kt5p_2db78c13-2384-4015-a886-14377224f4cd/console-operator/1.log" Jul 15 04:07:10.338692 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:07:10.338557 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7866497494-8kt5p" event={"ID":"2db78c13-2384-4015-a886-14377224f4cd","Type":"ContainerStarted","Data":"7f49d537a4320adc02f9e0fc70ef4e76aded907a04488af1291ae860f614fa8a"} Jul 15 04:07:10.338869 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:07:10.338842 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-7866497494-8kt5p" Jul 15 04:07:10.345351 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:07:10.345327 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:07:10.356856 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:07:10.356086 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-7866497494-8kt5p" podStartSLOduration=25.119808931 podStartE2EDuration="31.356067791s" totalImagesPullingTime="6.23625886s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 04:06:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 04:07:10.355766917 +0000 UTC m=+63.882567933" watchObservedRunningTime="2026-07-15 04:07:10.356067791 +0000 UTC m=+63.882868809" Jul 15 04:07:10.550873 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:07:10.550839 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:07:10.689024 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:07:10.688993 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-7866497494-8kt5p" Jul 15 04:07:10.796935 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:07:10.796901 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:07:10.877778 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:07:10.877742 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/7ff4b72e-814e-4fc3-bb51-80bbf1749dbf-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-z49zm\" (UID: \"7ff4b72e-814e-4fc3-bb51-80bbf1749dbf\") " pod="openshift-insights/insights-runtime-extractor-z49zm" Jul 15 04:07:10.877965 ip-10-0-128-222 kubenswrapper[2581]: E0715 04:07:10.877905 2581 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 15 04:07:10.878007 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:07:10.877960 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/7ff4b72e-814e-4fc3-bb51-80bbf1749dbf-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-z49zm\" (UID: \"7ff4b72e-814e-4fc3-bb51-80bbf1749dbf\") " pod="openshift-insights/insights-runtime-extractor-z49zm" Jul 15 04:07:10.878007 ip-10-0-128-222 kubenswrapper[2581]: E0715 04:07:10.877974 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7ff4b72e-814e-4fc3-bb51-80bbf1749dbf-insights-runtime-extractor-tls podName:7ff4b72e-814e-4fc3-bb51-80bbf1749dbf nodeName:}" failed. No retries permitted until 2026-07-15 04:07:26.877958315 +0000 UTC m=+80.404759308 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/7ff4b72e-814e-4fc3-bb51-80bbf1749dbf-insights-runtime-extractor-tls") pod "insights-runtime-extractor-z49zm" (UID: "7ff4b72e-814e-4fc3-bb51-80bbf1749dbf") : secret "insights-runtime-extractor-tls" not found Jul 15 04:07:10.878431 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:07:10.878414 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/7ff4b72e-814e-4fc3-bb51-80bbf1749dbf-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-z49zm\" (UID: \"7ff4b72e-814e-4fc3-bb51-80bbf1749dbf\") " pod="openshift-insights/insights-runtime-extractor-z49zm" Jul 15 04:07:10.897025 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:07:10.896990 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:07:10.997306 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:07:10.997229 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:07:11.051382 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:07:11.051355 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:07:11.163740 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:07:11.163709 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:07:11.341844 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:07:11.341759 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:07:11.440961 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:07:11.440930 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:07:11.544093 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:07:11.544060 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:07:11.594980 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:07:11.594890 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:07:11.685961 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:07:11.685927 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sxbbk\" (UniqueName: \"kubernetes.io/projected/5ac0aab6-1358-45d2-b257-eda461fc95da-kube-api-access-sxbbk\") pod \"network-check-target-4n42z\" (UID: \"5ac0aab6-1358-45d2-b257-eda461fc95da\") " pod="openshift-network-diagnostics/network-check-target-4n42z" Jul 15 04:07:11.686170 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:07:11.685981 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6616446d-4bdb-4867-a2f8-c39ed74908b9-original-pull-secret\") pod \"global-pull-secret-syncer-kz7p2\" (UID: \"6616446d-4bdb-4867-a2f8-c39ed74908b9\") " pod="kube-system/global-pull-secret-syncer-kz7p2" Jul 15 04:07:11.686247 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:07:11.686163 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5b46708f-6444-44fc-8274-3921be1c13c7-metrics-certs\") pod \"network-metrics-daemon-2jvh6\" (UID: \"5b46708f-6444-44fc-8274-3921be1c13c7\") " pod="openshift-multus/network-metrics-daemon-2jvh6" Jul 15 04:07:11.688369 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:07:11.688340 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 15 04:07:11.688485 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:07:11.688370 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 15 04:07:11.689324 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:07:11.689306 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sxbbk\" (UniqueName: \"kubernetes.io/projected/5ac0aab6-1358-45d2-b257-eda461fc95da-kube-api-access-sxbbk\") pod \"network-check-target-4n42z\" (UID: \"5ac0aab6-1358-45d2-b257-eda461fc95da\") " pod="openshift-network-diagnostics/network-check-target-4n42z" Jul 15 04:07:11.698861 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:07:11.698832 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5b46708f-6444-44fc-8274-3921be1c13c7-metrics-certs\") pod \"network-metrics-daemon-2jvh6\" (UID: \"5b46708f-6444-44fc-8274-3921be1c13c7\") " pod="openshift-multus/network-metrics-daemon-2jvh6" Jul 15 04:07:11.698970 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:07:11.698948 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6616446d-4bdb-4867-a2f8-c39ed74908b9-original-pull-secret\") pod \"global-pull-secret-syncer-kz7p2\" (UID: \"6616446d-4bdb-4867-a2f8-c39ed74908b9\") " pod="kube-system/global-pull-secret-syncer-kz7p2" Jul 15 04:07:11.741897 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:07:11.741860 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:07:11.840584 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:07:11.840552 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:07:11.909888 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:07:11.909860 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-nc2gd\"" Jul 15 04:07:11.917692 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:07:11.917662 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kz7p2" Jul 15 04:07:11.918712 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:07:11.918696 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4n42z" Jul 15 04:07:11.941663 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:07:11.941637 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-8rjwx\"" Jul 15 04:07:11.950385 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:07:11.950368 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2jvh6" Jul 15 04:07:11.953451 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:07:11.953401 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:07:12.095529 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:07:12.095496 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-kz7p2"] Jul 15 04:07:12.099252 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:07:12.099208 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6616446d_4bdb_4867_a2f8_c39ed74908b9.slice/crio-43f31de9b490ca2287c531c4e7d92feeb8868bb277e219b7be0373c9e2b9de52 WatchSource:0}: Error finding container 43f31de9b490ca2287c531c4e7d92feeb8868bb277e219b7be0373c9e2b9de52: Status 404 returned error can't find the container with id 43f31de9b490ca2287c531c4e7d92feeb8868bb277e219b7be0373c9e2b9de52 Jul 15 04:07:12.121514 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:07:12.121489 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-4n42z"] Jul 15 04:07:12.123619 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:07:12.123588 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5ac0aab6_1358_45d2_b257_eda461fc95da.slice/crio-d1c0eeff468727ef9e84fae7224680b61410efcf3a717bc1f9d2e39385dda7c9 WatchSource:0}: Error finding container d1c0eeff468727ef9e84fae7224680b61410efcf3a717bc1f9d2e39385dda7c9: Status 404 returned error can't find the container with id d1c0eeff468727ef9e84fae7224680b61410efcf3a717bc1f9d2e39385dda7c9 Jul 15 04:07:12.143686 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:07:12.143654 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-2jvh6"] Jul 15 04:07:12.146727 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:07:12.146698 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5b46708f_6444_44fc_8274_3921be1c13c7.slice/crio-b480c74418ceb5ecd6dd7d39f90b827fe31f942fab39b4b7f8ba8b011818398d WatchSource:0}: Error finding container b480c74418ceb5ecd6dd7d39f90b827fe31f942fab39b4b7f8ba8b011818398d: Status 404 returned error can't find the container with id b480c74418ceb5ecd6dd7d39f90b827fe31f942fab39b4b7f8ba8b011818398d Jul 15 04:07:12.228985 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:07:12.228961 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-x6lg7" Jul 15 04:07:12.346671 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:07:12.346629 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-2jvh6" event={"ID":"5b46708f-6444-44fc-8274-3921be1c13c7","Type":"ContainerStarted","Data":"b480c74418ceb5ecd6dd7d39f90b827fe31f942fab39b4b7f8ba8b011818398d"} Jul 15 04:07:12.347993 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:07:12.347969 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-4n42z" event={"ID":"5ac0aab6-1358-45d2-b257-eda461fc95da","Type":"ContainerStarted","Data":"6ae77f8f01346627197d77e178eed940ae6f9e721b7bd1d049c6896f502f38aa"} Jul 15 04:07:12.348102 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:07:12.348008 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-4n42z" event={"ID":"5ac0aab6-1358-45d2-b257-eda461fc95da","Type":"ContainerStarted","Data":"d1c0eeff468727ef9e84fae7224680b61410efcf3a717bc1f9d2e39385dda7c9"} Jul 15 04:07:12.348102 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:07:12.348045 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-4n42z" Jul 15 04:07:12.349171 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:07:12.349139 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:07:12.349171 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:07:12.349157 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-kz7p2" event={"ID":"6616446d-4bdb-4867-a2f8-c39ed74908b9","Type":"ContainerStarted","Data":"43f31de9b490ca2287c531c4e7d92feeb8868bb277e219b7be0373c9e2b9de52"} Jul 15 04:07:12.362586 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:07:12.362532 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-4n42z" podStartSLOduration=65.362515908 podStartE2EDuration="1m5.362515908s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 04:06:07 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 04:07:12.361428622 +0000 UTC m=+65.888229651" watchObservedRunningTime="2026-07-15 04:07:12.362515908 +0000 UTC m=+65.889316923" Jul 15 04:07:12.554179 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:07:12.554078 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:07:12.751114 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:07:12.751057 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:07:12.945956 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:07:12.945873 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:07:13.041953 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:07:13.041919 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:07:13.145640 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:07:13.145601 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:07:13.363231 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:07:13.363197 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:07:13.542183 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:07:13.542148 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:07:14.362950 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:07:14.362907 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-2jvh6" event={"ID":"5b46708f-6444-44fc-8274-3921be1c13c7","Type":"ContainerStarted","Data":"798ced66d544fafe128c52dff9139628e3e1dc5187de8c396ace8a3248c556f8"} Jul 15 04:07:14.363155 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:07:14.363013 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-2jvh6" event={"ID":"5b46708f-6444-44fc-8274-3921be1c13c7","Type":"ContainerStarted","Data":"2aa97f77e1981a657641d53d41ba1ea994855556f3cc87a2e5c993ce321bd23a"} Jul 15 04:07:14.379706 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:07:14.379649 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-2jvh6" podStartSLOduration=65.759805715 podStartE2EDuration="1m7.379633016s" totalImagesPullingTime="1.619827301s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 04:06:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 04:07:14.378158969 +0000 UTC m=+67.904959985" watchObservedRunningTime="2026-07-15 04:07:14.379633016 +0000 UTC m=+67.906434030" Jul 15 04:07:17.376183 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:07:17.376139 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-kz7p2" event={"ID":"6616446d-4bdb-4867-a2f8-c39ed74908b9","Type":"ContainerStarted","Data":"0bc537fb4c905357ed50e5866281ebb32a9c0c497c838972f4eceb01e0c21df0"} Jul 15 04:07:17.390111 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:07:17.390057 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-kz7p2" podStartSLOduration=64.569997312 podStartE2EDuration="1m9.39003591s" totalImagesPullingTime="4.820038598s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 04:06:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 04:07:17.389446917 +0000 UTC m=+70.916247970" watchObservedRunningTime="2026-07-15 04:07:17.39003591 +0000 UTC m=+70.916836930" Jul 15 04:07:18.345080 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:07:18.345027 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/bb386795-c0e9-4236-9b60-73ccf95c95e6-registry-tls\") pod \"image-registry-86bc794d9-k6v97\" (UID: \"bb386795-c0e9-4236-9b60-73ccf95c95e6\") " pod="openshift-image-registry/image-registry-86bc794d9-k6v97" Jul 15 04:07:18.345322 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:07:18.345102 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/4eaa0aee-36ae-4223-b552-73a6797c1ec1-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-tmhmf\" (UID: \"4eaa0aee-36ae-4223-b552-73a6797c1ec1\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-tmhmf" Jul 15 04:07:18.345322 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:07:18.345180 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a0a40e9b-cf54-4ae2-a584-ca5cadf85733-service-ca-bundle\") pod \"router-default-64997dd578-n79tf\" (UID: \"a0a40e9b-cf54-4ae2-a584-ca5cadf85733\") " pod="openshift-ingress/router-default-64997dd578-n79tf" Jul 15 04:07:18.345322 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:07:18.345214 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a0a40e9b-cf54-4ae2-a584-ca5cadf85733-metrics-certs\") pod \"router-default-64997dd578-n79tf\" (UID: \"a0a40e9b-cf54-4ae2-a584-ca5cadf85733\") " pod="openshift-ingress/router-default-64997dd578-n79tf" Jul 15 04:07:18.345809 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:07:18.345783 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a0a40e9b-cf54-4ae2-a584-ca5cadf85733-service-ca-bundle\") pod \"router-default-64997dd578-n79tf\" (UID: \"a0a40e9b-cf54-4ae2-a584-ca5cadf85733\") " pod="openshift-ingress/router-default-64997dd578-n79tf" Jul 15 04:07:18.347632 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:07:18.347607 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a0a40e9b-cf54-4ae2-a584-ca5cadf85733-metrics-certs\") pod \"router-default-64997dd578-n79tf\" (UID: \"a0a40e9b-cf54-4ae2-a584-ca5cadf85733\") " pod="openshift-ingress/router-default-64997dd578-n79tf" Jul 15 04:07:18.347728 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:07:18.347687 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/bb386795-c0e9-4236-9b60-73ccf95c95e6-registry-tls\") pod \"image-registry-86bc794d9-k6v97\" (UID: \"bb386795-c0e9-4236-9b60-73ccf95c95e6\") " pod="openshift-image-registry/image-registry-86bc794d9-k6v97" Jul 15 04:07:18.347728 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:07:18.347687 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/4eaa0aee-36ae-4223-b552-73a6797c1ec1-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-tmhmf\" (UID: \"4eaa0aee-36ae-4223-b552-73a6797c1ec1\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-tmhmf" Jul 15 04:07:18.445803 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:07:18.445746 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/d8a85153-9c3e-4ef3-934d-d69f03973e3d-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-cvvj2\" (UID: \"d8a85153-9c3e-4ef3-934d-d69f03973e3d\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-cvvj2" Jul 15 04:07:18.446324 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:07:18.445866 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/b46dec59-62a8-45be-a415-049fa148fcdd-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-n29ck\" (UID: \"b46dec59-62a8-45be-a415-049fa148fcdd\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-n29ck" Jul 15 04:07:18.451030 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:07:18.451002 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/d8a85153-9c3e-4ef3-934d-d69f03973e3d-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-cvvj2\" (UID: \"d8a85153-9c3e-4ef3-934d-d69f03973e3d\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-cvvj2" Jul 15 04:07:18.451189 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:07:18.451062 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/b46dec59-62a8-45be-a415-049fa148fcdd-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-n29ck\" (UID: \"b46dec59-62a8-45be-a415-049fa148fcdd\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-n29ck" Jul 15 04:07:18.511698 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:07:18.511665 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-tbr5d\"" Jul 15 04:07:18.519631 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:07:18.519603 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-64997dd578-n79tf" Jul 15 04:07:18.535463 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:07:18.535435 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-r7tdt\"" Jul 15 04:07:18.543379 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:07:18.543357 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-86bc794d9-k6v97" Jul 15 04:07:18.546946 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:07:18.546917 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d1ca6cbf-d937-4892-bc3b-ec5bb57a6734-metrics-tls\") pod \"dns-default-hvcwt\" (UID: \"d1ca6cbf-d937-4892-bc3b-ec5bb57a6734\") " pod="openshift-dns/dns-default-hvcwt" Jul 15 04:07:18.549383 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:07:18.549355 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d1ca6cbf-d937-4892-bc3b-ec5bb57a6734-metrics-tls\") pod \"dns-default-hvcwt\" (UID: \"d1ca6cbf-d937-4892-bc3b-ec5bb57a6734\") " pod="openshift-dns/dns-default-hvcwt" Jul 15 04:07:18.559430 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:07:18.559396 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-vvc6p\"" Jul 15 04:07:18.567835 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:07:18.567577 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-tmhmf" Jul 15 04:07:18.590678 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:07:18.590652 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-w46z7\"" Jul 15 04:07:18.599593 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:07:18.599140 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-n29ck" Jul 15 04:07:18.652976 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:07:18.652940 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-kg9jl\"" Jul 15 04:07:18.662544 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:07:18.662083 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6cf856758c-cvvj2" Jul 15 04:07:18.690166 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:07:18.689961 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-64997dd578-n79tf"] Jul 15 04:07:18.696045 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:07:18.696011 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda0a40e9b_cf54_4ae2_a584_ca5cadf85733.slice/crio-9ecbf723e2061884775c99d330735727ed7603c21aac6af1b405e4691d91542b WatchSource:0}: Error finding container 9ecbf723e2061884775c99d330735727ed7603c21aac6af1b405e4691d91542b: Status 404 returned error can't find the container with id 9ecbf723e2061884775c99d330735727ed7603c21aac6af1b405e4691d91542b Jul 15 04:07:18.732754 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:07:18.732055 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-2wv7r\"" Jul 15 04:07:18.740658 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:07:18.739022 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-86bc794d9-k6v97"] Jul 15 04:07:18.740805 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:07:18.740760 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-hvcwt" Jul 15 04:07:18.746964 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:07:18.746388 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbb386795_c0e9_4236_9b60_73ccf95c95e6.slice/crio-f620b13b97410e7fbdf306a8d5254df13859c83545fcc4e67b9c8501c19f8096 WatchSource:0}: Error finding container f620b13b97410e7fbdf306a8d5254df13859c83545fcc4e67b9c8501c19f8096: Status 404 returned error can't find the container with id f620b13b97410e7fbdf306a8d5254df13859c83545fcc4e67b9c8501c19f8096 Jul 15 04:07:18.761138 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:07:18.761099 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-65db858894-tmhmf"] Jul 15 04:07:18.816297 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:07:18.816142 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-n29ck"] Jul 15 04:07:18.828079 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:07:18.827258 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb46dec59_62a8_45be_a415_049fa148fcdd.slice/crio-08fa2fb9270e5c55753e4c506282126c06a946eb0c178e1446dec72680168102 WatchSource:0}: Error finding container 08fa2fb9270e5c55753e4c506282126c06a946eb0c178e1446dec72680168102: Status 404 returned error can't find the container with id 08fa2fb9270e5c55753e4c506282126c06a946eb0c178e1446dec72680168102 Jul 15 04:07:18.849956 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:07:18.849927 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-6cf856758c-cvvj2"] Jul 15 04:07:18.852863 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:07:18.852836 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd8a85153_9c3e_4ef3_934d_d69f03973e3d.slice/crio-0ade136e802ea24ffdc62d90aa42fcc0587e4525d69228313fa15b205ee1536c WatchSource:0}: Error finding container 0ade136e802ea24ffdc62d90aa42fcc0587e4525d69228313fa15b205ee1536c: Status 404 returned error can't find the container with id 0ade136e802ea24ffdc62d90aa42fcc0587e4525d69228313fa15b205ee1536c Jul 15 04:07:18.913851 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:07:18.913694 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-hvcwt"] Jul 15 04:07:18.916416 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:07:18.916390 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd1ca6cbf_d937_4892_bc3b_ec5bb57a6734.slice/crio-18b007601af90891c1953861dc67cfb09290faddd5f368194b08941e8e098b26 WatchSource:0}: Error finding container 18b007601af90891c1953861dc67cfb09290faddd5f368194b08941e8e098b26: Status 404 returned error can't find the container with id 18b007601af90891c1953861dc67cfb09290faddd5f368194b08941e8e098b26 Jul 15 04:07:19.043386 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:07:19.043347 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:07:19.140734 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:07:19.140699 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:07:19.240448 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:07:19.240418 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:07:19.342724 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:07:19.342683 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:07:19.388756 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:07:19.388720 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-n29ck" event={"ID":"b46dec59-62a8-45be-a415-049fa148fcdd","Type":"ContainerStarted","Data":"08fa2fb9270e5c55753e4c506282126c06a946eb0c178e1446dec72680168102"} Jul 15 04:07:19.390056 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:07:19.390024 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-tmhmf" event={"ID":"4eaa0aee-36ae-4223-b552-73a6797c1ec1","Type":"ContainerStarted","Data":"d9a57db2bbaf698158992aa356e67ff66282f36267f76231ada136faab447d66"} Jul 15 04:07:19.391241 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:07:19.391175 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-hvcwt" event={"ID":"d1ca6cbf-d937-4892-bc3b-ec5bb57a6734","Type":"ContainerStarted","Data":"18b007601af90891c1953861dc67cfb09290faddd5f368194b08941e8e098b26"} Jul 15 04:07:19.392351 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:07:19.392326 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-6cf856758c-cvvj2" event={"ID":"d8a85153-9c3e-4ef3-934d-d69f03973e3d","Type":"ContainerStarted","Data":"0ade136e802ea24ffdc62d90aa42fcc0587e4525d69228313fa15b205ee1536c"} Jul 15 04:07:19.393937 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:07:19.393914 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-86bc794d9-k6v97" event={"ID":"bb386795-c0e9-4236-9b60-73ccf95c95e6","Type":"ContainerStarted","Data":"97a20b043f4587de8f7b3c9b60dbb396cc57a2d022585eedbf768ffd019d44e9"} Jul 15 04:07:19.394067 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:07:19.393953 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-86bc794d9-k6v97" event={"ID":"bb386795-c0e9-4236-9b60-73ccf95c95e6","Type":"ContainerStarted","Data":"f620b13b97410e7fbdf306a8d5254df13859c83545fcc4e67b9c8501c19f8096"} Jul 15 04:07:19.394157 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:07:19.394106 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-86bc794d9-k6v97" Jul 15 04:07:19.395617 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:07:19.395591 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-64997dd578-n79tf" event={"ID":"a0a40e9b-cf54-4ae2-a584-ca5cadf85733","Type":"ContainerStarted","Data":"4f63ab35a358c52de1d67247ba7f63bf85ec228ca716668c43d18d7f5dd17f40"} Jul 15 04:07:19.395736 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:07:19.395661 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-64997dd578-n79tf" event={"ID":"a0a40e9b-cf54-4ae2-a584-ca5cadf85733","Type":"ContainerStarted","Data":"9ecbf723e2061884775c99d330735727ed7603c21aac6af1b405e4691d91542b"} Jul 15 04:07:19.416078 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:07:19.416018 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-86bc794d9-k6v97" podStartSLOduration=71.415995959 podStartE2EDuration="1m11.415995959s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 04:06:08 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 04:07:19.41506213 +0000 UTC m=+72.941863149" watchObservedRunningTime="2026-07-15 04:07:19.415995959 +0000 UTC m=+72.942796957" Jul 15 04:07:19.419418 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:07:19.419292 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:07:19.436229 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:07:19.435026 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-64997dd578-n79tf" podStartSLOduration=40.435003621 podStartE2EDuration="40.435003621s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 04:06:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 04:07:19.434536814 +0000 UTC m=+72.961337830" watchObservedRunningTime="2026-07-15 04:07:19.435003621 +0000 UTC m=+72.961804638" Jul 15 04:07:19.520353 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:07:19.520292 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-64997dd578-n79tf" Jul 15 04:07:19.523598 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:07:19.523565 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-64997dd578-n79tf" Jul 15 04:07:20.171854 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:07:20.171780 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:07:20.225731 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:07:20.225634 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:07:20.400414 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:07:20.400336 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-64997dd578-n79tf" Jul 15 04:07:20.401531 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:07:20.401499 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-64997dd578-n79tf" Jul 15 04:07:22.112215 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:07:22.112186 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:07:22.206247 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:07:22.206215 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:07:22.269451 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:07:22.269424 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:07:22.409672 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:07:22.409582 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-tmhmf" event={"ID":"4eaa0aee-36ae-4223-b552-73a6797c1ec1","Type":"ContainerStarted","Data":"e3b5ed67d30428ed185ec4db46f6f07f81172f20b74b9304a5a5af8cdaafe6b6"} Jul 15 04:07:22.409853 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:07:22.409685 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-tmhmf" event={"ID":"4eaa0aee-36ae-4223-b552-73a6797c1ec1","Type":"ContainerStarted","Data":"417c4b384274cb66cd43fcc640e34492552d895137f6fa4cb042bb9a57d04235"} Jul 15 04:07:22.411334 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:07:22.411305 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-hvcwt" event={"ID":"d1ca6cbf-d937-4892-bc3b-ec5bb57a6734","Type":"ContainerStarted","Data":"2e10696c7539d3be35921976d8a6345f708c64384a23f1115a80db1b03f6adc5"} Jul 15 04:07:22.411460 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:07:22.411356 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-hvcwt" Jul 15 04:07:22.411460 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:07:22.411373 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-hvcwt" event={"ID":"d1ca6cbf-d937-4892-bc3b-ec5bb57a6734","Type":"ContainerStarted","Data":"500f1d92fc2c42b6291a6c17e8bde372eeb9370730a545af058954e400a8799b"} Jul 15 04:07:22.412939 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:07:22.412908 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-6cf856758c-cvvj2" event={"ID":"d8a85153-9c3e-4ef3-934d-d69f03973e3d","Type":"ContainerStarted","Data":"f0bc2281ae9af2011a7a0a7d536198ca7e6658c7c8731905ffb5bfe95d47e4a6"} Jul 15 04:07:22.414401 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:07:22.414379 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-n29ck" event={"ID":"b46dec59-62a8-45be-a415-049fa148fcdd","Type":"ContainerStarted","Data":"e0721454b346839d12b1e8531930992b75b8e17d59757d6849c4b48edc17d1b2"} Jul 15 04:07:22.424979 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:07:22.424933 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-tmhmf" podStartSLOduration=40.519715618 podStartE2EDuration="43.424919232s" totalImagesPullingTime="2.905203614s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 04:06:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 04:07:22.423321991 +0000 UTC m=+75.950123021" watchObservedRunningTime="2026-07-15 04:07:22.424919232 +0000 UTC m=+75.951720247" Jul 15 04:07:22.437789 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:07:22.437743 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-6cf856758c-cvvj2" podStartSLOduration=40.567277687 podStartE2EDuration="43.437730035s" totalImagesPullingTime="2.870452348s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 04:06:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 04:07:22.436811791 +0000 UTC m=+75.963612807" watchObservedRunningTime="2026-07-15 04:07:22.437730035 +0000 UTC m=+75.964531053" Jul 15 04:07:22.455976 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:07:22.455899 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-n29ck" podStartSLOduration=40.55624589 podStartE2EDuration="43.455882024s" totalImagesPullingTime="2.899636134s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 04:06:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 04:07:22.454610339 +0000 UTC m=+75.981411356" watchObservedRunningTime="2026-07-15 04:07:22.455882024 +0000 UTC m=+75.982683039" Jul 15 04:07:22.475854 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:07:22.475801 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-hvcwt" podStartSLOduration=33.663664194 podStartE2EDuration="36.475777787s" totalImagesPullingTime="2.812113593s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 04:06:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 04:07:22.474650177 +0000 UTC m=+76.001451223" watchObservedRunningTime="2026-07-15 04:07:22.475777787 +0000 UTC m=+76.002578806" Jul 15 04:07:22.527174 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:07:22.527138 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:07:22.625388 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:07:22.625353 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:07:22.678737 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:07:22.678659 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:07:24.383163 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:07:24.383108 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:07:24.456751 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:07:24.456719 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:07:26.376302 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:07:26.376270 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:07:26.922661 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:07:26.922631 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/7ff4b72e-814e-4fc3-bb51-80bbf1749dbf-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-z49zm\" (UID: \"7ff4b72e-814e-4fc3-bb51-80bbf1749dbf\") " pod="openshift-insights/insights-runtime-extractor-z49zm" Jul 15 04:07:26.924938 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:07:26.924906 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/7ff4b72e-814e-4fc3-bb51-80bbf1749dbf-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-z49zm\" (UID: \"7ff4b72e-814e-4fc3-bb51-80bbf1749dbf\") " pod="openshift-insights/insights-runtime-extractor-z49zm" Jul 15 04:07:27.048374 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:07:27.048339 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-tzsqp\"" Jul 15 04:07:27.056354 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:07:27.056330 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-z49zm" Jul 15 04:07:27.183818 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:07:27.183619 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-z49zm"] Jul 15 04:07:27.186312 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:07:27.186286 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7ff4b72e_814e_4fc3_bb51_80bbf1749dbf.slice/crio-c711287eba99a17faff4da69b9ea39702b496efea8249e3054f08ed1154dfa8a WatchSource:0}: Error finding container c711287eba99a17faff4da69b9ea39702b496efea8249e3054f08ed1154dfa8a: Status 404 returned error can't find the container with id c711287eba99a17faff4da69b9ea39702b496efea8249e3054f08ed1154dfa8a Jul 15 04:07:27.432074 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:07:27.432039 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-z49zm" event={"ID":"7ff4b72e-814e-4fc3-bb51-80bbf1749dbf","Type":"ContainerStarted","Data":"c711287eba99a17faff4da69b9ea39702b496efea8249e3054f08ed1154dfa8a"} Jul 15 04:07:28.291597 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:07:28.291554 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:07:28.361179 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:07:28.361006 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:07:28.414551 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:07:28.414513 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:07:29.172996 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:07:29.172953 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:07:29.237903 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:07:29.237844 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:07:31.447934 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:07:31.447897 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-z49zm" event={"ID":"7ff4b72e-814e-4fc3-bb51-80bbf1749dbf","Type":"ContainerStarted","Data":"4b675ae8d7fb7723578e2ec6862f884982476700f524e784fb9202e46c6d7c19"} Jul 15 04:07:32.382577 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:07:32.382546 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:07:32.420607 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:07:32.420575 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-hvcwt" Jul 15 04:07:32.439764 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:07:32.439738 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:07:32.453660 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:07:32.453631 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-z49zm" event={"ID":"7ff4b72e-814e-4fc3-bb51-80bbf1749dbf","Type":"ContainerStarted","Data":"4cb912e6b8807e99fe52bc042d3151e9cb698b81a4cabda6d20252f5be0ba356"} Jul 15 04:07:35.467678 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:07:35.467638 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-z49zm" event={"ID":"7ff4b72e-814e-4fc3-bb51-80bbf1749dbf","Type":"ContainerStarted","Data":"ee6c1d0e6031164af2e44cb0199332379bd460e25b6c9652593519a3c2b046a4"} Jul 15 04:07:35.484273 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:07:35.484222 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-z49zm" podStartSLOduration=34.206833627 podStartE2EDuration="41.484201597s" totalImagesPullingTime="7.27736797s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 04:06:54 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 04:07:35.482891643 +0000 UTC m=+89.009692684" watchObservedRunningTime="2026-07-15 04:07:35.484201597 +0000 UTC m=+89.011002611" Jul 15 04:07:37.769208 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:07:37.769172 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:07:37.833449 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:07:37.833419 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:07:38.547556 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:07:38.547515 2581 patch_prober.go:28] interesting pod/image-registry-86bc794d9-k6v97 container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jul 15 04:07:38.547704 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:07:38.547574 2581 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-86bc794d9-k6v97" podUID="bb386795-c0e9-4236-9b60-73ccf95c95e6" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 15 04:07:39.376074 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:07:39.376038 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:07:39.986811 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:07:39.986777 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:07:40.041498 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:07:40.041468 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:07:40.404195 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:07:40.404168 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-86bc794d9-k6v97" Jul 15 04:07:40.560501 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:07:40.560471 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:07:40.661454 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:07:40.661381 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:07:40.713694 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:07:40.713663 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:07:41.532596 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:07:41.532565 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:07:41.596576 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:07:41.596543 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:07:42.418693 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:07:42.418662 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:07:42.627932 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:07:42.627897 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:07:42.652052 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:07:42.652017 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-84bd68b896-7pv89"] Jul 15 04:07:42.654814 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:07:42.654793 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-785778ff74-bnbjl"] Jul 15 04:07:42.654958 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:07:42.654939 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-7pv89" Jul 15 04:07:42.656965 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:07:42.656947 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-785778ff74-bnbjl" Jul 15 04:07:42.657597 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:07:42.657576 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\"" Jul 15 04:07:42.657836 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:07:42.657818 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\"" Jul 15 04:07:42.657895 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:07:42.657859 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 15 04:07:42.658313 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:07:42.658294 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-r8zmg\"" Jul 15 04:07:42.659396 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:07:42.659362 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\"" Jul 15 04:07:42.659558 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:07:42.659430 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\"" Jul 15 04:07:42.659558 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:07:42.659458 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-2nfkh\"" Jul 15 04:07:42.659728 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:07:42.659711 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\"" Jul 15 04:07:42.667387 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:07:42.667367 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-84bd68b896-7pv89"] Jul 15 04:07:42.669029 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:07:42.668982 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-785778ff74-bnbjl"] Jul 15 04:07:42.688864 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:07:42.688838 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-4jt5z"] Jul 15 04:07:42.691145 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:07:42.691111 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-4jt5z" Jul 15 04:07:42.693259 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:07:42.693238 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-5l45x\"" Jul 15 04:07:42.693381 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:07:42.693239 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 15 04:07:42.693381 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:07:42.693281 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 15 04:07:42.693381 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:07:42.693305 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 15 04:07:42.713029 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:07:42.713000 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:07:42.739469 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:07:42.739443 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/c1adb7b7-2826-4431-b154-636573627417-kube-state-metrics-tls\") pod \"kube-state-metrics-785778ff74-bnbjl\" (UID: \"c1adb7b7-2826-4431-b154-636573627417\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-bnbjl" Jul 15 04:07:42.739603 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:07:42.739471 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/03d9ee76-91a7-40fd-8200-c16c2aa5d6f3-node-exporter-textfile\") pod \"node-exporter-4jt5z\" (UID: \"03d9ee76-91a7-40fd-8200-c16c2aa5d6f3\") " pod="openshift-monitoring/node-exporter-4jt5z" Jul 15 04:07:42.739603 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:07:42.739500 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/03d9ee76-91a7-40fd-8200-c16c2aa5d6f3-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-4jt5z\" (UID: \"03d9ee76-91a7-40fd-8200-c16c2aa5d6f3\") " pod="openshift-monitoring/node-exporter-4jt5z" Jul 15 04:07:42.739603 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:07:42.739556 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/6b8dd87f-c467-4042-bbc4-d4e11f8c0532-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-84bd68b896-7pv89\" (UID: \"6b8dd87f-c467-4042-bbc4-d4e11f8c0532\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-7pv89" Jul 15 04:07:42.739603 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:07:42.739576 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2lswz\" (UniqueName: \"kubernetes.io/projected/6b8dd87f-c467-4042-bbc4-d4e11f8c0532-kube-api-access-2lswz\") pod \"openshift-state-metrics-84bd68b896-7pv89\" (UID: \"6b8dd87f-c467-4042-bbc4-d4e11f8c0532\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-7pv89" Jul 15 04:07:42.739603 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:07:42.739591 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/03d9ee76-91a7-40fd-8200-c16c2aa5d6f3-node-exporter-wtmp\") pod \"node-exporter-4jt5z\" (UID: \"03d9ee76-91a7-40fd-8200-c16c2aa5d6f3\") " pod="openshift-monitoring/node-exporter-4jt5z" Jul 15 04:07:42.739762 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:07:42.739637 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lx68j\" (UniqueName: \"kubernetes.io/projected/c1adb7b7-2826-4431-b154-636573627417-kube-api-access-lx68j\") pod \"kube-state-metrics-785778ff74-bnbjl\" (UID: \"c1adb7b7-2826-4431-b154-636573627417\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-bnbjl" Jul 15 04:07:42.739762 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:07:42.739655 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/03d9ee76-91a7-40fd-8200-c16c2aa5d6f3-metrics-client-ca\") pod \"node-exporter-4jt5z\" (UID: \"03d9ee76-91a7-40fd-8200-c16c2aa5d6f3\") " pod="openshift-monitoring/node-exporter-4jt5z" Jul 15 04:07:42.739762 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:07:42.739692 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/03d9ee76-91a7-40fd-8200-c16c2aa5d6f3-sys\") pod \"node-exporter-4jt5z\" (UID: \"03d9ee76-91a7-40fd-8200-c16c2aa5d6f3\") " pod="openshift-monitoring/node-exporter-4jt5z" Jul 15 04:07:42.739762 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:07:42.739714 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/c1adb7b7-2826-4431-b154-636573627417-volume-directive-shadow\") pod \"kube-state-metrics-785778ff74-bnbjl\" (UID: \"c1adb7b7-2826-4431-b154-636573627417\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-bnbjl" Jul 15 04:07:42.739762 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:07:42.739729 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c1adb7b7-2826-4431-b154-636573627417-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-785778ff74-bnbjl\" (UID: \"c1adb7b7-2826-4431-b154-636573627417\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-bnbjl" Jul 15 04:07:42.739762 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:07:42.739752 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/c1adb7b7-2826-4431-b154-636573627417-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-785778ff74-bnbjl\" (UID: \"c1adb7b7-2826-4431-b154-636573627417\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-bnbjl" Jul 15 04:07:42.739942 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:07:42.739772 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/03d9ee76-91a7-40fd-8200-c16c2aa5d6f3-root\") pod \"node-exporter-4jt5z\" (UID: \"03d9ee76-91a7-40fd-8200-c16c2aa5d6f3\") " pod="openshift-monitoring/node-exporter-4jt5z" Jul 15 04:07:42.739942 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:07:42.739789 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6b8dd87f-c467-4042-bbc4-d4e11f8c0532-metrics-client-ca\") pod \"openshift-state-metrics-84bd68b896-7pv89\" (UID: \"6b8dd87f-c467-4042-bbc4-d4e11f8c0532\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-7pv89" Jul 15 04:07:42.739942 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:07:42.739810 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/03d9ee76-91a7-40fd-8200-c16c2aa5d6f3-node-exporter-tls\") pod \"node-exporter-4jt5z\" (UID: \"03d9ee76-91a7-40fd-8200-c16c2aa5d6f3\") " pod="openshift-monitoring/node-exporter-4jt5z" Jul 15 04:07:42.739942 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:07:42.739843 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kj4dl\" (UniqueName: \"kubernetes.io/projected/03d9ee76-91a7-40fd-8200-c16c2aa5d6f3-kube-api-access-kj4dl\") pod \"node-exporter-4jt5z\" (UID: \"03d9ee76-91a7-40fd-8200-c16c2aa5d6f3\") " pod="openshift-monitoring/node-exporter-4jt5z" Jul 15 04:07:42.739942 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:07:42.739900 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/6b8dd87f-c467-4042-bbc4-d4e11f8c0532-openshift-state-metrics-tls\") pod \"openshift-state-metrics-84bd68b896-7pv89\" (UID: \"6b8dd87f-c467-4042-bbc4-d4e11f8c0532\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-7pv89" Jul 15 04:07:42.739942 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:07:42.739923 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c1adb7b7-2826-4431-b154-636573627417-metrics-client-ca\") pod \"kube-state-metrics-785778ff74-bnbjl\" (UID: \"c1adb7b7-2826-4431-b154-636573627417\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-bnbjl" Jul 15 04:07:42.739942 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:07:42.739938 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/03d9ee76-91a7-40fd-8200-c16c2aa5d6f3-node-exporter-accelerators-collector-config\") pod \"node-exporter-4jt5z\" (UID: \"03d9ee76-91a7-40fd-8200-c16c2aa5d6f3\") " pod="openshift-monitoring/node-exporter-4jt5z" Jul 15 04:07:42.777980 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:07:42.777948 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:07:42.840346 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:07:42.840311 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6b8dd87f-c467-4042-bbc4-d4e11f8c0532-metrics-client-ca\") pod \"openshift-state-metrics-84bd68b896-7pv89\" (UID: \"6b8dd87f-c467-4042-bbc4-d4e11f8c0532\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-7pv89" Jul 15 04:07:42.840346 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:07:42.840345 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/03d9ee76-91a7-40fd-8200-c16c2aa5d6f3-node-exporter-tls\") pod \"node-exporter-4jt5z\" (UID: \"03d9ee76-91a7-40fd-8200-c16c2aa5d6f3\") " pod="openshift-monitoring/node-exporter-4jt5z" Jul 15 04:07:42.840581 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:07:42.840366 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kj4dl\" (UniqueName: \"kubernetes.io/projected/03d9ee76-91a7-40fd-8200-c16c2aa5d6f3-kube-api-access-kj4dl\") pod \"node-exporter-4jt5z\" (UID: \"03d9ee76-91a7-40fd-8200-c16c2aa5d6f3\") " pod="openshift-monitoring/node-exporter-4jt5z" Jul 15 04:07:42.840581 ip-10-0-128-222 kubenswrapper[2581]: E0715 04:07:42.840463 2581 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Jul 15 04:07:42.840581 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:07:42.840496 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/6b8dd87f-c467-4042-bbc4-d4e11f8c0532-openshift-state-metrics-tls\") pod \"openshift-state-metrics-84bd68b896-7pv89\" (UID: \"6b8dd87f-c467-4042-bbc4-d4e11f8c0532\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-7pv89" Jul 15 04:07:42.840581 ip-10-0-128-222 kubenswrapper[2581]: E0715 04:07:42.840548 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/03d9ee76-91a7-40fd-8200-c16c2aa5d6f3-node-exporter-tls podName:03d9ee76-91a7-40fd-8200-c16c2aa5d6f3 nodeName:}" failed. No retries permitted until 2026-07-15 04:07:43.340527425 +0000 UTC m=+96.867328431 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/03d9ee76-91a7-40fd-8200-c16c2aa5d6f3-node-exporter-tls") pod "node-exporter-4jt5z" (UID: "03d9ee76-91a7-40fd-8200-c16c2aa5d6f3") : secret "node-exporter-tls" not found Jul 15 04:07:42.840581 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:07:42.840570 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c1adb7b7-2826-4431-b154-636573627417-metrics-client-ca\") pod \"kube-state-metrics-785778ff74-bnbjl\" (UID: \"c1adb7b7-2826-4431-b154-636573627417\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-bnbjl" Jul 15 04:07:42.840847 ip-10-0-128-222 kubenswrapper[2581]: E0715 04:07:42.840600 2581 secret.go:189] Couldn't get secret openshift-monitoring/openshift-state-metrics-tls: secret "openshift-state-metrics-tls" not found Jul 15 04:07:42.840847 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:07:42.840605 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/03d9ee76-91a7-40fd-8200-c16c2aa5d6f3-node-exporter-accelerators-collector-config\") pod \"node-exporter-4jt5z\" (UID: \"03d9ee76-91a7-40fd-8200-c16c2aa5d6f3\") " pod="openshift-monitoring/node-exporter-4jt5z" Jul 15 04:07:42.840847 ip-10-0-128-222 kubenswrapper[2581]: E0715 04:07:42.840655 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6b8dd87f-c467-4042-bbc4-d4e11f8c0532-openshift-state-metrics-tls podName:6b8dd87f-c467-4042-bbc4-d4e11f8c0532 nodeName:}" failed. No retries permitted until 2026-07-15 04:07:43.340637048 +0000 UTC m=+96.867438056 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "openshift-state-metrics-tls" (UniqueName: "kubernetes.io/secret/6b8dd87f-c467-4042-bbc4-d4e11f8c0532-openshift-state-metrics-tls") pod "openshift-state-metrics-84bd68b896-7pv89" (UID: "6b8dd87f-c467-4042-bbc4-d4e11f8c0532") : secret "openshift-state-metrics-tls" not found Jul 15 04:07:42.840847 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:07:42.840687 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/c1adb7b7-2826-4431-b154-636573627417-kube-state-metrics-tls\") pod \"kube-state-metrics-785778ff74-bnbjl\" (UID: \"c1adb7b7-2826-4431-b154-636573627417\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-bnbjl" Jul 15 04:07:42.840847 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:07:42.840723 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/03d9ee76-91a7-40fd-8200-c16c2aa5d6f3-node-exporter-textfile\") pod \"node-exporter-4jt5z\" (UID: \"03d9ee76-91a7-40fd-8200-c16c2aa5d6f3\") " pod="openshift-monitoring/node-exporter-4jt5z" Jul 15 04:07:42.840847 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:07:42.840749 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/03d9ee76-91a7-40fd-8200-c16c2aa5d6f3-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-4jt5z\" (UID: \"03d9ee76-91a7-40fd-8200-c16c2aa5d6f3\") " pod="openshift-monitoring/node-exporter-4jt5z" Jul 15 04:07:42.840847 ip-10-0-128-222 kubenswrapper[2581]: E0715 04:07:42.840788 2581 secret.go:189] Couldn't get secret openshift-monitoring/kube-state-metrics-tls: secret "kube-state-metrics-tls" not found Jul 15 04:07:42.840847 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:07:42.840810 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/6b8dd87f-c467-4042-bbc4-d4e11f8c0532-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-84bd68b896-7pv89\" (UID: \"6b8dd87f-c467-4042-bbc4-d4e11f8c0532\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-7pv89" Jul 15 04:07:42.840847 ip-10-0-128-222 kubenswrapper[2581]: E0715 04:07:42.840845 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c1adb7b7-2826-4431-b154-636573627417-kube-state-metrics-tls podName:c1adb7b7-2826-4431-b154-636573627417 nodeName:}" failed. No retries permitted until 2026-07-15 04:07:43.340829721 +0000 UTC m=+96.867630733 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-state-metrics-tls" (UniqueName: "kubernetes.io/secret/c1adb7b7-2826-4431-b154-636573627417-kube-state-metrics-tls") pod "kube-state-metrics-785778ff74-bnbjl" (UID: "c1adb7b7-2826-4431-b154-636573627417") : secret "kube-state-metrics-tls" not found Jul 15 04:07:42.841273 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:07:42.840866 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2lswz\" (UniqueName: \"kubernetes.io/projected/6b8dd87f-c467-4042-bbc4-d4e11f8c0532-kube-api-access-2lswz\") pod \"openshift-state-metrics-84bd68b896-7pv89\" (UID: \"6b8dd87f-c467-4042-bbc4-d4e11f8c0532\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-7pv89" Jul 15 04:07:42.841273 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:07:42.840894 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/03d9ee76-91a7-40fd-8200-c16c2aa5d6f3-node-exporter-wtmp\") pod \"node-exporter-4jt5z\" (UID: \"03d9ee76-91a7-40fd-8200-c16c2aa5d6f3\") " pod="openshift-monitoring/node-exporter-4jt5z" Jul 15 04:07:42.841273 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:07:42.840935 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lx68j\" (UniqueName: \"kubernetes.io/projected/c1adb7b7-2826-4431-b154-636573627417-kube-api-access-lx68j\") pod \"kube-state-metrics-785778ff74-bnbjl\" (UID: \"c1adb7b7-2826-4431-b154-636573627417\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-bnbjl" Jul 15 04:07:42.841273 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:07:42.840962 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/03d9ee76-91a7-40fd-8200-c16c2aa5d6f3-metrics-client-ca\") pod \"node-exporter-4jt5z\" (UID: \"03d9ee76-91a7-40fd-8200-c16c2aa5d6f3\") " pod="openshift-monitoring/node-exporter-4jt5z" Jul 15 04:07:42.841273 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:07:42.840996 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/03d9ee76-91a7-40fd-8200-c16c2aa5d6f3-sys\") pod \"node-exporter-4jt5z\" (UID: \"03d9ee76-91a7-40fd-8200-c16c2aa5d6f3\") " pod="openshift-monitoring/node-exporter-4jt5z" Jul 15 04:07:42.841273 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:07:42.841031 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/c1adb7b7-2826-4431-b154-636573627417-volume-directive-shadow\") pod \"kube-state-metrics-785778ff74-bnbjl\" (UID: \"c1adb7b7-2826-4431-b154-636573627417\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-bnbjl" Jul 15 04:07:42.841555 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:07:42.841331 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/03d9ee76-91a7-40fd-8200-c16c2aa5d6f3-sys\") pod \"node-exporter-4jt5z\" (UID: \"03d9ee76-91a7-40fd-8200-c16c2aa5d6f3\") " pod="openshift-monitoring/node-exporter-4jt5z" Jul 15 04:07:42.841555 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:07:42.841331 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6b8dd87f-c467-4042-bbc4-d4e11f8c0532-metrics-client-ca\") pod \"openshift-state-metrics-84bd68b896-7pv89\" (UID: \"6b8dd87f-c467-4042-bbc4-d4e11f8c0532\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-7pv89" Jul 15 04:07:42.841555 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:07:42.841425 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/03d9ee76-91a7-40fd-8200-c16c2aa5d6f3-node-exporter-wtmp\") pod \"node-exporter-4jt5z\" (UID: \"03d9ee76-91a7-40fd-8200-c16c2aa5d6f3\") " pod="openshift-monitoring/node-exporter-4jt5z" Jul 15 04:07:42.841555 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:07:42.841447 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/03d9ee76-91a7-40fd-8200-c16c2aa5d6f3-node-exporter-accelerators-collector-config\") pod \"node-exporter-4jt5z\" (UID: \"03d9ee76-91a7-40fd-8200-c16c2aa5d6f3\") " pod="openshift-monitoring/node-exporter-4jt5z" Jul 15 04:07:42.841555 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:07:42.841486 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c1adb7b7-2826-4431-b154-636573627417-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-785778ff74-bnbjl\" (UID: \"c1adb7b7-2826-4431-b154-636573627417\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-bnbjl" Jul 15 04:07:42.841555 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:07:42.841521 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/c1adb7b7-2826-4431-b154-636573627417-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-785778ff74-bnbjl\" (UID: \"c1adb7b7-2826-4431-b154-636573627417\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-bnbjl" Jul 15 04:07:42.841555 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:07:42.841549 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/03d9ee76-91a7-40fd-8200-c16c2aa5d6f3-root\") pod \"node-exporter-4jt5z\" (UID: \"03d9ee76-91a7-40fd-8200-c16c2aa5d6f3\") " pod="openshift-monitoring/node-exporter-4jt5z" Jul 15 04:07:42.841890 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:07:42.841624 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/03d9ee76-91a7-40fd-8200-c16c2aa5d6f3-root\") pod \"node-exporter-4jt5z\" (UID: \"03d9ee76-91a7-40fd-8200-c16c2aa5d6f3\") " pod="openshift-monitoring/node-exporter-4jt5z" Jul 15 04:07:42.841890 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:07:42.841737 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/c1adb7b7-2826-4431-b154-636573627417-volume-directive-shadow\") pod \"kube-state-metrics-785778ff74-bnbjl\" (UID: \"c1adb7b7-2826-4431-b154-636573627417\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-bnbjl" Jul 15 04:07:42.841890 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:07:42.841773 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/03d9ee76-91a7-40fd-8200-c16c2aa5d6f3-metrics-client-ca\") pod \"node-exporter-4jt5z\" (UID: \"03d9ee76-91a7-40fd-8200-c16c2aa5d6f3\") " pod="openshift-monitoring/node-exporter-4jt5z" Jul 15 04:07:42.841890 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:07:42.841858 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c1adb7b7-2826-4431-b154-636573627417-metrics-client-ca\") pod \"kube-state-metrics-785778ff74-bnbjl\" (UID: \"c1adb7b7-2826-4431-b154-636573627417\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-bnbjl" Jul 15 04:07:42.841890 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:07:42.841884 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/03d9ee76-91a7-40fd-8200-c16c2aa5d6f3-node-exporter-textfile\") pod \"node-exporter-4jt5z\" (UID: \"03d9ee76-91a7-40fd-8200-c16c2aa5d6f3\") " pod="openshift-monitoring/node-exporter-4jt5z" Jul 15 04:07:42.842189 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:07:42.842165 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/c1adb7b7-2826-4431-b154-636573627417-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-785778ff74-bnbjl\" (UID: \"c1adb7b7-2826-4431-b154-636573627417\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-bnbjl" Jul 15 04:07:42.843355 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:07:42.843335 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/03d9ee76-91a7-40fd-8200-c16c2aa5d6f3-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-4jt5z\" (UID: \"03d9ee76-91a7-40fd-8200-c16c2aa5d6f3\") " pod="openshift-monitoring/node-exporter-4jt5z" Jul 15 04:07:42.843495 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:07:42.843469 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/6b8dd87f-c467-4042-bbc4-d4e11f8c0532-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-84bd68b896-7pv89\" (UID: \"6b8dd87f-c467-4042-bbc4-d4e11f8c0532\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-7pv89" Jul 15 04:07:42.843876 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:07:42.843860 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c1adb7b7-2826-4431-b154-636573627417-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-785778ff74-bnbjl\" (UID: \"c1adb7b7-2826-4431-b154-636573627417\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-bnbjl" Jul 15 04:07:42.848527 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:07:42.848507 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lx68j\" (UniqueName: \"kubernetes.io/projected/c1adb7b7-2826-4431-b154-636573627417-kube-api-access-lx68j\") pod \"kube-state-metrics-785778ff74-bnbjl\" (UID: \"c1adb7b7-2826-4431-b154-636573627417\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-bnbjl" Jul 15 04:07:42.848645 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:07:42.848626 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kj4dl\" (UniqueName: \"kubernetes.io/projected/03d9ee76-91a7-40fd-8200-c16c2aa5d6f3-kube-api-access-kj4dl\") pod \"node-exporter-4jt5z\" (UID: \"03d9ee76-91a7-40fd-8200-c16c2aa5d6f3\") " pod="openshift-monitoring/node-exporter-4jt5z" Jul 15 04:07:42.848755 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:07:42.848737 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2lswz\" (UniqueName: \"kubernetes.io/projected/6b8dd87f-c467-4042-bbc4-d4e11f8c0532-kube-api-access-2lswz\") pod \"openshift-state-metrics-84bd68b896-7pv89\" (UID: \"6b8dd87f-c467-4042-bbc4-d4e11f8c0532\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-7pv89" Jul 15 04:07:42.915641 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:07:42.915607 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-86bc794d9-k6v97"] Jul 15 04:07:42.931022 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:07:42.930950 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:07:43.028811 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:07:43.028776 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:07:43.129322 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:07:43.129269 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:07:43.229600 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:07:43.229493 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:07:43.346460 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:07:43.346411 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/c1adb7b7-2826-4431-b154-636573627417-kube-state-metrics-tls\") pod \"kube-state-metrics-785778ff74-bnbjl\" (UID: \"c1adb7b7-2826-4431-b154-636573627417\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-bnbjl" Jul 15 04:07:43.346628 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:07:43.346503 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/03d9ee76-91a7-40fd-8200-c16c2aa5d6f3-node-exporter-tls\") pod \"node-exporter-4jt5z\" (UID: \"03d9ee76-91a7-40fd-8200-c16c2aa5d6f3\") " pod="openshift-monitoring/node-exporter-4jt5z" Jul 15 04:07:43.346628 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:07:43.346531 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/6b8dd87f-c467-4042-bbc4-d4e11f8c0532-openshift-state-metrics-tls\") pod \"openshift-state-metrics-84bd68b896-7pv89\" (UID: \"6b8dd87f-c467-4042-bbc4-d4e11f8c0532\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-7pv89" Jul 15 04:07:43.348833 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:07:43.348801 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/03d9ee76-91a7-40fd-8200-c16c2aa5d6f3-node-exporter-tls\") pod \"node-exporter-4jt5z\" (UID: \"03d9ee76-91a7-40fd-8200-c16c2aa5d6f3\") " pod="openshift-monitoring/node-exporter-4jt5z" Jul 15 04:07:43.348980 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:07:43.348858 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/6b8dd87f-c467-4042-bbc4-d4e11f8c0532-openshift-state-metrics-tls\") pod \"openshift-state-metrics-84bd68b896-7pv89\" (UID: \"6b8dd87f-c467-4042-bbc4-d4e11f8c0532\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-7pv89" Jul 15 04:07:43.348980 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:07:43.348969 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/c1adb7b7-2826-4431-b154-636573627417-kube-state-metrics-tls\") pod \"kube-state-metrics-785778ff74-bnbjl\" (UID: \"c1adb7b7-2826-4431-b154-636573627417\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-bnbjl" Jul 15 04:07:43.355907 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:07:43.355885 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-4n42z" Jul 15 04:07:43.373146 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:07:43.373108 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:07:43.477383 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:07:43.477336 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:07:43.565538 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:07:43.565465 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-7pv89" Jul 15 04:07:43.571110 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:07:43.571087 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-785778ff74-bnbjl" Jul 15 04:07:43.599581 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:07:43.599548 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-4jt5z" Jul 15 04:07:43.615305 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:07:43.615245 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod03d9ee76_91a7_40fd_8200_c16c2aa5d6f3.slice/crio-cc574611b8540095bd238c75d5bd4abad91edaabb352cba68cba27fba7d81332 WatchSource:0}: Error finding container cc574611b8540095bd238c75d5bd4abad91edaabb352cba68cba27fba7d81332: Status 404 returned error can't find the container with id cc574611b8540095bd238c75d5bd4abad91edaabb352cba68cba27fba7d81332 Jul 15 04:07:43.642655 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:07:43.642622 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:07:43.710305 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:07:43.710284 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-84bd68b896-7pv89"] Jul 15 04:07:43.712069 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:07:43.712044 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6b8dd87f_c467_4042_bbc4_d4e11f8c0532.slice/crio-a51ed11d1ce4da2312531944832007844691aae47da67482e28700e9ab278491 WatchSource:0}: Error finding container a51ed11d1ce4da2312531944832007844691aae47da67482e28700e9ab278491: Status 404 returned error can't find the container with id a51ed11d1ce4da2312531944832007844691aae47da67482e28700e9ab278491 Jul 15 04:07:43.723689 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:07:43.723667 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-785778ff74-bnbjl"] Jul 15 04:07:43.726200 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:07:43.726176 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc1adb7b7_2826_4431_b154_636573627417.slice/crio-28822f68fa4d37f7de7c1420a286787980853ffb13a6756f25888cc85e321eb9 WatchSource:0}: Error finding container 28822f68fa4d37f7de7c1420a286787980853ffb13a6756f25888cc85e321eb9: Status 404 returned error can't find the container with id 28822f68fa4d37f7de7c1420a286787980853ffb13a6756f25888cc85e321eb9 Jul 15 04:07:43.757728 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:07:43.757703 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:07:43.771276 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:07:43.771255 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 15 04:07:43.776102 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:07:43.776076 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 15 04:07:43.779380 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:07:43.779091 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jul 15 04:07:43.779380 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:07:43.779173 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jul 15 04:07:43.779380 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:07:43.779238 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jul 15 04:07:43.779380 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:07:43.779091 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jul 15 04:07:43.779380 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:07:43.779179 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jul 15 04:07:43.779380 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:07:43.779097 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jul 15 04:07:43.779850 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:07:43.779651 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jul 15 04:07:43.779850 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:07:43.779669 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jul 15 04:07:43.779850 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:07:43.779720 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jul 15 04:07:43.779850 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:07:43.779795 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-wg8vk\"" Jul 15 04:07:43.790178 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:07:43.790105 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 15 04:07:43.851293 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:07:43.851267 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d0b40b90-794d-4124-bd19-0a656d5f6566-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"d0b40b90-794d-4124-bd19-0a656d5f6566\") " pod="openshift-monitoring/alertmanager-main-0" Jul 15 04:07:43.851416 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:07:43.851305 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mw9nn\" (UniqueName: \"kubernetes.io/projected/d0b40b90-794d-4124-bd19-0a656d5f6566-kube-api-access-mw9nn\") pod \"alertmanager-main-0\" (UID: \"d0b40b90-794d-4124-bd19-0a656d5f6566\") " pod="openshift-monitoring/alertmanager-main-0" Jul 15 04:07:43.851416 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:07:43.851337 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/d0b40b90-794d-4124-bd19-0a656d5f6566-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"d0b40b90-794d-4124-bd19-0a656d5f6566\") " pod="openshift-monitoring/alertmanager-main-0" Jul 15 04:07:43.851520 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:07:43.851414 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/d0b40b90-794d-4124-bd19-0a656d5f6566-config-out\") pod \"alertmanager-main-0\" (UID: \"d0b40b90-794d-4124-bd19-0a656d5f6566\") " pod="openshift-monitoring/alertmanager-main-0" Jul 15 04:07:43.851520 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:07:43.851453 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/d0b40b90-794d-4124-bd19-0a656d5f6566-config-volume\") pod \"alertmanager-main-0\" (UID: \"d0b40b90-794d-4124-bd19-0a656d5f6566\") " pod="openshift-monitoring/alertmanager-main-0" Jul 15 04:07:43.851607 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:07:43.851528 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/d0b40b90-794d-4124-bd19-0a656d5f6566-web-config\") pod \"alertmanager-main-0\" (UID: \"d0b40b90-794d-4124-bd19-0a656d5f6566\") " pod="openshift-monitoring/alertmanager-main-0" Jul 15 04:07:43.851607 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:07:43.851564 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/d0b40b90-794d-4124-bd19-0a656d5f6566-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"d0b40b90-794d-4124-bd19-0a656d5f6566\") " pod="openshift-monitoring/alertmanager-main-0" Jul 15 04:07:43.851607 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:07:43.851600 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/d0b40b90-794d-4124-bd19-0a656d5f6566-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"d0b40b90-794d-4124-bd19-0a656d5f6566\") " pod="openshift-monitoring/alertmanager-main-0" Jul 15 04:07:43.851727 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:07:43.851637 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/d0b40b90-794d-4124-bd19-0a656d5f6566-tls-assets\") pod \"alertmanager-main-0\" (UID: \"d0b40b90-794d-4124-bd19-0a656d5f6566\") " pod="openshift-monitoring/alertmanager-main-0" Jul 15 04:07:43.851727 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:07:43.851664 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/d0b40b90-794d-4124-bd19-0a656d5f6566-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"d0b40b90-794d-4124-bd19-0a656d5f6566\") " pod="openshift-monitoring/alertmanager-main-0" Jul 15 04:07:43.851727 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:07:43.851689 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d0b40b90-794d-4124-bd19-0a656d5f6566-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"d0b40b90-794d-4124-bd19-0a656d5f6566\") " pod="openshift-monitoring/alertmanager-main-0" Jul 15 04:07:43.851727 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:07:43.851715 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/d0b40b90-794d-4124-bd19-0a656d5f6566-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"d0b40b90-794d-4124-bd19-0a656d5f6566\") " pod="openshift-monitoring/alertmanager-main-0" Jul 15 04:07:43.851871 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:07:43.851744 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/d0b40b90-794d-4124-bd19-0a656d5f6566-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"d0b40b90-794d-4124-bd19-0a656d5f6566\") " pod="openshift-monitoring/alertmanager-main-0" Jul 15 04:07:43.858960 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:07:43.858846 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:07:43.952439 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:07:43.952402 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/d0b40b90-794d-4124-bd19-0a656d5f6566-config-volume\") pod \"alertmanager-main-0\" (UID: \"d0b40b90-794d-4124-bd19-0a656d5f6566\") " pod="openshift-monitoring/alertmanager-main-0" Jul 15 04:07:43.952615 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:07:43.952454 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/d0b40b90-794d-4124-bd19-0a656d5f6566-web-config\") pod \"alertmanager-main-0\" (UID: \"d0b40b90-794d-4124-bd19-0a656d5f6566\") " pod="openshift-monitoring/alertmanager-main-0" Jul 15 04:07:43.952615 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:07:43.952477 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/d0b40b90-794d-4124-bd19-0a656d5f6566-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"d0b40b90-794d-4124-bd19-0a656d5f6566\") " pod="openshift-monitoring/alertmanager-main-0" Jul 15 04:07:43.952615 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:07:43.952504 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/d0b40b90-794d-4124-bd19-0a656d5f6566-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"d0b40b90-794d-4124-bd19-0a656d5f6566\") " pod="openshift-monitoring/alertmanager-main-0" Jul 15 04:07:43.952615 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:07:43.952536 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/d0b40b90-794d-4124-bd19-0a656d5f6566-tls-assets\") pod \"alertmanager-main-0\" (UID: \"d0b40b90-794d-4124-bd19-0a656d5f6566\") " pod="openshift-monitoring/alertmanager-main-0" Jul 15 04:07:43.952615 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:07:43.952554 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/d0b40b90-794d-4124-bd19-0a656d5f6566-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"d0b40b90-794d-4124-bd19-0a656d5f6566\") " pod="openshift-monitoring/alertmanager-main-0" Jul 15 04:07:43.952615 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:07:43.952570 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d0b40b90-794d-4124-bd19-0a656d5f6566-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"d0b40b90-794d-4124-bd19-0a656d5f6566\") " pod="openshift-monitoring/alertmanager-main-0" Jul 15 04:07:43.952615 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:07:43.952596 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/d0b40b90-794d-4124-bd19-0a656d5f6566-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"d0b40b90-794d-4124-bd19-0a656d5f6566\") " pod="openshift-monitoring/alertmanager-main-0" Jul 15 04:07:43.953291 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:07:43.953261 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/d0b40b90-794d-4124-bd19-0a656d5f6566-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"d0b40b90-794d-4124-bd19-0a656d5f6566\") " pod="openshift-monitoring/alertmanager-main-0" Jul 15 04:07:43.953399 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:07:43.953264 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/d0b40b90-794d-4124-bd19-0a656d5f6566-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"d0b40b90-794d-4124-bd19-0a656d5f6566\") " pod="openshift-monitoring/alertmanager-main-0" Jul 15 04:07:43.953399 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:07:43.953329 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d0b40b90-794d-4124-bd19-0a656d5f6566-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"d0b40b90-794d-4124-bd19-0a656d5f6566\") " pod="openshift-monitoring/alertmanager-main-0" Jul 15 04:07:43.953399 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:07:43.953362 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mw9nn\" (UniqueName: \"kubernetes.io/projected/d0b40b90-794d-4124-bd19-0a656d5f6566-kube-api-access-mw9nn\") pod \"alertmanager-main-0\" (UID: \"d0b40b90-794d-4124-bd19-0a656d5f6566\") " pod="openshift-monitoring/alertmanager-main-0" Jul 15 04:07:43.953556 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:07:43.953400 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/d0b40b90-794d-4124-bd19-0a656d5f6566-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"d0b40b90-794d-4124-bd19-0a656d5f6566\") " pod="openshift-monitoring/alertmanager-main-0" Jul 15 04:07:43.953556 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:07:43.953431 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/d0b40b90-794d-4124-bd19-0a656d5f6566-config-out\") pod \"alertmanager-main-0\" (UID: \"d0b40b90-794d-4124-bd19-0a656d5f6566\") " pod="openshift-monitoring/alertmanager-main-0" Jul 15 04:07:43.954224 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:07:43.954198 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d0b40b90-794d-4124-bd19-0a656d5f6566-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"d0b40b90-794d-4124-bd19-0a656d5f6566\") " pod="openshift-monitoring/alertmanager-main-0" Jul 15 04:07:43.954608 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:07:43.954582 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d0b40b90-794d-4124-bd19-0a656d5f6566-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"d0b40b90-794d-4124-bd19-0a656d5f6566\") " pod="openshift-monitoring/alertmanager-main-0" Jul 15 04:07:43.955446 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:07:43.955405 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/d0b40b90-794d-4124-bd19-0a656d5f6566-config-volume\") pod \"alertmanager-main-0\" (UID: \"d0b40b90-794d-4124-bd19-0a656d5f6566\") " pod="openshift-monitoring/alertmanager-main-0" Jul 15 04:07:43.955946 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:07:43.955926 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/d0b40b90-794d-4124-bd19-0a656d5f6566-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"d0b40b90-794d-4124-bd19-0a656d5f6566\") " pod="openshift-monitoring/alertmanager-main-0" Jul 15 04:07:43.956260 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:07:43.956237 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/d0b40b90-794d-4124-bd19-0a656d5f6566-web-config\") pod \"alertmanager-main-0\" (UID: \"d0b40b90-794d-4124-bd19-0a656d5f6566\") " pod="openshift-monitoring/alertmanager-main-0" Jul 15 04:07:43.956769 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:07:43.956593 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/d0b40b90-794d-4124-bd19-0a656d5f6566-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"d0b40b90-794d-4124-bd19-0a656d5f6566\") " pod="openshift-monitoring/alertmanager-main-0" Jul 15 04:07:43.956769 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:07:43.956717 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/d0b40b90-794d-4124-bd19-0a656d5f6566-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"d0b40b90-794d-4124-bd19-0a656d5f6566\") " pod="openshift-monitoring/alertmanager-main-0" Jul 15 04:07:43.957001 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:07:43.956974 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/d0b40b90-794d-4124-bd19-0a656d5f6566-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"d0b40b90-794d-4124-bd19-0a656d5f6566\") " pod="openshift-monitoring/alertmanager-main-0" Jul 15 04:07:43.957339 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:07:43.957295 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/d0b40b90-794d-4124-bd19-0a656d5f6566-tls-assets\") pod \"alertmanager-main-0\" (UID: \"d0b40b90-794d-4124-bd19-0a656d5f6566\") " pod="openshift-monitoring/alertmanager-main-0" Jul 15 04:07:43.957885 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:07:43.957866 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/d0b40b90-794d-4124-bd19-0a656d5f6566-config-out\") pod \"alertmanager-main-0\" (UID: \"d0b40b90-794d-4124-bd19-0a656d5f6566\") " pod="openshift-monitoring/alertmanager-main-0" Jul 15 04:07:43.958296 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:07:43.958281 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/d0b40b90-794d-4124-bd19-0a656d5f6566-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"d0b40b90-794d-4124-bd19-0a656d5f6566\") " pod="openshift-monitoring/alertmanager-main-0" Jul 15 04:07:43.961855 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:07:43.961833 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mw9nn\" (UniqueName: \"kubernetes.io/projected/d0b40b90-794d-4124-bd19-0a656d5f6566-kube-api-access-mw9nn\") pod \"alertmanager-main-0\" (UID: \"d0b40b90-794d-4124-bd19-0a656d5f6566\") " pod="openshift-monitoring/alertmanager-main-0" Jul 15 04:07:44.088274 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:07:44.088194 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 15 04:07:44.243342 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:07:44.243236 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 15 04:07:44.247458 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:07:44.247428 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd0b40b90_794d_4124_bd19_0a656d5f6566.slice/crio-8c6d9dc2c3086960059fd7004994dc5dae34d4e6a59a203fbf96ade2fbebf89d WatchSource:0}: Error finding container 8c6d9dc2c3086960059fd7004994dc5dae34d4e6a59a203fbf96ade2fbebf89d: Status 404 returned error can't find the container with id 8c6d9dc2c3086960059fd7004994dc5dae34d4e6a59a203fbf96ade2fbebf89d Jul 15 04:07:44.502977 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:07:44.502898 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-785778ff74-bnbjl" event={"ID":"c1adb7b7-2826-4431-b154-636573627417","Type":"ContainerStarted","Data":"28822f68fa4d37f7de7c1420a286787980853ffb13a6756f25888cc85e321eb9"} Jul 15 04:07:44.504451 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:07:44.504416 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-4jt5z" event={"ID":"03d9ee76-91a7-40fd-8200-c16c2aa5d6f3","Type":"ContainerStarted","Data":"cc574611b8540095bd238c75d5bd4abad91edaabb352cba68cba27fba7d81332"} Jul 15 04:07:44.506734 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:07:44.506691 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-7pv89" event={"ID":"6b8dd87f-c467-4042-bbc4-d4e11f8c0532","Type":"ContainerStarted","Data":"a34b9f44e06871d0834ec79b590ce156a25c8b3a91b3c127fd8dd7406c564f0f"} Jul 15 04:07:44.506871 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:07:44.506765 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-7pv89" event={"ID":"6b8dd87f-c467-4042-bbc4-d4e11f8c0532","Type":"ContainerStarted","Data":"048c595a9d7f319de0e7d8eba4823b8e651d24a042096f974daa332b65e0c014"} Jul 15 04:07:44.506871 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:07:44.506796 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-7pv89" event={"ID":"6b8dd87f-c467-4042-bbc4-d4e11f8c0532","Type":"ContainerStarted","Data":"a51ed11d1ce4da2312531944832007844691aae47da67482e28700e9ab278491"} Jul 15 04:07:44.508220 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:07:44.508184 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d0b40b90-794d-4124-bd19-0a656d5f6566","Type":"ContainerStarted","Data":"8c6d9dc2c3086960059fd7004994dc5dae34d4e6a59a203fbf96ade2fbebf89d"} Jul 15 04:07:45.158238 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:07:45.158143 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:07:45.259255 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:07:45.259224 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:07:45.514791 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:07:45.514387 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-785778ff74-bnbjl" event={"ID":"c1adb7b7-2826-4431-b154-636573627417","Type":"ContainerStarted","Data":"427c5d462c8e874aefc9568eee62ed4ae5b38f987d1ae3cd2ff10ca97dd492bb"} Jul 15 04:07:45.514791 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:07:45.514498 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-785778ff74-bnbjl" event={"ID":"c1adb7b7-2826-4431-b154-636573627417","Type":"ContainerStarted","Data":"1b8f1d79a96d2a92a889f090f50c0f5b97eea7c8c5dffb12e6bb653ec03998c0"} Jul 15 04:07:45.514791 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:07:45.514527 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-785778ff74-bnbjl" event={"ID":"c1adb7b7-2826-4431-b154-636573627417","Type":"ContainerStarted","Data":"bdf7cfd36d13afb0e1506c8fca3e4f35932155f92bb9705725fba16f98095ab6"} Jul 15 04:07:45.516697 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:07:45.516664 2581 generic.go:356] "Generic (PLEG): container finished" podID="03d9ee76-91a7-40fd-8200-c16c2aa5d6f3" containerID="4510462c290bec403c90e9673f58bf19c2e389f20ce338f96ffa7b7472c351fb" exitCode=0 Jul 15 04:07:45.516837 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:07:45.516710 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-4jt5z" event={"ID":"03d9ee76-91a7-40fd-8200-c16c2aa5d6f3","Type":"ContainerDied","Data":"4510462c290bec403c90e9673f58bf19c2e389f20ce338f96ffa7b7472c351fb"} Jul 15 04:07:45.533411 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:07:45.533357 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-785778ff74-bnbjl" podStartSLOduration=2.260894218 podStartE2EDuration="3.533337672s" totalImagesPullingTime="1.272443454s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 04:07:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 04:07:45.532034671 +0000 UTC m=+99.058835687" watchObservedRunningTime="2026-07-15 04:07:45.533337672 +0000 UTC m=+99.060138688" Jul 15 04:07:45.591430 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:07:45.591397 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:07:45.672281 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:07:45.672252 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:07:45.899258 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:07:45.899225 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:07:46.000032 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:07:45.999996 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:07:46.522895 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:07:46.522857 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-4jt5z" event={"ID":"03d9ee76-91a7-40fd-8200-c16c2aa5d6f3","Type":"ContainerStarted","Data":"9f781390e2978520500db2d389219b5df2b44d1fb6da0273e4e1a0e53813b17c"} Jul 15 04:07:46.523341 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:07:46.522920 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-4jt5z" event={"ID":"03d9ee76-91a7-40fd-8200-c16c2aa5d6f3","Type":"ContainerStarted","Data":"b45331979f4d326c4d12f0017031b7b5a34300e494f7a94ed3339a33d2cde490"} Jul 15 04:07:46.524973 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:07:46.524946 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-7pv89" event={"ID":"6b8dd87f-c467-4042-bbc4-d4e11f8c0532","Type":"ContainerStarted","Data":"2dd6f7b9e5d56760134473e30101bde1d3eeeddd108e3a4c73b8e4cc38c8775f"} Jul 15 04:07:46.526363 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:07:46.526336 2581 generic.go:356] "Generic (PLEG): container finished" podID="d0b40b90-794d-4124-bd19-0a656d5f6566" containerID="d23edb6469f10bb2b5c713fe4e1dbca8ed467e45a1279394840b0f914d5233cf" exitCode=0 Jul 15 04:07:46.526509 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:07:46.526419 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d0b40b90-794d-4124-bd19-0a656d5f6566","Type":"ContainerDied","Data":"d23edb6469f10bb2b5c713fe4e1dbca8ed467e45a1279394840b0f914d5233cf"} Jul 15 04:07:46.541964 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:07:46.541920 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-4jt5z" podStartSLOduration=3.113906029 podStartE2EDuration="4.541905086s" totalImagesPullingTime="1.334841374s" totalInitContainerRuntime="93.157683ms" isStatefulPod=true podCreationTimestamp="2026-07-15 04:07:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 04:07:46.540609126 +0000 UTC m=+100.067410160" watchObservedRunningTime="2026-07-15 04:07:46.541905086 +0000 UTC m=+100.068706101" Jul 15 04:07:46.556625 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:07:46.556584 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-7pv89" podStartSLOduration=2.585506462 podStartE2EDuration="4.556567649s" totalImagesPullingTime="1.971061187s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 04:07:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 04:07:46.556423659 +0000 UTC m=+100.083224731" watchObservedRunningTime="2026-07-15 04:07:46.556567649 +0000 UTC m=+100.083368656" Jul 15 04:07:46.971259 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:07:46.971227 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-77bc8bcdf5-cmdd5"] Jul 15 04:07:46.974755 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:07:46.974734 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-77bc8bcdf5-cmdd5" Jul 15 04:07:46.977036 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:07:46.977017 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jul 15 04:07:46.977281 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:07:46.977264 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\"" Jul 15 04:07:46.977369 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:07:46.977317 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\"" Jul 15 04:07:46.977427 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:07:46.977368 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\"" Jul 15 04:07:46.977475 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:07:46.977450 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-el59bsengvbkt\"" Jul 15 04:07:46.977475 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:07:46.977457 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-2x276\"" Jul 15 04:07:46.986768 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:07:46.986750 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/ba24f9e9-e5da-40b8-9812-a5fe45ed111b-secret-metrics-server-tls\") pod \"metrics-server-77bc8bcdf5-cmdd5\" (UID: \"ba24f9e9-e5da-40b8-9812-a5fe45ed111b\") " pod="openshift-monitoring/metrics-server-77bc8bcdf5-cmdd5" Jul 15 04:07:46.986868 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:07:46.986781 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/ba24f9e9-e5da-40b8-9812-a5fe45ed111b-metrics-server-audit-profiles\") pod \"metrics-server-77bc8bcdf5-cmdd5\" (UID: \"ba24f9e9-e5da-40b8-9812-a5fe45ed111b\") " pod="openshift-monitoring/metrics-server-77bc8bcdf5-cmdd5" Jul 15 04:07:46.986868 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:07:46.986812 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ba24f9e9-e5da-40b8-9812-a5fe45ed111b-client-ca-bundle\") pod \"metrics-server-77bc8bcdf5-cmdd5\" (UID: \"ba24f9e9-e5da-40b8-9812-a5fe45ed111b\") " pod="openshift-monitoring/metrics-server-77bc8bcdf5-cmdd5" Jul 15 04:07:46.986992 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:07:46.986973 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/ba24f9e9-e5da-40b8-9812-a5fe45ed111b-secret-metrics-server-client-certs\") pod \"metrics-server-77bc8bcdf5-cmdd5\" (UID: \"ba24f9e9-e5da-40b8-9812-a5fe45ed111b\") " pod="openshift-monitoring/metrics-server-77bc8bcdf5-cmdd5" Jul 15 04:07:46.987041 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:07:46.987026 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ba24f9e9-e5da-40b8-9812-a5fe45ed111b-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-77bc8bcdf5-cmdd5\" (UID: \"ba24f9e9-e5da-40b8-9812-a5fe45ed111b\") " pod="openshift-monitoring/metrics-server-77bc8bcdf5-cmdd5" Jul 15 04:07:46.987081 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:07:46.987052 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/ba24f9e9-e5da-40b8-9812-a5fe45ed111b-audit-log\") pod \"metrics-server-77bc8bcdf5-cmdd5\" (UID: \"ba24f9e9-e5da-40b8-9812-a5fe45ed111b\") " pod="openshift-monitoring/metrics-server-77bc8bcdf5-cmdd5" Jul 15 04:07:46.987116 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:07:46.987093 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fsnkc\" (UniqueName: \"kubernetes.io/projected/ba24f9e9-e5da-40b8-9812-a5fe45ed111b-kube-api-access-fsnkc\") pod \"metrics-server-77bc8bcdf5-cmdd5\" (UID: \"ba24f9e9-e5da-40b8-9812-a5fe45ed111b\") " pod="openshift-monitoring/metrics-server-77bc8bcdf5-cmdd5" Jul 15 04:07:46.989230 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:07:46.989212 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-77bc8bcdf5-cmdd5"] Jul 15 04:07:47.087528 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:07:47.087497 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/ba24f9e9-e5da-40b8-9812-a5fe45ed111b-secret-metrics-server-tls\") pod \"metrics-server-77bc8bcdf5-cmdd5\" (UID: \"ba24f9e9-e5da-40b8-9812-a5fe45ed111b\") " pod="openshift-monitoring/metrics-server-77bc8bcdf5-cmdd5" Jul 15 04:07:47.087690 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:07:47.087531 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/ba24f9e9-e5da-40b8-9812-a5fe45ed111b-metrics-server-audit-profiles\") pod \"metrics-server-77bc8bcdf5-cmdd5\" (UID: \"ba24f9e9-e5da-40b8-9812-a5fe45ed111b\") " pod="openshift-monitoring/metrics-server-77bc8bcdf5-cmdd5" Jul 15 04:07:47.087690 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:07:47.087566 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ba24f9e9-e5da-40b8-9812-a5fe45ed111b-client-ca-bundle\") pod \"metrics-server-77bc8bcdf5-cmdd5\" (UID: \"ba24f9e9-e5da-40b8-9812-a5fe45ed111b\") " pod="openshift-monitoring/metrics-server-77bc8bcdf5-cmdd5" Jul 15 04:07:47.087690 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:07:47.087617 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/ba24f9e9-e5da-40b8-9812-a5fe45ed111b-secret-metrics-server-client-certs\") pod \"metrics-server-77bc8bcdf5-cmdd5\" (UID: \"ba24f9e9-e5da-40b8-9812-a5fe45ed111b\") " pod="openshift-monitoring/metrics-server-77bc8bcdf5-cmdd5" Jul 15 04:07:47.087690 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:07:47.087655 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ba24f9e9-e5da-40b8-9812-a5fe45ed111b-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-77bc8bcdf5-cmdd5\" (UID: \"ba24f9e9-e5da-40b8-9812-a5fe45ed111b\") " pod="openshift-monitoring/metrics-server-77bc8bcdf5-cmdd5" Jul 15 04:07:47.087690 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:07:47.087679 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/ba24f9e9-e5da-40b8-9812-a5fe45ed111b-audit-log\") pod \"metrics-server-77bc8bcdf5-cmdd5\" (UID: \"ba24f9e9-e5da-40b8-9812-a5fe45ed111b\") " pod="openshift-monitoring/metrics-server-77bc8bcdf5-cmdd5" Jul 15 04:07:47.087937 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:07:47.087714 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fsnkc\" (UniqueName: \"kubernetes.io/projected/ba24f9e9-e5da-40b8-9812-a5fe45ed111b-kube-api-access-fsnkc\") pod \"metrics-server-77bc8bcdf5-cmdd5\" (UID: \"ba24f9e9-e5da-40b8-9812-a5fe45ed111b\") " pod="openshift-monitoring/metrics-server-77bc8bcdf5-cmdd5" Jul 15 04:07:47.088195 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:07:47.088159 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/ba24f9e9-e5da-40b8-9812-a5fe45ed111b-audit-log\") pod \"metrics-server-77bc8bcdf5-cmdd5\" (UID: \"ba24f9e9-e5da-40b8-9812-a5fe45ed111b\") " pod="openshift-monitoring/metrics-server-77bc8bcdf5-cmdd5" Jul 15 04:07:47.088718 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:07:47.088690 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ba24f9e9-e5da-40b8-9812-a5fe45ed111b-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-77bc8bcdf5-cmdd5\" (UID: \"ba24f9e9-e5da-40b8-9812-a5fe45ed111b\") " pod="openshift-monitoring/metrics-server-77bc8bcdf5-cmdd5" Jul 15 04:07:47.088829 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:07:47.088729 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/ba24f9e9-e5da-40b8-9812-a5fe45ed111b-metrics-server-audit-profiles\") pod \"metrics-server-77bc8bcdf5-cmdd5\" (UID: \"ba24f9e9-e5da-40b8-9812-a5fe45ed111b\") " pod="openshift-monitoring/metrics-server-77bc8bcdf5-cmdd5" Jul 15 04:07:47.090198 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:07:47.090172 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/ba24f9e9-e5da-40b8-9812-a5fe45ed111b-secret-metrics-server-tls\") pod \"metrics-server-77bc8bcdf5-cmdd5\" (UID: \"ba24f9e9-e5da-40b8-9812-a5fe45ed111b\") " pod="openshift-monitoring/metrics-server-77bc8bcdf5-cmdd5" Jul 15 04:07:47.090198 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:07:47.090189 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/ba24f9e9-e5da-40b8-9812-a5fe45ed111b-secret-metrics-server-client-certs\") pod \"metrics-server-77bc8bcdf5-cmdd5\" (UID: \"ba24f9e9-e5da-40b8-9812-a5fe45ed111b\") " pod="openshift-monitoring/metrics-server-77bc8bcdf5-cmdd5" Jul 15 04:07:47.090318 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:07:47.090202 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ba24f9e9-e5da-40b8-9812-a5fe45ed111b-client-ca-bundle\") pod \"metrics-server-77bc8bcdf5-cmdd5\" (UID: \"ba24f9e9-e5da-40b8-9812-a5fe45ed111b\") " pod="openshift-monitoring/metrics-server-77bc8bcdf5-cmdd5" Jul 15 04:07:47.095574 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:07:47.095555 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fsnkc\" (UniqueName: \"kubernetes.io/projected/ba24f9e9-e5da-40b8-9812-a5fe45ed111b-kube-api-access-fsnkc\") pod \"metrics-server-77bc8bcdf5-cmdd5\" (UID: \"ba24f9e9-e5da-40b8-9812-a5fe45ed111b\") " pod="openshift-monitoring/metrics-server-77bc8bcdf5-cmdd5" Jul 15 04:07:47.284369 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:07:47.284279 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-77bc8bcdf5-cmdd5" Jul 15 04:07:47.443067 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:07:47.443035 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-77bc8bcdf5-cmdd5"] Jul 15 04:07:47.446077 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:07:47.446030 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podba24f9e9_e5da_40b8_9812_a5fe45ed111b.slice/crio-04b772bbdfedf5d23deea76cf4d3312d30bfe68b56cc14be12678a66339e3f9e WatchSource:0}: Error finding container 04b772bbdfedf5d23deea76cf4d3312d30bfe68b56cc14be12678a66339e3f9e: Status 404 returned error can't find the container with id 04b772bbdfedf5d23deea76cf4d3312d30bfe68b56cc14be12678a66339e3f9e Jul 15 04:07:47.486533 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:07:47.486443 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:07:47.500089 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:07:47.500065 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-5f68df7f58-fcdhg"] Jul 15 04:07:47.505061 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:07:47.505038 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-fcdhg" Jul 15 04:07:47.507246 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:07:47.507221 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\"" Jul 15 04:07:47.507382 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:07:47.507310 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-2rb52\"" Jul 15 04:07:47.513497 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:07:47.513471 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-5f68df7f58-fcdhg"] Jul 15 04:07:47.533261 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:07:47.533229 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-77bc8bcdf5-cmdd5" event={"ID":"ba24f9e9-e5da-40b8-9812-a5fe45ed111b","Type":"ContainerStarted","Data":"04b772bbdfedf5d23deea76cf4d3312d30bfe68b56cc14be12678a66339e3f9e"} Jul 15 04:07:47.570825 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:07:47.570759 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:07:47.594064 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:07:47.594035 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/f622f33d-9069-4b94-a5d5-a4e67feafff0-monitoring-plugin-cert\") pod \"monitoring-plugin-5f68df7f58-fcdhg\" (UID: \"f622f33d-9069-4b94-a5d5-a4e67feafff0\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-fcdhg" Jul 15 04:07:47.594365 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:07:47.594343 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tmdbv\" (UniqueName: \"kubernetes.io/projected/f622f33d-9069-4b94-a5d5-a4e67feafff0-kube-api-access-tmdbv\") pod \"monitoring-plugin-5f68df7f58-fcdhg\" (UID: \"f622f33d-9069-4b94-a5d5-a4e67feafff0\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-fcdhg" Jul 15 04:07:47.672835 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:07:47.672798 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:07:47.695044 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:07:47.695011 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tmdbv\" (UniqueName: \"kubernetes.io/projected/f622f33d-9069-4b94-a5d5-a4e67feafff0-kube-api-access-tmdbv\") pod \"monitoring-plugin-5f68df7f58-fcdhg\" (UID: \"f622f33d-9069-4b94-a5d5-a4e67feafff0\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-fcdhg" Jul 15 04:07:47.695232 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:07:47.695134 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/f622f33d-9069-4b94-a5d5-a4e67feafff0-monitoring-plugin-cert\") pod \"monitoring-plugin-5f68df7f58-fcdhg\" (UID: \"f622f33d-9069-4b94-a5d5-a4e67feafff0\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-fcdhg" Jul 15 04:07:47.695315 ip-10-0-128-222 kubenswrapper[2581]: E0715 04:07:47.695248 2581 secret.go:189] Couldn't get secret openshift-monitoring/monitoring-plugin-cert: secret "monitoring-plugin-cert" not found Jul 15 04:07:47.695368 ip-10-0-128-222 kubenswrapper[2581]: E0715 04:07:47.695315 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f622f33d-9069-4b94-a5d5-a4e67feafff0-monitoring-plugin-cert podName:f622f33d-9069-4b94-a5d5-a4e67feafff0 nodeName:}" failed. No retries permitted until 2026-07-15 04:07:48.19529393 +0000 UTC m=+101.722094926 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "monitoring-plugin-cert" (UniqueName: "kubernetes.io/secret/f622f33d-9069-4b94-a5d5-a4e67feafff0-monitoring-plugin-cert") pod "monitoring-plugin-5f68df7f58-fcdhg" (UID: "f622f33d-9069-4b94-a5d5-a4e67feafff0") : secret "monitoring-plugin-cert" not found Jul 15 04:07:47.705291 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:07:47.705265 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tmdbv\" (UniqueName: \"kubernetes.io/projected/f622f33d-9069-4b94-a5d5-a4e67feafff0-kube-api-access-tmdbv\") pod \"monitoring-plugin-5f68df7f58-fcdhg\" (UID: \"f622f33d-9069-4b94-a5d5-a4e67feafff0\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-fcdhg" Jul 15 04:07:48.200264 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:07:48.200240 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/f622f33d-9069-4b94-a5d5-a4e67feafff0-monitoring-plugin-cert\") pod \"monitoring-plugin-5f68df7f58-fcdhg\" (UID: \"f622f33d-9069-4b94-a5d5-a4e67feafff0\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-fcdhg" Jul 15 04:07:48.200421 ip-10-0-128-222 kubenswrapper[2581]: E0715 04:07:48.200403 2581 secret.go:189] Couldn't get secret openshift-monitoring/monitoring-plugin-cert: secret "monitoring-plugin-cert" not found Jul 15 04:07:48.200503 ip-10-0-128-222 kubenswrapper[2581]: E0715 04:07:48.200491 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f622f33d-9069-4b94-a5d5-a4e67feafff0-monitoring-plugin-cert podName:f622f33d-9069-4b94-a5d5-a4e67feafff0 nodeName:}" failed. No retries permitted until 2026-07-15 04:07:49.200460473 +0000 UTC m=+102.727261470 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "monitoring-plugin-cert" (UniqueName: "kubernetes.io/secret/f622f33d-9069-4b94-a5d5-a4e67feafff0-monitoring-plugin-cert") pod "monitoring-plugin-5f68df7f58-fcdhg" (UID: "f622f33d-9069-4b94-a5d5-a4e67feafff0") : secret "monitoring-plugin-cert" not found Jul 15 04:07:48.540906 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:07:48.540871 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d0b40b90-794d-4124-bd19-0a656d5f6566","Type":"ContainerStarted","Data":"a74e98bb1366042a0ae42faf380a38bd75a2fa296a34fe91f0fee29f1b614bfc"} Jul 15 04:07:48.541290 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:07:48.540939 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d0b40b90-794d-4124-bd19-0a656d5f6566","Type":"ContainerStarted","Data":"eae743e352e1b219a5216035001e647ed40bf43c7043decbe70edb2223831cb0"} Jul 15 04:07:48.541290 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:07:48.540964 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d0b40b90-794d-4124-bd19-0a656d5f6566","Type":"ContainerStarted","Data":"82032a637e8b319122901a8b5325bffe562eb12984bb640ee5b4876e474109db"} Jul 15 04:07:48.541290 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:07:48.540989 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d0b40b90-794d-4124-bd19-0a656d5f6566","Type":"ContainerStarted","Data":"3ac65296a4448274ae9948abd3107b454253f5ec1ff858fd290b301000e8d27a"} Jul 15 04:07:48.541290 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:07:48.541014 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d0b40b90-794d-4124-bd19-0a656d5f6566","Type":"ContainerStarted","Data":"6f70a9520c89cffa73b33b07186acf345865a08e42ca001188ec06750a74debe"} Jul 15 04:07:48.636298 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:07:48.636263 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:07:49.005512 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:07:49.005476 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:07:49.209428 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:07:49.209397 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/f622f33d-9069-4b94-a5d5-a4e67feafff0-monitoring-plugin-cert\") pod \"monitoring-plugin-5f68df7f58-fcdhg\" (UID: \"f622f33d-9069-4b94-a5d5-a4e67feafff0\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-fcdhg" Jul 15 04:07:49.212090 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:07:49.212060 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/f622f33d-9069-4b94-a5d5-a4e67feafff0-monitoring-plugin-cert\") pod \"monitoring-plugin-5f68df7f58-fcdhg\" (UID: \"f622f33d-9069-4b94-a5d5-a4e67feafff0\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-fcdhg" Jul 15 04:07:49.316517 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:07:49.316447 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-fcdhg" Jul 15 04:07:49.456661 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:07:49.456553 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-5f68df7f58-fcdhg"] Jul 15 04:07:49.459683 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:07:49.459655 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf622f33d_9069_4b94_a5d5_a4e67feafff0.slice/crio-65bcb612ea95c46e967d8f2abdf8461bc484340643af245334b6d23ed4990f97 WatchSource:0}: Error finding container 65bcb612ea95c46e967d8f2abdf8461bc484340643af245334b6d23ed4990f97: Status 404 returned error can't find the container with id 65bcb612ea95c46e967d8f2abdf8461bc484340643af245334b6d23ed4990f97 Jul 15 04:07:49.547424 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:07:49.547386 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-fcdhg" event={"ID":"f622f33d-9069-4b94-a5d5-a4e67feafff0","Type":"ContainerStarted","Data":"65bcb612ea95c46e967d8f2abdf8461bc484340643af245334b6d23ed4990f97"} Jul 15 04:07:49.549316 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:07:49.549289 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-77bc8bcdf5-cmdd5" event={"ID":"ba24f9e9-e5da-40b8-9812-a5fe45ed111b","Type":"ContainerStarted","Data":"7d265e39f49c53d258548d7c129a9b32c68a23d6e4cd6f337b179e209a48bd69"} Jul 15 04:07:49.576182 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:07:49.576063 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-77bc8bcdf5-cmdd5" podStartSLOduration=1.648575318 podStartE2EDuration="3.576040218s" totalImagesPullingTime="1.9274649s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 04:07:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 04:07:49.575545521 +0000 UTC m=+103.102346540" watchObservedRunningTime="2026-07-15 04:07:49.576040218 +0000 UTC m=+103.102841235" Jul 15 04:07:50.118986 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:07:50.118953 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:07:50.220705 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:07:50.220667 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:07:50.549977 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:07:50.549939 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:07:50.558399 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:07:50.558368 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d0b40b90-794d-4124-bd19-0a656d5f6566","Type":"ContainerStarted","Data":"206d56b50ff9e4cdf2053acbb95d94911b18b568adeeced85ac1a75baafcaecc"} Jul 15 04:07:50.583110 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:07:50.583061 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.563568459 podStartE2EDuration="7.583046642s" totalImagesPullingTime="4.991121825s" totalInitContainerRuntime="28.356358ms" isStatefulPod=false podCreationTimestamp="2026-07-15 04:07:43 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 04:07:50.582108298 +0000 UTC m=+104.108909338" watchObservedRunningTime="2026-07-15 04:07:50.583046642 +0000 UTC m=+104.109847656" Jul 15 04:07:50.652139 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:07:50.652039 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:07:52.568829 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:07:52.568793 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-fcdhg" event={"ID":"f622f33d-9069-4b94-a5d5-a4e67feafff0","Type":"ContainerStarted","Data":"4ed4bd3ef7b5d38538600c8864d45bc5e13bcfd7661d085ad4542a63f8d6b5a4"} Jul 15 04:07:52.569271 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:07:52.569019 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-fcdhg" Jul 15 04:07:52.574297 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:07:52.574278 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-fcdhg" Jul 15 04:07:52.584505 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:07:52.584462 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-fcdhg" podStartSLOduration=3.253053968 podStartE2EDuration="5.5844472s" totalImagesPullingTime="2.331393232s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 04:07:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 04:07:52.582560338 +0000 UTC m=+106.109361353" watchObservedRunningTime="2026-07-15 04:07:52.5844472 +0000 UTC m=+106.111248216" Jul 15 04:07:54.289580 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:07:54.289543 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:07:54.394911 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:07:54.394882 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:07:58.226604 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:07:58.226573 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:07:58.281687 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:07:58.281659 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:07:58.332264 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:07:58.332228 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:08:07.285105 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:08:07.285060 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-77bc8bcdf5-cmdd5" Jul 15 04:08:07.285521 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:08:07.285146 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-77bc8bcdf5-cmdd5" Jul 15 04:08:07.936173 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:08:07.936107 2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-86bc794d9-k6v97" podUID="bb386795-c0e9-4236-9b60-73ccf95c95e6" containerName="registry" containerID="cri-o://97a20b043f4587de8f7b3c9b60dbb396cc57a2d022585eedbf768ffd019d44e9" gracePeriod=30 Jul 15 04:08:08.174561 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:08:08.174534 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-86bc794d9-k6v97" Jul 15 04:08:08.278792 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:08:08.278707 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/bb386795-c0e9-4236-9b60-73ccf95c95e6-registry-certificates\") pod \"bb386795-c0e9-4236-9b60-73ccf95c95e6\" (UID: \"bb386795-c0e9-4236-9b60-73ccf95c95e6\") " Jul 15 04:08:08.278792 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:08:08.278745 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/bb386795-c0e9-4236-9b60-73ccf95c95e6-trusted-ca\") pod \"bb386795-c0e9-4236-9b60-73ccf95c95e6\" (UID: \"bb386795-c0e9-4236-9b60-73ccf95c95e6\") " Jul 15 04:08:08.278966 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:08:08.278809 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/bb386795-c0e9-4236-9b60-73ccf95c95e6-installation-pull-secrets\") pod \"bb386795-c0e9-4236-9b60-73ccf95c95e6\" (UID: \"bb386795-c0e9-4236-9b60-73ccf95c95e6\") " Jul 15 04:08:08.278966 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:08:08.278837 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/bb386795-c0e9-4236-9b60-73ccf95c95e6-bound-sa-token\") pod \"bb386795-c0e9-4236-9b60-73ccf95c95e6\" (UID: \"bb386795-c0e9-4236-9b60-73ccf95c95e6\") " Jul 15 04:08:08.279037 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:08:08.278979 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/bb386795-c0e9-4236-9b60-73ccf95c95e6-image-registry-private-configuration\") pod \"bb386795-c0e9-4236-9b60-73ccf95c95e6\" (UID: \"bb386795-c0e9-4236-9b60-73ccf95c95e6\") " Jul 15 04:08:08.279037 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:08:08.279021 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/bb386795-c0e9-4236-9b60-73ccf95c95e6-ca-trust-extracted\") pod \"bb386795-c0e9-4236-9b60-73ccf95c95e6\" (UID: \"bb386795-c0e9-4236-9b60-73ccf95c95e6\") " Jul 15 04:08:08.279171 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:08:08.279047 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/bb386795-c0e9-4236-9b60-73ccf95c95e6-registry-tls\") pod \"bb386795-c0e9-4236-9b60-73ccf95c95e6\" (UID: \"bb386795-c0e9-4236-9b60-73ccf95c95e6\") " Jul 15 04:08:08.279171 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:08:08.279114 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-59rmx\" (UniqueName: \"kubernetes.io/projected/bb386795-c0e9-4236-9b60-73ccf95c95e6-kube-api-access-59rmx\") pod \"bb386795-c0e9-4236-9b60-73ccf95c95e6\" (UID: \"bb386795-c0e9-4236-9b60-73ccf95c95e6\") " Jul 15 04:08:08.279293 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:08:08.279217 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bb386795-c0e9-4236-9b60-73ccf95c95e6-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "bb386795-c0e9-4236-9b60-73ccf95c95e6" (UID: "bb386795-c0e9-4236-9b60-73ccf95c95e6"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 15 04:08:08.279375 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:08:08.279245 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bb386795-c0e9-4236-9b60-73ccf95c95e6-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "bb386795-c0e9-4236-9b60-73ccf95c95e6" (UID: "bb386795-c0e9-4236-9b60-73ccf95c95e6"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 15 04:08:08.279485 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:08:08.279466 2581 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/bb386795-c0e9-4236-9b60-73ccf95c95e6-registry-certificates\") on node \"ip-10-0-128-222.ec2.internal\" DevicePath \"\"" Jul 15 04:08:08.279557 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:08:08.279490 2581 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/bb386795-c0e9-4236-9b60-73ccf95c95e6-trusted-ca\") on node \"ip-10-0-128-222.ec2.internal\" DevicePath \"\"" Jul 15 04:08:08.281306 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:08:08.281277 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bb386795-c0e9-4236-9b60-73ccf95c95e6-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "bb386795-c0e9-4236-9b60-73ccf95c95e6" (UID: "bb386795-c0e9-4236-9b60-73ccf95c95e6"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 15 04:08:08.281427 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:08:08.281415 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bb386795-c0e9-4236-9b60-73ccf95c95e6-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "bb386795-c0e9-4236-9b60-73ccf95c95e6" (UID: "bb386795-c0e9-4236-9b60-73ccf95c95e6"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 15 04:08:08.281575 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:08:08.281550 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bb386795-c0e9-4236-9b60-73ccf95c95e6-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "bb386795-c0e9-4236-9b60-73ccf95c95e6" (UID: "bb386795-c0e9-4236-9b60-73ccf95c95e6"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 15 04:08:08.281650 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:08:08.281617 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bb386795-c0e9-4236-9b60-73ccf95c95e6-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "bb386795-c0e9-4236-9b60-73ccf95c95e6" (UID: "bb386795-c0e9-4236-9b60-73ccf95c95e6"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 15 04:08:08.281784 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:08:08.281769 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bb386795-c0e9-4236-9b60-73ccf95c95e6-kube-api-access-59rmx" (OuterVolumeSpecName: "kube-api-access-59rmx") pod "bb386795-c0e9-4236-9b60-73ccf95c95e6" (UID: "bb386795-c0e9-4236-9b60-73ccf95c95e6"). InnerVolumeSpecName "kube-api-access-59rmx". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 15 04:08:08.287618 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:08:08.287593 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bb386795-c0e9-4236-9b60-73ccf95c95e6-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "bb386795-c0e9-4236-9b60-73ccf95c95e6" (UID: "bb386795-c0e9-4236-9b60-73ccf95c95e6"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 04:08:08.380887 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:08:08.380848 2581 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/bb386795-c0e9-4236-9b60-73ccf95c95e6-installation-pull-secrets\") on node \"ip-10-0-128-222.ec2.internal\" DevicePath \"\"" Jul 15 04:08:08.380887 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:08:08.380879 2581 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/bb386795-c0e9-4236-9b60-73ccf95c95e6-bound-sa-token\") on node \"ip-10-0-128-222.ec2.internal\" DevicePath \"\"" Jul 15 04:08:08.380887 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:08:08.380893 2581 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/bb386795-c0e9-4236-9b60-73ccf95c95e6-image-registry-private-configuration\") on node \"ip-10-0-128-222.ec2.internal\" DevicePath \"\"" Jul 15 04:08:08.381080 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:08:08.380903 2581 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/bb386795-c0e9-4236-9b60-73ccf95c95e6-ca-trust-extracted\") on node \"ip-10-0-128-222.ec2.internal\" DevicePath \"\"" Jul 15 04:08:08.381080 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:08:08.380911 2581 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/bb386795-c0e9-4236-9b60-73ccf95c95e6-registry-tls\") on node \"ip-10-0-128-222.ec2.internal\" DevicePath \"\"" Jul 15 04:08:08.381080 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:08:08.380919 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-59rmx\" (UniqueName: \"kubernetes.io/projected/bb386795-c0e9-4236-9b60-73ccf95c95e6-kube-api-access-59rmx\") on node \"ip-10-0-128-222.ec2.internal\" DevicePath \"\"" Jul 15 04:08:08.633499 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:08:08.633466 2581 generic.go:356] "Generic (PLEG): container finished" podID="bb386795-c0e9-4236-9b60-73ccf95c95e6" containerID="97a20b043f4587de8f7b3c9b60dbb396cc57a2d022585eedbf768ffd019d44e9" exitCode=0 Jul 15 04:08:08.633639 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:08:08.633534 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-86bc794d9-k6v97" Jul 15 04:08:08.633639 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:08:08.633554 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-86bc794d9-k6v97" event={"ID":"bb386795-c0e9-4236-9b60-73ccf95c95e6","Type":"ContainerDied","Data":"97a20b043f4587de8f7b3c9b60dbb396cc57a2d022585eedbf768ffd019d44e9"} Jul 15 04:08:08.633722 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:08:08.633643 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-86bc794d9-k6v97" event={"ID":"bb386795-c0e9-4236-9b60-73ccf95c95e6","Type":"ContainerDied","Data":"f620b13b97410e7fbdf306a8d5254df13859c83545fcc4e67b9c8501c19f8096"} Jul 15 04:08:08.633722 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:08:08.633672 2581 scope.go:117] "RemoveContainer" containerID="97a20b043f4587de8f7b3c9b60dbb396cc57a2d022585eedbf768ffd019d44e9" Jul 15 04:08:08.642383 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:08:08.642363 2581 scope.go:117] "RemoveContainer" containerID="97a20b043f4587de8f7b3c9b60dbb396cc57a2d022585eedbf768ffd019d44e9" Jul 15 04:08:08.642653 ip-10-0-128-222 kubenswrapper[2581]: E0715 04:08:08.642628 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"97a20b043f4587de8f7b3c9b60dbb396cc57a2d022585eedbf768ffd019d44e9\": container with ID starting with 97a20b043f4587de8f7b3c9b60dbb396cc57a2d022585eedbf768ffd019d44e9 not found: ID does not exist" containerID="97a20b043f4587de8f7b3c9b60dbb396cc57a2d022585eedbf768ffd019d44e9" Jul 15 04:08:08.642698 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:08:08.642663 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"97a20b043f4587de8f7b3c9b60dbb396cc57a2d022585eedbf768ffd019d44e9"} err="failed to get container status \"97a20b043f4587de8f7b3c9b60dbb396cc57a2d022585eedbf768ffd019d44e9\": rpc error: code = NotFound desc = could not find container \"97a20b043f4587de8f7b3c9b60dbb396cc57a2d022585eedbf768ffd019d44e9\": container with ID starting with 97a20b043f4587de8f7b3c9b60dbb396cc57a2d022585eedbf768ffd019d44e9 not found: ID does not exist" Jul 15 04:08:08.654522 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:08:08.654485 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-86bc794d9-k6v97"] Jul 15 04:08:08.659591 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:08:08.659559 2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-86bc794d9-k6v97"] Jul 15 04:08:08.988859 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:08:08.988782 2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bb386795-c0e9-4236-9b60-73ccf95c95e6" path="/var/lib/kubelet/pods/bb386795-c0e9-4236-9b60-73ccf95c95e6/volumes" Jul 15 04:08:09.053078 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:08:09.053043 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:08:09.153766 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:08:09.153730 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:08:09.639109 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:08:09.639076 2581 generic.go:356] "Generic (PLEG): container finished" podID="aa52afbe-abd9-45ea-9f98-6a66b50b07b7" containerID="2b222a22a8db70f35ee5c66bd31127af3b1fef43664854058b65fbea780b1e25" exitCode=0 Jul 15 04:08:09.639519 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:08:09.639153 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-xgz4r" event={"ID":"aa52afbe-abd9-45ea-9f98-6a66b50b07b7","Type":"ContainerDied","Data":"2b222a22a8db70f35ee5c66bd31127af3b1fef43664854058b65fbea780b1e25"} Jul 15 04:08:09.639589 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:08:09.639553 2581 scope.go:117] "RemoveContainer" containerID="2b222a22a8db70f35ee5c66bd31127af3b1fef43664854058b65fbea780b1e25" Jul 15 04:08:09.640743 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:08:09.640721 2581 generic.go:356] "Generic (PLEG): container finished" podID="07b2020a-a077-46ee-abe8-44454ada45a4" containerID="81935db2103bf370c4f8d1c26cf9ba8b060243b9fa1fad75ec1dff79ad6f3a3f" exitCode=0 Jul 15 04:08:09.640858 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:08:09.640785 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-8zm4v" event={"ID":"07b2020a-a077-46ee-abe8-44454ada45a4","Type":"ContainerDied","Data":"81935db2103bf370c4f8d1c26cf9ba8b060243b9fa1fad75ec1dff79ad6f3a3f"} Jul 15 04:08:09.641162 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:08:09.641146 2581 scope.go:117] "RemoveContainer" containerID="81935db2103bf370c4f8d1c26cf9ba8b060243b9fa1fad75ec1dff79ad6f3a3f" Jul 15 04:08:10.648843 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:08:10.648812 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-xgz4r" event={"ID":"aa52afbe-abd9-45ea-9f98-6a66b50b07b7","Type":"ContainerStarted","Data":"d33ac70b3ae3190d3d41c99708c8e905f540ece0b6de7ee2c4d4da5e4540e96a"} Jul 15 04:08:10.650403 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:08:10.650381 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-8zm4v" event={"ID":"07b2020a-a077-46ee-abe8-44454ada45a4","Type":"ContainerStarted","Data":"4bd3f9247ac80c5e96083fe375235944ffe545ba34a94317b5d3366d7ebf82b8"} Jul 15 04:08:14.668284 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:08:14.668251 2581 generic.go:356] "Generic (PLEG): container finished" podID="81a32cdd-cc66-4a2b-9d86-08b37f285ca2" containerID="9b44ecfe24af0669b7aa9aabe029e956f57f35dfab90f60fca7a8b1100eec1b2" exitCode=0 Jul 15 04:08:14.668662 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:08:14.668310 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-68d9dd94cf-tr2rw" event={"ID":"81a32cdd-cc66-4a2b-9d86-08b37f285ca2","Type":"ContainerDied","Data":"9b44ecfe24af0669b7aa9aabe029e956f57f35dfab90f60fca7a8b1100eec1b2"} Jul 15 04:08:14.668662 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:08:14.668658 2581 scope.go:117] "RemoveContainer" containerID="9b44ecfe24af0669b7aa9aabe029e956f57f35dfab90f60fca7a8b1100eec1b2" Jul 15 04:08:15.421419 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:08:15.421382 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-64997dd578-n79tf_a0a40e9b-cf54-4ae2-a584-ca5cadf85733/router/0.log" Jul 15 04:08:15.434135 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:08:15.434098 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-mptrm_419f1d13-f9de-4b4a-ad52-a977ee3b7ef2/serve-healthcheck-canary/0.log" Jul 15 04:08:15.674324 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:08:15.674239 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-68d9dd94cf-tr2rw" event={"ID":"81a32cdd-cc66-4a2b-9d86-08b37f285ca2","Type":"ContainerStarted","Data":"9f4ada62510e4b354df5544ee13e70a9e4c0d425ac57a4378010b5a9773c3ca1"} Jul 15 04:08:16.066054 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:08:16.065976 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:08:16.166973 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:08:16.166941 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:08:16.219595 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:08:16.219565 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:08:24.048927 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:08:24.048892 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:08:24.102422 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:08:24.102384 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:08:27.295528 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:08:27.295492 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-77bc8bcdf5-cmdd5" Jul 15 04:08:27.299947 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:08:27.299921 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-77bc8bcdf5-cmdd5" Jul 15 04:08:30.809827 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:08:30.809796 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:09:01.933629 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:09:01.933518 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:09:02.908294 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:09:02.908260 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:09:02.998211 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:09:02.998180 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 15 04:09:02.998631 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:09:02.998464 2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="d0b40b90-794d-4124-bd19-0a656d5f6566" containerName="alertmanager" containerID="cri-o://6f70a9520c89cffa73b33b07186acf345865a08e42ca001188ec06750a74debe" gracePeriod=120 Jul 15 04:09:02.998631 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:09:02.998469 2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="d0b40b90-794d-4124-bd19-0a656d5f6566" containerName="kube-rbac-proxy-metric" containerID="cri-o://a74e98bb1366042a0ae42faf380a38bd75a2fa296a34fe91f0fee29f1b614bfc" gracePeriod=120 Jul 15 04:09:02.998631 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:09:02.998513 2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="d0b40b90-794d-4124-bd19-0a656d5f6566" containerName="kube-rbac-proxy-web" containerID="cri-o://82032a637e8b319122901a8b5325bffe562eb12984bb640ee5b4876e474109db" gracePeriod=120 Jul 15 04:09:02.998788 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:09:02.998549 2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="d0b40b90-794d-4124-bd19-0a656d5f6566" containerName="config-reloader" containerID="cri-o://3ac65296a4448274ae9948abd3107b454253f5ec1ff858fd290b301000e8d27a" gracePeriod=120 Jul 15 04:09:02.998788 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:09:02.998552 2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="d0b40b90-794d-4124-bd19-0a656d5f6566" containerName="prom-label-proxy" containerID="cri-o://206d56b50ff9e4cdf2053acbb95d94911b18b568adeeced85ac1a75baafcaecc" gracePeriod=120 Jul 15 04:09:02.998882 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:09:02.998549 2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="d0b40b90-794d-4124-bd19-0a656d5f6566" containerName="kube-rbac-proxy" containerID="cri-o://eae743e352e1b219a5216035001e647ed40bf43c7043decbe70edb2223831cb0" gracePeriod=120 Jul 15 04:09:03.879645 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:09:03.879613 2581 generic.go:356] "Generic (PLEG): container finished" podID="d0b40b90-794d-4124-bd19-0a656d5f6566" containerID="206d56b50ff9e4cdf2053acbb95d94911b18b568adeeced85ac1a75baafcaecc" exitCode=0 Jul 15 04:09:03.879645 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:09:03.879638 2581 generic.go:356] "Generic (PLEG): container finished" podID="d0b40b90-794d-4124-bd19-0a656d5f6566" containerID="eae743e352e1b219a5216035001e647ed40bf43c7043decbe70edb2223831cb0" exitCode=0 Jul 15 04:09:03.879645 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:09:03.879646 2581 generic.go:356] "Generic (PLEG): container finished" podID="d0b40b90-794d-4124-bd19-0a656d5f6566" containerID="3ac65296a4448274ae9948abd3107b454253f5ec1ff858fd290b301000e8d27a" exitCode=0 Jul 15 04:09:03.879645 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:09:03.879652 2581 generic.go:356] "Generic (PLEG): container finished" podID="d0b40b90-794d-4124-bd19-0a656d5f6566" containerID="6f70a9520c89cffa73b33b07186acf345865a08e42ca001188ec06750a74debe" exitCode=0 Jul 15 04:09:03.879902 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:09:03.879690 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d0b40b90-794d-4124-bd19-0a656d5f6566","Type":"ContainerDied","Data":"206d56b50ff9e4cdf2053acbb95d94911b18b568adeeced85ac1a75baafcaecc"} Jul 15 04:09:03.879902 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:09:03.879753 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d0b40b90-794d-4124-bd19-0a656d5f6566","Type":"ContainerDied","Data":"eae743e352e1b219a5216035001e647ed40bf43c7043decbe70edb2223831cb0"} Jul 15 04:09:03.879902 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:09:03.879781 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d0b40b90-794d-4124-bd19-0a656d5f6566","Type":"ContainerDied","Data":"3ac65296a4448274ae9948abd3107b454253f5ec1ff858fd290b301000e8d27a"} Jul 15 04:09:03.879902 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:09:03.879805 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d0b40b90-794d-4124-bd19-0a656d5f6566","Type":"ContainerDied","Data":"6f70a9520c89cffa73b33b07186acf345865a08e42ca001188ec06750a74debe"} Jul 15 04:09:04.248107 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:09:04.248084 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 15 04:09:04.367389 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:09:04.367354 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/d0b40b90-794d-4124-bd19-0a656d5f6566-web-config\") pod \"d0b40b90-794d-4124-bd19-0a656d5f6566\" (UID: \"d0b40b90-794d-4124-bd19-0a656d5f6566\") " Jul 15 04:09:04.367389 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:09:04.367390 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/d0b40b90-794d-4124-bd19-0a656d5f6566-cluster-tls-config\") pod \"d0b40b90-794d-4124-bd19-0a656d5f6566\" (UID: \"d0b40b90-794d-4124-bd19-0a656d5f6566\") " Jul 15 04:09:04.367693 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:09:04.367438 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mw9nn\" (UniqueName: \"kubernetes.io/projected/d0b40b90-794d-4124-bd19-0a656d5f6566-kube-api-access-mw9nn\") pod \"d0b40b90-794d-4124-bd19-0a656d5f6566\" (UID: \"d0b40b90-794d-4124-bd19-0a656d5f6566\") " Jul 15 04:09:04.367693 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:09:04.367453 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/d0b40b90-794d-4124-bd19-0a656d5f6566-tls-assets\") pod \"d0b40b90-794d-4124-bd19-0a656d5f6566\" (UID: \"d0b40b90-794d-4124-bd19-0a656d5f6566\") " Jul 15 04:09:04.367693 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:09:04.367472 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/d0b40b90-794d-4124-bd19-0a656d5f6566-secret-alertmanager-main-tls\") pod \"d0b40b90-794d-4124-bd19-0a656d5f6566\" (UID: \"d0b40b90-794d-4124-bd19-0a656d5f6566\") " Jul 15 04:09:04.367693 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:09:04.367499 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/d0b40b90-794d-4124-bd19-0a656d5f6566-secret-alertmanager-kube-rbac-proxy\") pod \"d0b40b90-794d-4124-bd19-0a656d5f6566\" (UID: \"d0b40b90-794d-4124-bd19-0a656d5f6566\") " Jul 15 04:09:04.367693 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:09:04.367539 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d0b40b90-794d-4124-bd19-0a656d5f6566-metrics-client-ca\") pod \"d0b40b90-794d-4124-bd19-0a656d5f6566\" (UID: \"d0b40b90-794d-4124-bd19-0a656d5f6566\") " Jul 15 04:09:04.367693 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:09:04.367568 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d0b40b90-794d-4124-bd19-0a656d5f6566-alertmanager-trusted-ca-bundle\") pod \"d0b40b90-794d-4124-bd19-0a656d5f6566\" (UID: \"d0b40b90-794d-4124-bd19-0a656d5f6566\") " Jul 15 04:09:04.367693 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:09:04.367602 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/d0b40b90-794d-4124-bd19-0a656d5f6566-alertmanager-main-db\") pod \"d0b40b90-794d-4124-bd19-0a656d5f6566\" (UID: \"d0b40b90-794d-4124-bd19-0a656d5f6566\") " Jul 15 04:09:04.367693 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:09:04.367631 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/d0b40b90-794d-4124-bd19-0a656d5f6566-secret-alertmanager-kube-rbac-proxy-web\") pod \"d0b40b90-794d-4124-bd19-0a656d5f6566\" (UID: \"d0b40b90-794d-4124-bd19-0a656d5f6566\") " Jul 15 04:09:04.367693 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:09:04.367672 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/d0b40b90-794d-4124-bd19-0a656d5f6566-config-volume\") pod \"d0b40b90-794d-4124-bd19-0a656d5f6566\" (UID: \"d0b40b90-794d-4124-bd19-0a656d5f6566\") " Jul 15 04:09:04.368163 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:09:04.367705 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/d0b40b90-794d-4124-bd19-0a656d5f6566-config-out\") pod \"d0b40b90-794d-4124-bd19-0a656d5f6566\" (UID: \"d0b40b90-794d-4124-bd19-0a656d5f6566\") " Jul 15 04:09:04.368163 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:09:04.367758 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/d0b40b90-794d-4124-bd19-0a656d5f6566-secret-alertmanager-kube-rbac-proxy-metric\") pod \"d0b40b90-794d-4124-bd19-0a656d5f6566\" (UID: \"d0b40b90-794d-4124-bd19-0a656d5f6566\") " Jul 15 04:09:04.368163 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:09:04.367984 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d0b40b90-794d-4124-bd19-0a656d5f6566-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "d0b40b90-794d-4124-bd19-0a656d5f6566" (UID: "d0b40b90-794d-4124-bd19-0a656d5f6566"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 15 04:09:04.370467 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:09:04.370422 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d0b40b90-794d-4124-bd19-0a656d5f6566-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "d0b40b90-794d-4124-bd19-0a656d5f6566" (UID: "d0b40b90-794d-4124-bd19-0a656d5f6566"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 15 04:09:04.370587 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:09:04.370476 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d0b40b90-794d-4124-bd19-0a656d5f6566-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "d0b40b90-794d-4124-bd19-0a656d5f6566" (UID: "d0b40b90-794d-4124-bd19-0a656d5f6566"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 04:09:04.370648 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:09:04.370587 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d0b40b90-794d-4124-bd19-0a656d5f6566-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "d0b40b90-794d-4124-bd19-0a656d5f6566" (UID: "d0b40b90-794d-4124-bd19-0a656d5f6566"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 15 04:09:04.370837 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:09:04.370812 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d0b40b90-794d-4124-bd19-0a656d5f6566-config-volume" (OuterVolumeSpecName: "config-volume") pod "d0b40b90-794d-4124-bd19-0a656d5f6566" (UID: "d0b40b90-794d-4124-bd19-0a656d5f6566"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 15 04:09:04.370919 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:09:04.370855 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d0b40b90-794d-4124-bd19-0a656d5f6566-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "d0b40b90-794d-4124-bd19-0a656d5f6566" (UID: "d0b40b90-794d-4124-bd19-0a656d5f6566"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 15 04:09:04.371104 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:09:04.371073 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d0b40b90-794d-4124-bd19-0a656d5f6566-kube-api-access-mw9nn" (OuterVolumeSpecName: "kube-api-access-mw9nn") pod "d0b40b90-794d-4124-bd19-0a656d5f6566" (UID: "d0b40b90-794d-4124-bd19-0a656d5f6566"). InnerVolumeSpecName "kube-api-access-mw9nn". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 15 04:09:04.371104 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:09:04.371073 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d0b40b90-794d-4124-bd19-0a656d5f6566-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "d0b40b90-794d-4124-bd19-0a656d5f6566" (UID: "d0b40b90-794d-4124-bd19-0a656d5f6566"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 15 04:09:04.371236 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:09:04.371105 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d0b40b90-794d-4124-bd19-0a656d5f6566-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "d0b40b90-794d-4124-bd19-0a656d5f6566" (UID: "d0b40b90-794d-4124-bd19-0a656d5f6566"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 15 04:09:04.372749 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:09:04.372725 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d0b40b90-794d-4124-bd19-0a656d5f6566-config-out" (OuterVolumeSpecName: "config-out") pod "d0b40b90-794d-4124-bd19-0a656d5f6566" (UID: "d0b40b90-794d-4124-bd19-0a656d5f6566"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 04:09:04.372924 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:09:04.372903 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d0b40b90-794d-4124-bd19-0a656d5f6566-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "d0b40b90-794d-4124-bd19-0a656d5f6566" (UID: "d0b40b90-794d-4124-bd19-0a656d5f6566"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 15 04:09:04.375170 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:09:04.375148 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d0b40b90-794d-4124-bd19-0a656d5f6566-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "d0b40b90-794d-4124-bd19-0a656d5f6566" (UID: "d0b40b90-794d-4124-bd19-0a656d5f6566"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 15 04:09:04.381412 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:09:04.381390 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d0b40b90-794d-4124-bd19-0a656d5f6566-web-config" (OuterVolumeSpecName: "web-config") pod "d0b40b90-794d-4124-bd19-0a656d5f6566" (UID: "d0b40b90-794d-4124-bd19-0a656d5f6566"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 15 04:09:04.468797 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:09:04.468705 2581 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/d0b40b90-794d-4124-bd19-0a656d5f6566-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-128-222.ec2.internal\" DevicePath \"\"" Jul 15 04:09:04.468797 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:09:04.468739 2581 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d0b40b90-794d-4124-bd19-0a656d5f6566-metrics-client-ca\") on node \"ip-10-0-128-222.ec2.internal\" DevicePath \"\"" Jul 15 04:09:04.468797 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:09:04.468751 2581 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d0b40b90-794d-4124-bd19-0a656d5f6566-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-128-222.ec2.internal\" DevicePath \"\"" Jul 15 04:09:04.468797 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:09:04.468759 2581 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/d0b40b90-794d-4124-bd19-0a656d5f6566-alertmanager-main-db\") on node \"ip-10-0-128-222.ec2.internal\" DevicePath \"\"" Jul 15 04:09:04.468797 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:09:04.468777 2581 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/d0b40b90-794d-4124-bd19-0a656d5f6566-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-128-222.ec2.internal\" DevicePath \"\"" Jul 15 04:09:04.468797 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:09:04.468787 2581 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/d0b40b90-794d-4124-bd19-0a656d5f6566-config-volume\") on node \"ip-10-0-128-222.ec2.internal\" DevicePath \"\"" Jul 15 04:09:04.468797 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:09:04.468795 2581 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/d0b40b90-794d-4124-bd19-0a656d5f6566-config-out\") on node \"ip-10-0-128-222.ec2.internal\" DevicePath \"\"" Jul 15 04:09:04.468797 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:09:04.468803 2581 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/d0b40b90-794d-4124-bd19-0a656d5f6566-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-128-222.ec2.internal\" DevicePath \"\"" Jul 15 04:09:04.469222 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:09:04.468812 2581 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/d0b40b90-794d-4124-bd19-0a656d5f6566-web-config\") on node \"ip-10-0-128-222.ec2.internal\" DevicePath \"\"" Jul 15 04:09:04.469222 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:09:04.468820 2581 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/d0b40b90-794d-4124-bd19-0a656d5f6566-cluster-tls-config\") on node \"ip-10-0-128-222.ec2.internal\" DevicePath \"\"" Jul 15 04:09:04.469222 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:09:04.468828 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mw9nn\" (UniqueName: \"kubernetes.io/projected/d0b40b90-794d-4124-bd19-0a656d5f6566-kube-api-access-mw9nn\") on node \"ip-10-0-128-222.ec2.internal\" DevicePath \"\"" Jul 15 04:09:04.469222 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:09:04.468836 2581 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/d0b40b90-794d-4124-bd19-0a656d5f6566-tls-assets\") on node \"ip-10-0-128-222.ec2.internal\" DevicePath \"\"" Jul 15 04:09:04.469222 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:09:04.468844 2581 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/d0b40b90-794d-4124-bd19-0a656d5f6566-secret-alertmanager-main-tls\") on node \"ip-10-0-128-222.ec2.internal\" DevicePath \"\"" Jul 15 04:09:04.886380 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:09:04.886347 2581 generic.go:356] "Generic (PLEG): container finished" podID="d0b40b90-794d-4124-bd19-0a656d5f6566" containerID="a74e98bb1366042a0ae42faf380a38bd75a2fa296a34fe91f0fee29f1b614bfc" exitCode=0 Jul 15 04:09:04.886380 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:09:04.886373 2581 generic.go:356] "Generic (PLEG): container finished" podID="d0b40b90-794d-4124-bd19-0a656d5f6566" containerID="82032a637e8b319122901a8b5325bffe562eb12984bb640ee5b4876e474109db" exitCode=0 Jul 15 04:09:04.886578 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:09:04.886436 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 15 04:09:04.886578 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:09:04.886431 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d0b40b90-794d-4124-bd19-0a656d5f6566","Type":"ContainerDied","Data":"a74e98bb1366042a0ae42faf380a38bd75a2fa296a34fe91f0fee29f1b614bfc"} Jul 15 04:09:04.886644 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:09:04.886599 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d0b40b90-794d-4124-bd19-0a656d5f6566","Type":"ContainerDied","Data":"82032a637e8b319122901a8b5325bffe562eb12984bb640ee5b4876e474109db"} Jul 15 04:09:04.886644 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:09:04.886629 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d0b40b90-794d-4124-bd19-0a656d5f6566","Type":"ContainerDied","Data":"8c6d9dc2c3086960059fd7004994dc5dae34d4e6a59a203fbf96ade2fbebf89d"} Jul 15 04:09:04.886708 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:09:04.886671 2581 scope.go:117] "RemoveContainer" containerID="206d56b50ff9e4cdf2053acbb95d94911b18b568adeeced85ac1a75baafcaecc" Jul 15 04:09:04.895187 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:09:04.895116 2581 scope.go:117] "RemoveContainer" containerID="a74e98bb1366042a0ae42faf380a38bd75a2fa296a34fe91f0fee29f1b614bfc" Jul 15 04:09:04.902234 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:09:04.902216 2581 scope.go:117] "RemoveContainer" containerID="eae743e352e1b219a5216035001e647ed40bf43c7043decbe70edb2223831cb0" Jul 15 04:09:04.909516 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:09:04.909490 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 15 04:09:04.910371 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:09:04.910350 2581 scope.go:117] "RemoveContainer" containerID="82032a637e8b319122901a8b5325bffe562eb12984bb640ee5b4876e474109db" Jul 15 04:09:04.913912 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:09:04.913892 2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 15 04:09:04.917672 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:09:04.917653 2581 scope.go:117] "RemoveContainer" containerID="3ac65296a4448274ae9948abd3107b454253f5ec1ff858fd290b301000e8d27a" Jul 15 04:09:04.924872 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:09:04.924852 2581 scope.go:117] "RemoveContainer" containerID="6f70a9520c89cffa73b33b07186acf345865a08e42ca001188ec06750a74debe" Jul 15 04:09:04.932539 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:09:04.932523 2581 scope.go:117] "RemoveContainer" containerID="d23edb6469f10bb2b5c713fe4e1dbca8ed467e45a1279394840b0f914d5233cf" Jul 15 04:09:04.942152 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:09:04.940091 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 15 04:09:04.942152 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:09:04.940297 2581 scope.go:117] "RemoveContainer" containerID="206d56b50ff9e4cdf2053acbb95d94911b18b568adeeced85ac1a75baafcaecc" Jul 15 04:09:04.942152 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:09:04.940530 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d0b40b90-794d-4124-bd19-0a656d5f6566" containerName="config-reloader" Jul 15 04:09:04.942152 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:09:04.940545 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="d0b40b90-794d-4124-bd19-0a656d5f6566" containerName="config-reloader" Jul 15 04:09:04.942152 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:09:04.940562 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d0b40b90-794d-4124-bd19-0a656d5f6566" containerName="init-config-reloader" Jul 15 04:09:04.942152 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:09:04.940570 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="d0b40b90-794d-4124-bd19-0a656d5f6566" containerName="init-config-reloader" Jul 15 04:09:04.942152 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:09:04.940581 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d0b40b90-794d-4124-bd19-0a656d5f6566" containerName="alertmanager" Jul 15 04:09:04.942152 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:09:04.940589 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="d0b40b90-794d-4124-bd19-0a656d5f6566" containerName="alertmanager" Jul 15 04:09:04.942152 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:09:04.940601 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d0b40b90-794d-4124-bd19-0a656d5f6566" containerName="kube-rbac-proxy" Jul 15 04:09:04.942152 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:09:04.940609 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="d0b40b90-794d-4124-bd19-0a656d5f6566" containerName="kube-rbac-proxy" Jul 15 04:09:04.942152 ip-10-0-128-222 kubenswrapper[2581]: E0715 04:09:04.940616 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"206d56b50ff9e4cdf2053acbb95d94911b18b568adeeced85ac1a75baafcaecc\": container with ID starting with 206d56b50ff9e4cdf2053acbb95d94911b18b568adeeced85ac1a75baafcaecc not found: ID does not exist" containerID="206d56b50ff9e4cdf2053acbb95d94911b18b568adeeced85ac1a75baafcaecc" Jul 15 04:09:04.942152 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:09:04.940631 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d0b40b90-794d-4124-bd19-0a656d5f6566" containerName="kube-rbac-proxy-web" Jul 15 04:09:04.942152 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:09:04.940639 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="d0b40b90-794d-4124-bd19-0a656d5f6566" containerName="kube-rbac-proxy-web" Jul 15 04:09:04.942152 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:09:04.940649 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d0b40b90-794d-4124-bd19-0a656d5f6566" containerName="kube-rbac-proxy-metric" Jul 15 04:09:04.942152 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:09:04.940658 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="d0b40b90-794d-4124-bd19-0a656d5f6566" containerName="kube-rbac-proxy-metric" Jul 15 04:09:04.942152 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:09:04.940666 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d0b40b90-794d-4124-bd19-0a656d5f6566" containerName="prom-label-proxy" Jul 15 04:09:04.942152 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:09:04.940674 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="d0b40b90-794d-4124-bd19-0a656d5f6566" containerName="prom-label-proxy" Jul 15 04:09:04.942152 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:09:04.940686 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bb386795-c0e9-4236-9b60-73ccf95c95e6" containerName="registry" Jul 15 04:09:04.942152 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:09:04.940694 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="bb386795-c0e9-4236-9b60-73ccf95c95e6" containerName="registry" Jul 15 04:09:04.942152 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:09:04.940682 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"206d56b50ff9e4cdf2053acbb95d94911b18b568adeeced85ac1a75baafcaecc"} err="failed to get container status \"206d56b50ff9e4cdf2053acbb95d94911b18b568adeeced85ac1a75baafcaecc\": rpc error: code = NotFound desc = could not find container \"206d56b50ff9e4cdf2053acbb95d94911b18b568adeeced85ac1a75baafcaecc\": container with ID starting with 206d56b50ff9e4cdf2053acbb95d94911b18b568adeeced85ac1a75baafcaecc not found: ID does not exist" Jul 15 04:09:04.942152 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:09:04.940710 2581 scope.go:117] "RemoveContainer" containerID="a74e98bb1366042a0ae42faf380a38bd75a2fa296a34fe91f0fee29f1b614bfc" Jul 15 04:09:04.942152 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:09:04.940767 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="d0b40b90-794d-4124-bd19-0a656d5f6566" containerName="kube-rbac-proxy-metric" Jul 15 04:09:04.942152 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:09:04.940782 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="d0b40b90-794d-4124-bd19-0a656d5f6566" containerName="config-reloader" Jul 15 04:09:04.942152 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:09:04.940793 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="d0b40b90-794d-4124-bd19-0a656d5f6566" containerName="alertmanager" Jul 15 04:09:04.942152 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:09:04.940801 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="d0b40b90-794d-4124-bd19-0a656d5f6566" containerName="kube-rbac-proxy-web" Jul 15 04:09:04.942152 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:09:04.940810 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="d0b40b90-794d-4124-bd19-0a656d5f6566" containerName="prom-label-proxy" Jul 15 04:09:04.942152 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:09:04.940818 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="d0b40b90-794d-4124-bd19-0a656d5f6566" containerName="kube-rbac-proxy" Jul 15 04:09:04.942152 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:09:04.940825 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="bb386795-c0e9-4236-9b60-73ccf95c95e6" containerName="registry" Jul 15 04:09:04.942152 ip-10-0-128-222 kubenswrapper[2581]: E0715 04:09:04.941048 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a74e98bb1366042a0ae42faf380a38bd75a2fa296a34fe91f0fee29f1b614bfc\": container with ID starting with a74e98bb1366042a0ae42faf380a38bd75a2fa296a34fe91f0fee29f1b614bfc not found: ID does not exist" containerID="a74e98bb1366042a0ae42faf380a38bd75a2fa296a34fe91f0fee29f1b614bfc" Jul 15 04:09:04.943432 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:09:04.941073 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a74e98bb1366042a0ae42faf380a38bd75a2fa296a34fe91f0fee29f1b614bfc"} err="failed to get container status \"a74e98bb1366042a0ae42faf380a38bd75a2fa296a34fe91f0fee29f1b614bfc\": rpc error: code = NotFound desc = could not find container \"a74e98bb1366042a0ae42faf380a38bd75a2fa296a34fe91f0fee29f1b614bfc\": container with ID starting with a74e98bb1366042a0ae42faf380a38bd75a2fa296a34fe91f0fee29f1b614bfc not found: ID does not exist" Jul 15 04:09:04.943432 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:09:04.941090 2581 scope.go:117] "RemoveContainer" containerID="eae743e352e1b219a5216035001e647ed40bf43c7043decbe70edb2223831cb0" Jul 15 04:09:04.943432 ip-10-0-128-222 kubenswrapper[2581]: E0715 04:09:04.942187 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"eae743e352e1b219a5216035001e647ed40bf43c7043decbe70edb2223831cb0\": container with ID starting with eae743e352e1b219a5216035001e647ed40bf43c7043decbe70edb2223831cb0 not found: ID does not exist" containerID="eae743e352e1b219a5216035001e647ed40bf43c7043decbe70edb2223831cb0" Jul 15 04:09:04.943432 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:09:04.942211 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"eae743e352e1b219a5216035001e647ed40bf43c7043decbe70edb2223831cb0"} err="failed to get container status \"eae743e352e1b219a5216035001e647ed40bf43c7043decbe70edb2223831cb0\": rpc error: code = NotFound desc = could not find container \"eae743e352e1b219a5216035001e647ed40bf43c7043decbe70edb2223831cb0\": container with ID starting with eae743e352e1b219a5216035001e647ed40bf43c7043decbe70edb2223831cb0 not found: ID does not exist" Jul 15 04:09:04.943432 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:09:04.942231 2581 scope.go:117] "RemoveContainer" containerID="82032a637e8b319122901a8b5325bffe562eb12984bb640ee5b4876e474109db" Jul 15 04:09:04.943432 ip-10-0-128-222 kubenswrapper[2581]: E0715 04:09:04.942742 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"82032a637e8b319122901a8b5325bffe562eb12984bb640ee5b4876e474109db\": container with ID starting with 82032a637e8b319122901a8b5325bffe562eb12984bb640ee5b4876e474109db not found: ID does not exist" containerID="82032a637e8b319122901a8b5325bffe562eb12984bb640ee5b4876e474109db" Jul 15 04:09:04.943432 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:09:04.942769 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"82032a637e8b319122901a8b5325bffe562eb12984bb640ee5b4876e474109db"} err="failed to get container status \"82032a637e8b319122901a8b5325bffe562eb12984bb640ee5b4876e474109db\": rpc error: code = NotFound desc = could not find container \"82032a637e8b319122901a8b5325bffe562eb12984bb640ee5b4876e474109db\": container with ID starting with 82032a637e8b319122901a8b5325bffe562eb12984bb640ee5b4876e474109db not found: ID does not exist" Jul 15 04:09:04.943432 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:09:04.942789 2581 scope.go:117] "RemoveContainer" containerID="3ac65296a4448274ae9948abd3107b454253f5ec1ff858fd290b301000e8d27a" Jul 15 04:09:04.943432 ip-10-0-128-222 kubenswrapper[2581]: E0715 04:09:04.943026 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3ac65296a4448274ae9948abd3107b454253f5ec1ff858fd290b301000e8d27a\": container with ID starting with 3ac65296a4448274ae9948abd3107b454253f5ec1ff858fd290b301000e8d27a not found: ID does not exist" containerID="3ac65296a4448274ae9948abd3107b454253f5ec1ff858fd290b301000e8d27a" Jul 15 04:09:04.943432 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:09:04.943055 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3ac65296a4448274ae9948abd3107b454253f5ec1ff858fd290b301000e8d27a"} err="failed to get container status \"3ac65296a4448274ae9948abd3107b454253f5ec1ff858fd290b301000e8d27a\": rpc error: code = NotFound desc = could not find container \"3ac65296a4448274ae9948abd3107b454253f5ec1ff858fd290b301000e8d27a\": container with ID starting with 3ac65296a4448274ae9948abd3107b454253f5ec1ff858fd290b301000e8d27a not found: ID does not exist" Jul 15 04:09:04.943432 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:09:04.943076 2581 scope.go:117] "RemoveContainer" containerID="6f70a9520c89cffa73b33b07186acf345865a08e42ca001188ec06750a74debe" Jul 15 04:09:04.943432 ip-10-0-128-222 kubenswrapper[2581]: E0715 04:09:04.943328 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6f70a9520c89cffa73b33b07186acf345865a08e42ca001188ec06750a74debe\": container with ID starting with 6f70a9520c89cffa73b33b07186acf345865a08e42ca001188ec06750a74debe not found: ID does not exist" containerID="6f70a9520c89cffa73b33b07186acf345865a08e42ca001188ec06750a74debe" Jul 15 04:09:04.943432 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:09:04.943348 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6f70a9520c89cffa73b33b07186acf345865a08e42ca001188ec06750a74debe"} err="failed to get container status \"6f70a9520c89cffa73b33b07186acf345865a08e42ca001188ec06750a74debe\": rpc error: code = NotFound desc = could not find container \"6f70a9520c89cffa73b33b07186acf345865a08e42ca001188ec06750a74debe\": container with ID starting with 6f70a9520c89cffa73b33b07186acf345865a08e42ca001188ec06750a74debe not found: ID does not exist" Jul 15 04:09:04.943432 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:09:04.943364 2581 scope.go:117] "RemoveContainer" containerID="d23edb6469f10bb2b5c713fe4e1dbca8ed467e45a1279394840b0f914d5233cf" Jul 15 04:09:04.944018 ip-10-0-128-222 kubenswrapper[2581]: E0715 04:09:04.943587 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d23edb6469f10bb2b5c713fe4e1dbca8ed467e45a1279394840b0f914d5233cf\": container with ID starting with d23edb6469f10bb2b5c713fe4e1dbca8ed467e45a1279394840b0f914d5233cf not found: ID does not exist" containerID="d23edb6469f10bb2b5c713fe4e1dbca8ed467e45a1279394840b0f914d5233cf" Jul 15 04:09:04.944018 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:09:04.943605 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d23edb6469f10bb2b5c713fe4e1dbca8ed467e45a1279394840b0f914d5233cf"} err="failed to get container status \"d23edb6469f10bb2b5c713fe4e1dbca8ed467e45a1279394840b0f914d5233cf\": rpc error: code = NotFound desc = could not find container \"d23edb6469f10bb2b5c713fe4e1dbca8ed467e45a1279394840b0f914d5233cf\": container with ID starting with d23edb6469f10bb2b5c713fe4e1dbca8ed467e45a1279394840b0f914d5233cf not found: ID does not exist" Jul 15 04:09:04.944018 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:09:04.943619 2581 scope.go:117] "RemoveContainer" containerID="206d56b50ff9e4cdf2053acbb95d94911b18b568adeeced85ac1a75baafcaecc" Jul 15 04:09:04.944018 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:09:04.943840 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"206d56b50ff9e4cdf2053acbb95d94911b18b568adeeced85ac1a75baafcaecc"} err="failed to get container status \"206d56b50ff9e4cdf2053acbb95d94911b18b568adeeced85ac1a75baafcaecc\": rpc error: code = NotFound desc = could not find container \"206d56b50ff9e4cdf2053acbb95d94911b18b568adeeced85ac1a75baafcaecc\": container with ID starting with 206d56b50ff9e4cdf2053acbb95d94911b18b568adeeced85ac1a75baafcaecc not found: ID does not exist" Jul 15 04:09:04.944018 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:09:04.943855 2581 scope.go:117] "RemoveContainer" containerID="a74e98bb1366042a0ae42faf380a38bd75a2fa296a34fe91f0fee29f1b614bfc" Jul 15 04:09:04.944242 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:09:04.944053 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a74e98bb1366042a0ae42faf380a38bd75a2fa296a34fe91f0fee29f1b614bfc"} err="failed to get container status \"a74e98bb1366042a0ae42faf380a38bd75a2fa296a34fe91f0fee29f1b614bfc\": rpc error: code = NotFound desc = could not find container \"a74e98bb1366042a0ae42faf380a38bd75a2fa296a34fe91f0fee29f1b614bfc\": container with ID starting with a74e98bb1366042a0ae42faf380a38bd75a2fa296a34fe91f0fee29f1b614bfc not found: ID does not exist" Jul 15 04:09:04.944242 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:09:04.944070 2581 scope.go:117] "RemoveContainer" containerID="eae743e352e1b219a5216035001e647ed40bf43c7043decbe70edb2223831cb0" Jul 15 04:09:04.944307 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:09:04.944249 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"eae743e352e1b219a5216035001e647ed40bf43c7043decbe70edb2223831cb0"} err="failed to get container status \"eae743e352e1b219a5216035001e647ed40bf43c7043decbe70edb2223831cb0\": rpc error: code = NotFound desc = could not find container \"eae743e352e1b219a5216035001e647ed40bf43c7043decbe70edb2223831cb0\": container with ID starting with eae743e352e1b219a5216035001e647ed40bf43c7043decbe70edb2223831cb0 not found: ID does not exist" Jul 15 04:09:04.944307 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:09:04.944272 2581 scope.go:117] "RemoveContainer" containerID="82032a637e8b319122901a8b5325bffe562eb12984bb640ee5b4876e474109db" Jul 15 04:09:04.944470 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:09:04.944455 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"82032a637e8b319122901a8b5325bffe562eb12984bb640ee5b4876e474109db"} err="failed to get container status \"82032a637e8b319122901a8b5325bffe562eb12984bb640ee5b4876e474109db\": rpc error: code = NotFound desc = could not find container \"82032a637e8b319122901a8b5325bffe562eb12984bb640ee5b4876e474109db\": container with ID starting with 82032a637e8b319122901a8b5325bffe562eb12984bb640ee5b4876e474109db not found: ID does not exist" Jul 15 04:09:04.944509 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:09:04.944471 2581 scope.go:117] "RemoveContainer" containerID="3ac65296a4448274ae9948abd3107b454253f5ec1ff858fd290b301000e8d27a" Jul 15 04:09:04.944664 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:09:04.944644 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3ac65296a4448274ae9948abd3107b454253f5ec1ff858fd290b301000e8d27a"} err="failed to get container status \"3ac65296a4448274ae9948abd3107b454253f5ec1ff858fd290b301000e8d27a\": rpc error: code = NotFound desc = could not find container \"3ac65296a4448274ae9948abd3107b454253f5ec1ff858fd290b301000e8d27a\": container with ID starting with 3ac65296a4448274ae9948abd3107b454253f5ec1ff858fd290b301000e8d27a not found: ID does not exist" Jul 15 04:09:04.944734 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:09:04.944666 2581 scope.go:117] "RemoveContainer" containerID="6f70a9520c89cffa73b33b07186acf345865a08e42ca001188ec06750a74debe" Jul 15 04:09:04.944874 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:09:04.944856 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6f70a9520c89cffa73b33b07186acf345865a08e42ca001188ec06750a74debe"} err="failed to get container status \"6f70a9520c89cffa73b33b07186acf345865a08e42ca001188ec06750a74debe\": rpc error: code = NotFound desc = could not find container \"6f70a9520c89cffa73b33b07186acf345865a08e42ca001188ec06750a74debe\": container with ID starting with 6f70a9520c89cffa73b33b07186acf345865a08e42ca001188ec06750a74debe not found: ID does not exist" Jul 15 04:09:04.944922 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:09:04.944875 2581 scope.go:117] "RemoveContainer" containerID="d23edb6469f10bb2b5c713fe4e1dbca8ed467e45a1279394840b0f914d5233cf" Jul 15 04:09:04.945079 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:09:04.945064 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d23edb6469f10bb2b5c713fe4e1dbca8ed467e45a1279394840b0f914d5233cf"} err="failed to get container status \"d23edb6469f10bb2b5c713fe4e1dbca8ed467e45a1279394840b0f914d5233cf\": rpc error: code = NotFound desc = could not find container \"d23edb6469f10bb2b5c713fe4e1dbca8ed467e45a1279394840b0f914d5233cf\": container with ID starting with d23edb6469f10bb2b5c713fe4e1dbca8ed467e45a1279394840b0f914d5233cf not found: ID does not exist" Jul 15 04:09:04.946741 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:09:04.946728 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 15 04:09:04.949008 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:09:04.948985 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jul 15 04:09:04.949115 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:09:04.948990 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jul 15 04:09:04.949115 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:09:04.949058 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jul 15 04:09:04.949347 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:09:04.949329 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jul 15 04:09:04.949416 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:09:04.949372 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jul 15 04:09:04.949416 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:09:04.949385 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jul 15 04:09:04.949416 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:09:04.949374 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-wg8vk\"" Jul 15 04:09:04.949546 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:09:04.949439 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jul 15 04:09:04.949546 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:09:04.949438 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jul 15 04:09:04.953689 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:09:04.953672 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jul 15 04:09:04.956779 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:09:04.956761 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 15 04:09:04.989723 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:09:04.989690 2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d0b40b90-794d-4124-bd19-0a656d5f6566" path="/var/lib/kubelet/pods/d0b40b90-794d-4124-bd19-0a656d5f6566/volumes" Jul 15 04:09:05.073347 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:09:05.073313 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/98f58506-f9c5-4cf3-9c18-fe1cb6197e02-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"98f58506-f9c5-4cf3-9c18-fe1cb6197e02\") " pod="openshift-monitoring/alertmanager-main-0" Jul 15 04:09:05.073347 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:09:05.073350 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/98f58506-f9c5-4cf3-9c18-fe1cb6197e02-config-out\") pod \"alertmanager-main-0\" (UID: \"98f58506-f9c5-4cf3-9c18-fe1cb6197e02\") " pod="openshift-monitoring/alertmanager-main-0" Jul 15 04:09:05.073533 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:09:05.073366 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/98f58506-f9c5-4cf3-9c18-fe1cb6197e02-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"98f58506-f9c5-4cf3-9c18-fe1cb6197e02\") " pod="openshift-monitoring/alertmanager-main-0" Jul 15 04:09:05.073533 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:09:05.073390 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/98f58506-f9c5-4cf3-9c18-fe1cb6197e02-tls-assets\") pod \"alertmanager-main-0\" (UID: \"98f58506-f9c5-4cf3-9c18-fe1cb6197e02\") " pod="openshift-monitoring/alertmanager-main-0" Jul 15 04:09:05.073533 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:09:05.073406 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/98f58506-f9c5-4cf3-9c18-fe1cb6197e02-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"98f58506-f9c5-4cf3-9c18-fe1cb6197e02\") " pod="openshift-monitoring/alertmanager-main-0" Jul 15 04:09:05.073533 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:09:05.073424 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/98f58506-f9c5-4cf3-9c18-fe1cb6197e02-web-config\") pod \"alertmanager-main-0\" (UID: \"98f58506-f9c5-4cf3-9c18-fe1cb6197e02\") " pod="openshift-monitoring/alertmanager-main-0" Jul 15 04:09:05.073533 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:09:05.073442 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/98f58506-f9c5-4cf3-9c18-fe1cb6197e02-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"98f58506-f9c5-4cf3-9c18-fe1cb6197e02\") " pod="openshift-monitoring/alertmanager-main-0" Jul 15 04:09:05.073678 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:09:05.073537 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/98f58506-f9c5-4cf3-9c18-fe1cb6197e02-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"98f58506-f9c5-4cf3-9c18-fe1cb6197e02\") " pod="openshift-monitoring/alertmanager-main-0" Jul 15 04:09:05.073678 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:09:05.073564 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gptk6\" (UniqueName: \"kubernetes.io/projected/98f58506-f9c5-4cf3-9c18-fe1cb6197e02-kube-api-access-gptk6\") pod \"alertmanager-main-0\" (UID: \"98f58506-f9c5-4cf3-9c18-fe1cb6197e02\") " pod="openshift-monitoring/alertmanager-main-0" Jul 15 04:09:05.073678 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:09:05.073597 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/98f58506-f9c5-4cf3-9c18-fe1cb6197e02-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"98f58506-f9c5-4cf3-9c18-fe1cb6197e02\") " pod="openshift-monitoring/alertmanager-main-0" Jul 15 04:09:05.073678 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:09:05.073643 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/98f58506-f9c5-4cf3-9c18-fe1cb6197e02-config-volume\") pod \"alertmanager-main-0\" (UID: \"98f58506-f9c5-4cf3-9c18-fe1cb6197e02\") " pod="openshift-monitoring/alertmanager-main-0" Jul 15 04:09:05.073678 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:09:05.073664 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/98f58506-f9c5-4cf3-9c18-fe1cb6197e02-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"98f58506-f9c5-4cf3-9c18-fe1cb6197e02\") " pod="openshift-monitoring/alertmanager-main-0" Jul 15 04:09:05.073822 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:09:05.073688 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/98f58506-f9c5-4cf3-9c18-fe1cb6197e02-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"98f58506-f9c5-4cf3-9c18-fe1cb6197e02\") " pod="openshift-monitoring/alertmanager-main-0" Jul 15 04:09:05.174196 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:09:05.174072 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/98f58506-f9c5-4cf3-9c18-fe1cb6197e02-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"98f58506-f9c5-4cf3-9c18-fe1cb6197e02\") " pod="openshift-monitoring/alertmanager-main-0" Jul 15 04:09:05.174196 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:09:05.174115 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gptk6\" (UniqueName: \"kubernetes.io/projected/98f58506-f9c5-4cf3-9c18-fe1cb6197e02-kube-api-access-gptk6\") pod \"alertmanager-main-0\" (UID: \"98f58506-f9c5-4cf3-9c18-fe1cb6197e02\") " pod="openshift-monitoring/alertmanager-main-0" Jul 15 04:09:05.174196 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:09:05.174167 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/98f58506-f9c5-4cf3-9c18-fe1cb6197e02-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"98f58506-f9c5-4cf3-9c18-fe1cb6197e02\") " pod="openshift-monitoring/alertmanager-main-0" Jul 15 04:09:05.174196 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:09:05.174186 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/98f58506-f9c5-4cf3-9c18-fe1cb6197e02-config-volume\") pod \"alertmanager-main-0\" (UID: \"98f58506-f9c5-4cf3-9c18-fe1cb6197e02\") " pod="openshift-monitoring/alertmanager-main-0" Jul 15 04:09:05.174539 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:09:05.174213 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/98f58506-f9c5-4cf3-9c18-fe1cb6197e02-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"98f58506-f9c5-4cf3-9c18-fe1cb6197e02\") " pod="openshift-monitoring/alertmanager-main-0" Jul 15 04:09:05.174539 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:09:05.174240 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/98f58506-f9c5-4cf3-9c18-fe1cb6197e02-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"98f58506-f9c5-4cf3-9c18-fe1cb6197e02\") " pod="openshift-monitoring/alertmanager-main-0" Jul 15 04:09:05.174539 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:09:05.174288 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/98f58506-f9c5-4cf3-9c18-fe1cb6197e02-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"98f58506-f9c5-4cf3-9c18-fe1cb6197e02\") " pod="openshift-monitoring/alertmanager-main-0" Jul 15 04:09:05.174539 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:09:05.174325 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/98f58506-f9c5-4cf3-9c18-fe1cb6197e02-config-out\") pod \"alertmanager-main-0\" (UID: \"98f58506-f9c5-4cf3-9c18-fe1cb6197e02\") " pod="openshift-monitoring/alertmanager-main-0" Jul 15 04:09:05.174539 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:09:05.174347 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/98f58506-f9c5-4cf3-9c18-fe1cb6197e02-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"98f58506-f9c5-4cf3-9c18-fe1cb6197e02\") " pod="openshift-monitoring/alertmanager-main-0" Jul 15 04:09:05.174539 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:09:05.174365 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/98f58506-f9c5-4cf3-9c18-fe1cb6197e02-tls-assets\") pod \"alertmanager-main-0\" (UID: \"98f58506-f9c5-4cf3-9c18-fe1cb6197e02\") " pod="openshift-monitoring/alertmanager-main-0" Jul 15 04:09:05.174539 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:09:05.174381 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/98f58506-f9c5-4cf3-9c18-fe1cb6197e02-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"98f58506-f9c5-4cf3-9c18-fe1cb6197e02\") " pod="openshift-monitoring/alertmanager-main-0" Jul 15 04:09:05.174539 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:09:05.174405 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/98f58506-f9c5-4cf3-9c18-fe1cb6197e02-web-config\") pod \"alertmanager-main-0\" (UID: \"98f58506-f9c5-4cf3-9c18-fe1cb6197e02\") " pod="openshift-monitoring/alertmanager-main-0" Jul 15 04:09:05.174539 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:09:05.174434 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/98f58506-f9c5-4cf3-9c18-fe1cb6197e02-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"98f58506-f9c5-4cf3-9c18-fe1cb6197e02\") " pod="openshift-monitoring/alertmanager-main-0" Jul 15 04:09:05.174987 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:09:05.174774 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/98f58506-f9c5-4cf3-9c18-fe1cb6197e02-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"98f58506-f9c5-4cf3-9c18-fe1cb6197e02\") " pod="openshift-monitoring/alertmanager-main-0" Jul 15 04:09:05.175417 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:09:05.175374 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/98f58506-f9c5-4cf3-9c18-fe1cb6197e02-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"98f58506-f9c5-4cf3-9c18-fe1cb6197e02\") " pod="openshift-monitoring/alertmanager-main-0" Jul 15 04:09:05.177266 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:09:05.177238 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/98f58506-f9c5-4cf3-9c18-fe1cb6197e02-config-out\") pod \"alertmanager-main-0\" (UID: \"98f58506-f9c5-4cf3-9c18-fe1cb6197e02\") " pod="openshift-monitoring/alertmanager-main-0" Jul 15 04:09:05.177436 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:09:05.177296 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/98f58506-f9c5-4cf3-9c18-fe1cb6197e02-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"98f58506-f9c5-4cf3-9c18-fe1cb6197e02\") " pod="openshift-monitoring/alertmanager-main-0" Jul 15 04:09:05.177566 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:09:05.177542 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/98f58506-f9c5-4cf3-9c18-fe1cb6197e02-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"98f58506-f9c5-4cf3-9c18-fe1cb6197e02\") " pod="openshift-monitoring/alertmanager-main-0" Jul 15 04:09:05.177630 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:09:05.177593 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/98f58506-f9c5-4cf3-9c18-fe1cb6197e02-config-volume\") pod \"alertmanager-main-0\" (UID: \"98f58506-f9c5-4cf3-9c18-fe1cb6197e02\") " pod="openshift-monitoring/alertmanager-main-0" Jul 15 04:09:05.177918 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:09:05.177890 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/98f58506-f9c5-4cf3-9c18-fe1cb6197e02-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"98f58506-f9c5-4cf3-9c18-fe1cb6197e02\") " pod="openshift-monitoring/alertmanager-main-0" Jul 15 04:09:05.177997 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:09:05.177978 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/98f58506-f9c5-4cf3-9c18-fe1cb6197e02-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"98f58506-f9c5-4cf3-9c18-fe1cb6197e02\") " pod="openshift-monitoring/alertmanager-main-0" Jul 15 04:09:05.178108 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:09:05.178081 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/98f58506-f9c5-4cf3-9c18-fe1cb6197e02-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"98f58506-f9c5-4cf3-9c18-fe1cb6197e02\") " pod="openshift-monitoring/alertmanager-main-0" Jul 15 04:09:05.178667 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:09:05.178647 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/98f58506-f9c5-4cf3-9c18-fe1cb6197e02-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"98f58506-f9c5-4cf3-9c18-fe1cb6197e02\") " pod="openshift-monitoring/alertmanager-main-0" Jul 15 04:09:05.179440 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:09:05.179421 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/98f58506-f9c5-4cf3-9c18-fe1cb6197e02-web-config\") pod \"alertmanager-main-0\" (UID: \"98f58506-f9c5-4cf3-9c18-fe1cb6197e02\") " pod="openshift-monitoring/alertmanager-main-0" Jul 15 04:09:05.180205 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:09:05.180184 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/98f58506-f9c5-4cf3-9c18-fe1cb6197e02-tls-assets\") pod \"alertmanager-main-0\" (UID: \"98f58506-f9c5-4cf3-9c18-fe1cb6197e02\") " pod="openshift-monitoring/alertmanager-main-0" Jul 15 04:09:05.182098 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:09:05.182075 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gptk6\" (UniqueName: \"kubernetes.io/projected/98f58506-f9c5-4cf3-9c18-fe1cb6197e02-kube-api-access-gptk6\") pod \"alertmanager-main-0\" (UID: \"98f58506-f9c5-4cf3-9c18-fe1cb6197e02\") " pod="openshift-monitoring/alertmanager-main-0" Jul 15 04:09:05.257072 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:09:05.257024 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 15 04:09:05.399041 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:09:05.398946 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 15 04:09:05.401724 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:09:05.401698 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod98f58506_f9c5_4cf3_9c18_fe1cb6197e02.slice/crio-fdc798f8af154e20606bdd35b7811d2deb045bbea0005f387edf40024872bf6d WatchSource:0}: Error finding container fdc798f8af154e20606bdd35b7811d2deb045bbea0005f387edf40024872bf6d: Status 404 returned error can't find the container with id fdc798f8af154e20606bdd35b7811d2deb045bbea0005f387edf40024872bf6d Jul 15 04:09:05.891716 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:09:05.891686 2581 generic.go:356] "Generic (PLEG): container finished" podID="98f58506-f9c5-4cf3-9c18-fe1cb6197e02" containerID="4e86f6a4010afcd099e12ffc9d41e0c0ed9417a02f6dbef6bf60973e8cc6f2bb" exitCode=0 Jul 15 04:09:05.891912 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:09:05.891785 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"98f58506-f9c5-4cf3-9c18-fe1cb6197e02","Type":"ContainerDied","Data":"4e86f6a4010afcd099e12ffc9d41e0c0ed9417a02f6dbef6bf60973e8cc6f2bb"} Jul 15 04:09:05.891912 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:09:05.891865 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"98f58506-f9c5-4cf3-9c18-fe1cb6197e02","Type":"ContainerStarted","Data":"fdc798f8af154e20606bdd35b7811d2deb045bbea0005f387edf40024872bf6d"} Jul 15 04:09:06.899192 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:09:06.899154 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"98f58506-f9c5-4cf3-9c18-fe1cb6197e02","Type":"ContainerStarted","Data":"926e96ebdcd9ad1169b810c88a617ecfeb6b82ce3e57c0d13e96b5b3313fa5fb"} Jul 15 04:09:06.899619 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:09:06.899223 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"98f58506-f9c5-4cf3-9c18-fe1cb6197e02","Type":"ContainerStarted","Data":"f40c597ead54629810b647c5f97a5cb0434f8c53fe7f51d2fc48be2a82366624"} Jul 15 04:09:06.899619 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:09:06.899248 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"98f58506-f9c5-4cf3-9c18-fe1cb6197e02","Type":"ContainerStarted","Data":"3308478e8a51854f7ae71847300e62b721cd43f8d2943576b1aa40412db5e4fc"} Jul 15 04:09:06.899619 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:09:06.899271 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"98f58506-f9c5-4cf3-9c18-fe1cb6197e02","Type":"ContainerStarted","Data":"e10042789668bd9cae427d19768d1a2dd3ffdb768a2e0d405fbd1f3779cad72a"} Jul 15 04:09:06.899619 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:09:06.899300 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"98f58506-f9c5-4cf3-9c18-fe1cb6197e02","Type":"ContainerStarted","Data":"a1fbeac23bc070fbe292e5069ec883b55cd2b9193e62438358c74aa627a36437"} Jul 15 04:09:06.899619 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:09:06.899323 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"98f58506-f9c5-4cf3-9c18-fe1cb6197e02","Type":"ContainerStarted","Data":"71ba1110bc25a8e2eb93967c8f3576e60f2aa6ca65980bbd4b81816f14ddc5bf"} Jul 15 04:09:06.925458 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:09:06.925405 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.909927431 podStartE2EDuration="2.925387589s" totalImagesPullingTime="0s" totalInitContainerRuntime="15.460158ms" isStatefulPod=false podCreationTimestamp="2026-07-15 04:09:04 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 04:09:06.923305967 +0000 UTC m=+180.450106976" watchObservedRunningTime="2026-07-15 04:09:06.925387589 +0000 UTC m=+180.452188604" Jul 15 04:09:07.022273 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:09:07.022237 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-7b46d6974c-hnn78"] Jul 15 04:09:07.027022 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:09:07.026997 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-7b46d6974c-hnn78" Jul 15 04:09:07.029113 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:09:07.029093 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\"" Jul 15 04:09:07.029405 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:09:07.029387 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\"" Jul 15 04:09:07.029480 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:09:07.029464 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\"" Jul 15 04:09:07.029480 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:09:07.029475 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\"" Jul 15 04:09:07.029564 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:09:07.029464 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\"" Jul 15 04:09:07.029701 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:09:07.029685 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-5hqqp\"" Jul 15 04:09:07.034270 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:09:07.034252 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\"" Jul 15 04:09:07.040779 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:09:07.040760 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-7b46d6974c-hnn78"] Jul 15 04:09:07.192012 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:09:07.191981 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a0a7afe1-49e5-4ba7-afc5-c1911aac011c-telemeter-trusted-ca-bundle\") pod \"telemeter-client-7b46d6974c-hnn78\" (UID: \"a0a7afe1-49e5-4ba7-afc5-c1911aac011c\") " pod="openshift-monitoring/telemeter-client-7b46d6974c-hnn78" Jul 15 04:09:07.192012 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:09:07.192019 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v8m9p\" (UniqueName: \"kubernetes.io/projected/a0a7afe1-49e5-4ba7-afc5-c1911aac011c-kube-api-access-v8m9p\") pod \"telemeter-client-7b46d6974c-hnn78\" (UID: \"a0a7afe1-49e5-4ba7-afc5-c1911aac011c\") " pod="openshift-monitoring/telemeter-client-7b46d6974c-hnn78" Jul 15 04:09:07.192247 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:09:07.192039 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/a0a7afe1-49e5-4ba7-afc5-c1911aac011c-telemeter-client-tls\") pod \"telemeter-client-7b46d6974c-hnn78\" (UID: \"a0a7afe1-49e5-4ba7-afc5-c1911aac011c\") " pod="openshift-monitoring/telemeter-client-7b46d6974c-hnn78" Jul 15 04:09:07.192247 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:09:07.192072 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a0a7afe1-49e5-4ba7-afc5-c1911aac011c-serving-certs-ca-bundle\") pod \"telemeter-client-7b46d6974c-hnn78\" (UID: \"a0a7afe1-49e5-4ba7-afc5-c1911aac011c\") " pod="openshift-monitoring/telemeter-client-7b46d6974c-hnn78" Jul 15 04:09:07.192247 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:09:07.192105 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a0a7afe1-49e5-4ba7-afc5-c1911aac011c-metrics-client-ca\") pod \"telemeter-client-7b46d6974c-hnn78\" (UID: \"a0a7afe1-49e5-4ba7-afc5-c1911aac011c\") " pod="openshift-monitoring/telemeter-client-7b46d6974c-hnn78" Jul 15 04:09:07.192247 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:09:07.192217 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/a0a7afe1-49e5-4ba7-afc5-c1911aac011c-federate-client-tls\") pod \"telemeter-client-7b46d6974c-hnn78\" (UID: \"a0a7afe1-49e5-4ba7-afc5-c1911aac011c\") " pod="openshift-monitoring/telemeter-client-7b46d6974c-hnn78" Jul 15 04:09:07.192371 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:09:07.192252 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a0a7afe1-49e5-4ba7-afc5-c1911aac011c-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-7b46d6974c-hnn78\" (UID: \"a0a7afe1-49e5-4ba7-afc5-c1911aac011c\") " pod="openshift-monitoring/telemeter-client-7b46d6974c-hnn78" Jul 15 04:09:07.192371 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:09:07.192290 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/a0a7afe1-49e5-4ba7-afc5-c1911aac011c-secret-telemeter-client\") pod \"telemeter-client-7b46d6974c-hnn78\" (UID: \"a0a7afe1-49e5-4ba7-afc5-c1911aac011c\") " pod="openshift-monitoring/telemeter-client-7b46d6974c-hnn78" Jul 15 04:09:07.293506 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:09:07.293473 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a0a7afe1-49e5-4ba7-afc5-c1911aac011c-telemeter-trusted-ca-bundle\") pod \"telemeter-client-7b46d6974c-hnn78\" (UID: \"a0a7afe1-49e5-4ba7-afc5-c1911aac011c\") " pod="openshift-monitoring/telemeter-client-7b46d6974c-hnn78" Jul 15 04:09:07.293506 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:09:07.293508 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v8m9p\" (UniqueName: \"kubernetes.io/projected/a0a7afe1-49e5-4ba7-afc5-c1911aac011c-kube-api-access-v8m9p\") pod \"telemeter-client-7b46d6974c-hnn78\" (UID: \"a0a7afe1-49e5-4ba7-afc5-c1911aac011c\") " pod="openshift-monitoring/telemeter-client-7b46d6974c-hnn78" Jul 15 04:09:07.293758 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:09:07.293529 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/a0a7afe1-49e5-4ba7-afc5-c1911aac011c-telemeter-client-tls\") pod \"telemeter-client-7b46d6974c-hnn78\" (UID: \"a0a7afe1-49e5-4ba7-afc5-c1911aac011c\") " pod="openshift-monitoring/telemeter-client-7b46d6974c-hnn78" Jul 15 04:09:07.293758 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:09:07.293554 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a0a7afe1-49e5-4ba7-afc5-c1911aac011c-serving-certs-ca-bundle\") pod \"telemeter-client-7b46d6974c-hnn78\" (UID: \"a0a7afe1-49e5-4ba7-afc5-c1911aac011c\") " pod="openshift-monitoring/telemeter-client-7b46d6974c-hnn78" Jul 15 04:09:07.293758 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:09:07.293575 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a0a7afe1-49e5-4ba7-afc5-c1911aac011c-metrics-client-ca\") pod \"telemeter-client-7b46d6974c-hnn78\" (UID: \"a0a7afe1-49e5-4ba7-afc5-c1911aac011c\") " pod="openshift-monitoring/telemeter-client-7b46d6974c-hnn78" Jul 15 04:09:07.293758 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:09:07.293617 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/a0a7afe1-49e5-4ba7-afc5-c1911aac011c-federate-client-tls\") pod \"telemeter-client-7b46d6974c-hnn78\" (UID: \"a0a7afe1-49e5-4ba7-afc5-c1911aac011c\") " pod="openshift-monitoring/telemeter-client-7b46d6974c-hnn78" Jul 15 04:09:07.293758 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:09:07.293650 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a0a7afe1-49e5-4ba7-afc5-c1911aac011c-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-7b46d6974c-hnn78\" (UID: \"a0a7afe1-49e5-4ba7-afc5-c1911aac011c\") " pod="openshift-monitoring/telemeter-client-7b46d6974c-hnn78" Jul 15 04:09:07.293758 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:09:07.293690 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/a0a7afe1-49e5-4ba7-afc5-c1911aac011c-secret-telemeter-client\") pod \"telemeter-client-7b46d6974c-hnn78\" (UID: \"a0a7afe1-49e5-4ba7-afc5-c1911aac011c\") " pod="openshift-monitoring/telemeter-client-7b46d6974c-hnn78" Jul 15 04:09:07.294637 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:09:07.294320 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a0a7afe1-49e5-4ba7-afc5-c1911aac011c-serving-certs-ca-bundle\") pod \"telemeter-client-7b46d6974c-hnn78\" (UID: \"a0a7afe1-49e5-4ba7-afc5-c1911aac011c\") " pod="openshift-monitoring/telemeter-client-7b46d6974c-hnn78" Jul 15 04:09:07.294637 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:09:07.294381 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a0a7afe1-49e5-4ba7-afc5-c1911aac011c-metrics-client-ca\") pod \"telemeter-client-7b46d6974c-hnn78\" (UID: \"a0a7afe1-49e5-4ba7-afc5-c1911aac011c\") " pod="openshift-monitoring/telemeter-client-7b46d6974c-hnn78" Jul 15 04:09:07.295244 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:09:07.295215 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a0a7afe1-49e5-4ba7-afc5-c1911aac011c-telemeter-trusted-ca-bundle\") pod \"telemeter-client-7b46d6974c-hnn78\" (UID: \"a0a7afe1-49e5-4ba7-afc5-c1911aac011c\") " pod="openshift-monitoring/telemeter-client-7b46d6974c-hnn78" Jul 15 04:09:07.296388 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:09:07.296363 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/a0a7afe1-49e5-4ba7-afc5-c1911aac011c-telemeter-client-tls\") pod \"telemeter-client-7b46d6974c-hnn78\" (UID: \"a0a7afe1-49e5-4ba7-afc5-c1911aac011c\") " pod="openshift-monitoring/telemeter-client-7b46d6974c-hnn78" Jul 15 04:09:07.296496 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:09:07.296438 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/a0a7afe1-49e5-4ba7-afc5-c1911aac011c-federate-client-tls\") pod \"telemeter-client-7b46d6974c-hnn78\" (UID: \"a0a7afe1-49e5-4ba7-afc5-c1911aac011c\") " pod="openshift-monitoring/telemeter-client-7b46d6974c-hnn78" Jul 15 04:09:07.296496 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:09:07.296488 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a0a7afe1-49e5-4ba7-afc5-c1911aac011c-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-7b46d6974c-hnn78\" (UID: \"a0a7afe1-49e5-4ba7-afc5-c1911aac011c\") " pod="openshift-monitoring/telemeter-client-7b46d6974c-hnn78" Jul 15 04:09:07.296575 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:09:07.296521 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/a0a7afe1-49e5-4ba7-afc5-c1911aac011c-secret-telemeter-client\") pod \"telemeter-client-7b46d6974c-hnn78\" (UID: \"a0a7afe1-49e5-4ba7-afc5-c1911aac011c\") " pod="openshift-monitoring/telemeter-client-7b46d6974c-hnn78" Jul 15 04:09:07.301399 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:09:07.301374 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v8m9p\" (UniqueName: \"kubernetes.io/projected/a0a7afe1-49e5-4ba7-afc5-c1911aac011c-kube-api-access-v8m9p\") pod \"telemeter-client-7b46d6974c-hnn78\" (UID: \"a0a7afe1-49e5-4ba7-afc5-c1911aac011c\") " pod="openshift-monitoring/telemeter-client-7b46d6974c-hnn78" Jul 15 04:09:07.337577 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:09:07.337550 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-7b46d6974c-hnn78" Jul 15 04:09:07.472621 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:09:07.472526 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-7b46d6974c-hnn78"] Jul 15 04:09:07.478716 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:09:07.478685 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda0a7afe1_49e5_4ba7_afc5_c1911aac011c.slice/crio-d08ceda3cb07fc0dcef866cbc54e043ca508fdcc10663c017f52d841381e5f77 WatchSource:0}: Error finding container d08ceda3cb07fc0dcef866cbc54e043ca508fdcc10663c017f52d841381e5f77: Status 404 returned error can't find the container with id d08ceda3cb07fc0dcef866cbc54e043ca508fdcc10663c017f52d841381e5f77 Jul 15 04:09:07.903842 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:09:07.903802 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-7b46d6974c-hnn78" event={"ID":"a0a7afe1-49e5-4ba7-afc5-c1911aac011c","Type":"ContainerStarted","Data":"d08ceda3cb07fc0dcef866cbc54e043ca508fdcc10663c017f52d841381e5f77"} Jul 15 04:09:09.913339 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:09:09.913301 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-7b46d6974c-hnn78" event={"ID":"a0a7afe1-49e5-4ba7-afc5-c1911aac011c","Type":"ContainerStarted","Data":"e60247a626b60e7037ea76202f70396488ab64a046754ef41e58aff0f328c4b0"} Jul 15 04:09:09.913828 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:09:09.913371 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-7b46d6974c-hnn78" event={"ID":"a0a7afe1-49e5-4ba7-afc5-c1911aac011c","Type":"ContainerStarted","Data":"337169c6715413e5bb65327a4112c9d2de115c6e95d46907c81d90202a02f4ea"} Jul 15 04:09:09.913828 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:09:09.913397 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-7b46d6974c-hnn78" event={"ID":"a0a7afe1-49e5-4ba7-afc5-c1911aac011c","Type":"ContainerStarted","Data":"0722d04e3d8e4cff1fbec3f9d12114f8656e6e0749f0647c74a0c9b65e5ef96d"} Jul 15 04:09:09.937196 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:09:09.937148 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-7b46d6974c-hnn78" podStartSLOduration=0.929882701 podStartE2EDuration="2.937114593s" totalImagesPullingTime="2.007231892s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 04:09:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 04:09:09.936385477 +0000 UTC m=+183.463186511" watchObservedRunningTime="2026-07-15 04:09:09.937114593 +0000 UTC m=+183.463915608" Jul 15 04:09:10.769288 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:09:10.769250 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:09:10.822968 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:09:10.822933 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:09:10.910311 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:09:10.910281 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:09:11.012167 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:09:11.012114 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:09:11.512525 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:09:11.512492 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:09:21.573237 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:09:21.573206 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:09:21.629949 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:09:21.629914 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:09:21.686784 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:09:21.686752 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:09:45.616846 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:09:45.616804 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:09:45.679497 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:09:45.679463 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:10:10.455714 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:10:10.455679 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:10:17.161489 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:10:17.161451 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:10:17.220700 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:10:17.220664 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:10:17.582553 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:10:17.582466 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:10:17.636331 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:10:17.636300 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:10:23.936095 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:10:23.936057 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:10:28.835351 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:10:28.835271 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:10:28.889460 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:10:28.889424 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:10:28.943037 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:10:28.943000 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:10:29.107617 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:10:29.107523 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:10:29.160978 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:10:29.160949 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:10:39.094793 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:10:39.094753 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:10:39.194632 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:10:39.194586 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:10:39.365038 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:10:39.365009 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:11:06.841548 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:11:06.841519 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-8kt5p_2db78c13-2384-4015-a886-14377224f4cd/console-operator/1.log" Jul 15 04:11:06.846141 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:11:06.846101 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-x6lg7_7cab18b8-43fd-46d1-a75d-6de40cbcd09a/ovn-acl-logging/0.log" Jul 15 04:11:06.849769 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:11:06.849740 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-8kt5p_2db78c13-2384-4015-a886-14377224f4cd/console-operator/1.log" Jul 15 04:11:06.854461 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:11:06.854439 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-x6lg7_7cab18b8-43fd-46d1-a75d-6de40cbcd09a/ovn-acl-logging/0.log" Jul 15 04:11:06.854676 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:11:06.854656 2581 kubelet.go:1648] "Image garbage collection succeeded" Jul 15 04:11:29.420997 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:11:29.420964 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:11:30.033326 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:11:30.033291 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540wmmzv"] Jul 15 04:11:30.036692 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:11:30.036675 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540wmmzv" Jul 15 04:11:30.039394 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:11:30.039360 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 15 04:11:30.039538 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:11:30.039402 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-7tb27\"" Jul 15 04:11:30.039970 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:11:30.039957 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 15 04:11:30.047457 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:11:30.047432 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540wmmzv"] Jul 15 04:11:30.117581 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:11:30.117540 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0676126d-2152-4f00-a554-9b673b78c8c8-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540wmmzv\" (UID: \"0676126d-2152-4f00-a554-9b673b78c8c8\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540wmmzv" Jul 15 04:11:30.117769 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:11:30.117672 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0676126d-2152-4f00-a554-9b673b78c8c8-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540wmmzv\" (UID: \"0676126d-2152-4f00-a554-9b673b78c8c8\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540wmmzv" Jul 15 04:11:30.117769 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:11:30.117717 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9n6t4\" (UniqueName: \"kubernetes.io/projected/0676126d-2152-4f00-a554-9b673b78c8c8-kube-api-access-9n6t4\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540wmmzv\" (UID: \"0676126d-2152-4f00-a554-9b673b78c8c8\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540wmmzv" Jul 15 04:11:30.218366 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:11:30.218334 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0676126d-2152-4f00-a554-9b673b78c8c8-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540wmmzv\" (UID: \"0676126d-2152-4f00-a554-9b673b78c8c8\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540wmmzv" Jul 15 04:11:30.218555 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:11:30.218394 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9n6t4\" (UniqueName: \"kubernetes.io/projected/0676126d-2152-4f00-a554-9b673b78c8c8-kube-api-access-9n6t4\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540wmmzv\" (UID: \"0676126d-2152-4f00-a554-9b673b78c8c8\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540wmmzv" Jul 15 04:11:30.218555 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:11:30.218434 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0676126d-2152-4f00-a554-9b673b78c8c8-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540wmmzv\" (UID: \"0676126d-2152-4f00-a554-9b673b78c8c8\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540wmmzv" Jul 15 04:11:30.218698 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:11:30.218676 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0676126d-2152-4f00-a554-9b673b78c8c8-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540wmmzv\" (UID: \"0676126d-2152-4f00-a554-9b673b78c8c8\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540wmmzv" Jul 15 04:11:30.218803 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:11:30.218785 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0676126d-2152-4f00-a554-9b673b78c8c8-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540wmmzv\" (UID: \"0676126d-2152-4f00-a554-9b673b78c8c8\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540wmmzv" Jul 15 04:11:30.227252 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:11:30.227226 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9n6t4\" (UniqueName: \"kubernetes.io/projected/0676126d-2152-4f00-a554-9b673b78c8c8-kube-api-access-9n6t4\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540wmmzv\" (UID: \"0676126d-2152-4f00-a554-9b673b78c8c8\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540wmmzv" Jul 15 04:11:30.346560 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:11:30.346477 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540wmmzv" Jul 15 04:11:30.482892 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:11:30.482868 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540wmmzv"] Jul 15 04:11:30.485629 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:11:30.485601 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0676126d_2152_4f00_a554_9b673b78c8c8.slice/crio-976ecd0b7d25ae95af1eae7edfc9d2c94fd9319cd1bd8a4f47bce33658594cfd WatchSource:0}: Error finding container 976ecd0b7d25ae95af1eae7edfc9d2c94fd9319cd1bd8a4f47bce33658594cfd: Status 404 returned error can't find the container with id 976ecd0b7d25ae95af1eae7edfc9d2c94fd9319cd1bd8a4f47bce33658594cfd Jul 15 04:11:30.487611 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:11:30.487590 2581 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 15 04:11:30.498659 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:11:30.498630 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540wmmzv" event={"ID":"0676126d-2152-4f00-a554-9b673b78c8c8","Type":"ContainerStarted","Data":"976ecd0b7d25ae95af1eae7edfc9d2c94fd9319cd1bd8a4f47bce33658594cfd"} Jul 15 04:11:31.177180 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:11:31.177151 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:11:39.541241 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:11:39.541200 2581 generic.go:356] "Generic (PLEG): container finished" podID="0676126d-2152-4f00-a554-9b673b78c8c8" containerID="2c85797260148509f6608e60d9c6e97f57561f74202fa35efded773124943dde" exitCode=0 Jul 15 04:11:39.541662 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:11:39.541288 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540wmmzv" event={"ID":"0676126d-2152-4f00-a554-9b673b78c8c8","Type":"ContainerDied","Data":"2c85797260148509f6608e60d9c6e97f57561f74202fa35efded773124943dde"} Jul 15 04:11:42.557735 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:11:42.557699 2581 generic.go:356] "Generic (PLEG): container finished" podID="0676126d-2152-4f00-a554-9b673b78c8c8" containerID="51eba017ce44299f431c8146df4b1d19b3111849574c9320017fe33621bcc378" exitCode=0 Jul 15 04:11:42.558113 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:11:42.557786 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540wmmzv" event={"ID":"0676126d-2152-4f00-a554-9b673b78c8c8","Type":"ContainerDied","Data":"51eba017ce44299f431c8146df4b1d19b3111849574c9320017fe33621bcc378"} Jul 15 04:11:50.597105 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:11:50.597064 2581 generic.go:356] "Generic (PLEG): container finished" podID="0676126d-2152-4f00-a554-9b673b78c8c8" containerID="7fc190d4c600356e55a75625993e40b1a1d0666f9cc6a6e5769a13e77830544d" exitCode=0 Jul 15 04:11:50.597531 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:11:50.597162 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540wmmzv" event={"ID":"0676126d-2152-4f00-a554-9b673b78c8c8","Type":"ContainerDied","Data":"7fc190d4c600356e55a75625993e40b1a1d0666f9cc6a6e5769a13e77830544d"} Jul 15 04:11:51.782234 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:11:51.782193 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540wmmzv" Jul 15 04:11:51.918391 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:11:51.918358 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9n6t4\" (UniqueName: \"kubernetes.io/projected/0676126d-2152-4f00-a554-9b673b78c8c8-kube-api-access-9n6t4\") pod \"0676126d-2152-4f00-a554-9b673b78c8c8\" (UID: \"0676126d-2152-4f00-a554-9b673b78c8c8\") " Jul 15 04:11:51.918563 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:11:51.918407 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0676126d-2152-4f00-a554-9b673b78c8c8-util\") pod \"0676126d-2152-4f00-a554-9b673b78c8c8\" (UID: \"0676126d-2152-4f00-a554-9b673b78c8c8\") " Jul 15 04:11:51.918563 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:11:51.918474 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0676126d-2152-4f00-a554-9b673b78c8c8-bundle\") pod \"0676126d-2152-4f00-a554-9b673b78c8c8\" (UID: \"0676126d-2152-4f00-a554-9b673b78c8c8\") " Jul 15 04:11:51.919161 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:11:51.919103 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0676126d-2152-4f00-a554-9b673b78c8c8-bundle" (OuterVolumeSpecName: "bundle") pod "0676126d-2152-4f00-a554-9b673b78c8c8" (UID: "0676126d-2152-4f00-a554-9b673b78c8c8"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 04:11:51.920660 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:11:51.920635 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0676126d-2152-4f00-a554-9b673b78c8c8-kube-api-access-9n6t4" (OuterVolumeSpecName: "kube-api-access-9n6t4") pod "0676126d-2152-4f00-a554-9b673b78c8c8" (UID: "0676126d-2152-4f00-a554-9b673b78c8c8"). InnerVolumeSpecName "kube-api-access-9n6t4". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 15 04:11:51.925284 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:11:51.925257 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0676126d-2152-4f00-a554-9b673b78c8c8-util" (OuterVolumeSpecName: "util") pod "0676126d-2152-4f00-a554-9b673b78c8c8" (UID: "0676126d-2152-4f00-a554-9b673b78c8c8"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 04:11:52.019456 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:11:52.019418 2581 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0676126d-2152-4f00-a554-9b673b78c8c8-bundle\") on node \"ip-10-0-128-222.ec2.internal\" DevicePath \"\"" Jul 15 04:11:52.019456 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:11:52.019450 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9n6t4\" (UniqueName: \"kubernetes.io/projected/0676126d-2152-4f00-a554-9b673b78c8c8-kube-api-access-9n6t4\") on node \"ip-10-0-128-222.ec2.internal\" DevicePath \"\"" Jul 15 04:11:52.019456 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:11:52.019461 2581 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0676126d-2152-4f00-a554-9b673b78c8c8-util\") on node \"ip-10-0-128-222.ec2.internal\" DevicePath \"\"" Jul 15 04:11:52.607729 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:11:52.607701 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540wmmzv" Jul 15 04:11:52.607893 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:11:52.607726 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540wmmzv" event={"ID":"0676126d-2152-4f00-a554-9b673b78c8c8","Type":"ContainerDied","Data":"976ecd0b7d25ae95af1eae7edfc9d2c94fd9319cd1bd8a4f47bce33658594cfd"} Jul 15 04:11:52.607893 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:11:52.607775 2581 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="976ecd0b7d25ae95af1eae7edfc9d2c94fd9319cd1bd8a4f47bce33658594cfd" Jul 15 04:11:56.042405 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:11:56.042367 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:11:57.061605 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:11:57.061576 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:11:58.005845 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:11:58.005815 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-2gnk9"] Jul 15 04:11:58.006175 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:11:58.006162 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0676126d-2152-4f00-a554-9b673b78c8c8" containerName="util" Jul 15 04:11:58.006175 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:11:58.006176 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="0676126d-2152-4f00-a554-9b673b78c8c8" containerName="util" Jul 15 04:11:58.006259 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:11:58.006189 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0676126d-2152-4f00-a554-9b673b78c8c8" containerName="pull" Jul 15 04:11:58.006259 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:11:58.006194 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="0676126d-2152-4f00-a554-9b673b78c8c8" containerName="pull" Jul 15 04:11:58.006259 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:11:58.006205 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0676126d-2152-4f00-a554-9b673b78c8c8" containerName="extract" Jul 15 04:11:58.006259 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:11:58.006211 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="0676126d-2152-4f00-a554-9b673b78c8c8" containerName="extract" Jul 15 04:11:58.006418 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:11:58.006263 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="0676126d-2152-4f00-a554-9b673b78c8c8" containerName="extract" Jul 15 04:11:58.008327 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:11:58.008311 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-2gnk9" Jul 15 04:11:58.010730 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:11:58.010707 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\"" Jul 15 04:11:58.010847 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:11:58.010727 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-8nbfk\"" Jul 15 04:11:58.010847 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:11:58.010764 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\"" Jul 15 04:11:58.021396 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:11:58.021371 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-2gnk9"] Jul 15 04:11:58.169049 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:11:58.169008 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1e96b49f-3c41-4fab-9ae5-370ff416509c-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-2gnk9\" (UID: \"1e96b49f-3c41-4fab-9ae5-370ff416509c\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-2gnk9" Jul 15 04:11:58.169578 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:11:58.169059 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pf8b5\" (UniqueName: \"kubernetes.io/projected/1e96b49f-3c41-4fab-9ae5-370ff416509c-kube-api-access-pf8b5\") pod \"cert-manager-operator-controller-manager-55c444bf86-2gnk9\" (UID: \"1e96b49f-3c41-4fab-9ae5-370ff416509c\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-2gnk9" Jul 15 04:11:58.270567 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:11:58.270453 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1e96b49f-3c41-4fab-9ae5-370ff416509c-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-2gnk9\" (UID: \"1e96b49f-3c41-4fab-9ae5-370ff416509c\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-2gnk9" Jul 15 04:11:58.270567 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:11:58.270528 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pf8b5\" (UniqueName: \"kubernetes.io/projected/1e96b49f-3c41-4fab-9ae5-370ff416509c-kube-api-access-pf8b5\") pod \"cert-manager-operator-controller-manager-55c444bf86-2gnk9\" (UID: \"1e96b49f-3c41-4fab-9ae5-370ff416509c\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-2gnk9" Jul 15 04:11:58.270840 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:11:58.270819 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1e96b49f-3c41-4fab-9ae5-370ff416509c-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-2gnk9\" (UID: \"1e96b49f-3c41-4fab-9ae5-370ff416509c\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-2gnk9" Jul 15 04:11:58.281762 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:11:58.281731 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pf8b5\" (UniqueName: \"kubernetes.io/projected/1e96b49f-3c41-4fab-9ae5-370ff416509c-kube-api-access-pf8b5\") pod \"cert-manager-operator-controller-manager-55c444bf86-2gnk9\" (UID: \"1e96b49f-3c41-4fab-9ae5-370ff416509c\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-2gnk9" Jul 15 04:11:58.317563 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:11:58.317484 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-2gnk9" Jul 15 04:11:58.458671 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:11:58.458509 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-2gnk9"] Jul 15 04:11:58.461808 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:11:58.461775 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1e96b49f_3c41_4fab_9ae5_370ff416509c.slice/crio-37aa6dbb4d5bc9f457d7102489ace73bcc666e25e8c55a70c683a8be803b8d41 WatchSource:0}: Error finding container 37aa6dbb4d5bc9f457d7102489ace73bcc666e25e8c55a70c683a8be803b8d41: Status 404 returned error can't find the container with id 37aa6dbb4d5bc9f457d7102489ace73bcc666e25e8c55a70c683a8be803b8d41 Jul 15 04:11:58.636928 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:11:58.636897 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-2gnk9" event={"ID":"1e96b49f-3c41-4fab-9ae5-370ff416509c","Type":"ContainerStarted","Data":"37aa6dbb4d5bc9f457d7102489ace73bcc666e25e8c55a70c683a8be803b8d41"} Jul 15 04:11:59.654648 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:11:59.654613 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:11:59.790400 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:11:59.790360 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:12:00.649859 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:12:00.649776 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-2gnk9" event={"ID":"1e96b49f-3c41-4fab-9ae5-370ff416509c","Type":"ContainerStarted","Data":"a5f415ec7f0fc1848197a66a82e3a049f9fe993361fa588c2c12afdc1c7eafd0"} Jul 15 04:12:00.672383 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:12:00.672325 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-2gnk9" podStartSLOduration=1.7363795180000001 podStartE2EDuration="3.672307808s" totalImagesPullingTime="1.93592829s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 04:11:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 04:12:00.670676531 +0000 UTC m=+354.197477575" watchObservedRunningTime="2026-07-15 04:12:00.672307808 +0000 UTC m=+354.199108822" Jul 15 04:12:01.043077 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:12:01.042998 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:12:01.179381 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:12:01.179338 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:12:01.326651 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:12:01.326565 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:12:01.454823 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:12:01.454790 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:12:01.886488 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:12:01.886452 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fgs7vh"] Jul 15 04:12:01.890034 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:12:01.890016 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fgs7vh" Jul 15 04:12:01.892804 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:12:01.892781 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 15 04:12:01.893108 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:12:01.893092 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-7tb27\"" Jul 15 04:12:01.893558 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:12:01.893545 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 15 04:12:01.903043 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:12:01.903020 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fgs7vh"] Jul 15 04:12:01.905530 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:12:01.905503 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6a4bbc1c-ffb3-4fc2-904f-db79786b85ae-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fgs7vh\" (UID: \"6a4bbc1c-ffb3-4fc2-904f-db79786b85ae\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fgs7vh" Jul 15 04:12:01.905659 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:12:01.905555 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6a4bbc1c-ffb3-4fc2-904f-db79786b85ae-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fgs7vh\" (UID: \"6a4bbc1c-ffb3-4fc2-904f-db79786b85ae\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fgs7vh" Jul 15 04:12:01.905659 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:12:01.905628 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xg2mc\" (UniqueName: \"kubernetes.io/projected/6a4bbc1c-ffb3-4fc2-904f-db79786b85ae-kube-api-access-xg2mc\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fgs7vh\" (UID: \"6a4bbc1c-ffb3-4fc2-904f-db79786b85ae\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fgs7vh" Jul 15 04:12:02.006094 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:12:02.006055 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6a4bbc1c-ffb3-4fc2-904f-db79786b85ae-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fgs7vh\" (UID: \"6a4bbc1c-ffb3-4fc2-904f-db79786b85ae\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fgs7vh" Jul 15 04:12:02.006094 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:12:02.006101 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6a4bbc1c-ffb3-4fc2-904f-db79786b85ae-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fgs7vh\" (UID: \"6a4bbc1c-ffb3-4fc2-904f-db79786b85ae\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fgs7vh" Jul 15 04:12:02.006315 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:12:02.006156 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xg2mc\" (UniqueName: \"kubernetes.io/projected/6a4bbc1c-ffb3-4fc2-904f-db79786b85ae-kube-api-access-xg2mc\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fgs7vh\" (UID: \"6a4bbc1c-ffb3-4fc2-904f-db79786b85ae\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fgs7vh" Jul 15 04:12:02.006493 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:12:02.006464 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6a4bbc1c-ffb3-4fc2-904f-db79786b85ae-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fgs7vh\" (UID: \"6a4bbc1c-ffb3-4fc2-904f-db79786b85ae\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fgs7vh" Jul 15 04:12:02.006532 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:12:02.006493 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6a4bbc1c-ffb3-4fc2-904f-db79786b85ae-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fgs7vh\" (UID: \"6a4bbc1c-ffb3-4fc2-904f-db79786b85ae\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fgs7vh" Jul 15 04:12:02.016202 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:12:02.016173 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xg2mc\" (UniqueName: \"kubernetes.io/projected/6a4bbc1c-ffb3-4fc2-904f-db79786b85ae-kube-api-access-xg2mc\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fgs7vh\" (UID: \"6a4bbc1c-ffb3-4fc2-904f-db79786b85ae\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fgs7vh" Jul 15 04:12:02.199770 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:12:02.199680 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fgs7vh" Jul 15 04:12:02.224116 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:12:02.224087 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-5p2mm"] Jul 15 04:12:02.227629 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:12:02.227605 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-5p2mm" Jul 15 04:12:02.230215 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:12:02.230185 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Jul 15 04:12:02.230441 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:12:02.230423 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-llmcd\"" Jul 15 04:12:02.230513 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:12:02.230448 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Jul 15 04:12:02.236864 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:12:02.236839 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-5p2mm"] Jul 15 04:12:02.308355 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:12:02.308303 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/67a84fb6-c1d0-44eb-bc73-253421417270-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-5p2mm\" (UID: \"67a84fb6-c1d0-44eb-bc73-253421417270\") " pod="cert-manager/cert-manager-webhook-6486ffd997-5p2mm" Jul 15 04:12:02.308534 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:12:02.308389 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lq5q2\" (UniqueName: \"kubernetes.io/projected/67a84fb6-c1d0-44eb-bc73-253421417270-kube-api-access-lq5q2\") pod \"cert-manager-webhook-6486ffd997-5p2mm\" (UID: \"67a84fb6-c1d0-44eb-bc73-253421417270\") " pod="cert-manager/cert-manager-webhook-6486ffd997-5p2mm" Jul 15 04:12:02.350164 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:12:02.348207 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fgs7vh"] Jul 15 04:12:02.353189 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:12:02.353155 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6a4bbc1c_ffb3_4fc2_904f_db79786b85ae.slice/crio-51970deef6f41c612184b5de4a13bb1fbb365626266d8e6e3866a1b032e07c91 WatchSource:0}: Error finding container 51970deef6f41c612184b5de4a13bb1fbb365626266d8e6e3866a1b032e07c91: Status 404 returned error can't find the container with id 51970deef6f41c612184b5de4a13bb1fbb365626266d8e6e3866a1b032e07c91 Jul 15 04:12:02.409541 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:12:02.409513 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/67a84fb6-c1d0-44eb-bc73-253421417270-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-5p2mm\" (UID: \"67a84fb6-c1d0-44eb-bc73-253421417270\") " pod="cert-manager/cert-manager-webhook-6486ffd997-5p2mm" Jul 15 04:12:02.409683 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:12:02.409553 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lq5q2\" (UniqueName: \"kubernetes.io/projected/67a84fb6-c1d0-44eb-bc73-253421417270-kube-api-access-lq5q2\") pod \"cert-manager-webhook-6486ffd997-5p2mm\" (UID: \"67a84fb6-c1d0-44eb-bc73-253421417270\") " pod="cert-manager/cert-manager-webhook-6486ffd997-5p2mm" Jul 15 04:12:02.432299 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:12:02.432269 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/67a84fb6-c1d0-44eb-bc73-253421417270-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-5p2mm\" (UID: \"67a84fb6-c1d0-44eb-bc73-253421417270\") " pod="cert-manager/cert-manager-webhook-6486ffd997-5p2mm" Jul 15 04:12:02.432435 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:12:02.432422 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lq5q2\" (UniqueName: \"kubernetes.io/projected/67a84fb6-c1d0-44eb-bc73-253421417270-kube-api-access-lq5q2\") pod \"cert-manager-webhook-6486ffd997-5p2mm\" (UID: \"67a84fb6-c1d0-44eb-bc73-253421417270\") " pod="cert-manager/cert-manager-webhook-6486ffd997-5p2mm" Jul 15 04:12:02.548961 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:12:02.548921 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-5p2mm" Jul 15 04:12:02.662442 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:12:02.662410 2581 generic.go:356] "Generic (PLEG): container finished" podID="6a4bbc1c-ffb3-4fc2-904f-db79786b85ae" containerID="ccf9a0a92fb6ec3f3c52f6f012e23e780d96bf5c51014992e000ae010e4dbc4c" exitCode=0 Jul 15 04:12:02.662601 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:12:02.662490 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fgs7vh" event={"ID":"6a4bbc1c-ffb3-4fc2-904f-db79786b85ae","Type":"ContainerDied","Data":"ccf9a0a92fb6ec3f3c52f6f012e23e780d96bf5c51014992e000ae010e4dbc4c"} Jul 15 04:12:02.662601 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:12:02.662542 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fgs7vh" event={"ID":"6a4bbc1c-ffb3-4fc2-904f-db79786b85ae","Type":"ContainerStarted","Data":"51970deef6f41c612184b5de4a13bb1fbb365626266d8e6e3866a1b032e07c91"} Jul 15 04:12:02.678937 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:12:02.678909 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-5p2mm"] Jul 15 04:12:02.681618 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:12:02.681593 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod67a84fb6_c1d0_44eb_bc73_253421417270.slice/crio-3e88dc962596a70540d7a6017818d08b178e2018ee382b262c8eeb55149ab0ca WatchSource:0}: Error finding container 3e88dc962596a70540d7a6017818d08b178e2018ee382b262c8eeb55149ab0ca: Status 404 returned error can't find the container with id 3e88dc962596a70540d7a6017818d08b178e2018ee382b262c8eeb55149ab0ca Jul 15 04:12:03.669845 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:12:03.669799 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-5p2mm" event={"ID":"67a84fb6-c1d0-44eb-bc73-253421417270","Type":"ContainerStarted","Data":"3e88dc962596a70540d7a6017818d08b178e2018ee382b262c8eeb55149ab0ca"} Jul 15 04:12:03.842192 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:12:03.842159 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:12:04.051296 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:12:04.051210 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:12:05.681674 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:12:05.681645 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-5p2mm" event={"ID":"67a84fb6-c1d0-44eb-bc73-253421417270","Type":"ContainerStarted","Data":"5dfd64633e905464cae89934de1cbc9e597d13986a561160fadce1de9d2bcc0b"} Jul 15 04:12:05.682071 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:12:05.681696 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-6486ffd997-5p2mm" Jul 15 04:12:05.696809 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:12:05.696749 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-6486ffd997-5p2mm" podStartSLOduration=1.0853079939999999 podStartE2EDuration="3.696729964s" totalImagesPullingTime="2.61142197s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 04:12:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 04:12:05.696179394 +0000 UTC m=+359.222980406" watchObservedRunningTime="2026-07-15 04:12:05.696729964 +0000 UTC m=+359.223530980" Jul 15 04:12:06.445193 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:12:06.445156 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:12:06.535111 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:12:06.535076 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:12:10.708716 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:12:10.708680 2581 generic.go:356] "Generic (PLEG): container finished" podID="6a4bbc1c-ffb3-4fc2-904f-db79786b85ae" containerID="2840e43431a9b11192d47f1ddfe8ac91401222b5ae9c335c7188264223f2947c" exitCode=0 Jul 15 04:12:10.709099 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:12:10.708760 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fgs7vh" event={"ID":"6a4bbc1c-ffb3-4fc2-904f-db79786b85ae","Type":"ContainerDied","Data":"2840e43431a9b11192d47f1ddfe8ac91401222b5ae9c335c7188264223f2947c"} Jul 15 04:12:10.820210 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:12:10.820180 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:12:10.921278 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:12:10.921238 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:12:11.252633 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:12:11.252599 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:12:11.689440 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:12:11.689412 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-6486ffd997-5p2mm" Jul 15 04:12:11.716524 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:12:11.716494 2581 generic.go:356] "Generic (PLEG): container finished" podID="6a4bbc1c-ffb3-4fc2-904f-db79786b85ae" containerID="53e999f807d28f9b8fbfae40df3531449e4d304a9addcba39780180b220cf937" exitCode=0 Jul 15 04:12:11.716878 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:12:11.716557 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fgs7vh" event={"ID":"6a4bbc1c-ffb3-4fc2-904f-db79786b85ae","Type":"ContainerDied","Data":"53e999f807d28f9b8fbfae40df3531449e4d304a9addcba39780180b220cf937"} Jul 15 04:12:11.992152 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:12:11.992049 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-55b4d954d5-kxhzf"] Jul 15 04:12:11.996107 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:12:11.996087 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-kxhzf" Jul 15 04:12:11.998241 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:12:11.998223 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-g5jq8\"" Jul 15 04:12:12.004428 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:12:12.004404 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-kxhzf"] Jul 15 04:12:12.099762 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:12:12.099722 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wzcwc\" (UniqueName: \"kubernetes.io/projected/87aa5298-bd9f-4efe-99b6-e43086247a07-kube-api-access-wzcwc\") pod \"cert-manager-55b4d954d5-kxhzf\" (UID: \"87aa5298-bd9f-4efe-99b6-e43086247a07\") " pod="cert-manager/cert-manager-55b4d954d5-kxhzf" Jul 15 04:12:12.099937 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:12:12.099850 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/87aa5298-bd9f-4efe-99b6-e43086247a07-bound-sa-token\") pod \"cert-manager-55b4d954d5-kxhzf\" (UID: \"87aa5298-bd9f-4efe-99b6-e43086247a07\") " pod="cert-manager/cert-manager-55b4d954d5-kxhzf" Jul 15 04:12:12.200888 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:12:12.200852 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/87aa5298-bd9f-4efe-99b6-e43086247a07-bound-sa-token\") pod \"cert-manager-55b4d954d5-kxhzf\" (UID: \"87aa5298-bd9f-4efe-99b6-e43086247a07\") " pod="cert-manager/cert-manager-55b4d954d5-kxhzf" Jul 15 04:12:12.201059 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:12:12.200909 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wzcwc\" (UniqueName: \"kubernetes.io/projected/87aa5298-bd9f-4efe-99b6-e43086247a07-kube-api-access-wzcwc\") pod \"cert-manager-55b4d954d5-kxhzf\" (UID: \"87aa5298-bd9f-4efe-99b6-e43086247a07\") " pod="cert-manager/cert-manager-55b4d954d5-kxhzf" Jul 15 04:12:12.213896 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:12:12.213868 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/87aa5298-bd9f-4efe-99b6-e43086247a07-bound-sa-token\") pod \"cert-manager-55b4d954d5-kxhzf\" (UID: \"87aa5298-bd9f-4efe-99b6-e43086247a07\") " pod="cert-manager/cert-manager-55b4d954d5-kxhzf" Jul 15 04:12:12.213896 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:12:12.213886 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wzcwc\" (UniqueName: \"kubernetes.io/projected/87aa5298-bd9f-4efe-99b6-e43086247a07-kube-api-access-wzcwc\") pod \"cert-manager-55b4d954d5-kxhzf\" (UID: \"87aa5298-bd9f-4efe-99b6-e43086247a07\") " pod="cert-manager/cert-manager-55b4d954d5-kxhzf" Jul 15 04:12:12.305592 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:12:12.305499 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-kxhzf" Jul 15 04:12:12.439189 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:12:12.439162 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-kxhzf"] Jul 15 04:12:12.441221 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:12:12.441193 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod87aa5298_bd9f_4efe_99b6_e43086247a07.slice/crio-3313b2086c8e5759c278a0f24782c586556d4760c1d153180ba905073b2cfffa WatchSource:0}: Error finding container 3313b2086c8e5759c278a0f24782c586556d4760c1d153180ba905073b2cfffa: Status 404 returned error can't find the container with id 3313b2086c8e5759c278a0f24782c586556d4760c1d153180ba905073b2cfffa Jul 15 04:12:12.722362 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:12:12.722326 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-kxhzf" event={"ID":"87aa5298-bd9f-4efe-99b6-e43086247a07","Type":"ContainerStarted","Data":"d10356c04d66ad60c6302875f93c3b81612647efac4aedf4fa075f516d4414ea"} Jul 15 04:12:12.722762 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:12:12.722373 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-kxhzf" event={"ID":"87aa5298-bd9f-4efe-99b6-e43086247a07","Type":"ContainerStarted","Data":"3313b2086c8e5759c278a0f24782c586556d4760c1d153180ba905073b2cfffa"} Jul 15 04:12:12.737775 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:12:12.737727 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-55b4d954d5-kxhzf" podStartSLOduration=1.737704929 podStartE2EDuration="1.737704929s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 04:12:11 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 04:12:12.736764521 +0000 UTC m=+366.263565539" watchObservedRunningTime="2026-07-15 04:12:12.737704929 +0000 UTC m=+366.264505945" Jul 15 04:12:12.851699 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:12:12.851674 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fgs7vh" Jul 15 04:12:12.908026 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:12:12.907989 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xg2mc\" (UniqueName: \"kubernetes.io/projected/6a4bbc1c-ffb3-4fc2-904f-db79786b85ae-kube-api-access-xg2mc\") pod \"6a4bbc1c-ffb3-4fc2-904f-db79786b85ae\" (UID: \"6a4bbc1c-ffb3-4fc2-904f-db79786b85ae\") " Jul 15 04:12:12.908212 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:12:12.908067 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6a4bbc1c-ffb3-4fc2-904f-db79786b85ae-util\") pod \"6a4bbc1c-ffb3-4fc2-904f-db79786b85ae\" (UID: \"6a4bbc1c-ffb3-4fc2-904f-db79786b85ae\") " Jul 15 04:12:12.908212 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:12:12.908175 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6a4bbc1c-ffb3-4fc2-904f-db79786b85ae-bundle\") pod \"6a4bbc1c-ffb3-4fc2-904f-db79786b85ae\" (UID: \"6a4bbc1c-ffb3-4fc2-904f-db79786b85ae\") " Jul 15 04:12:12.908507 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:12:12.908478 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6a4bbc1c-ffb3-4fc2-904f-db79786b85ae-bundle" (OuterVolumeSpecName: "bundle") pod "6a4bbc1c-ffb3-4fc2-904f-db79786b85ae" (UID: "6a4bbc1c-ffb3-4fc2-904f-db79786b85ae"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 04:12:12.910133 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:12:12.910107 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6a4bbc1c-ffb3-4fc2-904f-db79786b85ae-kube-api-access-xg2mc" (OuterVolumeSpecName: "kube-api-access-xg2mc") pod "6a4bbc1c-ffb3-4fc2-904f-db79786b85ae" (UID: "6a4bbc1c-ffb3-4fc2-904f-db79786b85ae"). InnerVolumeSpecName "kube-api-access-xg2mc". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 15 04:12:12.912875 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:12:12.912841 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6a4bbc1c-ffb3-4fc2-904f-db79786b85ae-util" (OuterVolumeSpecName: "util") pod "6a4bbc1c-ffb3-4fc2-904f-db79786b85ae" (UID: "6a4bbc1c-ffb3-4fc2-904f-db79786b85ae"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 04:12:13.009283 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:12:13.009255 2581 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6a4bbc1c-ffb3-4fc2-904f-db79786b85ae-bundle\") on node \"ip-10-0-128-222.ec2.internal\" DevicePath \"\"" Jul 15 04:12:13.009283 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:12:13.009280 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xg2mc\" (UniqueName: \"kubernetes.io/projected/6a4bbc1c-ffb3-4fc2-904f-db79786b85ae-kube-api-access-xg2mc\") on node \"ip-10-0-128-222.ec2.internal\" DevicePath \"\"" Jul 15 04:12:13.009448 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:12:13.009290 2581 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6a4bbc1c-ffb3-4fc2-904f-db79786b85ae-util\") on node \"ip-10-0-128-222.ec2.internal\" DevicePath \"\"" Jul 15 04:12:13.728585 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:12:13.728555 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fgs7vh" Jul 15 04:12:13.728974 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:12:13.728580 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fgs7vh" event={"ID":"6a4bbc1c-ffb3-4fc2-904f-db79786b85ae","Type":"ContainerDied","Data":"51970deef6f41c612184b5de4a13bb1fbb365626266d8e6e3866a1b032e07c91"} Jul 15 04:12:13.728974 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:12:13.728627 2581 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="51970deef6f41c612184b5de4a13bb1fbb365626266d8e6e3866a1b032e07c91" Jul 15 04:12:18.969702 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:12:18.969646 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:12:19.069558 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:12:19.069500 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:12:26.071776 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:12:26.071733 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:12:26.127107 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:12:26.127068 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:12:27.577818 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:12:27.577782 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af686x9"] Jul 15 04:12:27.578234 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:12:27.578156 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6a4bbc1c-ffb3-4fc2-904f-db79786b85ae" containerName="util" Jul 15 04:12:27.578234 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:12:27.578169 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="6a4bbc1c-ffb3-4fc2-904f-db79786b85ae" containerName="util" Jul 15 04:12:27.578234 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:12:27.578179 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6a4bbc1c-ffb3-4fc2-904f-db79786b85ae" containerName="pull" Jul 15 04:12:27.578234 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:12:27.578187 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="6a4bbc1c-ffb3-4fc2-904f-db79786b85ae" containerName="pull" Jul 15 04:12:27.578234 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:12:27.578202 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6a4bbc1c-ffb3-4fc2-904f-db79786b85ae" containerName="extract" Jul 15 04:12:27.578234 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:12:27.578209 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="6a4bbc1c-ffb3-4fc2-904f-db79786b85ae" containerName="extract" Jul 15 04:12:27.578420 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:12:27.578266 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="6a4bbc1c-ffb3-4fc2-904f-db79786b85ae" containerName="extract" Jul 15 04:12:27.582717 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:12:27.582696 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af686x9" Jul 15 04:12:27.584943 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:12:27.584921 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 15 04:12:27.585066 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:12:27.585004 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-7tb27\"" Jul 15 04:12:27.585957 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:12:27.585935 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 15 04:12:27.588589 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:12:27.588569 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af686x9"] Jul 15 04:12:27.643241 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:12:27.643206 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e95267da-c834-4ffd-a6d9-cc03153f0d12-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af686x9\" (UID: \"e95267da-c834-4ffd-a6d9-cc03153f0d12\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af686x9" Jul 15 04:12:27.643403 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:12:27.643257 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-djckj\" (UniqueName: \"kubernetes.io/projected/e95267da-c834-4ffd-a6d9-cc03153f0d12-kube-api-access-djckj\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af686x9\" (UID: \"e95267da-c834-4ffd-a6d9-cc03153f0d12\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af686x9" Jul 15 04:12:27.643403 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:12:27.643355 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e95267da-c834-4ffd-a6d9-cc03153f0d12-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af686x9\" (UID: \"e95267da-c834-4ffd-a6d9-cc03153f0d12\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af686x9" Jul 15 04:12:27.686866 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:12:27.686834 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:12:27.744137 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:12:27.744095 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e95267da-c834-4ffd-a6d9-cc03153f0d12-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af686x9\" (UID: \"e95267da-c834-4ffd-a6d9-cc03153f0d12\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af686x9" Jul 15 04:12:27.744308 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:12:27.744175 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e95267da-c834-4ffd-a6d9-cc03153f0d12-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af686x9\" (UID: \"e95267da-c834-4ffd-a6d9-cc03153f0d12\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af686x9" Jul 15 04:12:27.744308 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:12:27.744209 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-djckj\" (UniqueName: \"kubernetes.io/projected/e95267da-c834-4ffd-a6d9-cc03153f0d12-kube-api-access-djckj\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af686x9\" (UID: \"e95267da-c834-4ffd-a6d9-cc03153f0d12\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af686x9" Jul 15 04:12:27.744571 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:12:27.744550 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e95267da-c834-4ffd-a6d9-cc03153f0d12-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af686x9\" (UID: \"e95267da-c834-4ffd-a6d9-cc03153f0d12\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af686x9" Jul 15 04:12:27.744609 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:12:27.744551 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e95267da-c834-4ffd-a6d9-cc03153f0d12-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af686x9\" (UID: \"e95267da-c834-4ffd-a6d9-cc03153f0d12\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af686x9" Jul 15 04:12:27.753886 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:12:27.753854 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-djckj\" (UniqueName: \"kubernetes.io/projected/e95267da-c834-4ffd-a6d9-cc03153f0d12-kube-api-access-djckj\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af686x9\" (UID: \"e95267da-c834-4ffd-a6d9-cc03153f0d12\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af686x9" Jul 15 04:12:27.892904 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:12:27.892871 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af686x9" Jul 15 04:12:28.047188 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:12:28.047162 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af686x9"] Jul 15 04:12:28.049434 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:12:28.049409 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode95267da_c834_4ffd_a6d9_cc03153f0d12.slice/crio-3ef4c60da9772a7e951b34ed137889fc3420b462fda65127e4ace27959a7fdfc WatchSource:0}: Error finding container 3ef4c60da9772a7e951b34ed137889fc3420b462fda65127e4ace27959a7fdfc: Status 404 returned error can't find the container with id 3ef4c60da9772a7e951b34ed137889fc3420b462fda65127e4ace27959a7fdfc Jul 15 04:12:28.802568 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:12:28.802533 2581 generic.go:356] "Generic (PLEG): container finished" podID="e95267da-c834-4ffd-a6d9-cc03153f0d12" containerID="a738e6c7092e37e3d38d15e11c9881bffd5276227ec08553b7fab254f2cdb41f" exitCode=0 Jul 15 04:12:28.803000 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:12:28.802616 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af686x9" event={"ID":"e95267da-c834-4ffd-a6d9-cc03153f0d12","Type":"ContainerDied","Data":"a738e6c7092e37e3d38d15e11c9881bffd5276227ec08553b7fab254f2cdb41f"} Jul 15 04:12:28.803000 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:12:28.802662 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af686x9" event={"ID":"e95267da-c834-4ffd-a6d9-cc03153f0d12","Type":"ContainerStarted","Data":"3ef4c60da9772a7e951b34ed137889fc3420b462fda65127e4ace27959a7fdfc"} Jul 15 04:12:29.809810 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:12:29.809718 2581 generic.go:356] "Generic (PLEG): container finished" podID="e95267da-c834-4ffd-a6d9-cc03153f0d12" containerID="d33512e753679a3d9126b8f8c0fa673f9801ecb05fa66bf96dc363302e0e2c9a" exitCode=0 Jul 15 04:12:29.809810 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:12:29.809801 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af686x9" event={"ID":"e95267da-c834-4ffd-a6d9-cc03153f0d12","Type":"ContainerDied","Data":"d33512e753679a3d9126b8f8c0fa673f9801ecb05fa66bf96dc363302e0e2c9a"} Jul 15 04:12:30.816090 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:12:30.816055 2581 generic.go:356] "Generic (PLEG): container finished" podID="e95267da-c834-4ffd-a6d9-cc03153f0d12" containerID="b442659e8a751df5af39321c49da8be5e0d2692dc21e3f274da1e1c3554f00db" exitCode=0 Jul 15 04:12:30.816498 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:12:30.816105 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af686x9" event={"ID":"e95267da-c834-4ffd-a6d9-cc03153f0d12","Type":"ContainerDied","Data":"b442659e8a751df5af39321c49da8be5e0d2692dc21e3f274da1e1c3554f00db"} Jul 15 04:12:31.949392 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:12:31.949367 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af686x9" Jul 15 04:12:32.089915 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:12:32.089822 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-djckj\" (UniqueName: \"kubernetes.io/projected/e95267da-c834-4ffd-a6d9-cc03153f0d12-kube-api-access-djckj\") pod \"e95267da-c834-4ffd-a6d9-cc03153f0d12\" (UID: \"e95267da-c834-4ffd-a6d9-cc03153f0d12\") " Jul 15 04:12:32.089915 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:12:32.089860 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e95267da-c834-4ffd-a6d9-cc03153f0d12-util\") pod \"e95267da-c834-4ffd-a6d9-cc03153f0d12\" (UID: \"e95267da-c834-4ffd-a6d9-cc03153f0d12\") " Jul 15 04:12:32.089915 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:12:32.089895 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e95267da-c834-4ffd-a6d9-cc03153f0d12-bundle\") pod \"e95267da-c834-4ffd-a6d9-cc03153f0d12\" (UID: \"e95267da-c834-4ffd-a6d9-cc03153f0d12\") " Jul 15 04:12:32.090796 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:12:32.090770 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e95267da-c834-4ffd-a6d9-cc03153f0d12-bundle" (OuterVolumeSpecName: "bundle") pod "e95267da-c834-4ffd-a6d9-cc03153f0d12" (UID: "e95267da-c834-4ffd-a6d9-cc03153f0d12"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 04:12:32.092035 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:12:32.092014 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e95267da-c834-4ffd-a6d9-cc03153f0d12-kube-api-access-djckj" (OuterVolumeSpecName: "kube-api-access-djckj") pod "e95267da-c834-4ffd-a6d9-cc03153f0d12" (UID: "e95267da-c834-4ffd-a6d9-cc03153f0d12"). InnerVolumeSpecName "kube-api-access-djckj". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 15 04:12:32.095441 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:12:32.095401 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e95267da-c834-4ffd-a6d9-cc03153f0d12-util" (OuterVolumeSpecName: "util") pod "e95267da-c834-4ffd-a6d9-cc03153f0d12" (UID: "e95267da-c834-4ffd-a6d9-cc03153f0d12"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 04:12:32.191615 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:12:32.191579 2581 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e95267da-c834-4ffd-a6d9-cc03153f0d12-bundle\") on node \"ip-10-0-128-222.ec2.internal\" DevicePath \"\"" Jul 15 04:12:32.191615 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:12:32.191609 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-djckj\" (UniqueName: \"kubernetes.io/projected/e95267da-c834-4ffd-a6d9-cc03153f0d12-kube-api-access-djckj\") on node \"ip-10-0-128-222.ec2.internal\" DevicePath \"\"" Jul 15 04:12:32.191615 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:12:32.191619 2581 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e95267da-c834-4ffd-a6d9-cc03153f0d12-util\") on node \"ip-10-0-128-222.ec2.internal\" DevicePath \"\"" Jul 15 04:12:32.828271 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:12:32.828235 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af686x9" event={"ID":"e95267da-c834-4ffd-a6d9-cc03153f0d12","Type":"ContainerDied","Data":"3ef4c60da9772a7e951b34ed137889fc3420b462fda65127e4ace27959a7fdfc"} Jul 15 04:12:32.828454 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:12:32.828285 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af686x9" Jul 15 04:12:32.828454 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:12:32.828287 2581 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="3ef4c60da9772a7e951b34ed137889fc3420b462fda65127e4ace27959a7fdfc" Jul 15 04:12:43.691571 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:12:43.691535 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:12:43.790369 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:12:43.790337 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:12:44.504745 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:12:44.504706 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:12:44.730292 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:12:44.730259 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:12:44.821036 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:12:44.820958 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:12:44.842899 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:12:44.842867 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6dddd85b7f-vwqvs"] Jul 15 04:12:44.843228 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:12:44.843216 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e95267da-c834-4ffd-a6d9-cc03153f0d12" containerName="extract" Jul 15 04:12:44.843280 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:12:44.843229 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="e95267da-c834-4ffd-a6d9-cc03153f0d12" containerName="extract" Jul 15 04:12:44.843280 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:12:44.843239 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e95267da-c834-4ffd-a6d9-cc03153f0d12" containerName="pull" Jul 15 04:12:44.843280 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:12:44.843244 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="e95267da-c834-4ffd-a6d9-cc03153f0d12" containerName="pull" Jul 15 04:12:44.843280 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:12:44.843253 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e95267da-c834-4ffd-a6d9-cc03153f0d12" containerName="util" Jul 15 04:12:44.843280 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:12:44.843258 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="e95267da-c834-4ffd-a6d9-cc03153f0d12" containerName="util" Jul 15 04:12:44.843444 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:12:44.843337 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="e95267da-c834-4ffd-a6d9-cc03153f0d12" containerName="extract" Jul 15 04:12:44.847613 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:12:44.847597 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-6dddd85b7f-vwqvs" Jul 15 04:12:44.852654 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:12:44.852625 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jul 15 04:12:44.852834 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:12:44.852811 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-5c9wl\"" Jul 15 04:12:44.853905 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:12:44.853884 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jul 15 04:12:44.854161 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:12:44.854132 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jul 15 04:12:44.854251 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:12:44.854182 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jul 15 04:12:44.879088 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:12:44.879050 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6dddd85b7f-vwqvs"] Jul 15 04:12:45.009914 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:12:45.009871 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/fe24ce39-5cd7-4fc7-b16d-4e02a57c251e-manifests\") pod \"opendatahub-operator-controller-manager-6dddd85b7f-vwqvs\" (UID: \"fe24ce39-5cd7-4fc7-b16d-4e02a57c251e\") " pod="opendatahub/opendatahub-operator-controller-manager-6dddd85b7f-vwqvs" Jul 15 04:12:45.010172 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:12:45.009934 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/fe24ce39-5cd7-4fc7-b16d-4e02a57c251e-tmp\") pod \"opendatahub-operator-controller-manager-6dddd85b7f-vwqvs\" (UID: \"fe24ce39-5cd7-4fc7-b16d-4e02a57c251e\") " pod="opendatahub/opendatahub-operator-controller-manager-6dddd85b7f-vwqvs" Jul 15 04:12:45.010172 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:12:45.010019 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nssw5\" (UniqueName: \"kubernetes.io/projected/fe24ce39-5cd7-4fc7-b16d-4e02a57c251e-kube-api-access-nssw5\") pod \"opendatahub-operator-controller-manager-6dddd85b7f-vwqvs\" (UID: \"fe24ce39-5cd7-4fc7-b16d-4e02a57c251e\") " pod="opendatahub/opendatahub-operator-controller-manager-6dddd85b7f-vwqvs" Jul 15 04:12:45.010172 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:12:45.010091 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/fe24ce39-5cd7-4fc7-b16d-4e02a57c251e-webhook-cert\") pod \"opendatahub-operator-controller-manager-6dddd85b7f-vwqvs\" (UID: \"fe24ce39-5cd7-4fc7-b16d-4e02a57c251e\") " pod="opendatahub/opendatahub-operator-controller-manager-6dddd85b7f-vwqvs" Jul 15 04:12:45.010400 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:12:45.010280 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/fe24ce39-5cd7-4fc7-b16d-4e02a57c251e-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6dddd85b7f-vwqvs\" (UID: \"fe24ce39-5cd7-4fc7-b16d-4e02a57c251e\") " pod="opendatahub/opendatahub-operator-controller-manager-6dddd85b7f-vwqvs" Jul 15 04:12:45.023809 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:12:45.023756 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:12:45.111473 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:12:45.111435 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/fe24ce39-5cd7-4fc7-b16d-4e02a57c251e-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6dddd85b7f-vwqvs\" (UID: \"fe24ce39-5cd7-4fc7-b16d-4e02a57c251e\") " pod="opendatahub/opendatahub-operator-controller-manager-6dddd85b7f-vwqvs" Jul 15 04:12:45.111473 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:12:45.111488 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/fe24ce39-5cd7-4fc7-b16d-4e02a57c251e-manifests\") pod \"opendatahub-operator-controller-manager-6dddd85b7f-vwqvs\" (UID: \"fe24ce39-5cd7-4fc7-b16d-4e02a57c251e\") " pod="opendatahub/opendatahub-operator-controller-manager-6dddd85b7f-vwqvs" Jul 15 04:12:45.111718 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:12:45.111520 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/fe24ce39-5cd7-4fc7-b16d-4e02a57c251e-tmp\") pod \"opendatahub-operator-controller-manager-6dddd85b7f-vwqvs\" (UID: \"fe24ce39-5cd7-4fc7-b16d-4e02a57c251e\") " pod="opendatahub/opendatahub-operator-controller-manager-6dddd85b7f-vwqvs" Jul 15 04:12:45.111718 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:12:45.111583 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nssw5\" (UniqueName: \"kubernetes.io/projected/fe24ce39-5cd7-4fc7-b16d-4e02a57c251e-kube-api-access-nssw5\") pod \"opendatahub-operator-controller-manager-6dddd85b7f-vwqvs\" (UID: \"fe24ce39-5cd7-4fc7-b16d-4e02a57c251e\") " pod="opendatahub/opendatahub-operator-controller-manager-6dddd85b7f-vwqvs" Jul 15 04:12:45.111718 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:12:45.111630 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/fe24ce39-5cd7-4fc7-b16d-4e02a57c251e-webhook-cert\") pod \"opendatahub-operator-controller-manager-6dddd85b7f-vwqvs\" (UID: \"fe24ce39-5cd7-4fc7-b16d-4e02a57c251e\") " pod="opendatahub/opendatahub-operator-controller-manager-6dddd85b7f-vwqvs" Jul 15 04:12:45.112227 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:12:45.112202 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/fe24ce39-5cd7-4fc7-b16d-4e02a57c251e-manifests\") pod \"opendatahub-operator-controller-manager-6dddd85b7f-vwqvs\" (UID: \"fe24ce39-5cd7-4fc7-b16d-4e02a57c251e\") " pod="opendatahub/opendatahub-operator-controller-manager-6dddd85b7f-vwqvs" Jul 15 04:12:45.114278 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:12:45.114246 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/fe24ce39-5cd7-4fc7-b16d-4e02a57c251e-tmp\") pod \"opendatahub-operator-controller-manager-6dddd85b7f-vwqvs\" (UID: \"fe24ce39-5cd7-4fc7-b16d-4e02a57c251e\") " pod="opendatahub/opendatahub-operator-controller-manager-6dddd85b7f-vwqvs" Jul 15 04:12:45.114576 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:12:45.114551 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/fe24ce39-5cd7-4fc7-b16d-4e02a57c251e-webhook-cert\") pod \"opendatahub-operator-controller-manager-6dddd85b7f-vwqvs\" (UID: \"fe24ce39-5cd7-4fc7-b16d-4e02a57c251e\") " pod="opendatahub/opendatahub-operator-controller-manager-6dddd85b7f-vwqvs" Jul 15 04:12:45.114946 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:12:45.114897 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/fe24ce39-5cd7-4fc7-b16d-4e02a57c251e-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6dddd85b7f-vwqvs\" (UID: \"fe24ce39-5cd7-4fc7-b16d-4e02a57c251e\") " pod="opendatahub/opendatahub-operator-controller-manager-6dddd85b7f-vwqvs" Jul 15 04:12:45.121175 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:12:45.121147 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nssw5\" (UniqueName: \"kubernetes.io/projected/fe24ce39-5cd7-4fc7-b16d-4e02a57c251e-kube-api-access-nssw5\") pod \"opendatahub-operator-controller-manager-6dddd85b7f-vwqvs\" (UID: \"fe24ce39-5cd7-4fc7-b16d-4e02a57c251e\") " pod="opendatahub/opendatahub-operator-controller-manager-6dddd85b7f-vwqvs" Jul 15 04:12:45.124559 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:12:45.124505 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:12:45.158381 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:12:45.158351 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-6dddd85b7f-vwqvs" Jul 15 04:12:45.223919 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:12:45.223870 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:12:45.310398 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:12:45.310365 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6dddd85b7f-vwqvs"] Jul 15 04:12:45.314040 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:12:45.314014 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfe24ce39_5cd7_4fc7_b16d_4e02a57c251e.slice/crio-e38b9e3eedcec9587935da95a7f95a97c2c0423eb60b80b6129d42fad4ae902e WatchSource:0}: Error finding container e38b9e3eedcec9587935da95a7f95a97c2c0423eb60b80b6129d42fad4ae902e: Status 404 returned error can't find the container with id e38b9e3eedcec9587935da95a7f95a97c2c0423eb60b80b6129d42fad4ae902e Jul 15 04:12:45.315149 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:12:45.315095 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:12:45.380165 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:12:45.380023 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:12:45.473249 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:12:45.473216 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:12:45.895562 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:12:45.895487 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6dddd85b7f-vwqvs" event={"ID":"fe24ce39-5cd7-4fc7-b16d-4e02a57c251e","Type":"ContainerStarted","Data":"e38b9e3eedcec9587935da95a7f95a97c2c0423eb60b80b6129d42fad4ae902e"} Jul 15 04:12:46.009853 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:12:46.009813 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:12:46.114064 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:12:46.114020 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:12:48.913884 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:12:48.913850 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6dddd85b7f-vwqvs" event={"ID":"fe24ce39-5cd7-4fc7-b16d-4e02a57c251e","Type":"ContainerStarted","Data":"115422dbcc7259548803c3a16a2a132efe96482f26730a0007c6e98cbe4a9ce8"} Jul 15 04:12:49.920657 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:12:49.920622 2581 generic.go:356] "Generic (PLEG): container finished" podID="fe24ce39-5cd7-4fc7-b16d-4e02a57c251e" containerID="115422dbcc7259548803c3a16a2a132efe96482f26730a0007c6e98cbe4a9ce8" exitCode=0 Jul 15 04:12:49.921141 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:12:49.920694 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6dddd85b7f-vwqvs" event={"ID":"fe24ce39-5cd7-4fc7-b16d-4e02a57c251e","Type":"ContainerDied","Data":"115422dbcc7259548803c3a16a2a132efe96482f26730a0007c6e98cbe4a9ce8"} Jul 15 04:12:50.928505 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:12:50.928468 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6dddd85b7f-vwqvs" event={"ID":"fe24ce39-5cd7-4fc7-b16d-4e02a57c251e","Type":"ContainerStarted","Data":"526440e4519b1b87e89b03197eacbfcdf6005f0b7a2d50a738f8b523b072cd04"} Jul 15 04:12:50.928903 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:12:50.928553 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-6dddd85b7f-vwqvs" Jul 15 04:12:50.950314 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:12:50.950258 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-6dddd85b7f-vwqvs" podStartSLOduration=2.479416845 podStartE2EDuration="6.950241564s" totalImagesPullingTime="3.428292659s" totalInitContainerRuntime="1.04253206s" isStatefulPod=false podCreationTimestamp="2026-07-15 04:12:44 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 04:12:50.948832454 +0000 UTC m=+404.475633496" watchObservedRunningTime="2026-07-15 04:12:50.950241564 +0000 UTC m=+404.477042579" Jul 15 04:12:56.959020 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:12:56.958983 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:12:57.059824 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:12:57.059795 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:13:01.935087 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:13:01.935059 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-6dddd85b7f-vwqvs" Jul 15 04:13:03.921380 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:13:03.921330 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:13:04.032861 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:13:04.032825 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:13:04.575438 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:13:04.575393 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-w5vhc"] Jul 15 04:13:04.581352 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:13:04.581329 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-w5vhc" Jul 15 04:13:04.583695 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:13:04.583673 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\"" Jul 15 04:13:04.583821 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:13:04.583678 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-bh4hm\"" Jul 15 04:13:04.588360 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:13:04.588337 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-w5vhc"] Jul 15 04:13:04.607453 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:13:04.607421 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:13:04.670225 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:13:04.670194 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:13:04.679526 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:13:04.679498 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/07fbebee-5fcc-461a-872c-3c59aba1c9f1-cert\") pod \"odh-model-controller-7998c67dc4-w5vhc\" (UID: \"07fbebee-5fcc-461a-872c-3c59aba1c9f1\") " pod="opendatahub/odh-model-controller-7998c67dc4-w5vhc" Jul 15 04:13:04.679626 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:13:04.679536 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qwf8t\" (UniqueName: \"kubernetes.io/projected/07fbebee-5fcc-461a-872c-3c59aba1c9f1-kube-api-access-qwf8t\") pod \"odh-model-controller-7998c67dc4-w5vhc\" (UID: \"07fbebee-5fcc-461a-872c-3c59aba1c9f1\") " pod="opendatahub/odh-model-controller-7998c67dc4-w5vhc" Jul 15 04:13:04.769924 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:13:04.769893 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:13:04.780099 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:13:04.780070 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/07fbebee-5fcc-461a-872c-3c59aba1c9f1-cert\") pod \"odh-model-controller-7998c67dc4-w5vhc\" (UID: \"07fbebee-5fcc-461a-872c-3c59aba1c9f1\") " pod="opendatahub/odh-model-controller-7998c67dc4-w5vhc" Jul 15 04:13:04.780279 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:13:04.780111 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qwf8t\" (UniqueName: \"kubernetes.io/projected/07fbebee-5fcc-461a-872c-3c59aba1c9f1-kube-api-access-qwf8t\") pod \"odh-model-controller-7998c67dc4-w5vhc\" (UID: \"07fbebee-5fcc-461a-872c-3c59aba1c9f1\") " pod="opendatahub/odh-model-controller-7998c67dc4-w5vhc" Jul 15 04:13:04.780279 ip-10-0-128-222 kubenswrapper[2581]: E0715 04:13:04.780227 2581 secret.go:189] Couldn't get secret opendatahub/odh-model-controller-webhook-cert: secret "odh-model-controller-webhook-cert" not found Jul 15 04:13:04.780368 ip-10-0-128-222 kubenswrapper[2581]: E0715 04:13:04.780297 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/07fbebee-5fcc-461a-872c-3c59aba1c9f1-cert podName:07fbebee-5fcc-461a-872c-3c59aba1c9f1 nodeName:}" failed. No retries permitted until 2026-07-15 04:13:05.280280875 +0000 UTC m=+418.807081868 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/07fbebee-5fcc-461a-872c-3c59aba1c9f1-cert") pod "odh-model-controller-7998c67dc4-w5vhc" (UID: "07fbebee-5fcc-461a-872c-3c59aba1c9f1") : secret "odh-model-controller-webhook-cert" not found Jul 15 04:13:04.791943 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:13:04.791913 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qwf8t\" (UniqueName: \"kubernetes.io/projected/07fbebee-5fcc-461a-872c-3c59aba1c9f1-kube-api-access-qwf8t\") pod \"odh-model-controller-7998c67dc4-w5vhc\" (UID: \"07fbebee-5fcc-461a-872c-3c59aba1c9f1\") " pod="opendatahub/odh-model-controller-7998c67dc4-w5vhc" Jul 15 04:13:05.037851 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:13:05.037821 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:13:05.170979 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:13:05.170945 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:13:05.284780 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:13:05.284722 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/07fbebee-5fcc-461a-872c-3c59aba1c9f1-cert\") pod \"odh-model-controller-7998c67dc4-w5vhc\" (UID: \"07fbebee-5fcc-461a-872c-3c59aba1c9f1\") " pod="opendatahub/odh-model-controller-7998c67dc4-w5vhc" Jul 15 04:13:05.287221 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:13:05.287202 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/07fbebee-5fcc-461a-872c-3c59aba1c9f1-cert\") pod \"odh-model-controller-7998c67dc4-w5vhc\" (UID: \"07fbebee-5fcc-461a-872c-3c59aba1c9f1\") " pod="opendatahub/odh-model-controller-7998c67dc4-w5vhc" Jul 15 04:13:05.301647 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:13:05.301563 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:13:05.492312 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:13:05.492277 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-w5vhc" Jul 15 04:13:05.624956 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:13:05.624931 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-w5vhc"] Jul 15 04:13:05.626854 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:13:05.626827 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod07fbebee_5fcc_461a_872c_3c59aba1c9f1.slice/crio-88062870c9322d222e77facda62a294033dc5148770f4f35a523be050dac46d0 WatchSource:0}: Error finding container 88062870c9322d222e77facda62a294033dc5148770f4f35a523be050dac46d0: Status 404 returned error can't find the container with id 88062870c9322d222e77facda62a294033dc5148770f4f35a523be050dac46d0 Jul 15 04:13:06.008838 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:13:06.008803 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-w5vhc" event={"ID":"07fbebee-5fcc-461a-872c-3c59aba1c9f1","Type":"ContainerStarted","Data":"88062870c9322d222e77facda62a294033dc5148770f4f35a523be050dac46d0"} Jul 15 04:13:09.026413 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:13:09.026383 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-w5vhc" event={"ID":"07fbebee-5fcc-461a-872c-3c59aba1c9f1","Type":"ContainerStarted","Data":"416b6350ac45b04e91cdff4acd108a425869f1393cb0dc0df418bbf30681c98b"} Jul 15 04:13:09.026807 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:13:09.026519 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-7998c67dc4-w5vhc" Jul 15 04:13:09.042858 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:13:09.042798 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/odh-model-controller-7998c67dc4-w5vhc" podStartSLOduration=1.830613235 podStartE2EDuration="5.042777845s" totalImagesPullingTime="3.21216461s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 04:13:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 04:13:09.042027707 +0000 UTC m=+422.568828735" watchObservedRunningTime="2026-07-15 04:13:09.042777845 +0000 UTC m=+422.569578862" Jul 15 04:13:09.047072 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:13:09.047046 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:13:09.146583 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:13:09.146546 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:13:09.613099 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:13:09.613067 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:13:09.686650 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:13:09.686612 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-b8bc8694c-cvv52"] Jul 15 04:13:09.690211 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:13:09.690186 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-b8bc8694c-cvv52" Jul 15 04:13:09.692552 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:13:09.692528 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" Jul 15 04:13:09.692552 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:13:09.692537 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-q9vx4\"" Jul 15 04:13:09.693281 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:13:09.693261 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" Jul 15 04:13:09.698903 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:13:09.698881 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-b8bc8694c-cvv52"] Jul 15 04:13:09.722787 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:13:09.722751 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:13:09.728261 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:13:09.728236 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6qm88\" (UniqueName: \"kubernetes.io/projected/fe15406b-86ed-4c2e-afc7-4a1cb0c13379-kube-api-access-6qm88\") pod \"kube-auth-proxy-b8bc8694c-cvv52\" (UID: \"fe15406b-86ed-4c2e-afc7-4a1cb0c13379\") " pod="openshift-ingress/kube-auth-proxy-b8bc8694c-cvv52" Jul 15 04:13:09.728404 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:13:09.728278 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/fe15406b-86ed-4c2e-afc7-4a1cb0c13379-tmp\") pod \"kube-auth-proxy-b8bc8694c-cvv52\" (UID: \"fe15406b-86ed-4c2e-afc7-4a1cb0c13379\") " pod="openshift-ingress/kube-auth-proxy-b8bc8694c-cvv52" Jul 15 04:13:09.728404 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:13:09.728389 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fe15406b-86ed-4c2e-afc7-4a1cb0c13379-tls-certs\") pod \"kube-auth-proxy-b8bc8694c-cvv52\" (UID: \"fe15406b-86ed-4c2e-afc7-4a1cb0c13379\") " pod="openshift-ingress/kube-auth-proxy-b8bc8694c-cvv52" Jul 15 04:13:09.829636 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:13:09.829603 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6qm88\" (UniqueName: \"kubernetes.io/projected/fe15406b-86ed-4c2e-afc7-4a1cb0c13379-kube-api-access-6qm88\") pod \"kube-auth-proxy-b8bc8694c-cvv52\" (UID: \"fe15406b-86ed-4c2e-afc7-4a1cb0c13379\") " pod="openshift-ingress/kube-auth-proxy-b8bc8694c-cvv52" Jul 15 04:13:09.829636 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:13:09.829643 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/fe15406b-86ed-4c2e-afc7-4a1cb0c13379-tmp\") pod \"kube-auth-proxy-b8bc8694c-cvv52\" (UID: \"fe15406b-86ed-4c2e-afc7-4a1cb0c13379\") " pod="openshift-ingress/kube-auth-proxy-b8bc8694c-cvv52" Jul 15 04:13:09.829858 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:13:09.829688 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fe15406b-86ed-4c2e-afc7-4a1cb0c13379-tls-certs\") pod \"kube-auth-proxy-b8bc8694c-cvv52\" (UID: \"fe15406b-86ed-4c2e-afc7-4a1cb0c13379\") " pod="openshift-ingress/kube-auth-proxy-b8bc8694c-cvv52" Jul 15 04:13:09.831978 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:13:09.831951 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/fe15406b-86ed-4c2e-afc7-4a1cb0c13379-tmp\") pod \"kube-auth-proxy-b8bc8694c-cvv52\" (UID: \"fe15406b-86ed-4c2e-afc7-4a1cb0c13379\") " pod="openshift-ingress/kube-auth-proxy-b8bc8694c-cvv52" Jul 15 04:13:09.832136 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:13:09.832104 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fe15406b-86ed-4c2e-afc7-4a1cb0c13379-tls-certs\") pod \"kube-auth-proxy-b8bc8694c-cvv52\" (UID: \"fe15406b-86ed-4c2e-afc7-4a1cb0c13379\") " pod="openshift-ingress/kube-auth-proxy-b8bc8694c-cvv52" Jul 15 04:13:09.836590 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:13:09.836569 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6qm88\" (UniqueName: \"kubernetes.io/projected/fe15406b-86ed-4c2e-afc7-4a1cb0c13379-kube-api-access-6qm88\") pod \"kube-auth-proxy-b8bc8694c-cvv52\" (UID: \"fe15406b-86ed-4c2e-afc7-4a1cb0c13379\") " pod="openshift-ingress/kube-auth-proxy-b8bc8694c-cvv52" Jul 15 04:13:10.001330 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:13:10.001243 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-b8bc8694c-cvv52" Jul 15 04:13:10.130435 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:13:10.130411 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-b8bc8694c-cvv52"] Jul 15 04:13:10.132396 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:13:10.132366 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfe15406b_86ed_4c2e_afc7_4a1cb0c13379.slice/crio-761aaa709c67b5317b4a0de3b7c281bd0ff9ace5643c2647e76fad5384d845cf WatchSource:0}: Error finding container 761aaa709c67b5317b4a0de3b7c281bd0ff9ace5643c2647e76fad5384d845cf: Status 404 returned error can't find the container with id 761aaa709c67b5317b4a0de3b7c281bd0ff9ace5643c2647e76fad5384d845cf Jul 15 04:13:10.905891 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:13:10.905847 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:13:10.913879 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:13:10.913848 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-v7dgg"] Jul 15 04:13:10.917759 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:13:10.917737 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-v7dgg" Jul 15 04:13:10.920338 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:13:10.920314 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\"" Jul 15 04:13:10.920463 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:13:10.920342 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\"" Jul 15 04:13:10.920463 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:13:10.920368 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\"" Jul 15 04:13:10.920463 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:13:10.920369 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jul 15 04:13:10.920628 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:13:10.920615 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-nbcpr\"" Jul 15 04:13:10.933831 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:13:10.933765 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-v7dgg"] Jul 15 04:13:10.968085 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:13:10.968045 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:13:11.037967 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:13:11.037931 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-b8bc8694c-cvv52" event={"ID":"fe15406b-86ed-4c2e-afc7-4a1cb0c13379","Type":"ContainerStarted","Data":"761aaa709c67b5317b4a0de3b7c281bd0ff9ace5643c2647e76fad5384d845cf"} Jul 15 04:13:11.040445 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:13:11.040400 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/d0fc2b1e-3271-4f50-9852-28b84a1fa2b5-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-v7dgg\" (UID: \"d0fc2b1e-3271-4f50-9852-28b84a1fa2b5\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-v7dgg" Jul 15 04:13:11.040575 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:13:11.040482 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nqqjn\" (UniqueName: \"kubernetes.io/projected/d0fc2b1e-3271-4f50-9852-28b84a1fa2b5-kube-api-access-nqqjn\") pod \"istiod-openshift-gateway-7574459656-v7dgg\" (UID: \"d0fc2b1e-3271-4f50-9852-28b84a1fa2b5\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-v7dgg" Jul 15 04:13:11.040575 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:13:11.040544 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/d0fc2b1e-3271-4f50-9852-28b84a1fa2b5-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-v7dgg\" (UID: \"d0fc2b1e-3271-4f50-9852-28b84a1fa2b5\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-v7dgg" Jul 15 04:13:11.040703 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:13:11.040683 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d0fc2b1e-3271-4f50-9852-28b84a1fa2b5-istio-token\") pod \"istiod-openshift-gateway-7574459656-v7dgg\" (UID: \"d0fc2b1e-3271-4f50-9852-28b84a1fa2b5\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-v7dgg" Jul 15 04:13:11.040762 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:13:11.040729 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/d0fc2b1e-3271-4f50-9852-28b84a1fa2b5-local-certs\") pod \"istiod-openshift-gateway-7574459656-v7dgg\" (UID: \"d0fc2b1e-3271-4f50-9852-28b84a1fa2b5\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-v7dgg" Jul 15 04:13:11.040880 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:13:11.040855 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/d0fc2b1e-3271-4f50-9852-28b84a1fa2b5-cacerts\") pod \"istiod-openshift-gateway-7574459656-v7dgg\" (UID: \"d0fc2b1e-3271-4f50-9852-28b84a1fa2b5\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-v7dgg" Jul 15 04:13:11.041018 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:13:11.040892 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/d0fc2b1e-3271-4f50-9852-28b84a1fa2b5-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-v7dgg\" (UID: \"d0fc2b1e-3271-4f50-9852-28b84a1fa2b5\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-v7dgg" Jul 15 04:13:11.141562 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:13:11.141529 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/d0fc2b1e-3271-4f50-9852-28b84a1fa2b5-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-v7dgg\" (UID: \"d0fc2b1e-3271-4f50-9852-28b84a1fa2b5\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-v7dgg" Jul 15 04:13:11.142000 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:13:11.141621 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d0fc2b1e-3271-4f50-9852-28b84a1fa2b5-istio-token\") pod \"istiod-openshift-gateway-7574459656-v7dgg\" (UID: \"d0fc2b1e-3271-4f50-9852-28b84a1fa2b5\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-v7dgg" Jul 15 04:13:11.142000 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:13:11.141652 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/d0fc2b1e-3271-4f50-9852-28b84a1fa2b5-local-certs\") pod \"istiod-openshift-gateway-7574459656-v7dgg\" (UID: \"d0fc2b1e-3271-4f50-9852-28b84a1fa2b5\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-v7dgg" Jul 15 04:13:11.142000 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:13:11.141672 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/d0fc2b1e-3271-4f50-9852-28b84a1fa2b5-cacerts\") pod \"istiod-openshift-gateway-7574459656-v7dgg\" (UID: \"d0fc2b1e-3271-4f50-9852-28b84a1fa2b5\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-v7dgg" Jul 15 04:13:11.142000 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:13:11.141696 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/d0fc2b1e-3271-4f50-9852-28b84a1fa2b5-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-v7dgg\" (UID: \"d0fc2b1e-3271-4f50-9852-28b84a1fa2b5\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-v7dgg" Jul 15 04:13:11.142000 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:13:11.141769 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/d0fc2b1e-3271-4f50-9852-28b84a1fa2b5-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-v7dgg\" (UID: \"d0fc2b1e-3271-4f50-9852-28b84a1fa2b5\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-v7dgg" Jul 15 04:13:11.142000 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:13:11.141820 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nqqjn\" (UniqueName: \"kubernetes.io/projected/d0fc2b1e-3271-4f50-9852-28b84a1fa2b5-kube-api-access-nqqjn\") pod \"istiod-openshift-gateway-7574459656-v7dgg\" (UID: \"d0fc2b1e-3271-4f50-9852-28b84a1fa2b5\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-v7dgg" Jul 15 04:13:11.142840 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:13:11.142806 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/d0fc2b1e-3271-4f50-9852-28b84a1fa2b5-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-v7dgg\" (UID: \"d0fc2b1e-3271-4f50-9852-28b84a1fa2b5\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-v7dgg" Jul 15 04:13:11.144427 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:13:11.144381 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/d0fc2b1e-3271-4f50-9852-28b84a1fa2b5-cacerts\") pod \"istiod-openshift-gateway-7574459656-v7dgg\" (UID: \"d0fc2b1e-3271-4f50-9852-28b84a1fa2b5\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-v7dgg" Jul 15 04:13:11.144702 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:13:11.144502 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/d0fc2b1e-3271-4f50-9852-28b84a1fa2b5-local-certs\") pod \"istiod-openshift-gateway-7574459656-v7dgg\" (UID: \"d0fc2b1e-3271-4f50-9852-28b84a1fa2b5\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-v7dgg" Jul 15 04:13:11.144702 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:13:11.144541 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/d0fc2b1e-3271-4f50-9852-28b84a1fa2b5-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-v7dgg\" (UID: \"d0fc2b1e-3271-4f50-9852-28b84a1fa2b5\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-v7dgg" Jul 15 04:13:11.144872 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:13:11.144720 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/d0fc2b1e-3271-4f50-9852-28b84a1fa2b5-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-v7dgg\" (UID: \"d0fc2b1e-3271-4f50-9852-28b84a1fa2b5\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-v7dgg" Jul 15 04:13:11.156462 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:13:11.156371 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nqqjn\" (UniqueName: \"kubernetes.io/projected/d0fc2b1e-3271-4f50-9852-28b84a1fa2b5-kube-api-access-nqqjn\") pod \"istiod-openshift-gateway-7574459656-v7dgg\" (UID: \"d0fc2b1e-3271-4f50-9852-28b84a1fa2b5\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-v7dgg" Jul 15 04:13:11.156979 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:13:11.156953 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d0fc2b1e-3271-4f50-9852-28b84a1fa2b5-istio-token\") pod \"istiod-openshift-gateway-7574459656-v7dgg\" (UID: \"d0fc2b1e-3271-4f50-9852-28b84a1fa2b5\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-v7dgg" Jul 15 04:13:11.231134 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:13:11.231085 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-v7dgg" Jul 15 04:13:11.388763 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:13:11.388721 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-v7dgg"] Jul 15 04:13:11.391012 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:13:11.390983 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd0fc2b1e_3271_4f50_9852_28b84a1fa2b5.slice/crio-173321dcd902bb21ba18dffa52ce47e4f296ceac869e1f579296d6e68a180fe0 WatchSource:0}: Error finding container 173321dcd902bb21ba18dffa52ce47e4f296ceac869e1f579296d6e68a180fe0: Status 404 returned error can't find the container with id 173321dcd902bb21ba18dffa52ce47e4f296ceac869e1f579296d6e68a180fe0 Jul 15 04:13:12.043844 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:13:12.043798 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-v7dgg" event={"ID":"d0fc2b1e-3271-4f50-9852-28b84a1fa2b5","Type":"ContainerStarted","Data":"173321dcd902bb21ba18dffa52ce47e4f296ceac869e1f579296d6e68a180fe0"} Jul 15 04:13:12.512591 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:13:12.512548 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:13:14.058033 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:13:14.057991 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-b8bc8694c-cvv52" event={"ID":"fe15406b-86ed-4c2e-afc7-4a1cb0c13379","Type":"ContainerStarted","Data":"463ab759a77e802326c121a69b5d2d331b779c3446035731edd46968c48aaaae"} Jul 15 04:13:14.082884 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:13:14.082830 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-b8bc8694c-cvv52" podStartSLOduration=1.810321499 podStartE2EDuration="5.082812392s" totalImagesPullingTime="3.272490893s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 04:13:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 04:13:14.081096116 +0000 UTC m=+427.607897123" watchObservedRunningTime="2026-07-15 04:13:14.082812392 +0000 UTC m=+427.609613407" Jul 15 04:13:14.615751 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:13:14.615716 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:13:14.674782 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:13:14.674744 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-7s7wv"] Jul 15 04:13:14.681646 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:13:14.681611 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-7s7wv" Jul 15 04:13:14.683946 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:13:14.683925 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-94gs5\"" Jul 15 04:13:14.684523 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:13:14.684503 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\"" Jul 15 04:13:14.692580 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:13:14.692556 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-7s7wv"] Jul 15 04:13:14.697394 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:13:14.697369 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-f89sq"] Jul 15 04:13:14.701058 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:13:14.701038 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-f89sq" Jul 15 04:13:14.703390 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:13:14.703338 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-sw2p9\"" Jul 15 04:13:14.704818 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:13:14.704794 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\"" Jul 15 04:13:14.716656 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:13:14.716628 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-f89sq"] Jul 15 04:13:14.735010 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:13:14.734965 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:13:14.778665 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:13:14.778623 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/50d1b2bc-4e32-423e-8e77-2f7027e456c5-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-f89sq\" (UID: \"50d1b2bc-4e32-423e-8e77-2f7027e456c5\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-f89sq" Jul 15 04:13:14.778856 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:13:14.778748 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vgzbk\" (UniqueName: \"kubernetes.io/projected/25756405-68e2-4f3d-aa52-30c5dc2e3060-kube-api-access-vgzbk\") pod \"kserve-controller-manager-d6f4b65b8-7s7wv\" (UID: \"25756405-68e2-4f3d-aa52-30c5dc2e3060\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-7s7wv" Jul 15 04:13:14.778856 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:13:14.778815 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/25756405-68e2-4f3d-aa52-30c5dc2e3060-cert\") pod \"kserve-controller-manager-d6f4b65b8-7s7wv\" (UID: \"25756405-68e2-4f3d-aa52-30c5dc2e3060\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-7s7wv" Jul 15 04:13:14.778856 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:13:14.778846 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9twws\" (UniqueName: \"kubernetes.io/projected/50d1b2bc-4e32-423e-8e77-2f7027e456c5-kube-api-access-9twws\") pod \"llmisvc-controller-manager-777c6bd7d5-f89sq\" (UID: \"50d1b2bc-4e32-423e-8e77-2f7027e456c5\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-f89sq" Jul 15 04:13:14.816984 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:13:14.816950 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:13:14.880522 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:13:14.880429 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/50d1b2bc-4e32-423e-8e77-2f7027e456c5-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-f89sq\" (UID: \"50d1b2bc-4e32-423e-8e77-2f7027e456c5\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-f89sq" Jul 15 04:13:14.880522 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:13:14.880493 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vgzbk\" (UniqueName: \"kubernetes.io/projected/25756405-68e2-4f3d-aa52-30c5dc2e3060-kube-api-access-vgzbk\") pod \"kserve-controller-manager-d6f4b65b8-7s7wv\" (UID: \"25756405-68e2-4f3d-aa52-30c5dc2e3060\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-7s7wv" Jul 15 04:13:14.880762 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:13:14.880542 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/25756405-68e2-4f3d-aa52-30c5dc2e3060-cert\") pod \"kserve-controller-manager-d6f4b65b8-7s7wv\" (UID: \"25756405-68e2-4f3d-aa52-30c5dc2e3060\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-7s7wv" Jul 15 04:13:14.880762 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:13:14.880563 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9twws\" (UniqueName: \"kubernetes.io/projected/50d1b2bc-4e32-423e-8e77-2f7027e456c5-kube-api-access-9twws\") pod \"llmisvc-controller-manager-777c6bd7d5-f89sq\" (UID: \"50d1b2bc-4e32-423e-8e77-2f7027e456c5\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-f89sq" Jul 15 04:13:14.880762 ip-10-0-128-222 kubenswrapper[2581]: E0715 04:13:14.880667 2581 secret.go:189] Couldn't get secret opendatahub/kserve-webhook-server-cert: secret "kserve-webhook-server-cert" not found Jul 15 04:13:14.880928 ip-10-0-128-222 kubenswrapper[2581]: E0715 04:13:14.880789 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/25756405-68e2-4f3d-aa52-30c5dc2e3060-cert podName:25756405-68e2-4f3d-aa52-30c5dc2e3060 nodeName:}" failed. No retries permitted until 2026-07-15 04:13:15.380765915 +0000 UTC m=+428.907566927 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/25756405-68e2-4f3d-aa52-30c5dc2e3060-cert") pod "kserve-controller-manager-d6f4b65b8-7s7wv" (UID: "25756405-68e2-4f3d-aa52-30c5dc2e3060") : secret "kserve-webhook-server-cert" not found Jul 15 04:13:14.883472 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:13:14.883445 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/50d1b2bc-4e32-423e-8e77-2f7027e456c5-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-f89sq\" (UID: \"50d1b2bc-4e32-423e-8e77-2f7027e456c5\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-f89sq" Jul 15 04:13:14.897568 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:13:14.897544 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9twws\" (UniqueName: \"kubernetes.io/projected/50d1b2bc-4e32-423e-8e77-2f7027e456c5-kube-api-access-9twws\") pod \"llmisvc-controller-manager-777c6bd7d5-f89sq\" (UID: \"50d1b2bc-4e32-423e-8e77-2f7027e456c5\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-f89sq" Jul 15 04:13:14.901950 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:13:14.901928 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vgzbk\" (UniqueName: \"kubernetes.io/projected/25756405-68e2-4f3d-aa52-30c5dc2e3060-kube-api-access-vgzbk\") pod \"kserve-controller-manager-d6f4b65b8-7s7wv\" (UID: \"25756405-68e2-4f3d-aa52-30c5dc2e3060\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-7s7wv" Jul 15 04:13:15.015863 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:13:15.015825 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-f89sq" Jul 15 04:13:15.110474 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:13:15.108903 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:13:15.297550 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:13:15.296557 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 15 04:13:15.297550 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:13:15.296658 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 15 04:13:15.374323 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:13:15.374297 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-f89sq"] Jul 15 04:13:15.375901 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:13:15.375877 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod50d1b2bc_4e32_423e_8e77_2f7027e456c5.slice/crio-6167e201874d4ffed49cb22e31eaf265781eca0cc5112e8cbe82c34f54bd5a81 WatchSource:0}: Error finding container 6167e201874d4ffed49cb22e31eaf265781eca0cc5112e8cbe82c34f54bd5a81: Status 404 returned error can't find the container with id 6167e201874d4ffed49cb22e31eaf265781eca0cc5112e8cbe82c34f54bd5a81 Jul 15 04:13:15.385611 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:13:15.385588 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/25756405-68e2-4f3d-aa52-30c5dc2e3060-cert\") pod \"kserve-controller-manager-d6f4b65b8-7s7wv\" (UID: \"25756405-68e2-4f3d-aa52-30c5dc2e3060\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-7s7wv" Jul 15 04:13:15.387930 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:13:15.387901 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/25756405-68e2-4f3d-aa52-30c5dc2e3060-cert\") pod \"kserve-controller-manager-d6f4b65b8-7s7wv\" (UID: \"25756405-68e2-4f3d-aa52-30c5dc2e3060\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-7s7wv" Jul 15 04:13:15.594831 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:13:15.594744 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-7s7wv" Jul 15 04:13:15.739023 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:13:15.738998 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-7s7wv"] Jul 15 04:13:15.742009 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:13:15.741982 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod25756405_68e2_4f3d_aa52_30c5dc2e3060.slice/crio-937eab66c1c8176b7604efa59e9a37a04c7abc65a9067cc6560a56cf90c42325 WatchSource:0}: Error finding container 937eab66c1c8176b7604efa59e9a37a04c7abc65a9067cc6560a56cf90c42325: Status 404 returned error can't find the container with id 937eab66c1c8176b7604efa59e9a37a04c7abc65a9067cc6560a56cf90c42325 Jul 15 04:13:15.896753 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:13:15.896724 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:13:16.036401 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:13:16.036367 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:13:16.072019 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:13:16.071977 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-v7dgg" event={"ID":"d0fc2b1e-3271-4f50-9852-28b84a1fa2b5","Type":"ContainerStarted","Data":"6c386ee681bd65cc95afa6e1ad32d1edc97377198352d1b969aa51e4b8f97c78"} Jul 15 04:13:16.072244 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:13:16.072196 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-7574459656-v7dgg" Jul 15 04:13:16.073467 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:13:16.073444 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-7s7wv" event={"ID":"25756405-68e2-4f3d-aa52-30c5dc2e3060","Type":"ContainerStarted","Data":"937eab66c1c8176b7604efa59e9a37a04c7abc65a9067cc6560a56cf90c42325"} Jul 15 04:13:16.074188 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:13:16.074163 2581 patch_prober.go:28] interesting pod/istiod-openshift-gateway-7574459656-v7dgg container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Jul 15 04:13:16.074313 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:13:16.074213 2581 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-7574459656-v7dgg" podUID="d0fc2b1e-3271-4f50-9852-28b84a1fa2b5" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 15 04:13:16.074864 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:13:16.074845 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-f89sq" event={"ID":"50d1b2bc-4e32-423e-8e77-2f7027e456c5","Type":"ContainerStarted","Data":"6167e201874d4ffed49cb22e31eaf265781eca0cc5112e8cbe82c34f54bd5a81"} Jul 15 04:13:16.106825 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:13:16.106775 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-7574459656-v7dgg" podStartSLOduration=2.203536299 podStartE2EDuration="6.106752304s" totalImagesPullingTime="3.903216005s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 04:13:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 04:13:16.105531326 +0000 UTC m=+429.632332342" watchObservedRunningTime="2026-07-15 04:13:16.106752304 +0000 UTC m=+429.633553319" Jul 15 04:13:16.136232 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:13:16.136191 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:13:16.329327 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:13:16.329238 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-m42cb"] Jul 15 04:13:16.333776 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:13:16.333748 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-m42cb" Jul 15 04:13:16.336155 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:13:16.336098 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-c48sp\"" Jul 15 04:13:16.346018 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:13:16.345957 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-m42cb"] Jul 15 04:13:16.372208 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:13:16.372084 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:13:16.397018 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:13:16.396983 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5f13bbe7-af17-4625-9fb7-671b5b589569-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-m42cb\" (UID: \"5f13bbe7-af17-4625-9fb7-671b5b589569\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-m42cb" Jul 15 04:13:16.397233 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:13:16.397041 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5f13bbe7-af17-4625-9fb7-671b5b589569-istio-data\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-m42cb\" (UID: \"5f13bbe7-af17-4625-9fb7-671b5b589569\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-m42cb" Jul 15 04:13:16.397233 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:13:16.397066 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5f13bbe7-af17-4625-9fb7-671b5b589569-istio-token\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-m42cb\" (UID: \"5f13bbe7-af17-4625-9fb7-671b5b589569\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-m42cb" Jul 15 04:13:16.397233 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:13:16.397097 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5f13bbe7-af17-4625-9fb7-671b5b589569-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-m42cb\" (UID: \"5f13bbe7-af17-4625-9fb7-671b5b589569\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-m42cb" Jul 15 04:13:16.397233 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:13:16.397181 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5f13bbe7-af17-4625-9fb7-671b5b589569-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-m42cb\" (UID: \"5f13bbe7-af17-4625-9fb7-671b5b589569\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-m42cb" Jul 15 04:13:16.397233 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:13:16.397228 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5f13bbe7-af17-4625-9fb7-671b5b589569-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-m42cb\" (UID: \"5f13bbe7-af17-4625-9fb7-671b5b589569\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-m42cb" Jul 15 04:13:16.397453 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:13:16.397333 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9m9r6\" (UniqueName: \"kubernetes.io/projected/5f13bbe7-af17-4625-9fb7-671b5b589569-kube-api-access-9m9r6\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-m42cb\" (UID: \"5f13bbe7-af17-4625-9fb7-671b5b589569\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-m42cb" Jul 15 04:13:16.397453 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:13:16.397405 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5f13bbe7-af17-4625-9fb7-671b5b589569-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-m42cb\" (UID: \"5f13bbe7-af17-4625-9fb7-671b5b589569\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-m42cb" Jul 15 04:13:16.397453 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:13:16.397437 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5f13bbe7-af17-4625-9fb7-671b5b589569-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-m42cb\" (UID: \"5f13bbe7-af17-4625-9fb7-671b5b589569\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-m42cb" Jul 15 04:13:16.464948 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:13:16.464921 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:13:16.498232 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:13:16.498194 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5f13bbe7-af17-4625-9fb7-671b5b589569-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-m42cb\" (UID: \"5f13bbe7-af17-4625-9fb7-671b5b589569\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-m42cb" Jul 15 04:13:16.498232 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:13:16.498234 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5f13bbe7-af17-4625-9fb7-671b5b589569-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-m42cb\" (UID: \"5f13bbe7-af17-4625-9fb7-671b5b589569\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-m42cb" Jul 15 04:13:16.498468 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:13:16.498277 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5f13bbe7-af17-4625-9fb7-671b5b589569-istio-data\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-m42cb\" (UID: \"5f13bbe7-af17-4625-9fb7-671b5b589569\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-m42cb" Jul 15 04:13:16.498468 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:13:16.498296 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5f13bbe7-af17-4625-9fb7-671b5b589569-istio-token\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-m42cb\" (UID: \"5f13bbe7-af17-4625-9fb7-671b5b589569\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-m42cb" Jul 15 04:13:16.498468 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:13:16.498330 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5f13bbe7-af17-4625-9fb7-671b5b589569-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-m42cb\" (UID: \"5f13bbe7-af17-4625-9fb7-671b5b589569\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-m42cb" Jul 15 04:13:16.498468 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:13:16.498361 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5f13bbe7-af17-4625-9fb7-671b5b589569-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-m42cb\" (UID: \"5f13bbe7-af17-4625-9fb7-671b5b589569\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-m42cb" Jul 15 04:13:16.498662 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:13:16.498536 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5f13bbe7-af17-4625-9fb7-671b5b589569-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-m42cb\" (UID: \"5f13bbe7-af17-4625-9fb7-671b5b589569\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-m42cb" Jul 15 04:13:16.498662 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:13:16.498572 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5f13bbe7-af17-4625-9fb7-671b5b589569-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-m42cb\" (UID: \"5f13bbe7-af17-4625-9fb7-671b5b589569\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-m42cb" Jul 15 04:13:16.498662 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:13:16.498641 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9m9r6\" (UniqueName: \"kubernetes.io/projected/5f13bbe7-af17-4625-9fb7-671b5b589569-kube-api-access-9m9r6\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-m42cb\" (UID: \"5f13bbe7-af17-4625-9fb7-671b5b589569\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-m42cb" Jul 15 04:13:16.498662 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:13:16.498648 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5f13bbe7-af17-4625-9fb7-671b5b589569-istio-data\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-m42cb\" (UID: \"5f13bbe7-af17-4625-9fb7-671b5b589569\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-m42cb" Jul 15 04:13:16.498862 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:13:16.498720 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5f13bbe7-af17-4625-9fb7-671b5b589569-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-m42cb\" (UID: \"5f13bbe7-af17-4625-9fb7-671b5b589569\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-m42cb" Jul 15 04:13:16.498862 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:13:16.498740 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5f13bbe7-af17-4625-9fb7-671b5b589569-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-m42cb\" (UID: \"5f13bbe7-af17-4625-9fb7-671b5b589569\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-m42cb" Jul 15 04:13:16.498967 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:13:16.498930 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5f13bbe7-af17-4625-9fb7-671b5b589569-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-m42cb\" (UID: \"5f13bbe7-af17-4625-9fb7-671b5b589569\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-m42cb" Jul 15 04:13:16.499273 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:13:16.499249 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5f13bbe7-af17-4625-9fb7-671b5b589569-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-m42cb\" (UID: \"5f13bbe7-af17-4625-9fb7-671b5b589569\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-m42cb" Jul 15 04:13:16.500738 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:13:16.500719 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5f13bbe7-af17-4625-9fb7-671b5b589569-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-m42cb\" (UID: \"5f13bbe7-af17-4625-9fb7-671b5b589569\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-m42cb" Jul 15 04:13:16.501098 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:13:16.501072 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5f13bbe7-af17-4625-9fb7-671b5b589569-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-m42cb\" (UID: \"5f13bbe7-af17-4625-9fb7-671b5b589569\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-m42cb" Jul 15 04:13:16.505912 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:13:16.505889 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5f13bbe7-af17-4625-9fb7-671b5b589569-istio-token\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-m42cb\" (UID: \"5f13bbe7-af17-4625-9fb7-671b5b589569\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-m42cb" Jul 15 04:13:16.506237 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:13:16.506214 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9m9r6\" (UniqueName: \"kubernetes.io/projected/5f13bbe7-af17-4625-9fb7-671b5b589569-kube-api-access-9m9r6\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-m42cb\" (UID: \"5f13bbe7-af17-4625-9fb7-671b5b589569\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-m42cb" Jul 15 04:13:16.647616 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:13:16.647557 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-m42cb" Jul 15 04:13:16.770094 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:13:16.770057 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf47shcm"] Jul 15 04:13:16.774215 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:13:16.774158 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf47shcm" Jul 15 04:13:16.793688 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:13:16.793658 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf47shcm"] Jul 15 04:13:16.800077 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:13:16.800023 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:13:16.907005 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:13:16.906900 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/66fe008f-fec7-48e3-9961-d2182009e784-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf47shcm\" (UID: \"66fe008f-fec7-48e3-9961-d2182009e784\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf47shcm" Jul 15 04:13:16.907201 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:13:16.906991 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/66fe008f-fec7-48e3-9961-d2182009e784-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf47shcm\" (UID: \"66fe008f-fec7-48e3-9961-d2182009e784\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf47shcm" Jul 15 04:13:16.907201 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:13:16.907146 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sw87b\" (UniqueName: \"kubernetes.io/projected/66fe008f-fec7-48e3-9961-d2182009e784-kube-api-access-sw87b\") pod \"data-science-gateway-data-science-gateway-class-6576859cf47shcm\" (UID: \"66fe008f-fec7-48e3-9961-d2182009e784\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf47shcm" Jul 15 04:13:16.907341 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:13:16.907215 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/66fe008f-fec7-48e3-9961-d2182009e784-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf47shcm\" (UID: \"66fe008f-fec7-48e3-9961-d2182009e784\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf47shcm" Jul 15 04:13:16.907341 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:13:16.907249 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/66fe008f-fec7-48e3-9961-d2182009e784-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf47shcm\" (UID: \"66fe008f-fec7-48e3-9961-d2182009e784\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf47shcm" Jul 15 04:13:16.907341 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:13:16.907312 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/66fe008f-fec7-48e3-9961-d2182009e784-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf47shcm\" (UID: \"66fe008f-fec7-48e3-9961-d2182009e784\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf47shcm" Jul 15 04:13:16.907501 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:13:16.907346 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/66fe008f-fec7-48e3-9961-d2182009e784-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf47shcm\" (UID: \"66fe008f-fec7-48e3-9961-d2182009e784\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf47shcm" Jul 15 04:13:16.907501 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:13:16.907382 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/66fe008f-fec7-48e3-9961-d2182009e784-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf47shcm\" (UID: \"66fe008f-fec7-48e3-9961-d2182009e784\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf47shcm" Jul 15 04:13:16.907501 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:13:16.907415 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/66fe008f-fec7-48e3-9961-d2182009e784-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf47shcm\" (UID: \"66fe008f-fec7-48e3-9961-d2182009e784\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf47shcm" Jul 15 04:13:17.008912 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:13:17.008876 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/66fe008f-fec7-48e3-9961-d2182009e784-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf47shcm\" (UID: \"66fe008f-fec7-48e3-9961-d2182009e784\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf47shcm" Jul 15 04:13:17.008912 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:13:17.008920 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/66fe008f-fec7-48e3-9961-d2182009e784-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf47shcm\" (UID: \"66fe008f-fec7-48e3-9961-d2182009e784\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf47shcm" Jul 15 04:13:17.009185 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:13:17.008999 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/66fe008f-fec7-48e3-9961-d2182009e784-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf47shcm\" (UID: \"66fe008f-fec7-48e3-9961-d2182009e784\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf47shcm" Jul 15 04:13:17.009185 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:13:17.009030 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/66fe008f-fec7-48e3-9961-d2182009e784-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf47shcm\" (UID: \"66fe008f-fec7-48e3-9961-d2182009e784\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf47shcm" Jul 15 04:13:17.009185 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:13:17.009057 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sw87b\" (UniqueName: \"kubernetes.io/projected/66fe008f-fec7-48e3-9961-d2182009e784-kube-api-access-sw87b\") pod \"data-science-gateway-data-science-gateway-class-6576859cf47shcm\" (UID: \"66fe008f-fec7-48e3-9961-d2182009e784\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf47shcm" Jul 15 04:13:17.009185 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:13:17.009112 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/66fe008f-fec7-48e3-9961-d2182009e784-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf47shcm\" (UID: \"66fe008f-fec7-48e3-9961-d2182009e784\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf47shcm" Jul 15 04:13:17.009185 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:13:17.009167 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/66fe008f-fec7-48e3-9961-d2182009e784-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf47shcm\" (UID: \"66fe008f-fec7-48e3-9961-d2182009e784\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf47shcm" Jul 15 04:13:17.009453 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:13:17.009223 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/66fe008f-fec7-48e3-9961-d2182009e784-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf47shcm\" (UID: \"66fe008f-fec7-48e3-9961-d2182009e784\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf47shcm" Jul 15 04:13:17.009453 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:13:17.009258 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/66fe008f-fec7-48e3-9961-d2182009e784-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf47shcm\" (UID: \"66fe008f-fec7-48e3-9961-d2182009e784\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf47shcm" Jul 15 04:13:17.009831 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:13:17.009742 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/66fe008f-fec7-48e3-9961-d2182009e784-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf47shcm\" (UID: \"66fe008f-fec7-48e3-9961-d2182009e784\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf47shcm" Jul 15 04:13:17.009831 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:13:17.009759 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/66fe008f-fec7-48e3-9961-d2182009e784-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf47shcm\" (UID: \"66fe008f-fec7-48e3-9961-d2182009e784\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf47shcm" Jul 15 04:13:17.009831 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:13:17.009776 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/66fe008f-fec7-48e3-9961-d2182009e784-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf47shcm\" (UID: \"66fe008f-fec7-48e3-9961-d2182009e784\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf47shcm" Jul 15 04:13:17.009831 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:13:17.009808 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/66fe008f-fec7-48e3-9961-d2182009e784-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf47shcm\" (UID: \"66fe008f-fec7-48e3-9961-d2182009e784\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf47shcm" Jul 15 04:13:17.010149 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:13:17.009888 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/66fe008f-fec7-48e3-9961-d2182009e784-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf47shcm\" (UID: \"66fe008f-fec7-48e3-9961-d2182009e784\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf47shcm" Jul 15 04:13:17.012915 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:13:17.012868 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/66fe008f-fec7-48e3-9961-d2182009e784-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf47shcm\" (UID: \"66fe008f-fec7-48e3-9961-d2182009e784\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf47shcm" Jul 15 04:13:17.012915 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:13:17.012886 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/66fe008f-fec7-48e3-9961-d2182009e784-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf47shcm\" (UID: \"66fe008f-fec7-48e3-9961-d2182009e784\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf47shcm" Jul 15 04:13:17.018731 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:13:17.018705 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sw87b\" (UniqueName: \"kubernetes.io/projected/66fe008f-fec7-48e3-9961-d2182009e784-kube-api-access-sw87b\") pod \"data-science-gateway-data-science-gateway-class-6576859cf47shcm\" (UID: \"66fe008f-fec7-48e3-9961-d2182009e784\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf47shcm" Jul 15 04:13:17.020461 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:13:17.020431 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/66fe008f-fec7-48e3-9961-d2182009e784-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf47shcm\" (UID: \"66fe008f-fec7-48e3-9961-d2182009e784\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf47shcm" Jul 15 04:13:17.057852 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:13:17.057812 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-m42cb"] Jul 15 04:13:17.062344 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:13:17.062310 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5f13bbe7_af17_4625_9fb7_671b5b589569.slice/crio-76fec38b20018ad6a3bb6af0a7c8f807379479a9755c3c89135983e3b4f8343f WatchSource:0}: Error finding container 76fec38b20018ad6a3bb6af0a7c8f807379479a9755c3c89135983e3b4f8343f: Status 404 returned error can't find the container with id 76fec38b20018ad6a3bb6af0a7c8f807379479a9755c3c89135983e3b4f8343f Jul 15 04:13:17.084530 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:13:17.084490 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-m42cb" event={"ID":"5f13bbe7-af17-4625-9fb7-671b5b589569","Type":"ContainerStarted","Data":"76fec38b20018ad6a3bb6af0a7c8f807379479a9755c3c89135983e3b4f8343f"} Jul 15 04:13:17.085413 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:13:17.085370 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-7574459656-v7dgg" Jul 15 04:13:17.088605 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:13:17.088586 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf47shcm" Jul 15 04:13:17.255513 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:13:17.255485 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf47shcm"] Jul 15 04:13:17.258090 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:13:17.258064 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod66fe008f_fec7_48e3_9961_d2182009e784.slice/crio-7f40e45264db801550c49f2d616330ea787140fbc02cfa35142546a4eab43907 WatchSource:0}: Error finding container 7f40e45264db801550c49f2d616330ea787140fbc02cfa35142546a4eab43907: Status 404 returned error can't find the container with id 7f40e45264db801550c49f2d616330ea787140fbc02cfa35142546a4eab43907 Jul 15 04:13:17.419550 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:13:17.419426 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-v7dgg"] Jul 15 04:13:18.094823 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:13:18.094783 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf47shcm" event={"ID":"66fe008f-fec7-48e3-9961-d2182009e784","Type":"ContainerStarted","Data":"7f40e45264db801550c49f2d616330ea787140fbc02cfa35142546a4eab43907"} Jul 15 04:13:19.100432 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:13:19.100374 2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/istiod-openshift-gateway-7574459656-v7dgg" podUID="d0fc2b1e-3271-4f50-9852-28b84a1fa2b5" containerName="discovery" containerID="cri-o://6c386ee681bd65cc95afa6e1ad32d1edc97377198352d1b969aa51e4b8f97c78" gracePeriod=30 Jul 15 04:13:20.034490 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:13:20.034456 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-7998c67dc4-w5vhc" Jul 15 04:13:20.108832 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:13:20.108798 2581 generic.go:356] "Generic (PLEG): container finished" podID="d0fc2b1e-3271-4f50-9852-28b84a1fa2b5" containerID="6c386ee681bd65cc95afa6e1ad32d1edc97377198352d1b969aa51e4b8f97c78" exitCode=0 Jul 15 04:13:20.109302 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:13:20.108864 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-v7dgg" event={"ID":"d0fc2b1e-3271-4f50-9852-28b84a1fa2b5","Type":"ContainerDied","Data":"6c386ee681bd65cc95afa6e1ad32d1edc97377198352d1b969aa51e4b8f97c78"} Jul 15 04:13:20.491010 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:13:20.490984 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-v7dgg" Jul 15 04:13:20.491617 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:13:20.491594 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:13:20.558648 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:13:20.558605 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 15 04:13:20.558751 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:13:20.558704 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 15 04:13:20.558825 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:13:20.558751 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 15 04:13:20.559810 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:13:20.559266 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 15 04:13:20.559810 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:13:20.559341 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 15 04:13:20.559810 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:13:20.559384 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 15 04:13:20.652102 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:13:20.652006 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/d0fc2b1e-3271-4f50-9852-28b84a1fa2b5-istio-csr-ca-configmap\") pod \"d0fc2b1e-3271-4f50-9852-28b84a1fa2b5\" (UID: \"d0fc2b1e-3271-4f50-9852-28b84a1fa2b5\") " Jul 15 04:13:20.652102 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:13:20.652054 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/d0fc2b1e-3271-4f50-9852-28b84a1fa2b5-cacerts\") pod \"d0fc2b1e-3271-4f50-9852-28b84a1fa2b5\" (UID: \"d0fc2b1e-3271-4f50-9852-28b84a1fa2b5\") " Jul 15 04:13:20.652102 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:13:20.652089 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/d0fc2b1e-3271-4f50-9852-28b84a1fa2b5-local-certs\") pod \"d0fc2b1e-3271-4f50-9852-28b84a1fa2b5\" (UID: \"d0fc2b1e-3271-4f50-9852-28b84a1fa2b5\") " Jul 15 04:13:20.652409 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:13:20.652143 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/d0fc2b1e-3271-4f50-9852-28b84a1fa2b5-istio-csr-dns-cert\") pod \"d0fc2b1e-3271-4f50-9852-28b84a1fa2b5\" (UID: \"d0fc2b1e-3271-4f50-9852-28b84a1fa2b5\") " Jul 15 04:13:20.652409 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:13:20.652177 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/d0fc2b1e-3271-4f50-9852-28b84a1fa2b5-istio-kubeconfig\") pod \"d0fc2b1e-3271-4f50-9852-28b84a1fa2b5\" (UID: \"d0fc2b1e-3271-4f50-9852-28b84a1fa2b5\") " Jul 15 04:13:20.652409 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:13:20.652213 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nqqjn\" (UniqueName: \"kubernetes.io/projected/d0fc2b1e-3271-4f50-9852-28b84a1fa2b5-kube-api-access-nqqjn\") pod \"d0fc2b1e-3271-4f50-9852-28b84a1fa2b5\" (UID: \"d0fc2b1e-3271-4f50-9852-28b84a1fa2b5\") " Jul 15 04:13:20.652409 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:13:20.652291 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d0fc2b1e-3271-4f50-9852-28b84a1fa2b5-istio-token\") pod \"d0fc2b1e-3271-4f50-9852-28b84a1fa2b5\" (UID: \"d0fc2b1e-3271-4f50-9852-28b84a1fa2b5\") " Jul 15 04:13:20.652626 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:13:20.652486 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d0fc2b1e-3271-4f50-9852-28b84a1fa2b5-istio-csr-ca-configmap" (OuterVolumeSpecName: "istio-csr-ca-configmap") pod "d0fc2b1e-3271-4f50-9852-28b84a1fa2b5" (UID: "d0fc2b1e-3271-4f50-9852-28b84a1fa2b5"). InnerVolumeSpecName "istio-csr-ca-configmap". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 15 04:13:20.652683 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:13:20.652626 2581 reconciler_common.go:299] "Volume detached for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/d0fc2b1e-3271-4f50-9852-28b84a1fa2b5-istio-csr-ca-configmap\") on node \"ip-10-0-128-222.ec2.internal\" DevicePath \"\"" Jul 15 04:13:20.654950 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:13:20.654917 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d0fc2b1e-3271-4f50-9852-28b84a1fa2b5-istio-kubeconfig" (OuterVolumeSpecName: "istio-kubeconfig") pod "d0fc2b1e-3271-4f50-9852-28b84a1fa2b5" (UID: "d0fc2b1e-3271-4f50-9852-28b84a1fa2b5"). InnerVolumeSpecName "istio-kubeconfig". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 15 04:13:20.654950 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:13:20.654942 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d0fc2b1e-3271-4f50-9852-28b84a1fa2b5-istio-csr-dns-cert" (OuterVolumeSpecName: "istio-csr-dns-cert") pod "d0fc2b1e-3271-4f50-9852-28b84a1fa2b5" (UID: "d0fc2b1e-3271-4f50-9852-28b84a1fa2b5"). InnerVolumeSpecName "istio-csr-dns-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 15 04:13:20.655505 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:13:20.655451 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d0fc2b1e-3271-4f50-9852-28b84a1fa2b5-istio-token" (OuterVolumeSpecName: "istio-token") pod "d0fc2b1e-3271-4f50-9852-28b84a1fa2b5" (UID: "d0fc2b1e-3271-4f50-9852-28b84a1fa2b5"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 15 04:13:20.655611 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:13:20.655516 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d0fc2b1e-3271-4f50-9852-28b84a1fa2b5-local-certs" (OuterVolumeSpecName: "local-certs") pod "d0fc2b1e-3271-4f50-9852-28b84a1fa2b5" (UID: "d0fc2b1e-3271-4f50-9852-28b84a1fa2b5"). InnerVolumeSpecName "local-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 04:13:20.655662 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:13:20.655611 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d0fc2b1e-3271-4f50-9852-28b84a1fa2b5-cacerts" (OuterVolumeSpecName: "cacerts") pod "d0fc2b1e-3271-4f50-9852-28b84a1fa2b5" (UID: "d0fc2b1e-3271-4f50-9852-28b84a1fa2b5"). InnerVolumeSpecName "cacerts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 15 04:13:20.655787 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:13:20.655765 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d0fc2b1e-3271-4f50-9852-28b84a1fa2b5-kube-api-access-nqqjn" (OuterVolumeSpecName: "kube-api-access-nqqjn") pod "d0fc2b1e-3271-4f50-9852-28b84a1fa2b5" (UID: "d0fc2b1e-3271-4f50-9852-28b84a1fa2b5"). InnerVolumeSpecName "kube-api-access-nqqjn". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 15 04:13:20.753744 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:13:20.753653 2581 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d0fc2b1e-3271-4f50-9852-28b84a1fa2b5-istio-token\") on node \"ip-10-0-128-222.ec2.internal\" DevicePath \"\"" Jul 15 04:13:20.753744 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:13:20.753691 2581 reconciler_common.go:299] "Volume detached for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/d0fc2b1e-3271-4f50-9852-28b84a1fa2b5-cacerts\") on node \"ip-10-0-128-222.ec2.internal\" DevicePath \"\"" Jul 15 04:13:20.753744 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:13:20.753705 2581 reconciler_common.go:299] "Volume detached for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/d0fc2b1e-3271-4f50-9852-28b84a1fa2b5-local-certs\") on node \"ip-10-0-128-222.ec2.internal\" DevicePath \"\"" Jul 15 04:13:20.753744 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:13:20.753719 2581 reconciler_common.go:299] "Volume detached for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/d0fc2b1e-3271-4f50-9852-28b84a1fa2b5-istio-csr-dns-cert\") on node \"ip-10-0-128-222.ec2.internal\" DevicePath \"\"" Jul 15 04:13:20.753744 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:13:20.753733 2581 reconciler_common.go:299] "Volume detached for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/d0fc2b1e-3271-4f50-9852-28b84a1fa2b5-istio-kubeconfig\") on node \"ip-10-0-128-222.ec2.internal\" DevicePath \"\"" Jul 15 04:13:20.753997 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:13:20.753746 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nqqjn\" (UniqueName: \"kubernetes.io/projected/d0fc2b1e-3271-4f50-9852-28b84a1fa2b5-kube-api-access-nqqjn\") on node \"ip-10-0-128-222.ec2.internal\" DevicePath \"\"" Jul 15 04:13:21.116161 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:13:21.116101 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-m42cb" event={"ID":"5f13bbe7-af17-4625-9fb7-671b5b589569","Type":"ContainerStarted","Data":"75f6f5248835dc3c127f21a0980f043322ac6c36d2181ec73d76eed641a003a3"} Jul 15 04:13:21.117754 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:13:21.117728 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-7s7wv" event={"ID":"25756405-68e2-4f3d-aa52-30c5dc2e3060","Type":"ContainerStarted","Data":"24c640ad1a1a239f532e0c6dbfd6747c5d931975e68b7c3872bce348ccb7cfad"} Jul 15 04:13:21.117865 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:13:21.117806 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-7s7wv" Jul 15 04:13:21.119246 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:13:21.119225 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-f89sq" event={"ID":"50d1b2bc-4e32-423e-8e77-2f7027e456c5","Type":"ContainerStarted","Data":"1717eaa109ae3077d0f8ecf91089ac7ed9566a0b4eccfa198ecec16859621ead"} Jul 15 04:13:21.119350 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:13:21.119325 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-f89sq" Jul 15 04:13:21.120566 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:13:21.120550 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-v7dgg" Jul 15 04:13:21.120566 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:13:21.120552 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-v7dgg" event={"ID":"d0fc2b1e-3271-4f50-9852-28b84a1fa2b5","Type":"ContainerDied","Data":"173321dcd902bb21ba18dffa52ce47e4f296ceac869e1f579296d6e68a180fe0"} Jul 15 04:13:21.120748 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:13:21.120595 2581 scope.go:117] "RemoveContainer" containerID="6c386ee681bd65cc95afa6e1ad32d1edc97377198352d1b969aa51e4b8f97c78" Jul 15 04:13:21.122423 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:13:21.122372 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf47shcm" event={"ID":"66fe008f-fec7-48e3-9961-d2182009e784","Type":"ContainerStarted","Data":"bd32f57e3e51af3c0bc58dc0e7c23e4a52c1587426e9d06b455503d90e5d73b6"} Jul 15 04:13:21.156085 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:13:21.156027 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-m42cb" podStartSLOduration=1.662069029 podStartE2EDuration="5.15600703s" totalImagesPullingTime="3.493938001s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 04:13:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 04:13:21.154669803 +0000 UTC m=+434.681470819" watchObservedRunningTime="2026-07-15 04:13:21.15600703 +0000 UTC m=+434.682808053" Jul 15 04:13:21.181828 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:13:21.181767 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf47shcm" podStartSLOduration=1.882883229 podStartE2EDuration="5.181751409s" totalImagesPullingTime="3.29886818s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 04:13:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 04:13:21.180076742 +0000 UTC m=+434.706877759" watchObservedRunningTime="2026-07-15 04:13:21.181751409 +0000 UTC m=+434.708552424" Jul 15 04:13:21.193595 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:13:21.193568 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-v7dgg"] Jul 15 04:13:21.200005 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:13:21.199981 2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-v7dgg"] Jul 15 04:13:21.213926 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:13:21.213878 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-d6f4b65b8-7s7wv" podStartSLOduration=2.482488178 podStartE2EDuration="7.213863668s" totalImagesPullingTime="4.73137549s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 04:13:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 04:13:21.212705411 +0000 UTC m=+434.739506426" watchObservedRunningTime="2026-07-15 04:13:21.213863668 +0000 UTC m=+434.740664683" Jul 15 04:13:21.230152 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:13:21.230085 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-f89sq" podStartSLOduration=2.127054684 podStartE2EDuration="7.230071027s" totalImagesPullingTime="5.103016343s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 04:13:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 04:13:21.227413178 +0000 UTC m=+434.754214200" watchObservedRunningTime="2026-07-15 04:13:21.230071027 +0000 UTC m=+434.756872042" Jul 15 04:13:21.648387 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:13:21.648351 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-m42cb" Jul 15 04:13:21.650003 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:13:21.649982 2581 patch_prober.go:28] interesting pod/data-science-gateway-data-science-gateway-class-84cc848bd-m42cb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.39:15021/healthz/ready\": dial tcp 10.132.0.39:15021: connect: connection refused" start-of-body= Jul 15 04:13:21.650061 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:13:21.650030 2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-m42cb" podUID="5f13bbe7-af17-4625-9fb7-671b5b589569" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.39:15021/healthz/ready\": dial tcp 10.132.0.39:15021: connect: connection refused" Jul 15 04:13:22.089315 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:13:22.089278 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf47shcm" Jul 15 04:13:22.094277 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:13:22.094251 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf47shcm" Jul 15 04:13:22.130529 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:13:22.130495 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf47shcm" Jul 15 04:13:22.131357 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:13:22.131342 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf47shcm" Jul 15 04:13:22.180779 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:13:22.180748 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-m42cb"] Jul 15 04:13:22.648425 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:13:22.648390 2581 patch_prober.go:28] interesting pod/data-science-gateway-data-science-gateway-class-84cc848bd-m42cb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.39:15021/healthz/ready\": dial tcp 10.132.0.39:15021: connect: connection refused" start-of-body= Jul 15 04:13:22.648605 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:13:22.648447 2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-m42cb" podUID="5f13bbe7-af17-4625-9fb7-671b5b589569" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.39:15021/healthz/ready\": dial tcp 10.132.0.39:15021: connect: connection refused" Jul 15 04:13:22.990808 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:13:22.990731 2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d0fc2b1e-3271-4f50-9852-28b84a1fa2b5" path="/var/lib/kubelet/pods/d0fc2b1e-3271-4f50-9852-28b84a1fa2b5/volumes" Jul 15 04:13:23.648046 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:13:23.648016 2581 patch_prober.go:28] interesting pod/data-science-gateway-data-science-gateway-class-84cc848bd-m42cb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.39:15021/healthz/ready\": dial tcp 10.132.0.39:15021: connect: connection refused" start-of-body= Jul 15 04:13:23.648446 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:13:23.648068 2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-m42cb" podUID="5f13bbe7-af17-4625-9fb7-671b5b589569" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.39:15021/healthz/ready\": dial tcp 10.132.0.39:15021: connect: connection refused" Jul 15 04:13:24.140166 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:13:24.140084 2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-m42cb" podUID="5f13bbe7-af17-4625-9fb7-671b5b589569" containerName="istio-proxy" containerID="cri-o://75f6f5248835dc3c127f21a0980f043322ac6c36d2181ec73d76eed641a003a3" gracePeriod=30 Jul 15 04:13:25.085472 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:13:25.085434 2581 patch_prober.go:28] interesting pod/istiod-openshift-gateway-7574459656-v7dgg container/discovery namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.36:8080/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body= Jul 15 04:13:25.085856 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:13:25.085506 2581 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-7574459656-v7dgg" podUID="d0fc2b1e-3271-4f50-9852-28b84a1fa2b5" containerName="discovery" probeResult="failure" output="Get \"http://10.132.0.36:8080/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Jul 15 04:13:29.419208 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:13:29.419181 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-m42cb" Jul 15 04:13:29.538706 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:13:29.538671 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5f13bbe7-af17-4625-9fb7-671b5b589569-istio-data\") pod \"5f13bbe7-af17-4625-9fb7-671b5b589569\" (UID: \"5f13bbe7-af17-4625-9fb7-671b5b589569\") " Jul 15 04:13:29.538706 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:13:29.538706 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5f13bbe7-af17-4625-9fb7-671b5b589569-credential-socket\") pod \"5f13bbe7-af17-4625-9fb7-671b5b589569\" (UID: \"5f13bbe7-af17-4625-9fb7-671b5b589569\") " Jul 15 04:13:29.538953 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:13:29.538786 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5f13bbe7-af17-4625-9fb7-671b5b589569-workload-socket\") pod \"5f13bbe7-af17-4625-9fb7-671b5b589569\" (UID: \"5f13bbe7-af17-4625-9fb7-671b5b589569\") " Jul 15 04:13:29.538953 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:13:29.538842 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5f13bbe7-af17-4625-9fb7-671b5b589569-istiod-ca-cert\") pod \"5f13bbe7-af17-4625-9fb7-671b5b589569\" (UID: \"5f13bbe7-af17-4625-9fb7-671b5b589569\") " Jul 15 04:13:29.538953 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:13:29.538913 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5f13bbe7-af17-4625-9fb7-671b5b589569-workload-certs\") pod \"5f13bbe7-af17-4625-9fb7-671b5b589569\" (UID: \"5f13bbe7-af17-4625-9fb7-671b5b589569\") " Jul 15 04:13:29.538953 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:13:29.538944 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5f13bbe7-af17-4625-9fb7-671b5b589569-istio-token\") pod \"5f13bbe7-af17-4625-9fb7-671b5b589569\" (UID: \"5f13bbe7-af17-4625-9fb7-671b5b589569\") " Jul 15 04:13:29.539182 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:13:29.538972 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5f13bbe7-af17-4625-9fb7-671b5b589569-istio-data" (OuterVolumeSpecName: "istio-data") pod "5f13bbe7-af17-4625-9fb7-671b5b589569" (UID: "5f13bbe7-af17-4625-9fb7-671b5b589569"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 04:13:29.539182 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:13:29.538986 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5f13bbe7-af17-4625-9fb7-671b5b589569-istio-podinfo\") pod \"5f13bbe7-af17-4625-9fb7-671b5b589569\" (UID: \"5f13bbe7-af17-4625-9fb7-671b5b589569\") " Jul 15 04:13:29.539182 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:13:29.539048 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9m9r6\" (UniqueName: \"kubernetes.io/projected/5f13bbe7-af17-4625-9fb7-671b5b589569-kube-api-access-9m9r6\") pod \"5f13bbe7-af17-4625-9fb7-671b5b589569\" (UID: \"5f13bbe7-af17-4625-9fb7-671b5b589569\") " Jul 15 04:13:29.539182 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:13:29.539094 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5f13bbe7-af17-4625-9fb7-671b5b589569-istio-envoy\") pod \"5f13bbe7-af17-4625-9fb7-671b5b589569\" (UID: \"5f13bbe7-af17-4625-9fb7-671b5b589569\") " Jul 15 04:13:29.539182 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:13:29.539107 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5f13bbe7-af17-4625-9fb7-671b5b589569-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "5f13bbe7-af17-4625-9fb7-671b5b589569" (UID: "5f13bbe7-af17-4625-9fb7-671b5b589569"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 04:13:29.539182 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:13:29.539152 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5f13bbe7-af17-4625-9fb7-671b5b589569-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "5f13bbe7-af17-4625-9fb7-671b5b589569" (UID: "5f13bbe7-af17-4625-9fb7-671b5b589569"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 04:13:29.539552 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:13:29.539225 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5f13bbe7-af17-4625-9fb7-671b5b589569-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "5f13bbe7-af17-4625-9fb7-671b5b589569" (UID: "5f13bbe7-af17-4625-9fb7-671b5b589569"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 15 04:13:29.539552 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:13:29.539224 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5f13bbe7-af17-4625-9fb7-671b5b589569-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "5f13bbe7-af17-4625-9fb7-671b5b589569" (UID: "5f13bbe7-af17-4625-9fb7-671b5b589569"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 04:13:29.539552 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:13:29.539439 2581 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5f13bbe7-af17-4625-9fb7-671b5b589569-istio-data\") on node \"ip-10-0-128-222.ec2.internal\" DevicePath \"\"" Jul 15 04:13:29.539552 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:13:29.539460 2581 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5f13bbe7-af17-4625-9fb7-671b5b589569-credential-socket\") on node \"ip-10-0-128-222.ec2.internal\" DevicePath \"\"" Jul 15 04:13:29.539552 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:13:29.539475 2581 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5f13bbe7-af17-4625-9fb7-671b5b589569-workload-socket\") on node \"ip-10-0-128-222.ec2.internal\" DevicePath \"\"" Jul 15 04:13:29.539552 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:13:29.539488 2581 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5f13bbe7-af17-4625-9fb7-671b5b589569-istiod-ca-cert\") on node \"ip-10-0-128-222.ec2.internal\" DevicePath \"\"" Jul 15 04:13:29.539552 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:13:29.539501 2581 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5f13bbe7-af17-4625-9fb7-671b5b589569-workload-certs\") on node \"ip-10-0-128-222.ec2.internal\" DevicePath \"\"" Jul 15 04:13:29.541195 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:13:29.541169 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5f13bbe7-af17-4625-9fb7-671b5b589569-istio-token" (OuterVolumeSpecName: "istio-token") pod "5f13bbe7-af17-4625-9fb7-671b5b589569" (UID: "5f13bbe7-af17-4625-9fb7-671b5b589569"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 15 04:13:29.541314 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:13:29.541194 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5f13bbe7-af17-4625-9fb7-671b5b589569-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "5f13bbe7-af17-4625-9fb7-671b5b589569" (UID: "5f13bbe7-af17-4625-9fb7-671b5b589569"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 04:13:29.541470 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:13:29.541450 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5f13bbe7-af17-4625-9fb7-671b5b589569-kube-api-access-9m9r6" (OuterVolumeSpecName: "kube-api-access-9m9r6") pod "5f13bbe7-af17-4625-9fb7-671b5b589569" (UID: "5f13bbe7-af17-4625-9fb7-671b5b589569"). InnerVolumeSpecName "kube-api-access-9m9r6". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 15 04:13:29.541529 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:13:29.541480 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/5f13bbe7-af17-4625-9fb7-671b5b589569-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "5f13bbe7-af17-4625-9fb7-671b5b589569" (UID: "5f13bbe7-af17-4625-9fb7-671b5b589569"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 15 04:13:29.640202 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:13:29.640167 2581 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5f13bbe7-af17-4625-9fb7-671b5b589569-istio-token\") on node \"ip-10-0-128-222.ec2.internal\" DevicePath \"\"" Jul 15 04:13:29.640202 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:13:29.640195 2581 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5f13bbe7-af17-4625-9fb7-671b5b589569-istio-podinfo\") on node \"ip-10-0-128-222.ec2.internal\" DevicePath \"\"" Jul 15 04:13:29.640202 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:13:29.640204 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9m9r6\" (UniqueName: \"kubernetes.io/projected/5f13bbe7-af17-4625-9fb7-671b5b589569-kube-api-access-9m9r6\") on node \"ip-10-0-128-222.ec2.internal\" DevicePath \"\"" Jul 15 04:13:29.640411 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:13:29.640213 2581 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5f13bbe7-af17-4625-9fb7-671b5b589569-istio-envoy\") on node \"ip-10-0-128-222.ec2.internal\" DevicePath \"\"" Jul 15 04:13:30.171981 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:13:30.171947 2581 generic.go:356] "Generic (PLEG): container finished" podID="5f13bbe7-af17-4625-9fb7-671b5b589569" containerID="75f6f5248835dc3c127f21a0980f043322ac6c36d2181ec73d76eed641a003a3" exitCode=0 Jul 15 04:13:30.172161 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:13:30.171989 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-m42cb" Jul 15 04:13:30.172161 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:13:30.172004 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-m42cb" event={"ID":"5f13bbe7-af17-4625-9fb7-671b5b589569","Type":"ContainerDied","Data":"75f6f5248835dc3c127f21a0980f043322ac6c36d2181ec73d76eed641a003a3"} Jul 15 04:13:30.172161 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:13:30.172045 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-m42cb" event={"ID":"5f13bbe7-af17-4625-9fb7-671b5b589569","Type":"ContainerDied","Data":"76fec38b20018ad6a3bb6af0a7c8f807379479a9755c3c89135983e3b4f8343f"} Jul 15 04:13:30.172161 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:13:30.172064 2581 scope.go:117] "RemoveContainer" containerID="75f6f5248835dc3c127f21a0980f043322ac6c36d2181ec73d76eed641a003a3" Jul 15 04:13:30.188163 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:13:30.188138 2581 scope.go:117] "RemoveContainer" containerID="75f6f5248835dc3c127f21a0980f043322ac6c36d2181ec73d76eed641a003a3" Jul 15 04:13:30.188488 ip-10-0-128-222 kubenswrapper[2581]: E0715 04:13:30.188469 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"75f6f5248835dc3c127f21a0980f043322ac6c36d2181ec73d76eed641a003a3\": container with ID starting with 75f6f5248835dc3c127f21a0980f043322ac6c36d2181ec73d76eed641a003a3 not found: ID does not exist" containerID="75f6f5248835dc3c127f21a0980f043322ac6c36d2181ec73d76eed641a003a3" Jul 15 04:13:30.188545 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:13:30.188497 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"75f6f5248835dc3c127f21a0980f043322ac6c36d2181ec73d76eed641a003a3"} err="failed to get container status \"75f6f5248835dc3c127f21a0980f043322ac6c36d2181ec73d76eed641a003a3\": rpc error: code = NotFound desc = could not find container \"75f6f5248835dc3c127f21a0980f043322ac6c36d2181ec73d76eed641a003a3\": container with ID starting with 75f6f5248835dc3c127f21a0980f043322ac6c36d2181ec73d76eed641a003a3 not found: ID does not exist" Jul 15 04:13:30.197873 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:13:30.197848 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-m42cb"] Jul 15 04:13:30.201423 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:13:30.201399 2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-m42cb"] Jul 15 04:13:30.989818 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:13:30.989788 2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5f13bbe7-af17-4625-9fb7-671b5b589569" path="/var/lib/kubelet/pods/5f13bbe7-af17-4625-9fb7-671b5b589569/volumes" Jul 15 04:13:52.132785 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:13:52.132729 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-f89sq" Jul 15 04:13:52.135772 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:13:52.135749 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-7s7wv" Jul 15 04:14:05.702837 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:14:05.702802 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:14:05.800000 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:14:05.799964 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:14:05.927484 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:14:05.927446 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-kzvxx"] Jul 15 04:14:05.928080 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:14:05.928054 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5f13bbe7-af17-4625-9fb7-671b5b589569" containerName="istio-proxy" Jul 15 04:14:05.928080 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:14:05.928081 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="5f13bbe7-af17-4625-9fb7-671b5b589569" containerName="istio-proxy" Jul 15 04:14:05.928288 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:14:05.928110 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d0fc2b1e-3271-4f50-9852-28b84a1fa2b5" containerName="discovery" Jul 15 04:14:05.928288 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:14:05.928141 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="d0fc2b1e-3271-4f50-9852-28b84a1fa2b5" containerName="discovery" Jul 15 04:14:05.928288 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:14:05.928249 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="5f13bbe7-af17-4625-9fb7-671b5b589569" containerName="istio-proxy" Jul 15 04:14:05.928288 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:14:05.928263 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="d0fc2b1e-3271-4f50-9852-28b84a1fa2b5" containerName="discovery" Jul 15 04:14:05.931535 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:14:05.931513 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-kzvxx" Jul 15 04:14:05.934044 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:14:05.934021 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jul 15 04:14:05.934720 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:14:05.934696 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jul 15 04:14:05.934830 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:14:05.934705 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-catalog-dockercfg-mlr87\"" Jul 15 04:14:05.940692 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:14:05.940663 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-kzvxx"] Jul 15 04:14:05.971184 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:14:05.971092 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:14:06.077512 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:14:06.077473 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xgg5d\" (UniqueName: \"kubernetes.io/projected/09d2396b-626e-47ef-a1de-5960fa590681-kube-api-access-xgg5d\") pod \"kuadrant-operator-catalog-kzvxx\" (UID: \"09d2396b-626e-47ef-a1de-5960fa590681\") " pod="kuadrant-system/kuadrant-operator-catalog-kzvxx" Jul 15 04:14:06.178117 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:14:06.178073 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xgg5d\" (UniqueName: \"kubernetes.io/projected/09d2396b-626e-47ef-a1de-5960fa590681-kube-api-access-xgg5d\") pod \"kuadrant-operator-catalog-kzvxx\" (UID: \"09d2396b-626e-47ef-a1de-5960fa590681\") " pod="kuadrant-system/kuadrant-operator-catalog-kzvxx" Jul 15 04:14:06.186168 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:14:06.186115 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xgg5d\" (UniqueName: \"kubernetes.io/projected/09d2396b-626e-47ef-a1de-5960fa590681-kube-api-access-xgg5d\") pod \"kuadrant-operator-catalog-kzvxx\" (UID: \"09d2396b-626e-47ef-a1de-5960fa590681\") " pod="kuadrant-system/kuadrant-operator-catalog-kzvxx" Jul 15 04:14:06.243168 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:14:06.243052 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-kzvxx" Jul 15 04:14:06.298870 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:14:06.298843 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-kzvxx"] Jul 15 04:14:06.382501 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:14:06.382478 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-kzvxx"] Jul 15 04:14:06.384680 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:14:06.384657 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod09d2396b_626e_47ef_a1de_5960fa590681.slice/crio-b61d41c1f95dc03f185e51f14a839f6538407387a6a8797f4ef8908269c939c1 WatchSource:0}: Error finding container b61d41c1f95dc03f185e51f14a839f6538407387a6a8797f4ef8908269c939c1: Status 404 returned error can't find the container with id b61d41c1f95dc03f185e51f14a839f6538407387a6a8797f4ef8908269c939c1 Jul 15 04:14:06.502531 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:14:06.502449 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-7b868"] Jul 15 04:14:06.507112 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:14:06.507091 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-7b868" Jul 15 04:14:06.514773 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:14:06.514747 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-7b868"] Jul 15 04:14:06.682171 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:14:06.682101 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9zkc6\" (UniqueName: \"kubernetes.io/projected/edc31297-37f5-4239-bd8d-44c9b65ac162-kube-api-access-9zkc6\") pod \"kuadrant-operator-catalog-7b868\" (UID: \"edc31297-37f5-4239-bd8d-44c9b65ac162\") " pod="kuadrant-system/kuadrant-operator-catalog-7b868" Jul 15 04:14:06.722414 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:14:06.722380 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:14:06.783605 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:14:06.783513 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9zkc6\" (UniqueName: \"kubernetes.io/projected/edc31297-37f5-4239-bd8d-44c9b65ac162-kube-api-access-9zkc6\") pod \"kuadrant-operator-catalog-7b868\" (UID: \"edc31297-37f5-4239-bd8d-44c9b65ac162\") " pod="kuadrant-system/kuadrant-operator-catalog-7b868" Jul 15 04:14:06.791751 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:14:06.791721 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9zkc6\" (UniqueName: \"kubernetes.io/projected/edc31297-37f5-4239-bd8d-44c9b65ac162-kube-api-access-9zkc6\") pod \"kuadrant-operator-catalog-7b868\" (UID: \"edc31297-37f5-4239-bd8d-44c9b65ac162\") " pod="kuadrant-system/kuadrant-operator-catalog-7b868" Jul 15 04:14:06.817902 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:14:06.817875 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-7b868" Jul 15 04:14:06.924886 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:14:06.924856 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:14:06.964087 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:14:06.964018 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-7b868"] Jul 15 04:14:06.966946 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:14:06.966917 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podedc31297_37f5_4239_bd8d_44c9b65ac162.slice/crio-311b9e70753d7353b5f08679fe47b1da7e190a5d5e5d07dbd171bea58f17d42a WatchSource:0}: Error finding container 311b9e70753d7353b5f08679fe47b1da7e190a5d5e5d07dbd171bea58f17d42a: Status 404 returned error can't find the container with id 311b9e70753d7353b5f08679fe47b1da7e190a5d5e5d07dbd171bea58f17d42a Jul 15 04:14:07.364237 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:14:07.364195 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-7b868" event={"ID":"edc31297-37f5-4239-bd8d-44c9b65ac162","Type":"ContainerStarted","Data":"311b9e70753d7353b5f08679fe47b1da7e190a5d5e5d07dbd171bea58f17d42a"} Jul 15 04:14:07.365385 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:14:07.365353 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-kzvxx" event={"ID":"09d2396b-626e-47ef-a1de-5960fa590681","Type":"ContainerStarted","Data":"b61d41c1f95dc03f185e51f14a839f6538407387a6a8797f4ef8908269c939c1"} Jul 15 04:14:09.379953 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:14:09.379913 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-7b868" event={"ID":"edc31297-37f5-4239-bd8d-44c9b65ac162","Type":"ContainerStarted","Data":"fad6e66e81c292b15aa31f1cef67cb0a14e5c9238a18511309588b4b97fd4134"} Jul 15 04:14:09.381564 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:14:09.381533 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-kzvxx" event={"ID":"09d2396b-626e-47ef-a1de-5960fa590681","Type":"ContainerStarted","Data":"a21ea377b455bcc5ce6f7392affc0bb100b7e50d387e3ccbfb60233d2db34913"} Jul 15 04:14:09.381693 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:14:09.381559 2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-catalog-kzvxx" podUID="09d2396b-626e-47ef-a1de-5960fa590681" containerName="registry-server" containerID="cri-o://a21ea377b455bcc5ce6f7392affc0bb100b7e50d387e3ccbfb60233d2db34913" gracePeriod=2 Jul 15 04:14:09.397290 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:14:09.397243 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-7b868" podStartSLOduration=1.74650274 podStartE2EDuration="3.397224099s" totalImagesPullingTime="1.650721359s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 04:14:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 04:14:09.394644763 +0000 UTC m=+482.921445798" watchObservedRunningTime="2026-07-15 04:14:09.397224099 +0000 UTC m=+482.924025092" Jul 15 04:14:09.409318 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:14:09.409273 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-kzvxx" podStartSLOduration=2.180063404 podStartE2EDuration="4.409258262s" totalImagesPullingTime="2.229194858s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 04:14:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 04:14:09.407610455 +0000 UTC m=+482.934411503" watchObservedRunningTime="2026-07-15 04:14:09.409258262 +0000 UTC m=+482.936059276" Jul 15 04:14:09.634655 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:14:09.634591 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-kzvxx" Jul 15 04:14:09.814451 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:14:09.814414 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xgg5d\" (UniqueName: \"kubernetes.io/projected/09d2396b-626e-47ef-a1de-5960fa590681-kube-api-access-xgg5d\") pod \"09d2396b-626e-47ef-a1de-5960fa590681\" (UID: \"09d2396b-626e-47ef-a1de-5960fa590681\") " Jul 15 04:14:09.816569 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:14:09.816542 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/09d2396b-626e-47ef-a1de-5960fa590681-kube-api-access-xgg5d" (OuterVolumeSpecName: "kube-api-access-xgg5d") pod "09d2396b-626e-47ef-a1de-5960fa590681" (UID: "09d2396b-626e-47ef-a1de-5960fa590681"). InnerVolumeSpecName "kube-api-access-xgg5d". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 15 04:14:09.916004 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:14:09.915909 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xgg5d\" (UniqueName: \"kubernetes.io/projected/09d2396b-626e-47ef-a1de-5960fa590681-kube-api-access-xgg5d\") on node \"ip-10-0-128-222.ec2.internal\" DevicePath \"\"" Jul 15 04:14:10.396481 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:14:10.396443 2581 generic.go:356] "Generic (PLEG): container finished" podID="09d2396b-626e-47ef-a1de-5960fa590681" containerID="a21ea377b455bcc5ce6f7392affc0bb100b7e50d387e3ccbfb60233d2db34913" exitCode=0 Jul 15 04:14:10.396890 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:14:10.396502 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-kzvxx" Jul 15 04:14:10.396890 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:14:10.396528 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-kzvxx" event={"ID":"09d2396b-626e-47ef-a1de-5960fa590681","Type":"ContainerDied","Data":"a21ea377b455bcc5ce6f7392affc0bb100b7e50d387e3ccbfb60233d2db34913"} Jul 15 04:14:10.396890 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:14:10.396606 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-kzvxx" event={"ID":"09d2396b-626e-47ef-a1de-5960fa590681","Type":"ContainerDied","Data":"b61d41c1f95dc03f185e51f14a839f6538407387a6a8797f4ef8908269c939c1"} Jul 15 04:14:10.396890 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:14:10.396631 2581 scope.go:117] "RemoveContainer" containerID="a21ea377b455bcc5ce6f7392affc0bb100b7e50d387e3ccbfb60233d2db34913" Jul 15 04:14:10.406871 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:14:10.406840 2581 scope.go:117] "RemoveContainer" containerID="a21ea377b455bcc5ce6f7392affc0bb100b7e50d387e3ccbfb60233d2db34913" Jul 15 04:14:10.407199 ip-10-0-128-222 kubenswrapper[2581]: E0715 04:14:10.407112 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a21ea377b455bcc5ce6f7392affc0bb100b7e50d387e3ccbfb60233d2db34913\": container with ID starting with a21ea377b455bcc5ce6f7392affc0bb100b7e50d387e3ccbfb60233d2db34913 not found: ID does not exist" containerID="a21ea377b455bcc5ce6f7392affc0bb100b7e50d387e3ccbfb60233d2db34913" Jul 15 04:14:10.407199 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:14:10.407171 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a21ea377b455bcc5ce6f7392affc0bb100b7e50d387e3ccbfb60233d2db34913"} err="failed to get container status \"a21ea377b455bcc5ce6f7392affc0bb100b7e50d387e3ccbfb60233d2db34913\": rpc error: code = NotFound desc = could not find container \"a21ea377b455bcc5ce6f7392affc0bb100b7e50d387e3ccbfb60233d2db34913\": container with ID starting with a21ea377b455bcc5ce6f7392affc0bb100b7e50d387e3ccbfb60233d2db34913 not found: ID does not exist" Jul 15 04:14:10.419348 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:14:10.419320 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-kzvxx"] Jul 15 04:14:10.423684 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:14:10.423657 2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-kzvxx"] Jul 15 04:14:10.990224 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:14:10.990188 2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="09d2396b-626e-47ef-a1de-5960fa590681" path="/var/lib/kubelet/pods/09d2396b-626e-47ef-a1de-5960fa590681/volumes" Jul 15 04:14:11.950245 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:14:11.950216 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:14:12.004329 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:14:12.004297 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:14:12.103751 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:14:12.103721 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:14:12.205820 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:14:12.205738 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:14:12.690886 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:14:12.690851 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:14:12.747661 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:14:12.747628 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:14:16.818553 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:14:16.818518 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-catalog-7b868" Jul 15 04:14:16.819078 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:14:16.818613 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kuadrant-system/kuadrant-operator-catalog-7b868" Jul 15 04:14:16.842094 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:14:16.842068 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kuadrant-system/kuadrant-operator-catalog-7b868" Jul 15 04:14:17.454751 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:14:17.454721 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-catalog-7b868" Jul 15 04:14:21.731820 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:14:21.731777 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1kwr9g"] Jul 15 04:14:21.732433 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:14:21.732413 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="09d2396b-626e-47ef-a1de-5960fa590681" containerName="registry-server" Jul 15 04:14:21.732528 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:14:21.732435 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="09d2396b-626e-47ef-a1de-5960fa590681" containerName="registry-server" Jul 15 04:14:21.732587 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:14:21.732552 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="09d2396b-626e-47ef-a1de-5960fa590681" containerName="registry-server" Jul 15 04:14:21.737494 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:14:21.737471 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1kwr9g" Jul 15 04:14:21.740049 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:14:21.740026 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-qzv8h\"" Jul 15 04:14:21.742354 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:14:21.742328 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1kwr9g"] Jul 15 04:14:21.825317 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:14:21.825284 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hc85g\" (UniqueName: \"kubernetes.io/projected/09c03cbd-de94-45a0-8292-a85da4332b2c-kube-api-access-hc85g\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1kwr9g\" (UID: \"09c03cbd-de94-45a0-8292-a85da4332b2c\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1kwr9g" Jul 15 04:14:21.825535 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:14:21.825411 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/09c03cbd-de94-45a0-8292-a85da4332b2c-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1kwr9g\" (UID: \"09c03cbd-de94-45a0-8292-a85da4332b2c\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1kwr9g" Jul 15 04:14:21.825535 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:14:21.825473 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/09c03cbd-de94-45a0-8292-a85da4332b2c-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1kwr9g\" (UID: \"09c03cbd-de94-45a0-8292-a85da4332b2c\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1kwr9g" Jul 15 04:14:21.926791 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:14:21.926752 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/09c03cbd-de94-45a0-8292-a85da4332b2c-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1kwr9g\" (UID: \"09c03cbd-de94-45a0-8292-a85da4332b2c\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1kwr9g" Jul 15 04:14:21.926998 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:14:21.926800 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/09c03cbd-de94-45a0-8292-a85da4332b2c-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1kwr9g\" (UID: \"09c03cbd-de94-45a0-8292-a85da4332b2c\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1kwr9g" Jul 15 04:14:21.926998 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:14:21.926833 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hc85g\" (UniqueName: \"kubernetes.io/projected/09c03cbd-de94-45a0-8292-a85da4332b2c-kube-api-access-hc85g\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1kwr9g\" (UID: \"09c03cbd-de94-45a0-8292-a85da4332b2c\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1kwr9g" Jul 15 04:14:21.927273 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:14:21.927248 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/09c03cbd-de94-45a0-8292-a85da4332b2c-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1kwr9g\" (UID: \"09c03cbd-de94-45a0-8292-a85da4332b2c\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1kwr9g" Jul 15 04:14:21.927354 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:14:21.927272 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/09c03cbd-de94-45a0-8292-a85da4332b2c-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1kwr9g\" (UID: \"09c03cbd-de94-45a0-8292-a85da4332b2c\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1kwr9g" Jul 15 04:14:21.934838 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:14:21.934813 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hc85g\" (UniqueName: \"kubernetes.io/projected/09c03cbd-de94-45a0-8292-a85da4332b2c-kube-api-access-hc85g\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1kwr9g\" (UID: \"09c03cbd-de94-45a0-8292-a85da4332b2c\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1kwr9g" Jul 15 04:14:22.048775 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:14:22.048683 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1kwr9g" Jul 15 04:14:22.187334 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:14:22.187300 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1kwr9g"] Jul 15 04:14:22.190909 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:14:22.190876 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod09c03cbd_de94_45a0_8292_a85da4332b2c.slice/crio-2080483d307d2a7f49ab3cafd8577c50232208c28dafa6d8b14daac5d57cd34b WatchSource:0}: Error finding container 2080483d307d2a7f49ab3cafd8577c50232208c28dafa6d8b14daac5d57cd34b: Status 404 returned error can't find the container with id 2080483d307d2a7f49ab3cafd8577c50232208c28dafa6d8b14daac5d57cd34b Jul 15 04:14:22.458839 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:14:22.458806 2581 generic.go:356] "Generic (PLEG): container finished" podID="09c03cbd-de94-45a0-8292-a85da4332b2c" containerID="bdd68524010d0cfc9651e92541ec5a01da3385e89041338a69758ba94f60750f" exitCode=0 Jul 15 04:14:22.458993 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:14:22.458898 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1kwr9g" event={"ID":"09c03cbd-de94-45a0-8292-a85da4332b2c","Type":"ContainerDied","Data":"bdd68524010d0cfc9651e92541ec5a01da3385e89041338a69758ba94f60750f"} Jul 15 04:14:22.458993 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:14:22.458949 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1kwr9g" event={"ID":"09c03cbd-de94-45a0-8292-a85da4332b2c","Type":"ContainerStarted","Data":"2080483d307d2a7f49ab3cafd8577c50232208c28dafa6d8b14daac5d57cd34b"} Jul 15 04:14:22.537659 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:14:22.537630 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73jqkd7"] Jul 15 04:14:22.541447 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:14:22.541428 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73jqkd7" Jul 15 04:14:22.549970 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:14:22.549940 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73jqkd7"] Jul 15 04:14:22.631725 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:14:22.631685 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e20a831e-673b-4307-89f4-bca058be431a-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73jqkd7\" (UID: \"e20a831e-673b-4307-89f4-bca058be431a\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73jqkd7" Jul 15 04:14:22.631925 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:14:22.631735 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e20a831e-673b-4307-89f4-bca058be431a-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73jqkd7\" (UID: \"e20a831e-673b-4307-89f4-bca058be431a\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73jqkd7" Jul 15 04:14:22.631925 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:14:22.631767 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m57r5\" (UniqueName: \"kubernetes.io/projected/e20a831e-673b-4307-89f4-bca058be431a-kube-api-access-m57r5\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73jqkd7\" (UID: \"e20a831e-673b-4307-89f4-bca058be431a\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73jqkd7" Jul 15 04:14:22.733149 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:14:22.733043 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e20a831e-673b-4307-89f4-bca058be431a-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73jqkd7\" (UID: \"e20a831e-673b-4307-89f4-bca058be431a\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73jqkd7" Jul 15 04:14:22.733149 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:14:22.733090 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e20a831e-673b-4307-89f4-bca058be431a-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73jqkd7\" (UID: \"e20a831e-673b-4307-89f4-bca058be431a\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73jqkd7" Jul 15 04:14:22.733149 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:14:22.733133 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m57r5\" (UniqueName: \"kubernetes.io/projected/e20a831e-673b-4307-89f4-bca058be431a-kube-api-access-m57r5\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73jqkd7\" (UID: \"e20a831e-673b-4307-89f4-bca058be431a\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73jqkd7" Jul 15 04:14:22.733730 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:14:22.733430 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e20a831e-673b-4307-89f4-bca058be431a-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73jqkd7\" (UID: \"e20a831e-673b-4307-89f4-bca058be431a\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73jqkd7" Jul 15 04:14:22.733730 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:14:22.733472 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e20a831e-673b-4307-89f4-bca058be431a-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73jqkd7\" (UID: \"e20a831e-673b-4307-89f4-bca058be431a\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73jqkd7" Jul 15 04:14:22.740925 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:14:22.740895 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m57r5\" (UniqueName: \"kubernetes.io/projected/e20a831e-673b-4307-89f4-bca058be431a-kube-api-access-m57r5\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73jqkd7\" (UID: \"e20a831e-673b-4307-89f4-bca058be431a\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73jqkd7" Jul 15 04:14:22.779833 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:14:22.779801 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:14:22.852241 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:14:22.852203 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73jqkd7" Jul 15 04:14:22.885900 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:14:22.885871 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:14:22.932859 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:14:22.932828 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75944x6x"] Jul 15 04:14:22.938292 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:14:22.938061 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75944x6x" Jul 15 04:14:22.947232 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:14:22.947103 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75944x6x"] Jul 15 04:14:22.994483 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:14:22.994457 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73jqkd7"] Jul 15 04:14:22.996268 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:14:22.996239 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode20a831e_673b_4307_89f4_bca058be431a.slice/crio-bd1fcb26992b54cac4860aa21de68a5190840d1604d4ac04f3e5711edaf0764f WatchSource:0}: Error finding container bd1fcb26992b54cac4860aa21de68a5190840d1604d4ac04f3e5711edaf0764f: Status 404 returned error can't find the container with id bd1fcb26992b54cac4860aa21de68a5190840d1604d4ac04f3e5711edaf0764f Jul 15 04:14:23.036170 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:14:23.036109 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0b04d00f-dd42-4963-a0f4-c918108f00b7-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75944x6x\" (UID: \"0b04d00f-dd42-4963-a0f4-c918108f00b7\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75944x6x" Jul 15 04:14:23.036289 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:14:23.036196 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-btsvm\" (UniqueName: \"kubernetes.io/projected/0b04d00f-dd42-4963-a0f4-c918108f00b7-kube-api-access-btsvm\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75944x6x\" (UID: \"0b04d00f-dd42-4963-a0f4-c918108f00b7\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75944x6x" Jul 15 04:14:23.036289 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:14:23.036255 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0b04d00f-dd42-4963-a0f4-c918108f00b7-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75944x6x\" (UID: \"0b04d00f-dd42-4963-a0f4-c918108f00b7\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75944x6x" Jul 15 04:14:23.136837 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:14:23.136803 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0b04d00f-dd42-4963-a0f4-c918108f00b7-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75944x6x\" (UID: \"0b04d00f-dd42-4963-a0f4-c918108f00b7\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75944x6x" Jul 15 04:14:23.137006 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:14:23.136848 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-btsvm\" (UniqueName: \"kubernetes.io/projected/0b04d00f-dd42-4963-a0f4-c918108f00b7-kube-api-access-btsvm\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75944x6x\" (UID: \"0b04d00f-dd42-4963-a0f4-c918108f00b7\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75944x6x" Jul 15 04:14:23.137006 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:14:23.136876 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0b04d00f-dd42-4963-a0f4-c918108f00b7-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75944x6x\" (UID: \"0b04d00f-dd42-4963-a0f4-c918108f00b7\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75944x6x" Jul 15 04:14:23.137208 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:14:23.137189 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0b04d00f-dd42-4963-a0f4-c918108f00b7-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75944x6x\" (UID: \"0b04d00f-dd42-4963-a0f4-c918108f00b7\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75944x6x" Jul 15 04:14:23.137263 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:14:23.137222 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0b04d00f-dd42-4963-a0f4-c918108f00b7-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75944x6x\" (UID: \"0b04d00f-dd42-4963-a0f4-c918108f00b7\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75944x6x" Jul 15 04:14:23.144420 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:14:23.144392 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-btsvm\" (UniqueName: \"kubernetes.io/projected/0b04d00f-dd42-4963-a0f4-c918108f00b7-kube-api-access-btsvm\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75944x6x\" (UID: \"0b04d00f-dd42-4963-a0f4-c918108f00b7\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75944x6x" Jul 15 04:14:23.259018 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:14:23.258944 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75944x6x" Jul 15 04:14:23.334976 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:14:23.334936 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0g6k94"] Jul 15 04:14:23.339690 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:14:23.339668 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0g6k94" Jul 15 04:14:23.346872 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:14:23.346843 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0g6k94"] Jul 15 04:14:23.440049 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:14:23.439794 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-42bh4\" (UniqueName: \"kubernetes.io/projected/8835dd52-5c60-4e96-a90d-af88132ed1f6-kube-api-access-42bh4\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0g6k94\" (UID: \"8835dd52-5c60-4e96-a90d-af88132ed1f6\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0g6k94" Jul 15 04:14:23.440049 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:14:23.439832 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8835dd52-5c60-4e96-a90d-af88132ed1f6-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0g6k94\" (UID: \"8835dd52-5c60-4e96-a90d-af88132ed1f6\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0g6k94" Jul 15 04:14:23.440049 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:14:23.439938 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8835dd52-5c60-4e96-a90d-af88132ed1f6-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0g6k94\" (UID: \"8835dd52-5c60-4e96-a90d-af88132ed1f6\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0g6k94" Jul 15 04:14:23.468660 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:14:23.468626 2581 generic.go:356] "Generic (PLEG): container finished" podID="e20a831e-673b-4307-89f4-bca058be431a" containerID="ac13418680e560b7618fea30475c1d676921ec283f135bad067e7d27c92964a8" exitCode=0 Jul 15 04:14:23.468853 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:14:23.468710 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73jqkd7" event={"ID":"e20a831e-673b-4307-89f4-bca058be431a","Type":"ContainerDied","Data":"ac13418680e560b7618fea30475c1d676921ec283f135bad067e7d27c92964a8"} Jul 15 04:14:23.468853 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:14:23.468759 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73jqkd7" event={"ID":"e20a831e-673b-4307-89f4-bca058be431a","Type":"ContainerStarted","Data":"bd1fcb26992b54cac4860aa21de68a5190840d1604d4ac04f3e5711edaf0764f"} Jul 15 04:14:23.494399 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:14:23.494370 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75944x6x"] Jul 15 04:14:23.496244 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:14:23.496215 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0b04d00f_dd42_4963_a0f4_c918108f00b7.slice/crio-45b7b0d1d250a92a6df88816c80cf7ab7f44d3fedfb4bfac1b05916f15aa33d5 WatchSource:0}: Error finding container 45b7b0d1d250a92a6df88816c80cf7ab7f44d3fedfb4bfac1b05916f15aa33d5: Status 404 returned error can't find the container with id 45b7b0d1d250a92a6df88816c80cf7ab7f44d3fedfb4bfac1b05916f15aa33d5 Jul 15 04:14:23.541199 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:14:23.541164 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8835dd52-5c60-4e96-a90d-af88132ed1f6-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0g6k94\" (UID: \"8835dd52-5c60-4e96-a90d-af88132ed1f6\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0g6k94" Jul 15 04:14:23.541335 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:14:23.541265 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-42bh4\" (UniqueName: \"kubernetes.io/projected/8835dd52-5c60-4e96-a90d-af88132ed1f6-kube-api-access-42bh4\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0g6k94\" (UID: \"8835dd52-5c60-4e96-a90d-af88132ed1f6\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0g6k94" Jul 15 04:14:23.541335 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:14:23.541290 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8835dd52-5c60-4e96-a90d-af88132ed1f6-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0g6k94\" (UID: \"8835dd52-5c60-4e96-a90d-af88132ed1f6\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0g6k94" Jul 15 04:14:23.541643 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:14:23.541619 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8835dd52-5c60-4e96-a90d-af88132ed1f6-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0g6k94\" (UID: \"8835dd52-5c60-4e96-a90d-af88132ed1f6\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0g6k94" Jul 15 04:14:23.541691 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:14:23.541617 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8835dd52-5c60-4e96-a90d-af88132ed1f6-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0g6k94\" (UID: \"8835dd52-5c60-4e96-a90d-af88132ed1f6\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0g6k94" Jul 15 04:14:23.549483 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:14:23.549462 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-42bh4\" (UniqueName: \"kubernetes.io/projected/8835dd52-5c60-4e96-a90d-af88132ed1f6-kube-api-access-42bh4\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0g6k94\" (UID: \"8835dd52-5c60-4e96-a90d-af88132ed1f6\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0g6k94" Jul 15 04:14:23.651411 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:14:23.651379 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0g6k94" Jul 15 04:14:23.789505 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:14:23.789480 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0g6k94"] Jul 15 04:14:23.790775 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:14:23.790751 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8835dd52_5c60_4e96_a90d_af88132ed1f6.slice/crio-2c8562d5fc49beded274ce2eb167875498ee9c48620d5778f35477eb1f628d1c WatchSource:0}: Error finding container 2c8562d5fc49beded274ce2eb167875498ee9c48620d5778f35477eb1f628d1c: Status 404 returned error can't find the container with id 2c8562d5fc49beded274ce2eb167875498ee9c48620d5778f35477eb1f628d1c Jul 15 04:14:24.476242 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:14:24.476101 2581 generic.go:356] "Generic (PLEG): container finished" podID="09c03cbd-de94-45a0-8292-a85da4332b2c" containerID="9dd9df09ef73ff32087acb4aaffa1764b090d857b66fbdfc27e2cd197ecca6e8" exitCode=0 Jul 15 04:14:24.476242 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:14:24.476221 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1kwr9g" event={"ID":"09c03cbd-de94-45a0-8292-a85da4332b2c","Type":"ContainerDied","Data":"9dd9df09ef73ff32087acb4aaffa1764b090d857b66fbdfc27e2cd197ecca6e8"} Jul 15 04:14:24.478157 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:14:24.478133 2581 generic.go:356] "Generic (PLEG): container finished" podID="e20a831e-673b-4307-89f4-bca058be431a" containerID="86e572d7a211fd3ff749b0b9369ad02e610f7ade8143dcadb1b321d92aa554d2" exitCode=0 Jul 15 04:14:24.478229 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:14:24.478211 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73jqkd7" event={"ID":"e20a831e-673b-4307-89f4-bca058be431a","Type":"ContainerDied","Data":"86e572d7a211fd3ff749b0b9369ad02e610f7ade8143dcadb1b321d92aa554d2"} Jul 15 04:14:24.479737 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:14:24.479715 2581 generic.go:356] "Generic (PLEG): container finished" podID="8835dd52-5c60-4e96-a90d-af88132ed1f6" containerID="e6a331b0734b8cf5bff2b1a61f2f1e5543ee7d789e0db2a50316f792b1b49634" exitCode=0 Jul 15 04:14:24.479827 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:14:24.479787 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0g6k94" event={"ID":"8835dd52-5c60-4e96-a90d-af88132ed1f6","Type":"ContainerDied","Data":"e6a331b0734b8cf5bff2b1a61f2f1e5543ee7d789e0db2a50316f792b1b49634"} Jul 15 04:14:24.479888 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:14:24.479827 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0g6k94" event={"ID":"8835dd52-5c60-4e96-a90d-af88132ed1f6","Type":"ContainerStarted","Data":"2c8562d5fc49beded274ce2eb167875498ee9c48620d5778f35477eb1f628d1c"} Jul 15 04:14:24.481365 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:14:24.481342 2581 generic.go:356] "Generic (PLEG): container finished" podID="0b04d00f-dd42-4963-a0f4-c918108f00b7" containerID="9cf43a042d3aa939432e6185418924fbf2f5c2efd4999bcc9776b57d14f102b4" exitCode=0 Jul 15 04:14:24.481452 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:14:24.481376 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75944x6x" event={"ID":"0b04d00f-dd42-4963-a0f4-c918108f00b7","Type":"ContainerDied","Data":"9cf43a042d3aa939432e6185418924fbf2f5c2efd4999bcc9776b57d14f102b4"} Jul 15 04:14:24.481452 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:14:24.481407 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75944x6x" event={"ID":"0b04d00f-dd42-4963-a0f4-c918108f00b7","Type":"ContainerStarted","Data":"45b7b0d1d250a92a6df88816c80cf7ab7f44d3fedfb4bfac1b05916f15aa33d5"} Jul 15 04:14:25.488600 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:14:25.488525 2581 generic.go:356] "Generic (PLEG): container finished" podID="09c03cbd-de94-45a0-8292-a85da4332b2c" containerID="0a6ee99b58f04a9473f2741aa3a49fd3eb550effb7b1524c3ab9593616073945" exitCode=0 Jul 15 04:14:25.489032 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:14:25.488619 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1kwr9g" event={"ID":"09c03cbd-de94-45a0-8292-a85da4332b2c","Type":"ContainerDied","Data":"0a6ee99b58f04a9473f2741aa3a49fd3eb550effb7b1524c3ab9593616073945"} Jul 15 04:14:25.490925 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:14:25.490900 2581 generic.go:356] "Generic (PLEG): container finished" podID="e20a831e-673b-4307-89f4-bca058be431a" containerID="e3b7854b431be0dc4651ed4bdf1e864919f909a26b4a56c9ae64c14c0c9a2b64" exitCode=0 Jul 15 04:14:25.491092 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:14:25.490978 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73jqkd7" event={"ID":"e20a831e-673b-4307-89f4-bca058be431a","Type":"ContainerDied","Data":"e3b7854b431be0dc4651ed4bdf1e864919f909a26b4a56c9ae64c14c0c9a2b64"} Jul 15 04:14:25.492926 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:14:25.492903 2581 generic.go:356] "Generic (PLEG): container finished" podID="8835dd52-5c60-4e96-a90d-af88132ed1f6" containerID="76d268a24f4b6b56616dcc71c4e9126cadded8439a53484a4a1e55fa45f83d92" exitCode=0 Jul 15 04:14:25.493040 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:14:25.492977 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0g6k94" event={"ID":"8835dd52-5c60-4e96-a90d-af88132ed1f6","Type":"ContainerDied","Data":"76d268a24f4b6b56616dcc71c4e9126cadded8439a53484a4a1e55fa45f83d92"} Jul 15 04:14:26.500387 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:14:26.500357 2581 generic.go:356] "Generic (PLEG): container finished" podID="8835dd52-5c60-4e96-a90d-af88132ed1f6" containerID="299d2f75f8697f354a3798aa25d2ce10eef53ae9105ecea1e645d652e407ab4d" exitCode=0 Jul 15 04:14:26.500804 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:14:26.500441 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0g6k94" event={"ID":"8835dd52-5c60-4e96-a90d-af88132ed1f6","Type":"ContainerDied","Data":"299d2f75f8697f354a3798aa25d2ce10eef53ae9105ecea1e645d652e407ab4d"} Jul 15 04:14:26.502171 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:14:26.502147 2581 generic.go:356] "Generic (PLEG): container finished" podID="0b04d00f-dd42-4963-a0f4-c918108f00b7" containerID="86ace5c66fd5cef2a888504bd46ad577452ba252baa823f9f2d4f1532a60ac84" exitCode=0 Jul 15 04:14:26.502228 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:14:26.502208 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75944x6x" event={"ID":"0b04d00f-dd42-4963-a0f4-c918108f00b7","Type":"ContainerDied","Data":"86ace5c66fd5cef2a888504bd46ad577452ba252baa823f9f2d4f1532a60ac84"} Jul 15 04:14:26.651777 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:14:26.651750 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1kwr9g" Jul 15 04:14:26.718432 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:14:26.718406 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73jqkd7" Jul 15 04:14:26.778901 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:14:26.778815 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/09c03cbd-de94-45a0-8292-a85da4332b2c-bundle\") pod \"09c03cbd-de94-45a0-8292-a85da4332b2c\" (UID: \"09c03cbd-de94-45a0-8292-a85da4332b2c\") " Jul 15 04:14:26.778901 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:14:26.778877 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e20a831e-673b-4307-89f4-bca058be431a-bundle\") pod \"e20a831e-673b-4307-89f4-bca058be431a\" (UID: \"e20a831e-673b-4307-89f4-bca058be431a\") " Jul 15 04:14:26.779098 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:14:26.778923 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hc85g\" (UniqueName: \"kubernetes.io/projected/09c03cbd-de94-45a0-8292-a85da4332b2c-kube-api-access-hc85g\") pod \"09c03cbd-de94-45a0-8292-a85da4332b2c\" (UID: \"09c03cbd-de94-45a0-8292-a85da4332b2c\") " Jul 15 04:14:26.779098 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:14:26.778956 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/09c03cbd-de94-45a0-8292-a85da4332b2c-util\") pod \"09c03cbd-de94-45a0-8292-a85da4332b2c\" (UID: \"09c03cbd-de94-45a0-8292-a85da4332b2c\") " Jul 15 04:14:26.779098 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:14:26.778986 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-m57r5\" (UniqueName: \"kubernetes.io/projected/e20a831e-673b-4307-89f4-bca058be431a-kube-api-access-m57r5\") pod \"e20a831e-673b-4307-89f4-bca058be431a\" (UID: \"e20a831e-673b-4307-89f4-bca058be431a\") " Jul 15 04:14:26.779098 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:14:26.779030 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e20a831e-673b-4307-89f4-bca058be431a-util\") pod \"e20a831e-673b-4307-89f4-bca058be431a\" (UID: \"e20a831e-673b-4307-89f4-bca058be431a\") " Jul 15 04:14:26.779567 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:14:26.779531 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/09c03cbd-de94-45a0-8292-a85da4332b2c-bundle" (OuterVolumeSpecName: "bundle") pod "09c03cbd-de94-45a0-8292-a85da4332b2c" (UID: "09c03cbd-de94-45a0-8292-a85da4332b2c"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 04:14:26.779700 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:14:26.779662 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e20a831e-673b-4307-89f4-bca058be431a-bundle" (OuterVolumeSpecName: "bundle") pod "e20a831e-673b-4307-89f4-bca058be431a" (UID: "e20a831e-673b-4307-89f4-bca058be431a"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 04:14:26.781396 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:14:26.781374 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e20a831e-673b-4307-89f4-bca058be431a-kube-api-access-m57r5" (OuterVolumeSpecName: "kube-api-access-m57r5") pod "e20a831e-673b-4307-89f4-bca058be431a" (UID: "e20a831e-673b-4307-89f4-bca058be431a"). InnerVolumeSpecName "kube-api-access-m57r5". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 15 04:14:26.781554 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:14:26.781539 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/09c03cbd-de94-45a0-8292-a85da4332b2c-kube-api-access-hc85g" (OuterVolumeSpecName: "kube-api-access-hc85g") pod "09c03cbd-de94-45a0-8292-a85da4332b2c" (UID: "09c03cbd-de94-45a0-8292-a85da4332b2c"). InnerVolumeSpecName "kube-api-access-hc85g". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 15 04:14:26.785250 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:14:26.785211 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/09c03cbd-de94-45a0-8292-a85da4332b2c-util" (OuterVolumeSpecName: "util") pod "09c03cbd-de94-45a0-8292-a85da4332b2c" (UID: "09c03cbd-de94-45a0-8292-a85da4332b2c"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 04:14:26.785741 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:14:26.785719 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e20a831e-673b-4307-89f4-bca058be431a-util" (OuterVolumeSpecName: "util") pod "e20a831e-673b-4307-89f4-bca058be431a" (UID: "e20a831e-673b-4307-89f4-bca058be431a"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 04:14:26.880722 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:14:26.880688 2581 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/09c03cbd-de94-45a0-8292-a85da4332b2c-util\") on node \"ip-10-0-128-222.ec2.internal\" DevicePath \"\"" Jul 15 04:14:26.880722 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:14:26.880716 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-m57r5\" (UniqueName: \"kubernetes.io/projected/e20a831e-673b-4307-89f4-bca058be431a-kube-api-access-m57r5\") on node \"ip-10-0-128-222.ec2.internal\" DevicePath \"\"" Jul 15 04:14:26.880722 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:14:26.880727 2581 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e20a831e-673b-4307-89f4-bca058be431a-util\") on node \"ip-10-0-128-222.ec2.internal\" DevicePath \"\"" Jul 15 04:14:26.880963 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:14:26.880736 2581 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/09c03cbd-de94-45a0-8292-a85da4332b2c-bundle\") on node \"ip-10-0-128-222.ec2.internal\" DevicePath \"\"" Jul 15 04:14:26.880963 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:14:26.880744 2581 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e20a831e-673b-4307-89f4-bca058be431a-bundle\") on node \"ip-10-0-128-222.ec2.internal\" DevicePath \"\"" Jul 15 04:14:26.880963 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:14:26.880752 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hc85g\" (UniqueName: \"kubernetes.io/projected/09c03cbd-de94-45a0-8292-a85da4332b2c-kube-api-access-hc85g\") on node \"ip-10-0-128-222.ec2.internal\" DevicePath \"\"" Jul 15 04:14:27.510255 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:14:27.510222 2581 generic.go:356] "Generic (PLEG): container finished" podID="0b04d00f-dd42-4963-a0f4-c918108f00b7" containerID="d59997e96500f3d8dca01b0764fccf8a8d25f8e2dbf1c33790db74530ad20f5b" exitCode=0 Jul 15 04:14:27.510684 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:14:27.510282 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75944x6x" event={"ID":"0b04d00f-dd42-4963-a0f4-c918108f00b7","Type":"ContainerDied","Data":"d59997e96500f3d8dca01b0764fccf8a8d25f8e2dbf1c33790db74530ad20f5b"} Jul 15 04:14:27.512173 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:14:27.512152 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1kwr9g" Jul 15 04:14:27.512173 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:14:27.512165 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1kwr9g" event={"ID":"09c03cbd-de94-45a0-8292-a85da4332b2c","Type":"ContainerDied","Data":"2080483d307d2a7f49ab3cafd8577c50232208c28dafa6d8b14daac5d57cd34b"} Jul 15 04:14:27.512375 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:14:27.512199 2581 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="2080483d307d2a7f49ab3cafd8577c50232208c28dafa6d8b14daac5d57cd34b" Jul 15 04:14:27.514404 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:14:27.514367 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73jqkd7" event={"ID":"e20a831e-673b-4307-89f4-bca058be431a","Type":"ContainerDied","Data":"bd1fcb26992b54cac4860aa21de68a5190840d1604d4ac04f3e5711edaf0764f"} Jul 15 04:14:27.514513 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:14:27.514412 2581 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="bd1fcb26992b54cac4860aa21de68a5190840d1604d4ac04f3e5711edaf0764f" Jul 15 04:14:27.514617 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:14:27.514599 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73jqkd7" Jul 15 04:14:27.652187 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:14:27.652163 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0g6k94" Jul 15 04:14:27.789309 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:14:27.789224 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-42bh4\" (UniqueName: \"kubernetes.io/projected/8835dd52-5c60-4e96-a90d-af88132ed1f6-kube-api-access-42bh4\") pod \"8835dd52-5c60-4e96-a90d-af88132ed1f6\" (UID: \"8835dd52-5c60-4e96-a90d-af88132ed1f6\") " Jul 15 04:14:27.789309 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:14:27.789278 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8835dd52-5c60-4e96-a90d-af88132ed1f6-util\") pod \"8835dd52-5c60-4e96-a90d-af88132ed1f6\" (UID: \"8835dd52-5c60-4e96-a90d-af88132ed1f6\") " Jul 15 04:14:27.789518 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:14:27.789326 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8835dd52-5c60-4e96-a90d-af88132ed1f6-bundle\") pod \"8835dd52-5c60-4e96-a90d-af88132ed1f6\" (UID: \"8835dd52-5c60-4e96-a90d-af88132ed1f6\") " Jul 15 04:14:27.789826 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:14:27.789800 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8835dd52-5c60-4e96-a90d-af88132ed1f6-bundle" (OuterVolumeSpecName: "bundle") pod "8835dd52-5c60-4e96-a90d-af88132ed1f6" (UID: "8835dd52-5c60-4e96-a90d-af88132ed1f6"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 04:14:27.791462 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:14:27.791438 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8835dd52-5c60-4e96-a90d-af88132ed1f6-kube-api-access-42bh4" (OuterVolumeSpecName: "kube-api-access-42bh4") pod "8835dd52-5c60-4e96-a90d-af88132ed1f6" (UID: "8835dd52-5c60-4e96-a90d-af88132ed1f6"). InnerVolumeSpecName "kube-api-access-42bh4". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 15 04:14:27.794565 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:14:27.794543 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8835dd52-5c60-4e96-a90d-af88132ed1f6-util" (OuterVolumeSpecName: "util") pod "8835dd52-5c60-4e96-a90d-af88132ed1f6" (UID: "8835dd52-5c60-4e96-a90d-af88132ed1f6"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 04:14:27.891130 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:14:27.891082 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-42bh4\" (UniqueName: \"kubernetes.io/projected/8835dd52-5c60-4e96-a90d-af88132ed1f6-kube-api-access-42bh4\") on node \"ip-10-0-128-222.ec2.internal\" DevicePath \"\"" Jul 15 04:14:27.891130 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:14:27.891113 2581 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8835dd52-5c60-4e96-a90d-af88132ed1f6-util\") on node \"ip-10-0-128-222.ec2.internal\" DevicePath \"\"" Jul 15 04:14:27.891338 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:14:27.891148 2581 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8835dd52-5c60-4e96-a90d-af88132ed1f6-bundle\") on node \"ip-10-0-128-222.ec2.internal\" DevicePath \"\"" Jul 15 04:14:28.521792 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:14:28.521752 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0g6k94" Jul 15 04:14:28.521792 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:14:28.521761 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0g6k94" event={"ID":"8835dd52-5c60-4e96-a90d-af88132ed1f6","Type":"ContainerDied","Data":"2c8562d5fc49beded274ce2eb167875498ee9c48620d5778f35477eb1f628d1c"} Jul 15 04:14:28.522240 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:14:28.521814 2581 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="2c8562d5fc49beded274ce2eb167875498ee9c48620d5778f35477eb1f628d1c" Jul 15 04:14:28.655822 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:14:28.655800 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75944x6x" Jul 15 04:14:28.799059 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:14:28.798972 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0b04d00f-dd42-4963-a0f4-c918108f00b7-bundle\") pod \"0b04d00f-dd42-4963-a0f4-c918108f00b7\" (UID: \"0b04d00f-dd42-4963-a0f4-c918108f00b7\") " Jul 15 04:14:28.799059 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:14:28.799023 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-btsvm\" (UniqueName: \"kubernetes.io/projected/0b04d00f-dd42-4963-a0f4-c918108f00b7-kube-api-access-btsvm\") pod \"0b04d00f-dd42-4963-a0f4-c918108f00b7\" (UID: \"0b04d00f-dd42-4963-a0f4-c918108f00b7\") " Jul 15 04:14:28.799059 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:14:28.799056 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0b04d00f-dd42-4963-a0f4-c918108f00b7-util\") pod \"0b04d00f-dd42-4963-a0f4-c918108f00b7\" (UID: \"0b04d00f-dd42-4963-a0f4-c918108f00b7\") " Jul 15 04:14:28.799486 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:14:28.799453 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0b04d00f-dd42-4963-a0f4-c918108f00b7-bundle" (OuterVolumeSpecName: "bundle") pod "0b04d00f-dd42-4963-a0f4-c918108f00b7" (UID: "0b04d00f-dd42-4963-a0f4-c918108f00b7"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 04:14:28.801186 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:14:28.801166 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0b04d00f-dd42-4963-a0f4-c918108f00b7-kube-api-access-btsvm" (OuterVolumeSpecName: "kube-api-access-btsvm") pod "0b04d00f-dd42-4963-a0f4-c918108f00b7" (UID: "0b04d00f-dd42-4963-a0f4-c918108f00b7"). InnerVolumeSpecName "kube-api-access-btsvm". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 15 04:14:28.804432 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:14:28.804408 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0b04d00f-dd42-4963-a0f4-c918108f00b7-util" (OuterVolumeSpecName: "util") pod "0b04d00f-dd42-4963-a0f4-c918108f00b7" (UID: "0b04d00f-dd42-4963-a0f4-c918108f00b7"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 04:14:28.899982 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:14:28.899941 2581 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0b04d00f-dd42-4963-a0f4-c918108f00b7-bundle\") on node \"ip-10-0-128-222.ec2.internal\" DevicePath \"\"" Jul 15 04:14:28.899982 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:14:28.899976 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-btsvm\" (UniqueName: \"kubernetes.io/projected/0b04d00f-dd42-4963-a0f4-c918108f00b7-kube-api-access-btsvm\") on node \"ip-10-0-128-222.ec2.internal\" DevicePath \"\"" Jul 15 04:14:28.899982 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:14:28.899993 2581 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0b04d00f-dd42-4963-a0f4-c918108f00b7-util\") on node \"ip-10-0-128-222.ec2.internal\" DevicePath \"\"" Jul 15 04:14:29.529390 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:14:29.529353 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75944x6x" event={"ID":"0b04d00f-dd42-4963-a0f4-c918108f00b7","Type":"ContainerDied","Data":"45b7b0d1d250a92a6df88816c80cf7ab7f44d3fedfb4bfac1b05916f15aa33d5"} Jul 15 04:14:29.529390 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:14:29.529376 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75944x6x" Jul 15 04:14:29.529926 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:14:29.529426 2581 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="45b7b0d1d250a92a6df88816c80cf7ab7f44d3fedfb4bfac1b05916f15aa33d5" Jul 15 04:14:35.469309 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:14:35.469275 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:14:38.118075 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:14:38.118044 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-lcppc"] Jul 15 04:14:38.118513 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:14:38.118432 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0b04d00f-dd42-4963-a0f4-c918108f00b7" containerName="util" Jul 15 04:14:38.118513 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:14:38.118443 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="0b04d00f-dd42-4963-a0f4-c918108f00b7" containerName="util" Jul 15 04:14:38.118513 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:14:38.118451 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0b04d00f-dd42-4963-a0f4-c918108f00b7" containerName="extract" Jul 15 04:14:38.118513 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:14:38.118457 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="0b04d00f-dd42-4963-a0f4-c918108f00b7" containerName="extract" Jul 15 04:14:38.118513 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:14:38.118465 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="09c03cbd-de94-45a0-8292-a85da4332b2c" containerName="pull" Jul 15 04:14:38.118513 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:14:38.118470 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="09c03cbd-de94-45a0-8292-a85da4332b2c" containerName="pull" Jul 15 04:14:38.118513 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:14:38.118477 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8835dd52-5c60-4e96-a90d-af88132ed1f6" containerName="extract" Jul 15 04:14:38.118513 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:14:38.118483 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="8835dd52-5c60-4e96-a90d-af88132ed1f6" containerName="extract" Jul 15 04:14:38.118513 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:14:38.118491 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="09c03cbd-de94-45a0-8292-a85da4332b2c" containerName="extract" Jul 15 04:14:38.118513 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:14:38.118496 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="09c03cbd-de94-45a0-8292-a85da4332b2c" containerName="extract" Jul 15 04:14:38.118513 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:14:38.118502 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e20a831e-673b-4307-89f4-bca058be431a" containerName="extract" Jul 15 04:14:38.118513 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:14:38.118507 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="e20a831e-673b-4307-89f4-bca058be431a" containerName="extract" Jul 15 04:14:38.118513 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:14:38.118513 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e20a831e-673b-4307-89f4-bca058be431a" containerName="pull" Jul 15 04:14:38.118513 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:14:38.118518 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="e20a831e-673b-4307-89f4-bca058be431a" containerName="pull" Jul 15 04:14:38.118989 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:14:38.118533 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="09c03cbd-de94-45a0-8292-a85da4332b2c" containerName="util" Jul 15 04:14:38.118989 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:14:38.118538 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="09c03cbd-de94-45a0-8292-a85da4332b2c" containerName="util" Jul 15 04:14:38.118989 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:14:38.118545 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8835dd52-5c60-4e96-a90d-af88132ed1f6" containerName="util" Jul 15 04:14:38.118989 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:14:38.118550 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="8835dd52-5c60-4e96-a90d-af88132ed1f6" containerName="util" Jul 15 04:14:38.118989 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:14:38.118556 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8835dd52-5c60-4e96-a90d-af88132ed1f6" containerName="pull" Jul 15 04:14:38.118989 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:14:38.118561 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="8835dd52-5c60-4e96-a90d-af88132ed1f6" containerName="pull" Jul 15 04:14:38.118989 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:14:38.118566 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0b04d00f-dd42-4963-a0f4-c918108f00b7" containerName="pull" Jul 15 04:14:38.118989 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:14:38.118571 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="0b04d00f-dd42-4963-a0f4-c918108f00b7" containerName="pull" Jul 15 04:14:38.118989 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:14:38.118578 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e20a831e-673b-4307-89f4-bca058be431a" containerName="util" Jul 15 04:14:38.118989 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:14:38.118583 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="e20a831e-673b-4307-89f4-bca058be431a" containerName="util" Jul 15 04:14:38.118989 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:14:38.118644 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="e20a831e-673b-4307-89f4-bca058be431a" containerName="extract" Jul 15 04:14:38.118989 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:14:38.118652 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="8835dd52-5c60-4e96-a90d-af88132ed1f6" containerName="extract" Jul 15 04:14:38.118989 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:14:38.118660 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="0b04d00f-dd42-4963-a0f4-c918108f00b7" containerName="extract" Jul 15 04:14:38.118989 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:14:38.118667 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="09c03cbd-de94-45a0-8292-a85da4332b2c" containerName="extract" Jul 15 04:14:38.123615 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:14:38.123599 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-lcppc" Jul 15 04:14:38.126631 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:14:38.126613 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-wjzwm\"" Jul 15 04:14:38.135546 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:14:38.135524 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-lcppc"] Jul 15 04:14:38.297869 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:14:38.297832 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tqzkl\" (UniqueName: \"kubernetes.io/projected/dcea570b-dd39-4ea5-ba7f-744b6344c4ed-kube-api-access-tqzkl\") pod \"limitador-operator-controller-manager-859d7b78bd-lcppc\" (UID: \"dcea570b-dd39-4ea5-ba7f-744b6344c4ed\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-lcppc" Jul 15 04:14:38.398476 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:14:38.398382 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tqzkl\" (UniqueName: \"kubernetes.io/projected/dcea570b-dd39-4ea5-ba7f-744b6344c4ed-kube-api-access-tqzkl\") pod \"limitador-operator-controller-manager-859d7b78bd-lcppc\" (UID: \"dcea570b-dd39-4ea5-ba7f-744b6344c4ed\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-lcppc" Jul 15 04:14:38.407266 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:14:38.407230 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tqzkl\" (UniqueName: \"kubernetes.io/projected/dcea570b-dd39-4ea5-ba7f-744b6344c4ed-kube-api-access-tqzkl\") pod \"limitador-operator-controller-manager-859d7b78bd-lcppc\" (UID: \"dcea570b-dd39-4ea5-ba7f-744b6344c4ed\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-lcppc" Jul 15 04:14:38.434305 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:14:38.434271 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-lcppc" Jul 15 04:14:38.584877 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:14:38.584840 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-lcppc"] Jul 15 04:14:38.586411 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:14:38.586385 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddcea570b_dd39_4ea5_ba7f_744b6344c4ed.slice/crio-267c84dbfc7127e3df8577232f039a92cdc84ddda65008764802188920548604 WatchSource:0}: Error finding container 267c84dbfc7127e3df8577232f039a92cdc84ddda65008764802188920548604: Status 404 returned error can't find the container with id 267c84dbfc7127e3df8577232f039a92cdc84ddda65008764802188920548604 Jul 15 04:14:38.869885 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:14:38.869852 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:14:39.597477 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:14:39.597436 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-lcppc" event={"ID":"dcea570b-dd39-4ea5-ba7f-744b6344c4ed","Type":"ContainerStarted","Data":"267c84dbfc7127e3df8577232f039a92cdc84ddda65008764802188920548604"} Jul 15 04:14:39.666772 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:14:39.666740 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:14:40.604657 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:14:40.604557 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-lcppc" event={"ID":"dcea570b-dd39-4ea5-ba7f-744b6344c4ed","Type":"ContainerStarted","Data":"ecbbf04203de5bd54757894f16e6f2a4d0710f6091f8db7ec939763bce8064ee"} Jul 15 04:14:40.604657 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:14:40.604623 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-lcppc" Jul 15 04:14:40.623698 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:14:40.623649 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-lcppc" podStartSLOduration=0.983589251 podStartE2EDuration="2.623633379s" totalImagesPullingTime="1.640044128s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 04:14:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 04:14:40.6205279 +0000 UTC m=+514.147328938" watchObservedRunningTime="2026-07-15 04:14:40.623633379 +0000 UTC m=+514.150434460" Jul 15 04:14:42.184396 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:14:42.184366 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-sjs8b"] Jul 15 04:14:42.188669 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:14:42.188649 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-sjs8b" Jul 15 04:14:42.190937 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:14:42.190913 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-mx7t4\"" Jul 15 04:14:42.199976 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:14:42.199943 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-sjs8b"] Jul 15 04:14:42.337222 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:14:42.337180 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mj8f2\" (UniqueName: \"kubernetes.io/projected/e0a2895a-efba-492d-95fe-3dc052d95cc1-kube-api-access-mj8f2\") pod \"authorino-operator-75cc8d5cb7-sjs8b\" (UID: \"e0a2895a-efba-492d-95fe-3dc052d95cc1\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-sjs8b" Jul 15 04:14:42.438275 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:14:42.438193 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mj8f2\" (UniqueName: \"kubernetes.io/projected/e0a2895a-efba-492d-95fe-3dc052d95cc1-kube-api-access-mj8f2\") pod \"authorino-operator-75cc8d5cb7-sjs8b\" (UID: \"e0a2895a-efba-492d-95fe-3dc052d95cc1\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-sjs8b" Jul 15 04:14:42.449696 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:14:42.449661 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mj8f2\" (UniqueName: \"kubernetes.io/projected/e0a2895a-efba-492d-95fe-3dc052d95cc1-kube-api-access-mj8f2\") pod \"authorino-operator-75cc8d5cb7-sjs8b\" (UID: \"e0a2895a-efba-492d-95fe-3dc052d95cc1\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-sjs8b" Jul 15 04:14:42.506282 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:14:42.506246 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-sjs8b" Jul 15 04:14:42.650548 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:14:42.650511 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-sjs8b"] Jul 15 04:14:42.651569 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:14:42.651548 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode0a2895a_efba_492d_95fe_3dc052d95cc1.slice/crio-1d41d3bd18817752a6c806dc6aa4408e0c04f71cd1ee9925ab2d603ce05d0313 WatchSource:0}: Error finding container 1d41d3bd18817752a6c806dc6aa4408e0c04f71cd1ee9925ab2d603ce05d0313: Status 404 returned error can't find the container with id 1d41d3bd18817752a6c806dc6aa4408e0c04f71cd1ee9925ab2d603ce05d0313 Jul 15 04:14:42.920946 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:14:42.920918 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:14:43.017103 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:14:43.017069 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:14:43.289277 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:14:43.289196 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:14:43.625449 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:14:43.625413 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-sjs8b" event={"ID":"e0a2895a-efba-492d-95fe-3dc052d95cc1","Type":"ContainerStarted","Data":"1d41d3bd18817752a6c806dc6aa4408e0c04f71cd1ee9925ab2d603ce05d0313"} Jul 15 04:14:44.895920 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:14:44.895891 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:14:45.489292 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:14:45.489256 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-5rfbz"] Jul 15 04:14:45.493194 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:14:45.493170 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-5rfbz" Jul 15 04:14:45.495552 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:14:45.495532 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\"" Jul 15 04:14:45.495691 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:14:45.495532 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-tnslg\"" Jul 15 04:14:45.506601 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:14:45.506577 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-5rfbz"] Jul 15 04:14:45.638156 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:14:45.638112 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-sjs8b" event={"ID":"e0a2895a-efba-492d-95fe-3dc052d95cc1","Type":"ContainerStarted","Data":"902286539dfcaf7b544184a8b1fe3ecaf1137bd43fb930a2c31bbaca21b9ed2d"} Jul 15 04:14:45.638340 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:14:45.638193 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-sjs8b" Jul 15 04:14:45.656678 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:14:45.656621 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-75cc8d5cb7-sjs8b" podStartSLOduration=1.358648212 podStartE2EDuration="3.656602349s" totalImagesPullingTime="2.297954137s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 04:14:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 04:14:45.654210056 +0000 UTC m=+519.181011095" watchObservedRunningTime="2026-07-15 04:14:45.656602349 +0000 UTC m=+519.183403363" Jul 15 04:14:45.665537 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:14:45.665507 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5gm86\" (UniqueName: \"kubernetes.io/projected/a631b1b8-3bca-4899-a430-f267246be43b-kube-api-access-5gm86\") pod \"dns-operator-controller-manager-864dd78c4c-5rfbz\" (UID: \"a631b1b8-3bca-4899-a430-f267246be43b\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-5rfbz" Jul 15 04:14:45.766306 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:14:45.766217 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5gm86\" (UniqueName: \"kubernetes.io/projected/a631b1b8-3bca-4899-a430-f267246be43b-kube-api-access-5gm86\") pod \"dns-operator-controller-manager-864dd78c4c-5rfbz\" (UID: \"a631b1b8-3bca-4899-a430-f267246be43b\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-5rfbz" Jul 15 04:14:45.778335 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:14:45.778308 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5gm86\" (UniqueName: \"kubernetes.io/projected/a631b1b8-3bca-4899-a430-f267246be43b-kube-api-access-5gm86\") pod \"dns-operator-controller-manager-864dd78c4c-5rfbz\" (UID: \"a631b1b8-3bca-4899-a430-f267246be43b\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-5rfbz" Jul 15 04:14:45.803954 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:14:45.803914 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-5rfbz" Jul 15 04:14:45.947992 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:14:45.947964 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-5rfbz"] Jul 15 04:14:45.949520 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:14:45.949492 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda631b1b8_3bca_4899_a430_f267246be43b.slice/crio-5da4d6d117be1f46559b41746dbdce45a96ecf8d9c910f29475d4eae4f723909 WatchSource:0}: Error finding container 5da4d6d117be1f46559b41746dbdce45a96ecf8d9c910f29475d4eae4f723909: Status 404 returned error can't find the container with id 5da4d6d117be1f46559b41746dbdce45a96ecf8d9c910f29475d4eae4f723909 Jul 15 04:14:46.074641 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:14:46.074561 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:14:46.176116 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:14:46.176073 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:14:46.645292 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:14:46.645259 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-5rfbz" event={"ID":"a631b1b8-3bca-4899-a430-f267246be43b","Type":"ContainerStarted","Data":"5da4d6d117be1f46559b41746dbdce45a96ecf8d9c910f29475d4eae4f723909"} Jul 15 04:14:47.917476 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:14:47.917443 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:14:48.658778 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:14:48.658739 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-5rfbz" event={"ID":"a631b1b8-3bca-4899-a430-f267246be43b","Type":"ContainerStarted","Data":"d3306f05dfb81632bc35974da0e3f10a48b4c6a744bfe686e2f3a113e1207e9d"} Jul 15 04:14:48.658983 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:14:48.658795 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-5rfbz" Jul 15 04:14:48.680296 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:14:48.680248 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-5rfbz" podStartSLOduration=1.418818581 podStartE2EDuration="3.680231791s" totalImagesPullingTime="2.26141321s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 04:14:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 04:14:48.677681957 +0000 UTC m=+522.204482984" watchObservedRunningTime="2026-07-15 04:14:48.680231791 +0000 UTC m=+522.207032805" Jul 15 04:14:49.928703 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:14:49.928666 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-fmrht"] Jul 15 04:14:49.932355 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:14:49.932338 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-fmrht" Jul 15 04:14:49.935965 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:14:49.935937 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-d79pv\"" Jul 15 04:14:49.953540 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:14:49.953507 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-fmrht"] Jul 15 04:14:50.006402 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:14:50.006363 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/8c89d532-e8af-4f99-9870-8a9dd83e2cfb-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-fmrht\" (UID: \"8c89d532-e8af-4f99-9870-8a9dd83e2cfb\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-fmrht" Jul 15 04:14:50.006402 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:14:50.006400 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ll8rs\" (UniqueName: \"kubernetes.io/projected/8c89d532-e8af-4f99-9870-8a9dd83e2cfb-kube-api-access-ll8rs\") pod \"kuadrant-operator-controller-manager-8684c9ff49-fmrht\" (UID: \"8c89d532-e8af-4f99-9870-8a9dd83e2cfb\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-fmrht" Jul 15 04:14:50.107111 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:14:50.107072 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/8c89d532-e8af-4f99-9870-8a9dd83e2cfb-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-fmrht\" (UID: \"8c89d532-e8af-4f99-9870-8a9dd83e2cfb\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-fmrht" Jul 15 04:14:50.107111 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:14:50.107112 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ll8rs\" (UniqueName: \"kubernetes.io/projected/8c89d532-e8af-4f99-9870-8a9dd83e2cfb-kube-api-access-ll8rs\") pod \"kuadrant-operator-controller-manager-8684c9ff49-fmrht\" (UID: \"8c89d532-e8af-4f99-9870-8a9dd83e2cfb\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-fmrht" Jul 15 04:14:50.107476 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:14:50.107455 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/8c89d532-e8af-4f99-9870-8a9dd83e2cfb-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-fmrht\" (UID: \"8c89d532-e8af-4f99-9870-8a9dd83e2cfb\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-fmrht" Jul 15 04:14:50.115719 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:14:50.115690 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ll8rs\" (UniqueName: \"kubernetes.io/projected/8c89d532-e8af-4f99-9870-8a9dd83e2cfb-kube-api-access-ll8rs\") pod \"kuadrant-operator-controller-manager-8684c9ff49-fmrht\" (UID: \"8c89d532-e8af-4f99-9870-8a9dd83e2cfb\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-fmrht" Jul 15 04:14:50.243159 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:14:50.243109 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-fmrht" Jul 15 04:14:50.387336 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:14:50.387311 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-fmrht"] Jul 15 04:14:50.389328 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:14:50.389293 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8c89d532_e8af_4f99_9870_8a9dd83e2cfb.slice/crio-4b1da6d4f847ed250db6ce1c0b9ab5205df74cbb4e001c43e5791dc5dba6562c WatchSource:0}: Error finding container 4b1da6d4f847ed250db6ce1c0b9ab5205df74cbb4e001c43e5791dc5dba6562c: Status 404 returned error can't find the container with id 4b1da6d4f847ed250db6ce1c0b9ab5205df74cbb4e001c43e5791dc5dba6562c Jul 15 04:14:50.671585 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:14:50.671553 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-fmrht" event={"ID":"8c89d532-e8af-4f99-9870-8a9dd83e2cfb","Type":"ContainerStarted","Data":"4b1da6d4f847ed250db6ce1c0b9ab5205df74cbb4e001c43e5791dc5dba6562c"} Jul 15 04:14:51.092303 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:14:51.092208 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:14:51.192337 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:14:51.192304 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:14:51.613428 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:14:51.613401 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-lcppc" Jul 15 04:14:56.481192 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:14:56.481151 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:14:56.581140 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:14:56.581092 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:14:56.647908 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:14:56.647879 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-sjs8b" Jul 15 04:14:56.880088 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:14:56.880058 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:14:56.980501 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:14:56.980471 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:14:57.716563 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:14:57.716530 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-fmrht" event={"ID":"8c89d532-e8af-4f99-9870-8a9dd83e2cfb","Type":"ContainerStarted","Data":"27d5f4836e964e051a8fc0d05788a67b48cc14bf33480fd7f53ea38da1f1ca5d"} Jul 15 04:14:57.716952 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:14:57.716666 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-fmrht" Jul 15 04:14:57.740369 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:14:57.740314 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-fmrht" podStartSLOduration=2.234440637 podStartE2EDuration="8.740292009s" totalImagesPullingTime="6.505851372s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 04:14:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 04:14:57.738818247 +0000 UTC m=+531.265619262" watchObservedRunningTime="2026-07-15 04:14:57.740292009 +0000 UTC m=+531.267093042" Jul 15 04:14:59.666782 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:14:59.666692 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-5rfbz" Jul 15 04:14:59.773814 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:14:59.773784 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:14:59.888003 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:14:59.887973 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:15:00.000716 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:15:00.000631 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:15:04.026387 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:15:04.026350 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:15:04.126579 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:15:04.126544 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:15:08.725596 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:15:08.725568 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-fmrht" Jul 15 04:15:10.603501 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:15:10.603467 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-fmrht"] Jul 15 04:15:10.603930 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:15:10.603643 2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-fmrht" podUID="8c89d532-e8af-4f99-9870-8a9dd83e2cfb" containerName="manager" containerID="cri-o://27d5f4836e964e051a8fc0d05788a67b48cc14bf33480fd7f53ea38da1f1ca5d" gracePeriod=2 Jul 15 04:15:10.616408 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:15:10.616367 2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-fmrht"] Jul 15 04:15:10.616824 ip-10-0-128-222 kubenswrapper[2581]: E0715 04:15:10.616780 2581 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"8c89d532-e8af-4f99-9870-8a9dd83e2cfb\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Initialized\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Ready\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"observedGeneration\\\":2}}\" for pod \"kuadrant-system\"/\"kuadrant-operator-controller-manager-8684c9ff49-fmrht\": pods \"kuadrant-operator-controller-manager-8684c9ff49-fmrht\" not found" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-fmrht" Jul 15 04:15:10.619520 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:15:10.619498 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-bs52c"] Jul 15 04:15:10.619911 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:15:10.619899 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8c89d532-e8af-4f99-9870-8a9dd83e2cfb" containerName="manager" Jul 15 04:15:10.619954 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:15:10.619912 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="8c89d532-e8af-4f99-9870-8a9dd83e2cfb" containerName="manager" Jul 15 04:15:10.620003 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:15:10.619994 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="8c89d532-e8af-4f99-9870-8a9dd83e2cfb" containerName="manager" Jul 15 04:15:10.624355 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:15:10.624334 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-bs52c" Jul 15 04:15:10.626902 ip-10-0-128-222 kubenswrapper[2581]: E0715 04:15:10.626875 2581 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-fmrht\" is forbidden: User \"system:node:ip-10-0-128-222.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-222.ec2.internal' and this object" podUID="8c89d532-e8af-4f99-9870-8a9dd83e2cfb" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-fmrht" Jul 15 04:15:10.629008 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:15:10.628981 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-lcppc"] Jul 15 04:15:10.629233 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:15:10.629191 2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-lcppc" podUID="dcea570b-dd39-4ea5-ba7f-744b6344c4ed" containerName="manager" containerID="cri-o://ecbbf04203de5bd54757894f16e6f2a4d0710f6091f8db7ec939763bce8064ee" gracePeriod=2 Jul 15 04:15:10.638468 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:15:10.638440 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-nm5b6"] Jul 15 04:15:10.644986 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:15:10.644945 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-bs52c"] Jul 15 04:15:10.645156 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:15:10.645072 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-nm5b6" Jul 15 04:15:10.645506 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:15:10.645483 2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-lcppc"] Jul 15 04:15:10.663341 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:15:10.663297 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-nm5b6"] Jul 15 04:15:10.667477 ip-10-0-128-222 kubenswrapper[2581]: E0715 04:15:10.667434 2581 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-fmrht\" is forbidden: User \"system:node:ip-10-0-128-222.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-222.ec2.internal' and this object" podUID="8c89d532-e8af-4f99-9870-8a9dd83e2cfb" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-fmrht" Jul 15 04:15:10.673015 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:15:10.672990 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vmfcs"] Jul 15 04:15:10.673735 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:15:10.673667 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dcea570b-dd39-4ea5-ba7f-744b6344c4ed" containerName="manager" Jul 15 04:15:10.673735 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:15:10.673684 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="dcea570b-dd39-4ea5-ba7f-744b6344c4ed" containerName="manager" Jul 15 04:15:10.673852 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:15:10.673791 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="dcea570b-dd39-4ea5-ba7f-744b6344c4ed" containerName="manager" Jul 15 04:15:10.677329 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:15:10.677296 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vmfcs" Jul 15 04:15:10.691140 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:15:10.691101 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7gxp7\" (UniqueName: \"kubernetes.io/projected/eea7ea07-ad33-446b-bd74-b675749f6c9d-kube-api-access-7gxp7\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-bs52c\" (UID: \"eea7ea07-ad33-446b-bd74-b675749f6c9d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-bs52c" Jul 15 04:15:10.691271 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:15:10.691183 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ede579f2-417a-41e4-a08c-72ca1b50f003-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-nm5b6\" (UID: \"ede579f2-417a-41e4-a08c-72ca1b50f003\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-nm5b6" Jul 15 04:15:10.691271 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:15:10.691233 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/eea7ea07-ad33-446b-bd74-b675749f6c9d-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-bs52c\" (UID: \"eea7ea07-ad33-446b-bd74-b675749f6c9d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-bs52c" Jul 15 04:15:10.691386 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:15:10.691311 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-82kwn\" (UniqueName: \"kubernetes.io/projected/ede579f2-417a-41e4-a08c-72ca1b50f003-kube-api-access-82kwn\") pod \"kuadrant-operator-controller-manager-8684c9ff49-nm5b6\" (UID: \"ede579f2-417a-41e4-a08c-72ca1b50f003\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-nm5b6" Jul 15 04:15:10.694578 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:15:10.694553 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vmfcs"] Jul 15 04:15:10.694873 ip-10-0-128-222 kubenswrapper[2581]: E0715 04:15:10.694841 2581 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-lcppc\" is forbidden: User \"system:node:ip-10-0-128-222.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-222.ec2.internal' and this object" podUID="dcea570b-dd39-4ea5-ba7f-744b6344c4ed" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-lcppc" Jul 15 04:15:10.696678 ip-10-0-128-222 kubenswrapper[2581]: E0715 04:15:10.696646 2581 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-lcppc\" is forbidden: User \"system:node:ip-10-0-128-222.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-222.ec2.internal' and this object" podUID="dcea570b-dd39-4ea5-ba7f-744b6344c4ed" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-lcppc" Jul 15 04:15:10.708575 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:15:10.708550 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:15:10.717420 ip-10-0-128-222 kubenswrapper[2581]: E0715 04:15:10.717390 2581 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-fmrht\" is forbidden: User \"system:node:ip-10-0-128-222.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-222.ec2.internal' and this object" podUID="8c89d532-e8af-4f99-9870-8a9dd83e2cfb" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-fmrht" Jul 15 04:15:10.792947 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:15:10.792907 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7gxp7\" (UniqueName: \"kubernetes.io/projected/eea7ea07-ad33-446b-bd74-b675749f6c9d-kube-api-access-7gxp7\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-bs52c\" (UID: \"eea7ea07-ad33-446b-bd74-b675749f6c9d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-bs52c" Jul 15 04:15:10.793152 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:15:10.792954 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ede579f2-417a-41e4-a08c-72ca1b50f003-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-nm5b6\" (UID: \"ede579f2-417a-41e4-a08c-72ca1b50f003\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-nm5b6" Jul 15 04:15:10.793152 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:15:10.793006 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/eea7ea07-ad33-446b-bd74-b675749f6c9d-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-bs52c\" (UID: \"eea7ea07-ad33-446b-bd74-b675749f6c9d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-bs52c" Jul 15 04:15:10.793152 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:15:10.793043 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dsxsg\" (UniqueName: \"kubernetes.io/projected/2a600a19-ed24-4ac6-8d6d-8bb10876188e-kube-api-access-dsxsg\") pod \"limitador-operator-controller-manager-859d7b78bd-vmfcs\" (UID: \"2a600a19-ed24-4ac6-8d6d-8bb10876188e\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vmfcs" Jul 15 04:15:10.793345 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:15:10.793182 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-82kwn\" (UniqueName: \"kubernetes.io/projected/ede579f2-417a-41e4-a08c-72ca1b50f003-kube-api-access-82kwn\") pod \"kuadrant-operator-controller-manager-8684c9ff49-nm5b6\" (UID: \"ede579f2-417a-41e4-a08c-72ca1b50f003\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-nm5b6" Jul 15 04:15:10.793500 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:15:10.793480 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/eea7ea07-ad33-446b-bd74-b675749f6c9d-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-bs52c\" (UID: \"eea7ea07-ad33-446b-bd74-b675749f6c9d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-bs52c" Jul 15 04:15:10.793571 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:15:10.793546 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ede579f2-417a-41e4-a08c-72ca1b50f003-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-nm5b6\" (UID: \"ede579f2-417a-41e4-a08c-72ca1b50f003\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-nm5b6" Jul 15 04:15:10.795571 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:15:10.795548 2581 generic.go:356] "Generic (PLEG): container finished" podID="dcea570b-dd39-4ea5-ba7f-744b6344c4ed" containerID="ecbbf04203de5bd54757894f16e6f2a4d0710f6091f8db7ec939763bce8064ee" exitCode=0 Jul 15 04:15:10.798396 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:15:10.798358 2581 generic.go:356] "Generic (PLEG): container finished" podID="8c89d532-e8af-4f99-9870-8a9dd83e2cfb" containerID="27d5f4836e964e051a8fc0d05788a67b48cc14bf33480fd7f53ea38da1f1ca5d" exitCode=0 Jul 15 04:15:10.805035 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:15:10.804925 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7gxp7\" (UniqueName: \"kubernetes.io/projected/eea7ea07-ad33-446b-bd74-b675749f6c9d-kube-api-access-7gxp7\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-bs52c\" (UID: \"eea7ea07-ad33-446b-bd74-b675749f6c9d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-bs52c" Jul 15 04:15:10.805988 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:15:10.805951 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-82kwn\" (UniqueName: \"kubernetes.io/projected/ede579f2-417a-41e4-a08c-72ca1b50f003-kube-api-access-82kwn\") pod \"kuadrant-operator-controller-manager-8684c9ff49-nm5b6\" (UID: \"ede579f2-417a-41e4-a08c-72ca1b50f003\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-nm5b6" Jul 15 04:15:10.814384 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:15:10.814348 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:15:10.875373 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:15:10.875349 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-fmrht" Jul 15 04:15:10.877392 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:15:10.877374 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-lcppc" Jul 15 04:15:10.877459 ip-10-0-128-222 kubenswrapper[2581]: E0715 04:15:10.877372 2581 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-fmrht\" is forbidden: User \"system:node:ip-10-0-128-222.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-222.ec2.internal' and this object" podUID="8c89d532-e8af-4f99-9870-8a9dd83e2cfb" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-fmrht" Jul 15 04:15:10.878923 ip-10-0-128-222 kubenswrapper[2581]: E0715 04:15:10.878900 2581 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-lcppc\" is forbidden: User \"system:node:ip-10-0-128-222.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-222.ec2.internal' and this object" podUID="dcea570b-dd39-4ea5-ba7f-744b6344c4ed" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-lcppc" Jul 15 04:15:10.880519 ip-10-0-128-222 kubenswrapper[2581]: E0715 04:15:10.880498 2581 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-lcppc\" is forbidden: User \"system:node:ip-10-0-128-222.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-222.ec2.internal' and this object" podUID="dcea570b-dd39-4ea5-ba7f-744b6344c4ed" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-lcppc" Jul 15 04:15:10.881954 ip-10-0-128-222 kubenswrapper[2581]: E0715 04:15:10.881935 2581 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-fmrht\" is forbidden: User \"system:node:ip-10-0-128-222.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-222.ec2.internal' and this object" podUID="8c89d532-e8af-4f99-9870-8a9dd83e2cfb" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-fmrht" Jul 15 04:15:10.894532 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:15:10.894504 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dsxsg\" (UniqueName: \"kubernetes.io/projected/2a600a19-ed24-4ac6-8d6d-8bb10876188e-kube-api-access-dsxsg\") pod \"limitador-operator-controller-manager-859d7b78bd-vmfcs\" (UID: \"2a600a19-ed24-4ac6-8d6d-8bb10876188e\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vmfcs" Jul 15 04:15:10.911837 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:15:10.911775 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:15:10.912220 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:15:10.912204 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dsxsg\" (UniqueName: \"kubernetes.io/projected/2a600a19-ed24-4ac6-8d6d-8bb10876188e-kube-api-access-dsxsg\") pod \"limitador-operator-controller-manager-859d7b78bd-vmfcs\" (UID: \"2a600a19-ed24-4ac6-8d6d-8bb10876188e\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vmfcs" Jul 15 04:15:10.995008 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:15:10.994984 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ll8rs\" (UniqueName: \"kubernetes.io/projected/8c89d532-e8af-4f99-9870-8a9dd83e2cfb-kube-api-access-ll8rs\") pod \"8c89d532-e8af-4f99-9870-8a9dd83e2cfb\" (UID: \"8c89d532-e8af-4f99-9870-8a9dd83e2cfb\") " Jul 15 04:15:10.995171 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:15:10.995080 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tqzkl\" (UniqueName: \"kubernetes.io/projected/dcea570b-dd39-4ea5-ba7f-744b6344c4ed-kube-api-access-tqzkl\") pod \"dcea570b-dd39-4ea5-ba7f-744b6344c4ed\" (UID: \"dcea570b-dd39-4ea5-ba7f-744b6344c4ed\") " Jul 15 04:15:10.995171 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:15:10.995116 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/8c89d532-e8af-4f99-9870-8a9dd83e2cfb-extensions-socket-volume\") pod \"8c89d532-e8af-4f99-9870-8a9dd83e2cfb\" (UID: \"8c89d532-e8af-4f99-9870-8a9dd83e2cfb\") " Jul 15 04:15:10.995539 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:15:10.995515 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8c89d532-e8af-4f99-9870-8a9dd83e2cfb-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "8c89d532-e8af-4f99-9870-8a9dd83e2cfb" (UID: "8c89d532-e8af-4f99-9870-8a9dd83e2cfb"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 04:15:10.997240 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:15:10.997218 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dcea570b-dd39-4ea5-ba7f-744b6344c4ed-kube-api-access-tqzkl" (OuterVolumeSpecName: "kube-api-access-tqzkl") pod "dcea570b-dd39-4ea5-ba7f-744b6344c4ed" (UID: "dcea570b-dd39-4ea5-ba7f-744b6344c4ed"). InnerVolumeSpecName "kube-api-access-tqzkl". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 15 04:15:10.997240 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:15:10.997232 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8c89d532-e8af-4f99-9870-8a9dd83e2cfb-kube-api-access-ll8rs" (OuterVolumeSpecName: "kube-api-access-ll8rs") pod "8c89d532-e8af-4f99-9870-8a9dd83e2cfb" (UID: "8c89d532-e8af-4f99-9870-8a9dd83e2cfb"). InnerVolumeSpecName "kube-api-access-ll8rs". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 15 04:15:11.018600 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:15:11.018561 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:15:11.029576 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:15:11.029547 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-bs52c" Jul 15 04:15:11.038623 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:15:11.038599 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-nm5b6" Jul 15 04:15:11.045603 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:15:11.045576 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vmfcs" Jul 15 04:15:11.097316 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:15:11.096496 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tqzkl\" (UniqueName: \"kubernetes.io/projected/dcea570b-dd39-4ea5-ba7f-744b6344c4ed-kube-api-access-tqzkl\") on node \"ip-10-0-128-222.ec2.internal\" DevicePath \"\"" Jul 15 04:15:11.097316 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:15:11.096529 2581 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/8c89d532-e8af-4f99-9870-8a9dd83e2cfb-extensions-socket-volume\") on node \"ip-10-0-128-222.ec2.internal\" DevicePath \"\"" Jul 15 04:15:11.097316 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:15:11.096545 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ll8rs\" (UniqueName: \"kubernetes.io/projected/8c89d532-e8af-4f99-9870-8a9dd83e2cfb-kube-api-access-ll8rs\") on node \"ip-10-0-128-222.ec2.internal\" DevicePath \"\"" Jul 15 04:15:11.205716 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:15:11.205688 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-bs52c"] Jul 15 04:15:11.208236 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:15:11.208206 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeea7ea07_ad33_446b_bd74_b675749f6c9d.slice/crio-030f6a7a246b2186d3a062d14abdf81c55cfdd9668491f56c650f2f89a277065 WatchSource:0}: Error finding container 030f6a7a246b2186d3a062d14abdf81c55cfdd9668491f56c650f2f89a277065: Status 404 returned error can't find the container with id 030f6a7a246b2186d3a062d14abdf81c55cfdd9668491f56c650f2f89a277065 Jul 15 04:15:11.225199 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:15:11.225172 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podede579f2_417a_41e4_a08c_72ca1b50f003.slice/crio-218e54e8d14d20239ae5c0cbae5f5eb14baf0059bc8c0ebe5330a8f25668a391 WatchSource:0}: Error finding container 218e54e8d14d20239ae5c0cbae5f5eb14baf0059bc8c0ebe5330a8f25668a391: Status 404 returned error can't find the container with id 218e54e8d14d20239ae5c0cbae5f5eb14baf0059bc8c0ebe5330a8f25668a391 Jul 15 04:15:11.226020 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:15:11.225993 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-nm5b6"] Jul 15 04:15:11.246398 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:15:11.246375 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vmfcs"] Jul 15 04:15:11.247549 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:15:11.247523 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2a600a19_ed24_4ac6_8d6d_8bb10876188e.slice/crio-a46d344a1f2319505ad55fec0a5c401c91dfd201c4bd117a7a7a76840e4c415c WatchSource:0}: Error finding container a46d344a1f2319505ad55fec0a5c401c91dfd201c4bd117a7a7a76840e4c415c: Status 404 returned error can't find the container with id a46d344a1f2319505ad55fec0a5c401c91dfd201c4bd117a7a7a76840e4c415c Jul 15 04:15:11.811781 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:15:11.811745 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-nm5b6" event={"ID":"ede579f2-417a-41e4-a08c-72ca1b50f003","Type":"ContainerStarted","Data":"adcbec10e5ef2612704461e77a8793829afb3372c805ad3fd8e302e880676d2d"} Jul 15 04:15:11.812310 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:15:11.811837 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-nm5b6" event={"ID":"ede579f2-417a-41e4-a08c-72ca1b50f003","Type":"ContainerStarted","Data":"218e54e8d14d20239ae5c0cbae5f5eb14baf0059bc8c0ebe5330a8f25668a391"} Jul 15 04:15:11.812310 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:15:11.811872 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-nm5b6" Jul 15 04:15:11.813249 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:15:11.813231 2581 scope.go:117] "RemoveContainer" containerID="ecbbf04203de5bd54757894f16e6f2a4d0710f6091f8db7ec939763bce8064ee" Jul 15 04:15:11.813330 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:15:11.813231 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-lcppc" Jul 15 04:15:11.815043 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:15:11.815015 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-bs52c" event={"ID":"eea7ea07-ad33-446b-bd74-b675749f6c9d","Type":"ContainerStarted","Data":"e962491a6aa1f0d3ec700912d9b00a53bed37462597b366cb12129b7ab286694"} Jul 15 04:15:11.815196 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:15:11.815074 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-bs52c" Jul 15 04:15:11.815196 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:15:11.815103 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-bs52c" event={"ID":"eea7ea07-ad33-446b-bd74-b675749f6c9d","Type":"ContainerStarted","Data":"030f6a7a246b2186d3a062d14abdf81c55cfdd9668491f56c650f2f89a277065"} Jul 15 04:15:11.816520 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:15:11.816493 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-fmrht" Jul 15 04:15:11.818198 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:15:11.818175 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vmfcs" event={"ID":"2a600a19-ed24-4ac6-8d6d-8bb10876188e","Type":"ContainerStarted","Data":"d64af96ac850dec9cec10fe9bc17d94b4b71ad61f61c5e0f612812cd797809c1"} Jul 15 04:15:11.818300 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:15:11.818217 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vmfcs" event={"ID":"2a600a19-ed24-4ac6-8d6d-8bb10876188e","Type":"ContainerStarted","Data":"a46d344a1f2319505ad55fec0a5c401c91dfd201c4bd117a7a7a76840e4c415c"} Jul 15 04:15:11.818300 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:15:11.818260 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vmfcs" Jul 15 04:15:11.824640 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:15:11.824576 2581 scope.go:117] "RemoveContainer" containerID="27d5f4836e964e051a8fc0d05788a67b48cc14bf33480fd7f53ea38da1f1ca5d" Jul 15 04:15:11.830411 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:15:11.830352 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-nm5b6" podStartSLOduration=1.830338282 podStartE2EDuration="1.830338282s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 04:15:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 04:15:11.828758424 +0000 UTC m=+545.355559439" watchObservedRunningTime="2026-07-15 04:15:11.830338282 +0000 UTC m=+545.357139364" Jul 15 04:15:11.847326 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:15:11.847281 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vmfcs" podStartSLOduration=1.847254685 podStartE2EDuration="1.847254685s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 04:15:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 04:15:11.845647156 +0000 UTC m=+545.372448185" watchObservedRunningTime="2026-07-15 04:15:11.847254685 +0000 UTC m=+545.374055699" Jul 15 04:15:11.867621 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:15:11.867573 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-bs52c" podStartSLOduration=1.8675588250000001 podStartE2EDuration="1.867558825s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 04:15:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 04:15:11.865500449 +0000 UTC m=+545.392301461" watchObservedRunningTime="2026-07-15 04:15:11.867558825 +0000 UTC m=+545.394359840" Jul 15 04:15:12.990176 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:15:12.990117 2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8c89d532-e8af-4f99-9870-8a9dd83e2cfb" path="/var/lib/kubelet/pods/8c89d532-e8af-4f99-9870-8a9dd83e2cfb/volumes" Jul 15 04:15:12.990664 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:15:12.990647 2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="dcea570b-dd39-4ea5-ba7f-744b6344c4ed" path="/var/lib/kubelet/pods/dcea570b-dd39-4ea5-ba7f-744b6344c4ed/volumes" Jul 15 04:15:14.448674 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:15:14.448642 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:15:14.550223 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:15:14.550193 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:15:14.650113 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:15:14.650075 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:15:14.752246 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:15:14.752159 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:15:18.251068 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:15:18.251031 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:15:18.307189 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:15:18.307156 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:15:22.807194 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:15:22.807166 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:15:22.827871 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:15:22.827842 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-nm5b6" Jul 15 04:15:22.828433 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:15:22.828378 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-bs52c" Jul 15 04:15:22.828586 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:15:22.828559 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vmfcs" Jul 15 04:15:22.895787 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:15:22.895757 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:15:22.918847 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:15:22.918735 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-nm5b6"] Jul 15 04:15:22.919037 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:15:22.918985 2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-nm5b6" podUID="ede579f2-417a-41e4-a08c-72ca1b50f003" containerName="manager" containerID="cri-o://adcbec10e5ef2612704461e77a8793829afb3372c805ad3fd8e302e880676d2d" gracePeriod=10 Jul 15 04:15:23.154448 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:15:23.154237 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-v7bb9"] Jul 15 04:15:23.162704 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:15:23.162681 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-v7bb9" Jul 15 04:15:23.176715 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:15:23.176686 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-nm5b6" Jul 15 04:15:23.196546 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:15:23.196510 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-v7bb9"] Jul 15 04:15:23.312053 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:15:23.312022 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ede579f2-417a-41e4-a08c-72ca1b50f003-extensions-socket-volume\") pod \"ede579f2-417a-41e4-a08c-72ca1b50f003\" (UID: \"ede579f2-417a-41e4-a08c-72ca1b50f003\") " Jul 15 04:15:23.312237 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:15:23.312084 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-82kwn\" (UniqueName: \"kubernetes.io/projected/ede579f2-417a-41e4-a08c-72ca1b50f003-kube-api-access-82kwn\") pod \"ede579f2-417a-41e4-a08c-72ca1b50f003\" (UID: \"ede579f2-417a-41e4-a08c-72ca1b50f003\") " Jul 15 04:15:23.312413 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:15:23.312391 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t4bp9\" (UniqueName: \"kubernetes.io/projected/6674d5ab-95cf-4aaa-8ce0-d6732dd721a9-kube-api-access-t4bp9\") pod \"kuadrant-operator-controller-manager-86878c769f-v7bb9\" (UID: \"6674d5ab-95cf-4aaa-8ce0-d6732dd721a9\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-v7bb9" Jul 15 04:15:23.312468 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:15:23.312446 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/6674d5ab-95cf-4aaa-8ce0-d6732dd721a9-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-v7bb9\" (UID: \"6674d5ab-95cf-4aaa-8ce0-d6732dd721a9\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-v7bb9" Jul 15 04:15:23.312522 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:15:23.312460 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ede579f2-417a-41e4-a08c-72ca1b50f003-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "ede579f2-417a-41e4-a08c-72ca1b50f003" (UID: "ede579f2-417a-41e4-a08c-72ca1b50f003"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 04:15:23.312590 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:15:23.312569 2581 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ede579f2-417a-41e4-a08c-72ca1b50f003-extensions-socket-volume\") on node \"ip-10-0-128-222.ec2.internal\" DevicePath \"\"" Jul 15 04:15:23.314049 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:15:23.314027 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ede579f2-417a-41e4-a08c-72ca1b50f003-kube-api-access-82kwn" (OuterVolumeSpecName: "kube-api-access-82kwn") pod "ede579f2-417a-41e4-a08c-72ca1b50f003" (UID: "ede579f2-417a-41e4-a08c-72ca1b50f003"). InnerVolumeSpecName "kube-api-access-82kwn". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 15 04:15:23.413384 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:15:23.413348 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t4bp9\" (UniqueName: \"kubernetes.io/projected/6674d5ab-95cf-4aaa-8ce0-d6732dd721a9-kube-api-access-t4bp9\") pod \"kuadrant-operator-controller-manager-86878c769f-v7bb9\" (UID: \"6674d5ab-95cf-4aaa-8ce0-d6732dd721a9\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-v7bb9" Jul 15 04:15:23.413543 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:15:23.413393 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/6674d5ab-95cf-4aaa-8ce0-d6732dd721a9-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-v7bb9\" (UID: \"6674d5ab-95cf-4aaa-8ce0-d6732dd721a9\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-v7bb9" Jul 15 04:15:23.413543 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:15:23.413474 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-82kwn\" (UniqueName: \"kubernetes.io/projected/ede579f2-417a-41e4-a08c-72ca1b50f003-kube-api-access-82kwn\") on node \"ip-10-0-128-222.ec2.internal\" DevicePath \"\"" Jul 15 04:15:23.413788 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:15:23.413772 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/6674d5ab-95cf-4aaa-8ce0-d6732dd721a9-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-v7bb9\" (UID: \"6674d5ab-95cf-4aaa-8ce0-d6732dd721a9\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-v7bb9" Jul 15 04:15:23.421739 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:15:23.421714 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t4bp9\" (UniqueName: \"kubernetes.io/projected/6674d5ab-95cf-4aaa-8ce0-d6732dd721a9-kube-api-access-t4bp9\") pod \"kuadrant-operator-controller-manager-86878c769f-v7bb9\" (UID: \"6674d5ab-95cf-4aaa-8ce0-d6732dd721a9\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-v7bb9" Jul 15 04:15:23.484562 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:15:23.484525 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-v7bb9" Jul 15 04:15:23.637798 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:15:23.637768 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-v7bb9"] Jul 15 04:15:23.639300 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:15:23.639272 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6674d5ab_95cf_4aaa_8ce0_d6732dd721a9.slice/crio-ddeebe1a5232be37388cef4e043b6ff77b324ad031cd448a07e685853a3cfc5e WatchSource:0}: Error finding container ddeebe1a5232be37388cef4e043b6ff77b324ad031cd448a07e685853a3cfc5e: Status 404 returned error can't find the container with id ddeebe1a5232be37388cef4e043b6ff77b324ad031cd448a07e685853a3cfc5e Jul 15 04:15:23.895173 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:15:23.895103 2581 generic.go:356] "Generic (PLEG): container finished" podID="ede579f2-417a-41e4-a08c-72ca1b50f003" containerID="adcbec10e5ef2612704461e77a8793829afb3372c805ad3fd8e302e880676d2d" exitCode=0 Jul 15 04:15:23.895635 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:15:23.895181 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-nm5b6" Jul 15 04:15:23.895635 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:15:23.895191 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-nm5b6" event={"ID":"ede579f2-417a-41e4-a08c-72ca1b50f003","Type":"ContainerDied","Data":"adcbec10e5ef2612704461e77a8793829afb3372c805ad3fd8e302e880676d2d"} Jul 15 04:15:23.895635 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:15:23.895250 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-nm5b6" event={"ID":"ede579f2-417a-41e4-a08c-72ca1b50f003","Type":"ContainerDied","Data":"218e54e8d14d20239ae5c0cbae5f5eb14baf0059bc8c0ebe5330a8f25668a391"} Jul 15 04:15:23.895635 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:15:23.895272 2581 scope.go:117] "RemoveContainer" containerID="adcbec10e5ef2612704461e77a8793829afb3372c805ad3fd8e302e880676d2d" Jul 15 04:15:23.896869 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:15:23.896849 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-v7bb9" event={"ID":"6674d5ab-95cf-4aaa-8ce0-d6732dd721a9","Type":"ContainerStarted","Data":"414f6a9ec3c6fad8ce0e082b1b979965bc37a01e383db22b3feee21e0f44f9fd"} Jul 15 04:15:23.896984 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:15:23.896890 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-v7bb9" event={"ID":"6674d5ab-95cf-4aaa-8ce0-d6732dd721a9","Type":"ContainerStarted","Data":"ddeebe1a5232be37388cef4e043b6ff77b324ad031cd448a07e685853a3cfc5e"} Jul 15 04:15:23.897025 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:15:23.896985 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-v7bb9" Jul 15 04:15:23.904999 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:15:23.904986 2581 scope.go:117] "RemoveContainer" containerID="adcbec10e5ef2612704461e77a8793829afb3372c805ad3fd8e302e880676d2d" Jul 15 04:15:23.905286 ip-10-0-128-222 kubenswrapper[2581]: E0715 04:15:23.905260 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"adcbec10e5ef2612704461e77a8793829afb3372c805ad3fd8e302e880676d2d\": container with ID starting with adcbec10e5ef2612704461e77a8793829afb3372c805ad3fd8e302e880676d2d not found: ID does not exist" containerID="adcbec10e5ef2612704461e77a8793829afb3372c805ad3fd8e302e880676d2d" Jul 15 04:15:23.905384 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:15:23.905292 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"adcbec10e5ef2612704461e77a8793829afb3372c805ad3fd8e302e880676d2d"} err="failed to get container status \"adcbec10e5ef2612704461e77a8793829afb3372c805ad3fd8e302e880676d2d\": rpc error: code = NotFound desc = could not find container \"adcbec10e5ef2612704461e77a8793829afb3372c805ad3fd8e302e880676d2d\": container with ID starting with adcbec10e5ef2612704461e77a8793829afb3372c805ad3fd8e302e880676d2d not found: ID does not exist" Jul 15 04:15:23.922515 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:15:23.922462 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-v7bb9" podStartSLOduration=0.922442896 podStartE2EDuration="922.442896ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 04:15:23 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 04:15:23.920907415 +0000 UTC m=+557.447708429" watchObservedRunningTime="2026-07-15 04:15:23.922442896 +0000 UTC m=+557.449243911" Jul 15 04:15:23.936446 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:15:23.936382 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-nm5b6"] Jul 15 04:15:23.945232 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:15:23.945207 2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-nm5b6"] Jul 15 04:15:24.990499 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:15:24.990470 2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ede579f2-417a-41e4-a08c-72ca1b50f003" path="/var/lib/kubelet/pods/ede579f2-417a-41e4-a08c-72ca1b50f003/volumes" Jul 15 04:15:34.906629 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:15:34.906600 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-v7bb9" Jul 15 04:15:34.956033 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:15:34.956001 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-bs52c"] Jul 15 04:15:34.956282 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:15:34.956255 2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-bs52c" podUID="eea7ea07-ad33-446b-bd74-b675749f6c9d" containerName="manager" containerID="cri-o://e962491a6aa1f0d3ec700912d9b00a53bed37462597b366cb12129b7ab286694" gracePeriod=10 Jul 15 04:15:35.210412 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:15:35.210390 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-bs52c" Jul 15 04:15:35.326448 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:15:35.326414 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/eea7ea07-ad33-446b-bd74-b675749f6c9d-extensions-socket-volume\") pod \"eea7ea07-ad33-446b-bd74-b675749f6c9d\" (UID: \"eea7ea07-ad33-446b-bd74-b675749f6c9d\") " Jul 15 04:15:35.326648 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:15:35.326498 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7gxp7\" (UniqueName: \"kubernetes.io/projected/eea7ea07-ad33-446b-bd74-b675749f6c9d-kube-api-access-7gxp7\") pod \"eea7ea07-ad33-446b-bd74-b675749f6c9d\" (UID: \"eea7ea07-ad33-446b-bd74-b675749f6c9d\") " Jul 15 04:15:35.326869 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:15:35.326843 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/eea7ea07-ad33-446b-bd74-b675749f6c9d-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "eea7ea07-ad33-446b-bd74-b675749f6c9d" (UID: "eea7ea07-ad33-446b-bd74-b675749f6c9d"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 04:15:35.328544 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:15:35.328520 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/eea7ea07-ad33-446b-bd74-b675749f6c9d-kube-api-access-7gxp7" (OuterVolumeSpecName: "kube-api-access-7gxp7") pod "eea7ea07-ad33-446b-bd74-b675749f6c9d" (UID: "eea7ea07-ad33-446b-bd74-b675749f6c9d"). InnerVolumeSpecName "kube-api-access-7gxp7". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 15 04:15:35.427874 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:15:35.427839 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7gxp7\" (UniqueName: \"kubernetes.io/projected/eea7ea07-ad33-446b-bd74-b675749f6c9d-kube-api-access-7gxp7\") on node \"ip-10-0-128-222.ec2.internal\" DevicePath \"\"" Jul 15 04:15:35.427874 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:15:35.427866 2581 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/eea7ea07-ad33-446b-bd74-b675749f6c9d-extensions-socket-volume\") on node \"ip-10-0-128-222.ec2.internal\" DevicePath \"\"" Jul 15 04:15:35.979196 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:15:35.979152 2581 generic.go:356] "Generic (PLEG): container finished" podID="eea7ea07-ad33-446b-bd74-b675749f6c9d" containerID="e962491a6aa1f0d3ec700912d9b00a53bed37462597b366cb12129b7ab286694" exitCode=0 Jul 15 04:15:35.979196 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:15:35.979189 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-bs52c" Jul 15 04:15:35.979654 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:15:35.979231 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-bs52c" event={"ID":"eea7ea07-ad33-446b-bd74-b675749f6c9d","Type":"ContainerDied","Data":"e962491a6aa1f0d3ec700912d9b00a53bed37462597b366cb12129b7ab286694"} Jul 15 04:15:35.979654 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:15:35.979283 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-bs52c" event={"ID":"eea7ea07-ad33-446b-bd74-b675749f6c9d","Type":"ContainerDied","Data":"030f6a7a246b2186d3a062d14abdf81c55cfdd9668491f56c650f2f89a277065"} Jul 15 04:15:35.979654 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:15:35.979308 2581 scope.go:117] "RemoveContainer" containerID="e962491a6aa1f0d3ec700912d9b00a53bed37462597b366cb12129b7ab286694" Jul 15 04:15:35.991302 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:15:35.991281 2581 scope.go:117] "RemoveContainer" containerID="e962491a6aa1f0d3ec700912d9b00a53bed37462597b366cb12129b7ab286694" Jul 15 04:15:35.991923 ip-10-0-128-222 kubenswrapper[2581]: E0715 04:15:35.991897 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e962491a6aa1f0d3ec700912d9b00a53bed37462597b366cb12129b7ab286694\": container with ID starting with e962491a6aa1f0d3ec700912d9b00a53bed37462597b366cb12129b7ab286694 not found: ID does not exist" containerID="e962491a6aa1f0d3ec700912d9b00a53bed37462597b366cb12129b7ab286694" Jul 15 04:15:35.992027 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:15:35.991934 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e962491a6aa1f0d3ec700912d9b00a53bed37462597b366cb12129b7ab286694"} err="failed to get container status \"e962491a6aa1f0d3ec700912d9b00a53bed37462597b366cb12129b7ab286694\": rpc error: code = NotFound desc = could not find container \"e962491a6aa1f0d3ec700912d9b00a53bed37462597b366cb12129b7ab286694\": container with ID starting with e962491a6aa1f0d3ec700912d9b00a53bed37462597b366cb12129b7ab286694 not found: ID does not exist" Jul 15 04:15:36.006657 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:15:36.006631 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-bs52c"] Jul 15 04:15:36.012800 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:15:36.012776 2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-bs52c"] Jul 15 04:15:36.990454 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:15:36.990421 2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="eea7ea07-ad33-446b-bd74-b675749f6c9d" path="/var/lib/kubelet/pods/eea7ea07-ad33-446b-bd74-b675749f6c9d/volumes" Jul 15 04:15:39.426580 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:15:39.426542 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-mwc8f"] Jul 15 04:15:39.427062 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:15:39.427046 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="eea7ea07-ad33-446b-bd74-b675749f6c9d" containerName="manager" Jul 15 04:15:39.427062 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:15:39.427060 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="eea7ea07-ad33-446b-bd74-b675749f6c9d" containerName="manager" Jul 15 04:15:39.427206 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:15:39.427082 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ede579f2-417a-41e4-a08c-72ca1b50f003" containerName="manager" Jul 15 04:15:39.427206 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:15:39.427088 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="ede579f2-417a-41e4-a08c-72ca1b50f003" containerName="manager" Jul 15 04:15:39.427206 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:15:39.427185 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="ede579f2-417a-41e4-a08c-72ca1b50f003" containerName="manager" Jul 15 04:15:39.427206 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:15:39.427197 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="eea7ea07-ad33-446b-bd74-b675749f6c9d" containerName="manager" Jul 15 04:15:39.430088 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:15:39.430064 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-mwc8f" Jul 15 04:15:39.432387 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:15:39.432371 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-rgnsx\"" Jul 15 04:15:39.442512 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:15:39.442489 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-mwc8f"] Jul 15 04:15:39.454494 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:15:39.454470 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:15:39.466807 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:15:39.466778 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5q9qf\" (UniqueName: \"kubernetes.io/projected/8b83a502-4967-479d-b3e6-dbdffd64638a-kube-api-access-5q9qf\") pod \"maas-default-gateway-openshift-default-56654dcf7-mwc8f\" (UID: \"8b83a502-4967-479d-b3e6-dbdffd64638a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-mwc8f" Jul 15 04:15:39.466945 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:15:39.466819 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8b83a502-4967-479d-b3e6-dbdffd64638a-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-mwc8f\" (UID: \"8b83a502-4967-479d-b3e6-dbdffd64638a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-mwc8f" Jul 15 04:15:39.466945 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:15:39.466862 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8b83a502-4967-479d-b3e6-dbdffd64638a-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-mwc8f\" (UID: \"8b83a502-4967-479d-b3e6-dbdffd64638a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-mwc8f" Jul 15 04:15:39.466945 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:15:39.466894 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8b83a502-4967-479d-b3e6-dbdffd64638a-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-mwc8f\" (UID: \"8b83a502-4967-479d-b3e6-dbdffd64638a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-mwc8f" Jul 15 04:15:39.466945 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:15:39.466928 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8b83a502-4967-479d-b3e6-dbdffd64638a-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-mwc8f\" (UID: \"8b83a502-4967-479d-b3e6-dbdffd64638a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-mwc8f" Jul 15 04:15:39.467095 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:15:39.466954 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8b83a502-4967-479d-b3e6-dbdffd64638a-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-mwc8f\" (UID: \"8b83a502-4967-479d-b3e6-dbdffd64638a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-mwc8f" Jul 15 04:15:39.467095 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:15:39.467022 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8b83a502-4967-479d-b3e6-dbdffd64638a-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-mwc8f\" (UID: \"8b83a502-4967-479d-b3e6-dbdffd64638a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-mwc8f" Jul 15 04:15:39.467095 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:15:39.467038 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8b83a502-4967-479d-b3e6-dbdffd64638a-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-mwc8f\" (UID: \"8b83a502-4967-479d-b3e6-dbdffd64638a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-mwc8f" Jul 15 04:15:39.467095 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:15:39.467061 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8b83a502-4967-479d-b3e6-dbdffd64638a-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-mwc8f\" (UID: \"8b83a502-4967-479d-b3e6-dbdffd64638a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-mwc8f" Jul 15 04:15:39.567563 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:15:39.567525 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5q9qf\" (UniqueName: \"kubernetes.io/projected/8b83a502-4967-479d-b3e6-dbdffd64638a-kube-api-access-5q9qf\") pod \"maas-default-gateway-openshift-default-56654dcf7-mwc8f\" (UID: \"8b83a502-4967-479d-b3e6-dbdffd64638a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-mwc8f" Jul 15 04:15:39.567563 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:15:39.567570 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8b83a502-4967-479d-b3e6-dbdffd64638a-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-mwc8f\" (UID: \"8b83a502-4967-479d-b3e6-dbdffd64638a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-mwc8f" Jul 15 04:15:39.567830 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:15:39.567596 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8b83a502-4967-479d-b3e6-dbdffd64638a-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-mwc8f\" (UID: \"8b83a502-4967-479d-b3e6-dbdffd64638a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-mwc8f" Jul 15 04:15:39.567830 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:15:39.567621 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8b83a502-4967-479d-b3e6-dbdffd64638a-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-mwc8f\" (UID: \"8b83a502-4967-479d-b3e6-dbdffd64638a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-mwc8f" Jul 15 04:15:39.567830 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:15:39.567654 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8b83a502-4967-479d-b3e6-dbdffd64638a-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-mwc8f\" (UID: \"8b83a502-4967-479d-b3e6-dbdffd64638a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-mwc8f" Jul 15 04:15:39.567830 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:15:39.567680 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8b83a502-4967-479d-b3e6-dbdffd64638a-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-mwc8f\" (UID: \"8b83a502-4967-479d-b3e6-dbdffd64638a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-mwc8f" Jul 15 04:15:39.567830 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:15:39.567729 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8b83a502-4967-479d-b3e6-dbdffd64638a-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-mwc8f\" (UID: \"8b83a502-4967-479d-b3e6-dbdffd64638a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-mwc8f" Jul 15 04:15:39.567830 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:15:39.567774 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8b83a502-4967-479d-b3e6-dbdffd64638a-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-mwc8f\" (UID: \"8b83a502-4967-479d-b3e6-dbdffd64638a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-mwc8f" Jul 15 04:15:39.568215 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:15:39.568097 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8b83a502-4967-479d-b3e6-dbdffd64638a-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-mwc8f\" (UID: \"8b83a502-4967-479d-b3e6-dbdffd64638a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-mwc8f" Jul 15 04:15:39.568215 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:15:39.568179 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8b83a502-4967-479d-b3e6-dbdffd64638a-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-mwc8f\" (UID: \"8b83a502-4967-479d-b3e6-dbdffd64638a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-mwc8f" Jul 15 04:15:39.568301 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:15:39.568246 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8b83a502-4967-479d-b3e6-dbdffd64638a-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-mwc8f\" (UID: \"8b83a502-4967-479d-b3e6-dbdffd64638a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-mwc8f" Jul 15 04:15:39.568301 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:15:39.568075 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8b83a502-4967-479d-b3e6-dbdffd64638a-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-mwc8f\" (UID: \"8b83a502-4967-479d-b3e6-dbdffd64638a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-mwc8f" Jul 15 04:15:39.568301 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:15:39.568290 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8b83a502-4967-479d-b3e6-dbdffd64638a-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-mwc8f\" (UID: \"8b83a502-4967-479d-b3e6-dbdffd64638a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-mwc8f" Jul 15 04:15:39.568526 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:15:39.568503 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8b83a502-4967-479d-b3e6-dbdffd64638a-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-mwc8f\" (UID: \"8b83a502-4967-479d-b3e6-dbdffd64638a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-mwc8f" Jul 15 04:15:39.570178 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:15:39.570156 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8b83a502-4967-479d-b3e6-dbdffd64638a-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-mwc8f\" (UID: \"8b83a502-4967-479d-b3e6-dbdffd64638a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-mwc8f" Jul 15 04:15:39.570314 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:15:39.570297 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8b83a502-4967-479d-b3e6-dbdffd64638a-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-mwc8f\" (UID: \"8b83a502-4967-479d-b3e6-dbdffd64638a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-mwc8f" Jul 15 04:15:39.575391 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:15:39.575366 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8b83a502-4967-479d-b3e6-dbdffd64638a-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-mwc8f\" (UID: \"8b83a502-4967-479d-b3e6-dbdffd64638a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-mwc8f" Jul 15 04:15:39.575516 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:15:39.575473 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5q9qf\" (UniqueName: \"kubernetes.io/projected/8b83a502-4967-479d-b3e6-dbdffd64638a-kube-api-access-5q9qf\") pod \"maas-default-gateway-openshift-default-56654dcf7-mwc8f\" (UID: \"8b83a502-4967-479d-b3e6-dbdffd64638a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-mwc8f" Jul 15 04:15:39.741833 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:15:39.741741 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-mwc8f" Jul 15 04:15:39.887908 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:15:39.887881 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-mwc8f"] Jul 15 04:15:39.888917 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:15:39.888892 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8b83a502_4967_479d_b3e6_dbdffd64638a.slice/crio-4ede6ff52825033ac5a119399ef9e039d885c09c6da1f9d5b43f3c44fbff12b1 WatchSource:0}: Error finding container 4ede6ff52825033ac5a119399ef9e039d885c09c6da1f9d5b43f3c44fbff12b1: Status 404 returned error can't find the container with id 4ede6ff52825033ac5a119399ef9e039d885c09c6da1f9d5b43f3c44fbff12b1 Jul 15 04:15:39.891098 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:15:39.891068 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 15 04:15:39.891175 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:15:39.891149 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 15 04:15:39.891224 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:15:39.891181 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 15 04:15:39.903109 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:15:39.903081 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:15:40.007156 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:15:40.007054 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-mwc8f" event={"ID":"8b83a502-4967-479d-b3e6-dbdffd64638a","Type":"ContainerStarted","Data":"1c7e341babfa08f4754d98623a4d174ea5f69b99c56d074123043e5ba158bc9e"} Jul 15 04:15:40.007156 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:15:40.007113 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-mwc8f" event={"ID":"8b83a502-4967-479d-b3e6-dbdffd64638a","Type":"ContainerStarted","Data":"4ede6ff52825033ac5a119399ef9e039d885c09c6da1f9d5b43f3c44fbff12b1"} Jul 15 04:15:40.027878 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:15:40.027825 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-mwc8f" podStartSLOduration=1.027806779 podStartE2EDuration="1.027806779s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 04:15:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 04:15:40.025536794 +0000 UTC m=+573.552337811" watchObservedRunningTime="2026-07-15 04:15:40.027806779 +0000 UTC m=+573.554607794" Jul 15 04:15:40.742333 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:15:40.742294 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-mwc8f" Jul 15 04:15:40.747054 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:15:40.747030 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-mwc8f" Jul 15 04:15:41.012808 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:15:41.012726 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-mwc8f" Jul 15 04:15:41.013791 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:15:41.013771 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-mwc8f" Jul 15 04:15:43.480301 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:15:43.480265 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:15:43.543884 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:15:43.543855 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:15:53.981216 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:15:53.981180 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:15:54.080039 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:15:54.080009 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:15:54.180668 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:15:54.180632 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:15:54.284447 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:15:54.284369 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2txpt"] Jul 15 04:15:54.288015 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:15:54.287992 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-2txpt" Jul 15 04:15:54.290079 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:15:54.290056 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" Jul 15 04:15:54.290223 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:15:54.290082 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-qzv8h\"" Jul 15 04:15:54.295878 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:15:54.295851 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2txpt"] Jul 15 04:15:54.325040 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:15:54.325006 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2txpt"] Jul 15 04:15:54.417538 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:15:54.417510 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/65f76998-7615-4f88-b841-d97da32326b7-config-file\") pod \"limitador-limitador-54d6d988d5-2txpt\" (UID: \"65f76998-7615-4f88-b841-d97da32326b7\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-2txpt" Jul 15 04:15:54.417726 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:15:54.417569 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z9f7c\" (UniqueName: \"kubernetes.io/projected/65f76998-7615-4f88-b841-d97da32326b7-kube-api-access-z9f7c\") pod \"limitador-limitador-54d6d988d5-2txpt\" (UID: \"65f76998-7615-4f88-b841-d97da32326b7\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-2txpt" Jul 15 04:15:54.518607 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:15:54.518570 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z9f7c\" (UniqueName: \"kubernetes.io/projected/65f76998-7615-4f88-b841-d97da32326b7-kube-api-access-z9f7c\") pod \"limitador-limitador-54d6d988d5-2txpt\" (UID: \"65f76998-7615-4f88-b841-d97da32326b7\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-2txpt" Jul 15 04:15:54.518788 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:15:54.518647 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/65f76998-7615-4f88-b841-d97da32326b7-config-file\") pod \"limitador-limitador-54d6d988d5-2txpt\" (UID: \"65f76998-7615-4f88-b841-d97da32326b7\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-2txpt" Jul 15 04:15:54.519258 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:15:54.519237 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/65f76998-7615-4f88-b841-d97da32326b7-config-file\") pod \"limitador-limitador-54d6d988d5-2txpt\" (UID: \"65f76998-7615-4f88-b841-d97da32326b7\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-2txpt" Jul 15 04:15:54.525867 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:15:54.525848 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z9f7c\" (UniqueName: \"kubernetes.io/projected/65f76998-7615-4f88-b841-d97da32326b7-kube-api-access-z9f7c\") pod \"limitador-limitador-54d6d988d5-2txpt\" (UID: \"65f76998-7615-4f88-b841-d97da32326b7\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-2txpt" Jul 15 04:15:54.601064 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:15:54.600972 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-2txpt" Jul 15 04:15:54.736008 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:15:54.735981 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2txpt"] Jul 15 04:15:54.737059 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:15:54.737033 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod65f76998_7615_4f88_b841_d97da32326b7.slice/crio-760d6410b239e81f9dcbca66fb33bb80c718ceb2dc1ddcb20f84cb776b63add5 WatchSource:0}: Error finding container 760d6410b239e81f9dcbca66fb33bb80c718ceb2dc1ddcb20f84cb776b63add5: Status 404 returned error can't find the container with id 760d6410b239e81f9dcbca66fb33bb80c718ceb2dc1ddcb20f84cb776b63add5 Jul 15 04:15:54.800614 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:15:54.800569 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:15:54.878306 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:15:54.878270 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:15:55.100596 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:15:55.100557 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-2txpt" event={"ID":"65f76998-7615-4f88-b841-d97da32326b7","Type":"ContainerStarted","Data":"760d6410b239e81f9dcbca66fb33bb80c718ceb2dc1ddcb20f84cb776b63add5"} Jul 15 04:15:58.126438 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:15:58.126404 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-2txpt" event={"ID":"65f76998-7615-4f88-b841-d97da32326b7","Type":"ContainerStarted","Data":"89890f0770c7314f3cd1d8b8d2fa4508349b838672c3d288655912b3003d00a0"} Jul 15 04:15:58.126811 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:15:58.126537 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-2txpt" Jul 15 04:15:58.145541 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:15:58.145492 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-54d6d988d5-2txpt" podStartSLOduration=1.659501724 podStartE2EDuration="4.145476266s" totalImagesPullingTime="2.485974542s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 04:15:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 04:15:58.143444683 +0000 UTC m=+591.670245696" watchObservedRunningTime="2026-07-15 04:15:58.145476266 +0000 UTC m=+591.672277280" Jul 15 04:16:06.890455 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:16:06.890422 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-8kt5p_2db78c13-2384-4015-a886-14377224f4cd/console-operator/1.log" Jul 15 04:16:06.894113 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:16:06.894087 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-8kt5p_2db78c13-2384-4015-a886-14377224f4cd/console-operator/1.log" Jul 15 04:16:06.894483 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:16:06.894469 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-x6lg7_7cab18b8-43fd-46d1-a75d-6de40cbcd09a/ovn-acl-logging/0.log" Jul 15 04:16:06.897874 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:16:06.897856 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-x6lg7_7cab18b8-43fd-46d1-a75d-6de40cbcd09a/ovn-acl-logging/0.log" Jul 15 04:16:09.132817 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:16:09.132791 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-2txpt" Jul 15 04:16:12.777514 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:16:12.777477 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:16:12.877546 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:16:12.877516 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:16:13.455767 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:16:13.455730 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:16:25.540610 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:16:25.540566 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:16:26.006658 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:16:26.006625 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:16:32.534210 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:16:32.534172 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:16:33.699160 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:16:33.699106 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:16:36.038293 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:16:36.038254 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:16:36.136141 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:16:36.136099 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:17:05.093674 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:17:05.093635 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:17:07.063311 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:17:07.063255 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:17:07.161039 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:17:07.161007 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:17:07.578852 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:17:07.578821 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:17:08.045038 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:17:08.045008 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:17:08.151409 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:17:08.151359 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:17:08.241019 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:17:08.240988 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:17:08.286026 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:17:08.285998 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2txpt"] Jul 15 04:17:16.598922 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:17:16.598890 2581 generic.go:356] "Generic (PLEG): container finished" podID="8b83a502-4967-479d-b3e6-dbdffd64638a" containerID="1c7e341babfa08f4754d98623a4d174ea5f69b99c56d074123043e5ba158bc9e" exitCode=0 Jul 15 04:17:16.599368 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:17:16.598962 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-mwc8f" event={"ID":"8b83a502-4967-479d-b3e6-dbdffd64638a","Type":"ContainerDied","Data":"1c7e341babfa08f4754d98623a4d174ea5f69b99c56d074123043e5ba158bc9e"} Jul 15 04:17:16.599498 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:17:16.599481 2581 scope.go:117] "RemoveContainer" containerID="1c7e341babfa08f4754d98623a4d174ea5f69b99c56d074123043e5ba158bc9e" Jul 15 04:17:16.600678 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:17:16.600652 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 15 04:17:16.600746 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:17:16.600717 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 15 04:17:16.600782 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:17:16.600748 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 15 04:17:17.606479 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:17:17.606441 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-mwc8f" event={"ID":"8b83a502-4967-479d-b3e6-dbdffd64638a","Type":"ContainerStarted","Data":"f360ad4c90c4e8a88bc270ee5a3de48edf49555fd7282154b530eadacb808194"} Jul 15 04:17:17.742775 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:17:17.742733 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-mwc8f" Jul 15 04:17:17.742981 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:17:17.742861 2581 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-mwc8f container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.55:15021/healthz/ready\": dial tcp 10.132.0.55:15021: connect: connection refused" start-of-body= Jul 15 04:17:17.742981 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:17:17.742907 2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-mwc8f" podUID="8b83a502-4967-479d-b3e6-dbdffd64638a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.55:15021/healthz/ready\": dial tcp 10.132.0.55:15021: connect: connection refused" Jul 15 04:17:18.500457 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:17:18.500425 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:17:18.606548 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:17:18.606513 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:17:18.742937 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:17:18.742896 2581 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-mwc8f container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.55:15021/healthz/ready\": dial tcp 10.132.0.55:15021: connect: connection refused" start-of-body= Jul 15 04:17:18.743170 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:17:18.742966 2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-mwc8f" podUID="8b83a502-4967-479d-b3e6-dbdffd64638a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.55:15021/healthz/ready\": dial tcp 10.132.0.55:15021: connect: connection refused" Jul 15 04:17:19.743273 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:17:19.743228 2581 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-mwc8f container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.55:15021/healthz/ready\": dial tcp 10.132.0.55:15021: connect: connection refused" start-of-body= Jul 15 04:17:19.743777 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:17:19.743296 2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-mwc8f" podUID="8b83a502-4967-479d-b3e6-dbdffd64638a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.55:15021/healthz/ready\": dial tcp 10.132.0.55:15021: connect: connection refused" Jul 15 04:17:20.742845 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:17:20.742796 2581 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-mwc8f container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.55:15021/healthz/ready\": dial tcp 10.132.0.55:15021: connect: connection refused" start-of-body= Jul 15 04:17:20.743153 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:17:20.742894 2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-mwc8f" podUID="8b83a502-4967-479d-b3e6-dbdffd64638a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.55:15021/healthz/ready\": dial tcp 10.132.0.55:15021: connect: connection refused" Jul 15 04:17:21.746926 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:17:21.746899 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-mwc8f" Jul 15 04:17:21.747382 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:17:21.747233 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-mwc8f" Jul 15 04:17:21.747957 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:17:21.747937 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-mwc8f" Jul 15 04:17:23.639846 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:17:23.639810 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:17:26.718499 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:17:26.718462 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:17:27.188425 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:17:27.188395 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2txpt"] Jul 15 04:17:35.419314 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:17:35.419264 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:17:36.092391 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:17:36.092345 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2txpt"] Jul 15 04:17:41.209218 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:17:41.209184 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:17:42.582812 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:17:42.582773 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2txpt"] Jul 15 04:17:55.974907 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:17:55.974871 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbk2vf8"] Jul 15 04:17:55.979181 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:17:55.979160 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbk2vf8" Jul 15 04:17:55.981595 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:17:55.981568 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jul 15 04:17:55.981722 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:17:55.981601 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jul 15 04:17:55.982233 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:17:55.982212 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-wlffh\"" Jul 15 04:17:55.982389 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:17:55.982367 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\"" Jul 15 04:17:55.989749 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:17:55.989707 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbk2vf8"] Jul 15 04:17:56.005740 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:17:56.005703 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:17:56.109955 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:17:56.109921 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/39c3fba6-aa9c-4c05-8aa2-0962a43da278-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbk2vf8\" (UID: \"39c3fba6-aa9c-4c05-8aa2-0962a43da278\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbk2vf8" Jul 15 04:17:56.110160 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:17:56.109961 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/39c3fba6-aa9c-4c05-8aa2-0962a43da278-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbk2vf8\" (UID: \"39c3fba6-aa9c-4c05-8aa2-0962a43da278\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbk2vf8" Jul 15 04:17:56.110160 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:17:56.110028 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nhsvm\" (UniqueName: \"kubernetes.io/projected/39c3fba6-aa9c-4c05-8aa2-0962a43da278-kube-api-access-nhsvm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbk2vf8\" (UID: \"39c3fba6-aa9c-4c05-8aa2-0962a43da278\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbk2vf8" Jul 15 04:17:56.110160 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:17:56.110063 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/39c3fba6-aa9c-4c05-8aa2-0962a43da278-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbk2vf8\" (UID: \"39c3fba6-aa9c-4c05-8aa2-0962a43da278\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbk2vf8" Jul 15 04:17:56.110306 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:17:56.110186 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/39c3fba6-aa9c-4c05-8aa2-0962a43da278-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbk2vf8\" (UID: \"39c3fba6-aa9c-4c05-8aa2-0962a43da278\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbk2vf8" Jul 15 04:17:56.110306 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:17:56.110228 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/39c3fba6-aa9c-4c05-8aa2-0962a43da278-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbk2vf8\" (UID: \"39c3fba6-aa9c-4c05-8aa2-0962a43da278\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbk2vf8" Jul 15 04:17:56.211480 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:17:56.211443 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/39c3fba6-aa9c-4c05-8aa2-0962a43da278-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbk2vf8\" (UID: \"39c3fba6-aa9c-4c05-8aa2-0962a43da278\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbk2vf8" Jul 15 04:17:56.211667 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:17:56.211496 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/39c3fba6-aa9c-4c05-8aa2-0962a43da278-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbk2vf8\" (UID: \"39c3fba6-aa9c-4c05-8aa2-0962a43da278\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbk2vf8" Jul 15 04:17:56.211667 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:17:56.211535 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/39c3fba6-aa9c-4c05-8aa2-0962a43da278-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbk2vf8\" (UID: \"39c3fba6-aa9c-4c05-8aa2-0962a43da278\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbk2vf8" Jul 15 04:17:56.211667 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:17:56.211571 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/39c3fba6-aa9c-4c05-8aa2-0962a43da278-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbk2vf8\" (UID: \"39c3fba6-aa9c-4c05-8aa2-0962a43da278\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbk2vf8" Jul 15 04:17:56.211667 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:17:56.211617 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nhsvm\" (UniqueName: \"kubernetes.io/projected/39c3fba6-aa9c-4c05-8aa2-0962a43da278-kube-api-access-nhsvm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbk2vf8\" (UID: \"39c3fba6-aa9c-4c05-8aa2-0962a43da278\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbk2vf8" Jul 15 04:17:56.211876 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:17:56.211674 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/39c3fba6-aa9c-4c05-8aa2-0962a43da278-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbk2vf8\" (UID: \"39c3fba6-aa9c-4c05-8aa2-0962a43da278\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbk2vf8" Jul 15 04:17:56.212011 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:17:56.211979 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/39c3fba6-aa9c-4c05-8aa2-0962a43da278-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbk2vf8\" (UID: \"39c3fba6-aa9c-4c05-8aa2-0962a43da278\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbk2vf8" Jul 15 04:17:56.212157 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:17:56.212033 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/39c3fba6-aa9c-4c05-8aa2-0962a43da278-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbk2vf8\" (UID: \"39c3fba6-aa9c-4c05-8aa2-0962a43da278\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbk2vf8" Jul 15 04:17:56.212157 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:17:56.212069 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/39c3fba6-aa9c-4c05-8aa2-0962a43da278-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbk2vf8\" (UID: \"39c3fba6-aa9c-4c05-8aa2-0962a43da278\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbk2vf8" Jul 15 04:17:56.213777 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:17:56.213748 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/39c3fba6-aa9c-4c05-8aa2-0962a43da278-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbk2vf8\" (UID: \"39c3fba6-aa9c-4c05-8aa2-0962a43da278\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbk2vf8" Jul 15 04:17:56.214037 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:17:56.214020 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/39c3fba6-aa9c-4c05-8aa2-0962a43da278-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbk2vf8\" (UID: \"39c3fba6-aa9c-4c05-8aa2-0962a43da278\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbk2vf8" Jul 15 04:17:56.219535 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:17:56.219513 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nhsvm\" (UniqueName: \"kubernetes.io/projected/39c3fba6-aa9c-4c05-8aa2-0962a43da278-kube-api-access-nhsvm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbk2vf8\" (UID: \"39c3fba6-aa9c-4c05-8aa2-0962a43da278\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbk2vf8" Jul 15 04:17:56.291368 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:17:56.291278 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbk2vf8" Jul 15 04:17:56.433070 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:17:56.433047 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbk2vf8"] Jul 15 04:17:56.434512 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:17:56.434476 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod39c3fba6_aa9c_4c05_8aa2_0962a43da278.slice/crio-f3cf39e1bad7439df1ae89c7053ebf957318e271b0038b90ad778268b42dc83c WatchSource:0}: Error finding container f3cf39e1bad7439df1ae89c7053ebf957318e271b0038b90ad778268b42dc83c: Status 404 returned error can't find the container with id f3cf39e1bad7439df1ae89c7053ebf957318e271b0038b90ad778268b42dc83c Jul 15 04:17:56.436230 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:17:56.436213 2581 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 15 04:17:56.841623 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:17:56.841544 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbk2vf8" event={"ID":"39c3fba6-aa9c-4c05-8aa2-0962a43da278","Type":"ContainerStarted","Data":"f3cf39e1bad7439df1ae89c7053ebf957318e271b0038b90ad778268b42dc83c"} Jul 15 04:17:57.849322 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:17:57.849228 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbk2vf8" event={"ID":"39c3fba6-aa9c-4c05-8aa2-0962a43da278","Type":"ContainerStarted","Data":"77f612abb89f839cbe47939ae5e9c22cc4789144ec5c4430cefc8f67aa13855f"} Jul 15 04:17:57.869862 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:17:57.869811 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbk2vf8" podStartSLOduration=1.854452592 podStartE2EDuration="2.86979466s" totalImagesPullingTime="1.015342068s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 04:17:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 04:17:57.867158966 +0000 UTC m=+711.393959982" watchObservedRunningTime="2026-07-15 04:17:57.86979466 +0000 UTC m=+711.396595675" Jul 15 04:17:57.885462 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:17:57.885428 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2txpt"] Jul 15 04:18:06.292107 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:18:06.292004 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbk2vf8" Jul 15 04:18:06.292107 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:18:06.292083 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbk2vf8" Jul 15 04:18:06.304576 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:18:06.304543 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbk2vf8" Jul 15 04:18:06.789553 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:18:06.789515 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-5dxzh"] Jul 15 04:18:06.793332 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:18:06.793300 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-5dxzh" Jul 15 04:18:06.796141 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:18:06.796105 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\"" Jul 15 04:18:06.804371 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:18:06.804349 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-5dxzh"] Jul 15 04:18:06.876199 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:18:06.876166 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:18:06.913600 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:18:06.913572 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbk2vf8" Jul 15 04:18:06.917802 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:18:06.917779 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1dac2ac6-b47f-44d4-b745-c39fc3b4a04c-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-5dxzh\" (UID: \"1dac2ac6-b47f-44d4-b745-c39fc3b4a04c\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-5dxzh" Jul 15 04:18:06.917925 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:18:06.917814 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1dac2ac6-b47f-44d4-b745-c39fc3b4a04c-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-5dxzh\" (UID: \"1dac2ac6-b47f-44d4-b745-c39fc3b4a04c\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-5dxzh" Jul 15 04:18:06.917925 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:18:06.917853 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8vx88\" (UniqueName: \"kubernetes.io/projected/1dac2ac6-b47f-44d4-b745-c39fc3b4a04c-kube-api-access-8vx88\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-5dxzh\" (UID: \"1dac2ac6-b47f-44d4-b745-c39fc3b4a04c\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-5dxzh" Jul 15 04:18:06.917925 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:18:06.917898 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1dac2ac6-b47f-44d4-b745-c39fc3b4a04c-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-5dxzh\" (UID: \"1dac2ac6-b47f-44d4-b745-c39fc3b4a04c\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-5dxzh" Jul 15 04:18:06.918037 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:18:06.917963 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1dac2ac6-b47f-44d4-b745-c39fc3b4a04c-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-5dxzh\" (UID: \"1dac2ac6-b47f-44d4-b745-c39fc3b4a04c\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-5dxzh" Jul 15 04:18:06.918037 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:18:06.918005 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1dac2ac6-b47f-44d4-b745-c39fc3b4a04c-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-5dxzh\" (UID: \"1dac2ac6-b47f-44d4-b745-c39fc3b4a04c\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-5dxzh" Jul 15 04:18:07.019268 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:18:07.019232 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1dac2ac6-b47f-44d4-b745-c39fc3b4a04c-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-5dxzh\" (UID: \"1dac2ac6-b47f-44d4-b745-c39fc3b4a04c\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-5dxzh" Jul 15 04:18:07.019485 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:18:07.019299 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1dac2ac6-b47f-44d4-b745-c39fc3b4a04c-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-5dxzh\" (UID: \"1dac2ac6-b47f-44d4-b745-c39fc3b4a04c\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-5dxzh" Jul 15 04:18:07.019485 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:18:07.019359 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1dac2ac6-b47f-44d4-b745-c39fc3b4a04c-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-5dxzh\" (UID: \"1dac2ac6-b47f-44d4-b745-c39fc3b4a04c\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-5dxzh" Jul 15 04:18:07.019610 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:18:07.019507 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1dac2ac6-b47f-44d4-b745-c39fc3b4a04c-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-5dxzh\" (UID: \"1dac2ac6-b47f-44d4-b745-c39fc3b4a04c\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-5dxzh" Jul 15 04:18:07.019610 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:18:07.019578 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1dac2ac6-b47f-44d4-b745-c39fc3b4a04c-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-5dxzh\" (UID: \"1dac2ac6-b47f-44d4-b745-c39fc3b4a04c\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-5dxzh" Jul 15 04:18:07.019723 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:18:07.019635 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8vx88\" (UniqueName: \"kubernetes.io/projected/1dac2ac6-b47f-44d4-b745-c39fc3b4a04c-kube-api-access-8vx88\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-5dxzh\" (UID: \"1dac2ac6-b47f-44d4-b745-c39fc3b4a04c\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-5dxzh" Jul 15 04:18:07.019782 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:18:07.019720 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1dac2ac6-b47f-44d4-b745-c39fc3b4a04c-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-5dxzh\" (UID: \"1dac2ac6-b47f-44d4-b745-c39fc3b4a04c\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-5dxzh" Jul 15 04:18:07.019941 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:18:07.019912 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1dac2ac6-b47f-44d4-b745-c39fc3b4a04c-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-5dxzh\" (UID: \"1dac2ac6-b47f-44d4-b745-c39fc3b4a04c\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-5dxzh" Jul 15 04:18:07.020047 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:18:07.019969 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1dac2ac6-b47f-44d4-b745-c39fc3b4a04c-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-5dxzh\" (UID: \"1dac2ac6-b47f-44d4-b745-c39fc3b4a04c\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-5dxzh" Jul 15 04:18:07.021486 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:18:07.021463 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1dac2ac6-b47f-44d4-b745-c39fc3b4a04c-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-5dxzh\" (UID: \"1dac2ac6-b47f-44d4-b745-c39fc3b4a04c\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-5dxzh" Jul 15 04:18:07.021728 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:18:07.021713 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\"" Jul 15 04:18:07.027292 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:18:07.027269 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8vx88\" (UniqueName: \"kubernetes.io/projected/1dac2ac6-b47f-44d4-b745-c39fc3b4a04c-kube-api-access-8vx88\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-5dxzh\" (UID: \"1dac2ac6-b47f-44d4-b745-c39fc3b4a04c\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-5dxzh" Jul 15 04:18:07.032073 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:18:07.032037 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1dac2ac6-b47f-44d4-b745-c39fc3b4a04c-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-5dxzh\" (UID: \"1dac2ac6-b47f-44d4-b745-c39fc3b4a04c\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-5dxzh" Jul 15 04:18:07.104341 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:18:07.104237 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-5dxzh" Jul 15 04:18:07.256587 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:18:07.256555 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-5dxzh"] Jul 15 04:18:07.257617 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:18:07.257592 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1dac2ac6_b47f_44d4_b745_c39fc3b4a04c.slice/crio-19e60791380e2caed6e3f3198ac82315a528844ba43f377d17042d2c505de979 WatchSource:0}: Error finding container 19e60791380e2caed6e3f3198ac82315a528844ba43f377d17042d2c505de979: Status 404 returned error can't find the container with id 19e60791380e2caed6e3f3198ac82315a528844ba43f377d17042d2c505de979 Jul 15 04:18:07.910196 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:18:07.910155 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-5dxzh" event={"ID":"1dac2ac6-b47f-44d4-b745-c39fc3b4a04c","Type":"ContainerStarted","Data":"d1dbdbcc9f8613ace3d2d15c2a8c301ad3998081c408b9031f209e128fb06122"} Jul 15 04:18:07.910624 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:18:07.910224 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-5dxzh" event={"ID":"1dac2ac6-b47f-44d4-b745-c39fc3b4a04c","Type":"ContainerStarted","Data":"19e60791380e2caed6e3f3198ac82315a528844ba43f377d17042d2c505de979"} Jul 15 04:18:07.927436 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:18:07.927370 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-5dxzh" podStartSLOduration=1.745839135 podStartE2EDuration="1.927347138s" totalImagesPullingTime="181.508003ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 04:18:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 04:18:07.926005517 +0000 UTC m=+721.452806538" watchObservedRunningTime="2026-07-15 04:18:07.927347138 +0000 UTC m=+721.454148154" Jul 15 04:18:09.179078 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:18:09.179041 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2txpt"] Jul 15 04:18:16.517576 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:18:16.517542 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:18:17.104981 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:18:17.104944 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-5dxzh" Jul 15 04:18:17.105191 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:18:17.105099 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-5dxzh" Jul 15 04:18:17.118991 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:18:17.118958 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-5dxzh" Jul 15 04:18:17.981860 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:18:17.981833 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-5dxzh" Jul 15 04:18:19.685255 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:18:19.685217 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2txpt"] Jul 15 04:19:00.414805 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:19:00.414748 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:19:11.090492 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:19:11.090457 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:19:38.790739 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:19:38.790655 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:19:38.845645 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:19:38.845616 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:19:40.381597 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:19:40.381558 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:19:40.499770 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:19:40.499738 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:19:41.711089 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:19:41.711058 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:19:41.811001 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:19:41.810961 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:20:03.079197 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:20:03.079162 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:20:11.785138 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:20:11.785097 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2txpt"] Jul 15 04:20:21.778737 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:20:21.778705 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2txpt"] Jul 15 04:20:32.385814 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:20:32.385776 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2txpt"] Jul 15 04:20:42.586347 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:20:42.586311 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2txpt"] Jul 15 04:20:52.877826 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:20:52.877783 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2txpt"] Jul 15 04:20:55.626952 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:20:55.626919 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:20:57.175075 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:20:57.175025 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:21:06.934650 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:21:06.934620 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-8kt5p_2db78c13-2384-4015-a886-14377224f4cd/console-operator/1.log" Jul 15 04:21:06.935695 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:21:06.935673 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-8kt5p_2db78c13-2384-4015-a886-14377224f4cd/console-operator/1.log" Jul 15 04:21:06.938902 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:21:06.938882 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-x6lg7_7cab18b8-43fd-46d1-a75d-6de40cbcd09a/ovn-acl-logging/0.log" Jul 15 04:21:06.939850 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:21:06.939833 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-x6lg7_7cab18b8-43fd-46d1-a75d-6de40cbcd09a/ovn-acl-logging/0.log" Jul 15 04:21:33.263942 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:21:33.263907 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:21:33.366203 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:21:33.366167 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:21:33.505438 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:21:33.505400 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:21:39.354029 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:21:39.353995 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:21:40.506072 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:21:40.506036 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:21:45.545887 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:21:45.545853 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:21:45.610013 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:21:45.609980 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:22:02.414676 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:22:02.414639 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2txpt"] Jul 15 04:22:13.291376 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:22:13.291339 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2txpt"] Jul 15 04:22:23.880999 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:22:23.880963 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2txpt"] Jul 15 04:22:31.397325 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:22:31.397237 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2txpt"] Jul 15 04:22:42.477304 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:22:42.477250 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2txpt"] Jul 15 04:22:51.388669 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:22:51.388635 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2txpt"] Jul 15 04:23:03.382447 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:23:03.382397 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2txpt"] Jul 15 04:23:04.563642 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:23:04.563590 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:23:13.379452 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:23:13.379398 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2txpt"] Jul 15 04:23:39.391091 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:23:39.391053 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2txpt"] Jul 15 04:23:48.886573 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:23:48.886533 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2txpt"] Jul 15 04:24:11.576554 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:24:11.576517 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2txpt"] Jul 15 04:24:21.678442 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:24:21.678404 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2txpt"] Jul 15 04:24:40.084176 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:24:40.084139 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2txpt"] Jul 15 04:24:49.892288 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:24:49.892250 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2txpt"] Jul 15 04:24:59.689791 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:24:59.689749 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2txpt"] Jul 15 04:25:08.382182 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:25:08.382139 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2txpt"] Jul 15 04:25:18.083789 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:25:18.083751 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2txpt"] Jul 15 04:25:44.096016 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:25:44.095929 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-v7bb9"] Jul 15 04:25:44.096695 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:25:44.096165 2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-v7bb9" podUID="6674d5ab-95cf-4aaa-8ce0-d6732dd721a9" containerName="manager" containerID="cri-o://414f6a9ec3c6fad8ce0e082b1b979965bc37a01e383db22b3feee21e0f44f9fd" gracePeriod=10 Jul 15 04:25:47.459530 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:25:47.459505 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-v7bb9" Jul 15 04:25:47.534581 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:25:47.534488 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/6674d5ab-95cf-4aaa-8ce0-d6732dd721a9-extensions-socket-volume\") pod \"6674d5ab-95cf-4aaa-8ce0-d6732dd721a9\" (UID: \"6674d5ab-95cf-4aaa-8ce0-d6732dd721a9\") " Jul 15 04:25:47.534757 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:25:47.534625 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-t4bp9\" (UniqueName: \"kubernetes.io/projected/6674d5ab-95cf-4aaa-8ce0-d6732dd721a9-kube-api-access-t4bp9\") pod \"6674d5ab-95cf-4aaa-8ce0-d6732dd721a9\" (UID: \"6674d5ab-95cf-4aaa-8ce0-d6732dd721a9\") " Jul 15 04:25:47.534959 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:25:47.534934 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6674d5ab-95cf-4aaa-8ce0-d6732dd721a9-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "6674d5ab-95cf-4aaa-8ce0-d6732dd721a9" (UID: "6674d5ab-95cf-4aaa-8ce0-d6732dd721a9"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 04:25:47.535028 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:25:47.535013 2581 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/6674d5ab-95cf-4aaa-8ce0-d6732dd721a9-extensions-socket-volume\") on node \"ip-10-0-128-222.ec2.internal\" DevicePath \"\"" Jul 15 04:25:47.536600 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:25:47.536572 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6674d5ab-95cf-4aaa-8ce0-d6732dd721a9-kube-api-access-t4bp9" (OuterVolumeSpecName: "kube-api-access-t4bp9") pod "6674d5ab-95cf-4aaa-8ce0-d6732dd721a9" (UID: "6674d5ab-95cf-4aaa-8ce0-d6732dd721a9"). InnerVolumeSpecName "kube-api-access-t4bp9". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 15 04:25:47.635961 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:25:47.635926 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-t4bp9\" (UniqueName: \"kubernetes.io/projected/6674d5ab-95cf-4aaa-8ce0-d6732dd721a9-kube-api-access-t4bp9\") on node \"ip-10-0-128-222.ec2.internal\" DevicePath \"\"" Jul 15 04:25:47.715950 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:25:47.715916 2581 generic.go:356] "Generic (PLEG): container finished" podID="6674d5ab-95cf-4aaa-8ce0-d6732dd721a9" containerID="414f6a9ec3c6fad8ce0e082b1b979965bc37a01e383db22b3feee21e0f44f9fd" exitCode=0 Jul 15 04:25:47.716150 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:25:47.715959 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-v7bb9" Jul 15 04:25:47.716150 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:25:47.715982 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-v7bb9" event={"ID":"6674d5ab-95cf-4aaa-8ce0-d6732dd721a9","Type":"ContainerDied","Data":"414f6a9ec3c6fad8ce0e082b1b979965bc37a01e383db22b3feee21e0f44f9fd"} Jul 15 04:25:47.716150 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:25:47.716025 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-v7bb9" event={"ID":"6674d5ab-95cf-4aaa-8ce0-d6732dd721a9","Type":"ContainerDied","Data":"ddeebe1a5232be37388cef4e043b6ff77b324ad031cd448a07e685853a3cfc5e"} Jul 15 04:25:47.716150 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:25:47.716045 2581 scope.go:117] "RemoveContainer" containerID="414f6a9ec3c6fad8ce0e082b1b979965bc37a01e383db22b3feee21e0f44f9fd" Jul 15 04:25:47.726449 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:25:47.726430 2581 scope.go:117] "RemoveContainer" containerID="414f6a9ec3c6fad8ce0e082b1b979965bc37a01e383db22b3feee21e0f44f9fd" Jul 15 04:25:47.726732 ip-10-0-128-222 kubenswrapper[2581]: E0715 04:25:47.726710 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"414f6a9ec3c6fad8ce0e082b1b979965bc37a01e383db22b3feee21e0f44f9fd\": container with ID starting with 414f6a9ec3c6fad8ce0e082b1b979965bc37a01e383db22b3feee21e0f44f9fd not found: ID does not exist" containerID="414f6a9ec3c6fad8ce0e082b1b979965bc37a01e383db22b3feee21e0f44f9fd" Jul 15 04:25:47.726802 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:25:47.726741 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"414f6a9ec3c6fad8ce0e082b1b979965bc37a01e383db22b3feee21e0f44f9fd"} err="failed to get container status \"414f6a9ec3c6fad8ce0e082b1b979965bc37a01e383db22b3feee21e0f44f9fd\": rpc error: code = NotFound desc = could not find container \"414f6a9ec3c6fad8ce0e082b1b979965bc37a01e383db22b3feee21e0f44f9fd\": container with ID starting with 414f6a9ec3c6fad8ce0e082b1b979965bc37a01e383db22b3feee21e0f44f9fd not found: ID does not exist" Jul 15 04:25:47.737363 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:25:47.737340 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-v7bb9"] Jul 15 04:25:47.744073 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:25:47.744048 2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-v7bb9"] Jul 15 04:25:48.990426 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:25:48.990395 2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6674d5ab-95cf-4aaa-8ce0-d6732dd721a9" path="/var/lib/kubelet/pods/6674d5ab-95cf-4aaa-8ce0-d6732dd721a9/volumes" Jul 15 04:26:06.974772 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:26:06.974740 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-8kt5p_2db78c13-2384-4015-a886-14377224f4cd/console-operator/1.log" Jul 15 04:26:06.977109 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:26:06.977086 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-8kt5p_2db78c13-2384-4015-a886-14377224f4cd/console-operator/1.log" Jul 15 04:26:06.978645 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:26:06.978626 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-x6lg7_7cab18b8-43fd-46d1-a75d-6de40cbcd09a/ovn-acl-logging/0.log" Jul 15 04:26:06.981199 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:26:06.981181 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-x6lg7_7cab18b8-43fd-46d1-a75d-6de40cbcd09a/ovn-acl-logging/0.log" Jul 15 04:26:17.889803 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:26:17.889767 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:26:42.063156 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:26:42.063103 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:26:45.281817 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:26:45.281779 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-9xjcq"] Jul 15 04:26:45.282280 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:26:45.282265 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6674d5ab-95cf-4aaa-8ce0-d6732dd721a9" containerName="manager" Jul 15 04:26:45.282280 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:26:45.282281 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="6674d5ab-95cf-4aaa-8ce0-d6732dd721a9" containerName="manager" Jul 15 04:26:45.282370 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:26:45.282356 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="6674d5ab-95cf-4aaa-8ce0-d6732dd721a9" containerName="manager" Jul 15 04:26:45.285570 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:26:45.285552 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-9xjcq" Jul 15 04:26:45.288100 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:26:45.288082 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-d79pv\"" Jul 15 04:26:45.302056 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:26:45.302021 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-9xjcq"] Jul 15 04:26:45.408883 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:26:45.408844 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e53e2e89-dbe4-4095-8f2f-8efafc1d31de-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-9xjcq\" (UID: \"e53e2e89-dbe4-4095-8f2f-8efafc1d31de\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-9xjcq" Jul 15 04:26:45.409060 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:26:45.409024 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z4x9d\" (UniqueName: \"kubernetes.io/projected/e53e2e89-dbe4-4095-8f2f-8efafc1d31de-kube-api-access-z4x9d\") pod \"kuadrant-operator-controller-manager-86878c769f-9xjcq\" (UID: \"e53e2e89-dbe4-4095-8f2f-8efafc1d31de\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-9xjcq" Jul 15 04:26:45.509684 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:26:45.509644 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z4x9d\" (UniqueName: \"kubernetes.io/projected/e53e2e89-dbe4-4095-8f2f-8efafc1d31de-kube-api-access-z4x9d\") pod \"kuadrant-operator-controller-manager-86878c769f-9xjcq\" (UID: \"e53e2e89-dbe4-4095-8f2f-8efafc1d31de\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-9xjcq" Jul 15 04:26:45.509684 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:26:45.509691 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e53e2e89-dbe4-4095-8f2f-8efafc1d31de-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-9xjcq\" (UID: \"e53e2e89-dbe4-4095-8f2f-8efafc1d31de\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-9xjcq" Jul 15 04:26:45.510050 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:26:45.510034 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e53e2e89-dbe4-4095-8f2f-8efafc1d31de-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-9xjcq\" (UID: \"e53e2e89-dbe4-4095-8f2f-8efafc1d31de\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-9xjcq" Jul 15 04:26:45.518050 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:26:45.518022 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z4x9d\" (UniqueName: \"kubernetes.io/projected/e53e2e89-dbe4-4095-8f2f-8efafc1d31de-kube-api-access-z4x9d\") pod \"kuadrant-operator-controller-manager-86878c769f-9xjcq\" (UID: \"e53e2e89-dbe4-4095-8f2f-8efafc1d31de\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-9xjcq" Jul 15 04:26:45.596877 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:26:45.596778 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-9xjcq" Jul 15 04:26:45.757965 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:26:45.757940 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-9xjcq"] Jul 15 04:26:45.760501 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:26:45.760471 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode53e2e89_dbe4_4095_8f2f_8efafc1d31de.slice/crio-42cce63c791d4b9ce9ab985b5421996b949e54cbd3e35bb74007dbd777a2aa3f WatchSource:0}: Error finding container 42cce63c791d4b9ce9ab985b5421996b949e54cbd3e35bb74007dbd777a2aa3f: Status 404 returned error can't find the container with id 42cce63c791d4b9ce9ab985b5421996b949e54cbd3e35bb74007dbd777a2aa3f Jul 15 04:26:46.065867 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:26:46.065834 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-9xjcq" event={"ID":"e53e2e89-dbe4-4095-8f2f-8efafc1d31de","Type":"ContainerStarted","Data":"13929301d5d42ac0e07fc672dc83b7db2ba0ffcf80885aa641d1f7fa3186c4a3"} Jul 15 04:26:46.066071 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:26:46.065886 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-9xjcq" event={"ID":"e53e2e89-dbe4-4095-8f2f-8efafc1d31de","Type":"ContainerStarted","Data":"42cce63c791d4b9ce9ab985b5421996b949e54cbd3e35bb74007dbd777a2aa3f"} Jul 15 04:26:46.066071 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:26:46.065972 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-9xjcq" Jul 15 04:26:46.086840 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:26:46.086789 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-9xjcq" podStartSLOduration=1.086773689 podStartE2EDuration="1.086773689s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 04:26:45 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 04:26:46.08461164 +0000 UTC m=+1239.611412676" watchObservedRunningTime="2026-07-15 04:26:46.086773689 +0000 UTC m=+1239.613574704" Jul 15 04:26:49.461311 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:26:49.461275 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:26:57.075308 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:26:57.075270 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-9xjcq" Jul 15 04:27:05.980946 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:27:05.980910 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2txpt"] Jul 15 04:27:15.578807 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:27:15.578767 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2txpt"] Jul 15 04:27:28.280767 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:27:28.280728 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2txpt"] Jul 15 04:27:41.285838 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:27:41.285793 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2txpt"] Jul 15 04:27:50.975843 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:27:50.975802 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2txpt"] Jul 15 04:28:00.287773 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:28:00.287733 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2txpt"] Jul 15 04:28:10.787346 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:28:10.787312 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2txpt"] Jul 15 04:28:20.482844 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:28:20.482805 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2txpt"] Jul 15 04:28:31.388984 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:28:31.388894 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2txpt"] Jul 15 04:28:38.043808 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:28:38.043774 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:28:38.123388 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:28:38.123354 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:28:41.682741 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:28:41.682690 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2txpt"] Jul 15 04:28:50.886096 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:28:50.886060 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2txpt"] Jul 15 04:29:14.279802 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:29:14.279762 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2txpt"] Jul 15 04:29:23.882320 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:29:23.882279 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2txpt"] Jul 15 04:29:34.380074 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:29:34.380036 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2txpt"] Jul 15 04:29:44.279810 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:29:44.279774 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2txpt"] Jul 15 04:29:50.773899 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:29:50.773862 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2txpt"] Jul 15 04:30:06.785562 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:30:06.785478 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2txpt"] Jul 15 04:30:16.279907 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:30:16.279867 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2txpt"] Jul 15 04:30:25.580332 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:30:25.580293 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2txpt"] Jul 15 04:30:33.586777 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:30:33.586736 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2txpt"] Jul 15 04:30:43.780224 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:30:43.780191 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2txpt"] Jul 15 04:30:52.979781 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:30:52.979748 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2txpt"] Jul 15 04:31:05.730932 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:31:05.730892 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2txpt"] Jul 15 04:31:07.016978 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:31:07.016948 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-8kt5p_2db78c13-2384-4015-a886-14377224f4cd/console-operator/1.log" Jul 15 04:31:07.021149 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:31:07.021112 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-x6lg7_7cab18b8-43fd-46d1-a75d-6de40cbcd09a/ovn-acl-logging/0.log" Jul 15 04:31:07.022102 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:31:07.022083 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-8kt5p_2db78c13-2384-4015-a886-14377224f4cd/console-operator/1.log" Jul 15 04:31:07.026481 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:31:07.026463 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-x6lg7_7cab18b8-43fd-46d1-a75d-6de40cbcd09a/ovn-acl-logging/0.log" Jul 15 04:31:15.377258 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:31:15.377226 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2txpt"] Jul 15 04:31:24.487248 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:31:24.487212 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2txpt"] Jul 15 04:31:33.778621 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:31:33.778540 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2txpt"] Jul 15 04:31:46.588070 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:31:46.588033 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2txpt"] Jul 15 04:31:55.888702 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:31:55.888671 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2txpt"] Jul 15 04:32:08.290015 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:32:08.289977 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2txpt"] Jul 15 04:32:19.683536 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:32:19.683500 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2txpt"] Jul 15 04:32:27.895159 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:32:27.895107 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:32:29.075472 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:32:29.075441 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2txpt"] Jul 15 04:32:31.260617 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:32:31.260582 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:32:38.766842 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:32:38.766800 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:32:43.381960 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:32:43.381924 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2txpt"] Jul 15 04:32:47.036305 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:32:47.036263 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:32:52.164667 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:32:52.164622 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:32:55.314243 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:32:55.314209 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:32:55.411555 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:32:55.411526 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:32:55.778365 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:32:55.778320 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:32:56.056951 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:32:56.056865 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2txpt"] Jul 15 04:33:01.705550 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:33:01.705512 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:33:01.802300 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:33:01.802262 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:33:02.968440 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:33:02.968406 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:33:03.163025 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:33:03.162993 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:33:03.289988 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:33:03.289892 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:33:03.613953 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:33:03.613918 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:33:03.719990 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:33:03.719952 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:33:05.986928 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:33:05.986894 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2txpt"] Jul 15 04:33:05.987732 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:33:05.987695 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:33:18.427629 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:33:18.427594 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:33:21.081209 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:33:21.081174 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2txpt"] Jul 15 04:33:22.325830 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:33:22.325774 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:33:22.972628 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:33:22.972587 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:33:28.899525 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:33:28.899484 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:33:28.999715 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:33:28.999681 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:33:33.152997 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:33:33.152965 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:33:33.530351 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:33:33.530223 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:33:33.632981 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:33:33.632946 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:33:33.730363 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:33:33.730319 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:33:34.987274 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:33:34.987238 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:33:35.088475 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:33:35.088442 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:33:35.553353 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:33:35.553300 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:33:35.658632 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:33:35.658590 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:33:35.755421 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:33:35.755387 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:33:39.746688 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:33:39.746643 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:33:39.799649 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:33:39.799613 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:33:43.127369 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:33:43.127331 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:33:43.578538 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:33:43.578452 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2txpt"] Jul 15 04:34:39.620819 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:34:39.620723 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:34:39.726532 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:34:39.726488 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:34:42.580809 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:34:42.580772 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2txpt"] Jul 15 04:34:44.775936 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:34:44.775902 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:34:45.578029 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:34:45.577994 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:34:46.173998 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:34:46.173954 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:34:51.176500 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:34:51.176465 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:34:51.278553 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:34:51.278520 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:34:51.399036 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:34:51.398992 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:34:51.459235 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:34:51.459104 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:34:52.504522 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:34:52.504491 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:34:52.600539 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:34:52.600498 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:34:52.741353 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:34:52.741320 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:34:53.177405 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:34:53.177364 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:34:53.275204 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:34:53.275170 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:34:53.330725 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:34:53.330688 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:34:54.508177 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:34:54.508135 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:34:55.979872 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:34:55.979829 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2txpt"] Jul 15 04:35:06.222261 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:35:06.222221 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:36:07.058643 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:36:07.058614 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-8kt5p_2db78c13-2384-4015-a886-14377224f4cd/console-operator/1.log" Jul 15 04:36:07.062985 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:36:07.062959 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-x6lg7_7cab18b8-43fd-46d1-a75d-6de40cbcd09a/ovn-acl-logging/0.log" Jul 15 04:36:07.064188 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:36:07.064167 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-8kt5p_2db78c13-2384-4015-a886-14377224f4cd/console-operator/1.log" Jul 15 04:36:07.068358 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:36:07.068338 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-x6lg7_7cab18b8-43fd-46d1-a75d-6de40cbcd09a/ovn-acl-logging/0.log" Jul 15 04:36:08.121315 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:36:08.121274 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:36:10.875331 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:36:10.875294 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2txpt"] Jul 15 04:36:12.783727 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:36:12.783686 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:36:18.436406 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:36:18.436354 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:36:18.500899 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:36:18.500858 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:36:20.913374 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:36:20.913341 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:36:21.015154 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:36:21.015110 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:36:23.823179 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:36:23.823116 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:36:24.147302 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:36:24.147268 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:36:25.261210 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:36:25.261165 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:36:25.343957 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:36:25.343925 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:36:25.477926 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:36:25.477883 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:36:25.584062 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:36:25.583967 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:36:25.898030 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:36:25.897998 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:36:25.998258 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:36:25.998216 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:36:27.880843 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:36:27.880808 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2txpt"] Jul 15 04:37:40.149871 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:37:40.149830 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:37:43.175785 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:37:43.175745 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2txpt"] Jul 15 04:37:44.792963 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:37:44.792925 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:37:50.675311 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:37:50.675273 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:37:50.735207 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:37:50.735172 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:37:54.985454 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:37:54.985405 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:37:55.635396 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:37:55.635358 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:37:55.736885 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:37:55.736850 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:37:55.845328 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:37:55.845289 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:37:56.008998 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:37:56.008957 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:37:57.395155 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:37:57.395103 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:38:02.964212 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:38:02.964177 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:38:03.029802 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:38:03.029768 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:38:03.112897 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:38:03.112817 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:38:03.203650 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:38:03.203617 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:38:03.303672 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:38:03.303555 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:38:03.439439 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:38:03.439403 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:38:03.539812 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:38:03.539774 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:38:03.814849 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:38:03.814809 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:38:29.737944 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:38:29.737898 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:38:35.379499 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:38:35.379439 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:38:35.441566 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:38:35.441532 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:38:35.523206 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:38:35.523155 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:38:35.619329 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:38:35.619290 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:38:51.545549 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:38:51.545509 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:38:55.649136 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:38:55.649084 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:38:57.219713 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:38:57.219670 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:38:57.325179 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:38:57.325145 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:38:57.420055 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:38:57.420017 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:39:08.021962 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:39:08.021882 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:39:08.871238 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:39:08.871200 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:39:14.548495 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:39:14.548453 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:39:14.601427 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:39:14.601388 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:39:14.700279 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:39:14.700237 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:39:14.797776 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:39:14.797744 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:39:14.897517 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:39:14.897478 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:39:15.685591 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:39:15.685553 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:39:15.786394 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:39:15.786356 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:39:15.882625 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:39:15.882591 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:39:16.789023 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:39:16.788990 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2txpt"] Jul 15 04:39:17.557175 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:39:17.557102 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:39:23.299669 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:39:23.299620 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:39:23.397192 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:39:23.397152 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:39:24.042809 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:39:24.042750 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:39:26.085219 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:39:26.085185 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2txpt"] Jul 15 04:39:29.626772 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:39:29.626731 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:39:29.687886 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:39:29.687851 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:39:29.871634 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:39:29.871587 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:39:30.204175 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:39:30.204110 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:39:30.425843 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:39:30.425802 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:39:33.597316 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:39:33.597282 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:39:33.705073 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:39:33.705040 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:39:33.891398 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:39:33.891356 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:39:34.042712 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:39:34.042674 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:39:34.369294 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:39:34.369241 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:39:34.470369 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:39:34.470337 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:39:38.134061 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:39:38.134029 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:39:38.587288 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:39:38.587198 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2txpt"] Jul 15 04:39:38.828068 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:39:38.828023 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:39:38.929167 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:39:38.929113 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:39:39.353856 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:39:39.353773 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:39:44.958307 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:39:44.958269 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:39:45.059010 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:39:45.058978 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:39:55.723413 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:39:55.723378 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:39:58.480102 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:39:58.480063 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2txpt"] Jul 15 04:40:00.406607 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:40:00.406568 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:40:06.133335 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:40:06.133297 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:40:06.276490 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:40:06.276454 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:40:11.102023 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:40:11.101977 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:40:11.348062 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:40:11.348024 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:40:11.476268 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:40:11.476234 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:40:11.571051 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:40:11.571011 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:40:11.724048 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:40:11.724013 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:40:17.323710 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:40:17.323668 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:40:17.430752 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:40:17.430715 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:40:17.524539 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:40:17.524501 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:40:17.705771 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:40:17.705726 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:40:23.263834 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:40:23.263752 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:40:23.323101 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:40:23.323061 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:40:23.681093 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:40:23.681047 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:40:30.219878 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:40:30.219782 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:40:30.553740 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:40:30.553652 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:40:30.746381 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:40:30.746343 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:40:33.920548 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:40:33.920497 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:40:34.014557 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:40:34.014519 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:40:34.173369 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:40:34.173276 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:40:34.588107 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:40:34.588014 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:40:34.729684 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:40:34.729648 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:40:34.829608 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:40:34.829577 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:40:38.440173 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:40:38.440133 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:40:38.480323 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:40:38.480284 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2txpt"] Jul 15 04:40:44.829723 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:40:44.829688 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:40:47.703137 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:40:47.703100 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2txpt"] Jul 15 04:41:03.482273 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:41:03.482231 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2txpt"] Jul 15 04:41:07.109633 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:41:07.109604 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-8kt5p_2db78c13-2384-4015-a886-14377224f4cd/console-operator/1.log" Jul 15 04:41:07.113618 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:41:07.113597 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-x6lg7_7cab18b8-43fd-46d1-a75d-6de40cbcd09a/ovn-acl-logging/0.log" Jul 15 04:41:07.121624 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:41:07.121605 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-8kt5p_2db78c13-2384-4015-a886-14377224f4cd/console-operator/1.log" Jul 15 04:41:07.126241 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:41:07.126223 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-x6lg7_7cab18b8-43fd-46d1-a75d-6de40cbcd09a/ovn-acl-logging/0.log" Jul 15 04:41:17.354582 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:41:17.354545 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:41:20.497714 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:41:20.497675 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2txpt"] Jul 15 04:41:21.685829 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:41:21.685785 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:41:21.781990 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:41:21.781953 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:41:21.911981 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:41:21.911943 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:41:26.975198 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:41:26.975158 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:42:03.688443 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:42:03.688359 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:42:04.124374 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:42:04.124341 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:42:09.696759 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:42:09.696723 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:42:09.798059 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:42:09.798005 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:42:14.339725 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:42:14.339682 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:42:14.573786 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:42:14.573753 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:42:15.648003 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:42:15.647971 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:42:15.745713 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:42:15.745672 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:42:15.845585 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:42:15.845549 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:42:16.629436 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:42:16.629382 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:42:16.728183 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:42:16.728114 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:42:16.828351 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:42:16.828309 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:42:18.252331 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:42:18.252288 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:42:18.485154 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:42:18.485085 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2txpt"] Jul 15 04:42:23.930843 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:42:23.930801 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:42:24.030877 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:42:24.030843 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:42:24.635674 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:42:24.635633 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:42:30.626557 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:42:30.626519 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:42:30.734229 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:42:30.734188 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:42:30.831614 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:42:30.831583 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:42:33.182471 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:42:33.182437 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2txpt"] Jul 15 04:42:41.377754 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:42:41.377699 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:42:41.746879 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:42:41.746776 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:43:02.755435 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:43:02.755403 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:43:08.468053 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:43:08.468018 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:43:08.537028 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:43:08.536989 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:43:08.854327 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:43:08.854230 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:43:09.204905 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:43:09.204868 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:43:09.283473 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:43:09.283435 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:43:11.684168 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:43:11.684116 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:43:11.790589 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:43:11.790550 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:43:11.946842 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:43:11.946748 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:43:12.180671 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:43:12.180641 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:43:12.422217 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:43:12.422182 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:43:12.522852 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:43:12.522804 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:43:16.215256 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:43:16.215224 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:43:16.284384 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:43:16.284351 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2txpt"] Jul 15 04:43:16.617085 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:43:16.617043 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:43:16.902531 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:43:16.902428 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:43:17.145359 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:43:17.145328 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:43:19.749948 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:43:19.749913 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:43:19.849579 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:43:19.849544 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:43:19.983289 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:43:19.983258 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:43:20.148797 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:43:20.148762 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:43:20.478368 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:43:20.478274 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:43:20.578556 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:43:20.578517 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:43:24.259269 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:43:24.259215 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:43:24.981183 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:43:24.981144 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2txpt"] Jul 15 04:43:30.682078 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:43:30.681988 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:43:33.333096 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:43:33.333060 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:43:33.435416 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:43:33.435370 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:43:35.076887 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:43:35.076848 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2txpt"] Jul 15 04:43:41.342347 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:43:41.342309 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:43:41.440981 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:43:41.440944 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:43:46.476440 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:43:46.476402 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2txpt"] Jul 15 04:44:04.716729 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:44:04.716693 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:44:10.092712 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:44:10.092680 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2txpt"] Jul 15 04:44:18.648950 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:44:18.648895 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:44:18.702285 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:44:18.702252 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:44:22.930259 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:44:22.930214 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:44:23.847079 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:44:23.847030 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:44:24.462497 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:44:24.462459 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:44:24.566755 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:44:24.566715 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:44:30.285593 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:44:30.285562 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2txpt"] Jul 15 04:44:34.430214 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:44:34.430176 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:44:39.074191 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:44:39.074108 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:44:44.507146 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:44:44.507080 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:44:44.590113 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:44:44.590076 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2txpt"] Jul 15 04:44:44.591736 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:44:44.591708 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:44:44.968393 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:44:44.968363 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:44:45.069260 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:44:45.069223 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:44:49.790962 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:44:49.790926 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:44:50.024495 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:44:50.024461 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:44:50.689499 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:44:50.689466 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:44:50.790837 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:44:50.790802 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:45:00.662762 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:45:00.662667 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:45:03.787203 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:45:03.787163 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2txpt"] Jul 15 04:45:05.274670 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:45:05.274622 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:45:10.992841 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:45:10.992801 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:45:11.056418 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:45:11.056382 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:45:15.958659 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:45:15.958621 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:45:16.202814 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:45:16.202774 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:45:16.579608 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:45:16.579563 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:45:16.914836 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:45:16.914802 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:45:17.121885 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:45:17.121846 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:45:20.389066 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:45:20.389031 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:45:20.478098 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:45:20.478065 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:45:20.551973 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:45:20.551940 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:45:20.654884 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:45:20.654794 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:45:21.044942 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:45:21.044850 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:45:21.143488 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:45:21.143458 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:45:24.906577 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:45:24.906541 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:45:25.399245 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:45:25.399196 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:45:25.697106 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:45:25.697017 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2txpt"] Jul 15 04:45:25.729078 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:45:25.729042 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:45:26.447109 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:45:26.447064 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:45:28.448716 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:45:28.448673 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:45:28.546319 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:45:28.546277 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:45:28.727491 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:45:28.727398 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:45:28.978899 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:45:28.978807 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:45:29.206877 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:45:29.206839 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:45:29.303306 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:45:29.303222 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:45:32.971891 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:45:32.971859 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:45:35.782806 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:45:35.782770 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2txpt"] Jul 15 04:45:41.677350 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:45:41.677305 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:45:41.782875 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:45:41.782832 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:45:50.962610 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:45:50.962569 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:45:51.059831 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:45:51.059790 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:45:51.686171 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:45:51.686136 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:45:55.082886 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:45:55.082844 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2txpt"] Jul 15 04:45:56.250453 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:45:56.250412 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:45:58.556310 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:45:58.556276 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:46:02.163669 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:46:02.163632 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:46:02.218989 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:46:02.218955 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:46:06.940830 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:46:06.940778 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:46:07.152984 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:46:07.152953 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-8kt5p_2db78c13-2384-4015-a886-14377224f4cd/console-operator/1.log" Jul 15 04:46:07.156998 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:46:07.156976 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-x6lg7_7cab18b8-43fd-46d1-a75d-6de40cbcd09a/ovn-acl-logging/0.log" Jul 15 04:46:07.166418 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:46:07.166398 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-8kt5p_2db78c13-2384-4015-a886-14377224f4cd/console-operator/1.log" Jul 15 04:46:07.170368 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:46:07.170348 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-x6lg7_7cab18b8-43fd-46d1-a75d-6de40cbcd09a/ovn-acl-logging/0.log" Jul 15 04:46:07.174892 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:46:07.174858 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:46:17.838747 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:46:17.838706 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:46:21.078205 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:46:21.078170 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2txpt"] Jul 15 04:46:22.390330 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:46:22.390296 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:46:22.490722 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:46:22.490690 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:46:22.591762 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:46:22.591731 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:46:28.057476 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:46:28.057438 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:46:28.125307 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:46:28.125254 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:46:33.160068 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:46:33.160021 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:46:33.405197 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:46:33.405159 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:46:33.770953 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:46:33.770923 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:46:34.095193 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:46:34.095069 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:46:34.219885 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:46:34.219853 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:46:36.830444 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:46:36.830281 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:46:36.924956 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:46:36.924923 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:46:37.068166 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:46:37.068093 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:46:37.302914 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:46:37.302865 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:46:37.599195 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:46:37.599090 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:46:37.699965 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:46:37.699920 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:46:41.342724 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:46:41.342690 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:46:41.702339 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:46:41.702295 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:46:42.028555 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:46:42.028449 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:46:42.260875 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:46:42.260837 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:46:42.321715 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:46:42.321615 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:46:42.782449 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:46:42.782410 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2txpt"] Jul 15 04:46:44.876748 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:46:44.876707 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:46:44.974026 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:46:44.973986 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:46:45.292478 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:46:45.292391 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:46:45.425433 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:46:45.425399 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:46:45.766380 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:46:45.766347 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:46:45.868250 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:46:45.868195 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:46:49.437998 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:46:49.437957 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:46:54.882206 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:46:54.882171 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2txpt"] Jul 15 04:46:58.324890 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:46:58.324852 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:46:58.424099 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:46:58.424060 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:47:06.647642 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:47:06.647603 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:47:06.753715 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:47:06.753681 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:47:10.021308 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:47:10.021271 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:47:12.680432 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:47:12.680396 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2txpt"] Jul 15 04:47:26.406803 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:47:26.406752 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:47:30.284817 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:47:30.284781 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2txpt"] Jul 15 04:47:47.682792 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:47:47.682755 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2txpt"] Jul 15 04:48:03.310543 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:48:03.310459 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2txpt"] Jul 15 04:48:22.887263 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:48:22.887225 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2txpt"] Jul 15 04:48:31.571631 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:48:31.571586 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:48:41.090776 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:48:41.090736 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2txpt"] Jul 15 04:48:55.103736 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:48:55.103706 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:48:55.204688 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:48:55.204646 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:48:58.784211 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:48:58.784175 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2txpt"] Jul 15 04:49:14.481795 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:49:14.481758 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2txpt"] Jul 15 04:49:29.662398 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:49:29.662308 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:49:30.392658 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:49:30.392626 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:49:33.186837 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:49:33.186804 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2txpt"] Jul 15 04:49:34.411609 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:49:34.411565 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:49:49.977747 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:49:49.977713 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2txpt"] Jul 15 04:50:07.393247 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:50:07.393209 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:50:11.887455 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:50:11.887415 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2txpt"] Jul 15 04:50:31.585988 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:50:31.585951 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2txpt"] Jul 15 04:50:48.610355 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:50:48.610313 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:50:49.693545 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:50:49.693509 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:50:54.181055 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:50:54.181015 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2txpt"] Jul 15 04:50:58.808392 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:50:58.808273 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:51:07.193641 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:51:07.193612 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-8kt5p_2db78c13-2384-4015-a886-14377224f4cd/console-operator/1.log" Jul 15 04:51:07.197889 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:51:07.197867 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-x6lg7_7cab18b8-43fd-46d1-a75d-6de40cbcd09a/ovn-acl-logging/0.log" Jul 15 04:51:07.213244 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:51:07.213215 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-8kt5p_2db78c13-2384-4015-a886-14377224f4cd/console-operator/1.log" Jul 15 04:51:07.217437 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:51:07.217417 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-x6lg7_7cab18b8-43fd-46d1-a75d-6de40cbcd09a/ovn-acl-logging/0.log" Jul 15 04:51:10.578655 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:51:10.578615 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2txpt"] Jul 15 04:51:19.518552 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:51:19.518509 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:51:23.233371 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:51:23.233313 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:51:23.297380 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:51:23.297333 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2txpt"] Jul 15 04:51:23.332528 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:51:23.332487 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:51:48.185359 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:51:48.185316 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2txpt"] Jul 15 04:51:58.005051 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:51:58.005010 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:51:58.103516 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:51:58.103476 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:51:59.221566 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:51:59.221530 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:51:59.319090 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:51:59.319057 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:52:06.701076 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:52:06.701041 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2txpt"] Jul 15 04:52:07.624466 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:52:07.624346 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:52:07.723748 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:52:07.723700 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:52:11.562996 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:52:11.562940 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:52:12.508410 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:52:12.508360 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:52:13.587014 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:52:13.586979 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/test-curl-7455-140321047716784"] Jul 15 04:52:13.590810 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:52:13.590793 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7455-140321047716784" Jul 15 04:52:13.593415 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:52:13.593394 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-dockercfg-t2vh2\"" Jul 15 04:52:13.599022 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:52:13.599000 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/test-curl-7455-140321047716784"] Jul 15 04:52:13.677690 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:52:13.677649 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2nps9\" (UniqueName: \"kubernetes.io/projected/f9cf8298-408c-400c-8a3c-80b7f6fcab5b-kube-api-access-2nps9\") pod \"test-curl-7455-140321047716784\" (UID: \"f9cf8298-408c-400c-8a3c-80b7f6fcab5b\") " pod="openshift-ingress/test-curl-7455-140321047716784" Jul 15 04:52:13.778520 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:52:13.778484 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2nps9\" (UniqueName: \"kubernetes.io/projected/f9cf8298-408c-400c-8a3c-80b7f6fcab5b-kube-api-access-2nps9\") pod \"test-curl-7455-140321047716784\" (UID: \"f9cf8298-408c-400c-8a3c-80b7f6fcab5b\") " pod="openshift-ingress/test-curl-7455-140321047716784" Jul 15 04:52:13.789563 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:52:13.789535 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2nps9\" (UniqueName: \"kubernetes.io/projected/f9cf8298-408c-400c-8a3c-80b7f6fcab5b-kube-api-access-2nps9\") pod \"test-curl-7455-140321047716784\" (UID: \"f9cf8298-408c-400c-8a3c-80b7f6fcab5b\") " pod="openshift-ingress/test-curl-7455-140321047716784" Jul 15 04:52:13.901072 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:52:13.901030 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7455-140321047716784" Jul 15 04:52:14.047685 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:52:14.047654 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/test-curl-7455-140321047716784"] Jul 15 04:52:14.049281 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:52:14.049255 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf9cf8298_408c_400c_8a3c_80b7f6fcab5b.slice/crio-af7f2e80cfd024337884cdd6fb6733ad8c407d86cdf3ce3fd76a71738ea5d80f WatchSource:0}: Error finding container af7f2e80cfd024337884cdd6fb6733ad8c407d86cdf3ce3fd76a71738ea5d80f: Status 404 returned error can't find the container with id af7f2e80cfd024337884cdd6fb6733ad8c407d86cdf3ce3fd76a71738ea5d80f Jul 15 04:52:14.050933 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:52:14.050915 2581 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 15 04:52:14.387915 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:52:14.387876 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/test-curl-7455-140321047716784" event={"ID":"f9cf8298-408c-400c-8a3c-80b7f6fcab5b","Type":"ContainerStarted","Data":"af7f2e80cfd024337884cdd6fb6733ad8c407d86cdf3ce3fd76a71738ea5d80f"} Jul 15 04:52:15.394878 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:52:15.394838 2581 generic.go:356] "Generic (PLEG): container finished" podID="f9cf8298-408c-400c-8a3c-80b7f6fcab5b" containerID="7277b4149f570b6791e0dced9fe2ecf8d273d77d187c3e6b8142dc901d1327f6" exitCode=0 Jul 15 04:52:15.395289 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:52:15.394935 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/test-curl-7455-140321047716784" event={"ID":"f9cf8298-408c-400c-8a3c-80b7f6fcab5b","Type":"ContainerDied","Data":"7277b4149f570b6791e0dced9fe2ecf8d273d77d187c3e6b8142dc901d1327f6"} Jul 15 04:52:16.545373 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:52:16.545347 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7455-140321047716784" Jul 15 04:52:16.565834 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:52:16.565787 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_test-curl-7455-140321047716784_f9cf8298-408c-400c-8a3c-80b7f6fcab5b/test-curl-7455-140321047716784/0.log" Jul 15 04:52:16.592247 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:52:16.592215 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/test-curl-7455-140321047716784"] Jul 15 04:52:16.596404 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:52:16.596367 2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/test-curl-7455-140321047716784"] Jul 15 04:52:16.604866 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:52:16.604843 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2nps9\" (UniqueName: \"kubernetes.io/projected/f9cf8298-408c-400c-8a3c-80b7f6fcab5b-kube-api-access-2nps9\") pod \"f9cf8298-408c-400c-8a3c-80b7f6fcab5b\" (UID: \"f9cf8298-408c-400c-8a3c-80b7f6fcab5b\") " Jul 15 04:52:16.606968 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:52:16.606946 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f9cf8298-408c-400c-8a3c-80b7f6fcab5b-kube-api-access-2nps9" (OuterVolumeSpecName: "kube-api-access-2nps9") pod "f9cf8298-408c-400c-8a3c-80b7f6fcab5b" (UID: "f9cf8298-408c-400c-8a3c-80b7f6fcab5b"). InnerVolumeSpecName "kube-api-access-2nps9". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 15 04:52:16.706292 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:52:16.706199 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2nps9\" (UniqueName: \"kubernetes.io/projected/f9cf8298-408c-400c-8a3c-80b7f6fcab5b-kube-api-access-2nps9\") on node \"ip-10-0-128-222.ec2.internal\" DevicePath \"\"" Jul 15 04:52:16.729034 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:52:16.728993 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/test-curl-7455-140321047062064"] Jul 15 04:52:16.729531 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:52:16.729505 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f9cf8298-408c-400c-8a3c-80b7f6fcab5b" containerName="test-curl-7455-140321047716784" Jul 15 04:52:16.729531 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:52:16.729529 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="f9cf8298-408c-400c-8a3c-80b7f6fcab5b" containerName="test-curl-7455-140321047716784" Jul 15 04:52:16.729671 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:52:16.729614 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="f9cf8298-408c-400c-8a3c-80b7f6fcab5b" containerName="test-curl-7455-140321047716784" Jul 15 04:52:16.732851 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:52:16.732833 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7455-140321047062064" Jul 15 04:52:16.741347 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:52:16.741324 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/test-curl-7455-140321047062064"] Jul 15 04:52:16.806727 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:52:16.806684 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kbxxh\" (UniqueName: \"kubernetes.io/projected/df444772-97a9-4264-8600-be1088691ef7-kube-api-access-kbxxh\") pod \"test-curl-7455-140321047062064\" (UID: \"df444772-97a9-4264-8600-be1088691ef7\") " pod="openshift-ingress/test-curl-7455-140321047062064" Jul 15 04:52:16.907518 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:52:16.907485 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kbxxh\" (UniqueName: \"kubernetes.io/projected/df444772-97a9-4264-8600-be1088691ef7-kube-api-access-kbxxh\") pod \"test-curl-7455-140321047062064\" (UID: \"df444772-97a9-4264-8600-be1088691ef7\") " pod="openshift-ingress/test-curl-7455-140321047062064" Jul 15 04:52:16.917025 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:52:16.916992 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kbxxh\" (UniqueName: \"kubernetes.io/projected/df444772-97a9-4264-8600-be1088691ef7-kube-api-access-kbxxh\") pod \"test-curl-7455-140321047062064\" (UID: \"df444772-97a9-4264-8600-be1088691ef7\") " pod="openshift-ingress/test-curl-7455-140321047062064" Jul 15 04:52:16.991068 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:52:16.990968 2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f9cf8298-408c-400c-8a3c-80b7f6fcab5b" path="/var/lib/kubelet/pods/f9cf8298-408c-400c-8a3c-80b7f6fcab5b/volumes" Jul 15 04:52:17.042696 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:52:17.042663 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7455-140321047062064" Jul 15 04:52:17.191456 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:52:17.191424 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/test-curl-7455-140321047062064"] Jul 15 04:52:17.193283 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:52:17.193258 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poddf444772_97a9_4264_8600_be1088691ef7.slice/crio-ed117826587b0cc9bef026b0734d46d3c440e4c6fb3bf4a176ff57c9f5aa3469 WatchSource:0}: Error finding container ed117826587b0cc9bef026b0734d46d3c440e4c6fb3bf4a176ff57c9f5aa3469: Status 404 returned error can't find the container with id ed117826587b0cc9bef026b0734d46d3c440e4c6fb3bf4a176ff57c9f5aa3469 Jul 15 04:52:17.408366 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:52:17.408333 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7455-140321047716784" Jul 15 04:52:17.408573 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:52:17.408341 2581 scope.go:117] "RemoveContainer" containerID="7277b4149f570b6791e0dced9fe2ecf8d273d77d187c3e6b8142dc901d1327f6" Jul 15 04:52:17.409802 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:52:17.409776 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/test-curl-7455-140321047062064" event={"ID":"df444772-97a9-4264-8600-be1088691ef7","Type":"ContainerStarted","Data":"ed117826587b0cc9bef026b0734d46d3c440e4c6fb3bf4a176ff57c9f5aa3469"} Jul 15 04:52:18.066087 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:52:18.066043 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:52:18.121368 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:52:18.121326 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:52:18.418662 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:52:18.418632 2581 generic.go:356] "Generic (PLEG): container finished" podID="df444772-97a9-4264-8600-be1088691ef7" containerID="e27211267c8f0c0bca479bc79ef303823709cc7854638a63998005da363bf378" exitCode=0 Jul 15 04:52:18.418841 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:52:18.418718 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/test-curl-7455-140321047062064" event={"ID":"df444772-97a9-4264-8600-be1088691ef7","Type":"ContainerDied","Data":"e27211267c8f0c0bca479bc79ef303823709cc7854638a63998005da363bf378"} Jul 15 04:52:19.582297 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:52:19.582271 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7455-140321047062064" Jul 15 04:52:19.605763 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:52:19.605728 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_test-curl-7455-140321047062064_df444772-97a9-4264-8600-be1088691ef7/test-curl-7455-140321047062064/0.log" Jul 15 04:52:19.630425 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:52:19.630388 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/test-curl-7455-140321047062064"] Jul 15 04:52:19.634326 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:52:19.634290 2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/test-curl-7455-140321047062064"] Jul 15 04:52:19.636543 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:52:19.636528 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kbxxh\" (UniqueName: \"kubernetes.io/projected/df444772-97a9-4264-8600-be1088691ef7-kube-api-access-kbxxh\") pod \"df444772-97a9-4264-8600-be1088691ef7\" (UID: \"df444772-97a9-4264-8600-be1088691ef7\") " Jul 15 04:52:19.638558 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:52:19.638534 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/df444772-97a9-4264-8600-be1088691ef7-kube-api-access-kbxxh" (OuterVolumeSpecName: "kube-api-access-kbxxh") pod "df444772-97a9-4264-8600-be1088691ef7" (UID: "df444772-97a9-4264-8600-be1088691ef7"). InnerVolumeSpecName "kube-api-access-kbxxh". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 15 04:52:19.737746 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:52:19.737655 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kbxxh\" (UniqueName: \"kubernetes.io/projected/df444772-97a9-4264-8600-be1088691ef7-kube-api-access-kbxxh\") on node \"ip-10-0-128-222.ec2.internal\" DevicePath \"\"" Jul 15 04:52:19.827217 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:52:19.827182 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/test-curl-7455-140321046990688"] Jul 15 04:52:19.827670 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:52:19.827655 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="df444772-97a9-4264-8600-be1088691ef7" containerName="test-curl-7455-140321047062064" Jul 15 04:52:19.827719 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:52:19.827672 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="df444772-97a9-4264-8600-be1088691ef7" containerName="test-curl-7455-140321047062064" Jul 15 04:52:19.827784 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:52:19.827775 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="df444772-97a9-4264-8600-be1088691ef7" containerName="test-curl-7455-140321047062064" Jul 15 04:52:19.831057 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:52:19.831041 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7455-140321046990688" Jul 15 04:52:19.836802 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:52:19.836778 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/test-curl-7455-140321046990688"] Jul 15 04:52:19.938917 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:52:19.938878 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f59ld\" (UniqueName: \"kubernetes.io/projected/95d55e38-1edd-4aea-8d0a-e9c3f11e4e33-kube-api-access-f59ld\") pod \"test-curl-7455-140321046990688\" (UID: \"95d55e38-1edd-4aea-8d0a-e9c3f11e4e33\") " pod="openshift-ingress/test-curl-7455-140321046990688" Jul 15 04:52:20.039662 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:52:20.039571 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f59ld\" (UniqueName: \"kubernetes.io/projected/95d55e38-1edd-4aea-8d0a-e9c3f11e4e33-kube-api-access-f59ld\") pod \"test-curl-7455-140321046990688\" (UID: \"95d55e38-1edd-4aea-8d0a-e9c3f11e4e33\") " pod="openshift-ingress/test-curl-7455-140321046990688" Jul 15 04:52:20.048102 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:52:20.048072 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f59ld\" (UniqueName: \"kubernetes.io/projected/95d55e38-1edd-4aea-8d0a-e9c3f11e4e33-kube-api-access-f59ld\") pod \"test-curl-7455-140321046990688\" (UID: \"95d55e38-1edd-4aea-8d0a-e9c3f11e4e33\") " pod="openshift-ingress/test-curl-7455-140321046990688" Jul 15 04:52:20.140951 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:52:20.140907 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7455-140321046990688" Jul 15 04:52:20.282646 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:52:20.282617 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/test-curl-7455-140321046990688"] Jul 15 04:52:20.284258 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:52:20.284234 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod95d55e38_1edd_4aea_8d0a_e9c3f11e4e33.slice/crio-75aedd9401b62c3346352a7089fb5e6b6526e1c872cd8b012c1c056fb23fa200 WatchSource:0}: Error finding container 75aedd9401b62c3346352a7089fb5e6b6526e1c872cd8b012c1c056fb23fa200: Status 404 returned error can't find the container with id 75aedd9401b62c3346352a7089fb5e6b6526e1c872cd8b012c1c056fb23fa200 Jul 15 04:52:20.434098 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:52:20.434063 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/test-curl-7455-140321046990688" event={"ID":"95d55e38-1edd-4aea-8d0a-e9c3f11e4e33","Type":"ContainerStarted","Data":"75aedd9401b62c3346352a7089fb5e6b6526e1c872cd8b012c1c056fb23fa200"} Jul 15 04:52:20.435336 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:52:20.435304 2581 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="ed117826587b0cc9bef026b0734d46d3c440e4c6fb3bf4a176ff57c9f5aa3469" Jul 15 04:52:20.435336 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:52:20.435316 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7455-140321047062064" Jul 15 04:52:20.445745 ip-10-0-128-222 kubenswrapper[2581]: E0715 04:52:20.445716 2581 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7455-140321047062064\" is forbidden: User \"system:node:ip-10-0-128-222.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-ingress\": no relationship found between node 'ip-10-0-128-222.ec2.internal' and this object" podUID="df444772-97a9-4264-8600-be1088691ef7" pod="openshift-ingress/test-curl-7455-140321047062064" Jul 15 04:52:20.991399 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:52:20.991366 2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="df444772-97a9-4264-8600-be1088691ef7" path="/var/lib/kubelet/pods/df444772-97a9-4264-8600-be1088691ef7/volumes" Jul 15 04:52:21.442842 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:52:21.442805 2581 generic.go:356] "Generic (PLEG): container finished" podID="95d55e38-1edd-4aea-8d0a-e9c3f11e4e33" containerID="c44816caaeb762faa5be15a605290d29cb289660a3bad1829f0cc6482b561229" exitCode=0 Jul 15 04:52:21.443019 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:52:21.442900 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/test-curl-7455-140321046990688" event={"ID":"95d55e38-1edd-4aea-8d0a-e9c3f11e4e33","Type":"ContainerDied","Data":"c44816caaeb762faa5be15a605290d29cb289660a3bad1829f0cc6482b561229"} Jul 15 04:52:22.594720 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:52:22.594696 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7455-140321046990688" Jul 15 04:52:22.615635 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:52:22.615608 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_test-curl-7455-140321046990688_95d55e38-1edd-4aea-8d0a-e9c3f11e4e33/test-curl-7455-140321046990688/0.log" Jul 15 04:52:22.645274 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:52:22.645227 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/test-curl-7455-140321046990688"] Jul 15 04:52:22.656975 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:52:22.656945 2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/test-curl-7455-140321046990688"] Jul 15 04:52:22.667975 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:52:22.667948 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-f59ld\" (UniqueName: \"kubernetes.io/projected/95d55e38-1edd-4aea-8d0a-e9c3f11e4e33-kube-api-access-f59ld\") pod \"95d55e38-1edd-4aea-8d0a-e9c3f11e4e33\" (UID: \"95d55e38-1edd-4aea-8d0a-e9c3f11e4e33\") " Jul 15 04:52:22.670164 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:52:22.670115 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/95d55e38-1edd-4aea-8d0a-e9c3f11e4e33-kube-api-access-f59ld" (OuterVolumeSpecName: "kube-api-access-f59ld") pod "95d55e38-1edd-4aea-8d0a-e9c3f11e4e33" (UID: "95d55e38-1edd-4aea-8d0a-e9c3f11e4e33"). InnerVolumeSpecName "kube-api-access-f59ld". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 15 04:52:22.769571 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:52:22.769482 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-f59ld\" (UniqueName: \"kubernetes.io/projected/95d55e38-1edd-4aea-8d0a-e9c3f11e4e33-kube-api-access-f59ld\") on node \"ip-10-0-128-222.ec2.internal\" DevicePath \"\"" Jul 15 04:52:22.778476 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:52:22.778447 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/test-curl-7455-140321046990688"] Jul 15 04:52:22.778924 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:52:22.778912 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="95d55e38-1edd-4aea-8d0a-e9c3f11e4e33" containerName="test-curl-7455-140321046990688" Jul 15 04:52:22.778967 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:52:22.778926 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="95d55e38-1edd-4aea-8d0a-e9c3f11e4e33" containerName="test-curl-7455-140321046990688" Jul 15 04:52:22.779037 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:52:22.779027 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="95d55e38-1edd-4aea-8d0a-e9c3f11e4e33" containerName="test-curl-7455-140321046990688" Jul 15 04:52:22.782183 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:52:22.782166 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7455-140321046990688" Jul 15 04:52:22.787934 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:52:22.787909 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/test-curl-7455-140321046990688"] Jul 15 04:52:22.870986 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:52:22.870949 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c4rgx\" (UniqueName: \"kubernetes.io/projected/89bba7b3-ad00-42e8-a6a4-bec9c42a6c19-kube-api-access-c4rgx\") pod \"test-curl-7455-140321046990688\" (UID: \"89bba7b3-ad00-42e8-a6a4-bec9c42a6c19\") " pod="openshift-ingress/test-curl-7455-140321046990688" Jul 15 04:52:22.972403 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:52:22.972366 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c4rgx\" (UniqueName: \"kubernetes.io/projected/89bba7b3-ad00-42e8-a6a4-bec9c42a6c19-kube-api-access-c4rgx\") pod \"test-curl-7455-140321046990688\" (UID: \"89bba7b3-ad00-42e8-a6a4-bec9c42a6c19\") " pod="openshift-ingress/test-curl-7455-140321046990688" Jul 15 04:52:22.980645 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:52:22.980627 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c4rgx\" (UniqueName: \"kubernetes.io/projected/89bba7b3-ad00-42e8-a6a4-bec9c42a6c19-kube-api-access-c4rgx\") pod \"test-curl-7455-140321046990688\" (UID: \"89bba7b3-ad00-42e8-a6a4-bec9c42a6c19\") " pod="openshift-ingress/test-curl-7455-140321046990688" Jul 15 04:52:22.991671 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:52:22.991647 2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="95d55e38-1edd-4aea-8d0a-e9c3f11e4e33" path="/var/lib/kubelet/pods/95d55e38-1edd-4aea-8d0a-e9c3f11e4e33/volumes" Jul 15 04:52:23.092343 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:52:23.092262 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7455-140321046990688" Jul 15 04:52:23.230961 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:52:23.230935 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/test-curl-7455-140321046990688"] Jul 15 04:52:23.232877 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:52:23.232851 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod89bba7b3_ad00_42e8_a6a4_bec9c42a6c19.slice/crio-1e8bea9d27b4fa1139b4f57e96b3fe53f1c6dc3b6c355a4cc8c31e0a3769ce6d WatchSource:0}: Error finding container 1e8bea9d27b4fa1139b4f57e96b3fe53f1c6dc3b6c355a4cc8c31e0a3769ce6d: Status 404 returned error can't find the container with id 1e8bea9d27b4fa1139b4f57e96b3fe53f1c6dc3b6c355a4cc8c31e0a3769ce6d Jul 15 04:52:23.455992 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:52:23.455963 2581 scope.go:117] "RemoveContainer" containerID="c44816caaeb762faa5be15a605290d29cb289660a3bad1829f0cc6482b561229" Jul 15 04:52:23.456234 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:52:23.455966 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7455-140321046990688" Jul 15 04:52:23.457889 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:52:23.457865 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/test-curl-7455-140321046990688" event={"ID":"89bba7b3-ad00-42e8-a6a4-bec9c42a6c19","Type":"ContainerStarted","Data":"1e8bea9d27b4fa1139b4f57e96b3fe53f1c6dc3b6c355a4cc8c31e0a3769ce6d"} Jul 15 04:52:24.466138 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:52:24.466095 2581 generic.go:356] "Generic (PLEG): container finished" podID="89bba7b3-ad00-42e8-a6a4-bec9c42a6c19" containerID="577eb29d65967d654b1fe77e10ed13edb4a02b03e78cf069e589a37bf190f20e" exitCode=0 Jul 15 04:52:24.466503 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:52:24.466182 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/test-curl-7455-140321046990688" event={"ID":"89bba7b3-ad00-42e8-a6a4-bec9c42a6c19","Type":"ContainerDied","Data":"577eb29d65967d654b1fe77e10ed13edb4a02b03e78cf069e589a37bf190f20e"} Jul 15 04:52:25.007084 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:52:25.007047 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2txpt"] Jul 15 04:52:25.621320 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:52:25.621296 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7455-140321046990688" Jul 15 04:52:25.664400 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:52:25.664366 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_test-curl-7455-140321046990688_89bba7b3-ad00-42e8-a6a4-bec9c42a6c19/test-curl-7455-140321046990688/0.log" Jul 15 04:52:25.698379 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:52:25.698348 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/test-curl-7455-140321046990688"] Jul 15 04:52:25.699831 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:52:25.699812 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-c4rgx\" (UniqueName: \"kubernetes.io/projected/89bba7b3-ad00-42e8-a6a4-bec9c42a6c19-kube-api-access-c4rgx\") pod \"89bba7b3-ad00-42e8-a6a4-bec9c42a6c19\" (UID: \"89bba7b3-ad00-42e8-a6a4-bec9c42a6c19\") " Jul 15 04:52:25.701987 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:52:25.701965 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/89bba7b3-ad00-42e8-a6a4-bec9c42a6c19-kube-api-access-c4rgx" (OuterVolumeSpecName: "kube-api-access-c4rgx") pod "89bba7b3-ad00-42e8-a6a4-bec9c42a6c19" (UID: "89bba7b3-ad00-42e8-a6a4-bec9c42a6c19"). InnerVolumeSpecName "kube-api-access-c4rgx". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 15 04:52:25.706409 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:52:25.706386 2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/test-curl-7455-140321046990688"] Jul 15 04:52:25.801010 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:52:25.800919 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-c4rgx\" (UniqueName: \"kubernetes.io/projected/89bba7b3-ad00-42e8-a6a4-bec9c42a6c19-kube-api-access-c4rgx\") on node \"ip-10-0-128-222.ec2.internal\" DevicePath \"\"" Jul 15 04:52:25.840294 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:52:25.840262 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/test-curl-7455-140321047113280"] Jul 15 04:52:25.840731 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:52:25.840718 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="89bba7b3-ad00-42e8-a6a4-bec9c42a6c19" containerName="test-curl-7455-140321046990688" Jul 15 04:52:25.840775 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:52:25.840733 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="89bba7b3-ad00-42e8-a6a4-bec9c42a6c19" containerName="test-curl-7455-140321046990688" Jul 15 04:52:25.840833 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:52:25.840824 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="89bba7b3-ad00-42e8-a6a4-bec9c42a6c19" containerName="test-curl-7455-140321046990688" Jul 15 04:52:25.843915 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:52:25.843896 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7455-140321047113280" Jul 15 04:52:25.854555 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:52:25.854527 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/test-curl-7455-140321047113280"] Jul 15 04:52:25.902164 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:52:25.902105 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qmc8r\" (UniqueName: \"kubernetes.io/projected/4fb8f8ef-2f2c-46f7-b585-75551d1b136c-kube-api-access-qmc8r\") pod \"test-curl-7455-140321047113280\" (UID: \"4fb8f8ef-2f2c-46f7-b585-75551d1b136c\") " pod="openshift-ingress/test-curl-7455-140321047113280" Jul 15 04:52:26.003478 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:52:26.003433 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qmc8r\" (UniqueName: \"kubernetes.io/projected/4fb8f8ef-2f2c-46f7-b585-75551d1b136c-kube-api-access-qmc8r\") pod \"test-curl-7455-140321047113280\" (UID: \"4fb8f8ef-2f2c-46f7-b585-75551d1b136c\") " pod="openshift-ingress/test-curl-7455-140321047113280" Jul 15 04:52:26.012071 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:52:26.012044 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qmc8r\" (UniqueName: \"kubernetes.io/projected/4fb8f8ef-2f2c-46f7-b585-75551d1b136c-kube-api-access-qmc8r\") pod \"test-curl-7455-140321047113280\" (UID: \"4fb8f8ef-2f2c-46f7-b585-75551d1b136c\") " pod="openshift-ingress/test-curl-7455-140321047113280" Jul 15 04:52:26.153182 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:52:26.153145 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7455-140321047113280" Jul 15 04:52:26.317900 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:52:26.317873 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/test-curl-7455-140321047113280"] Jul 15 04:52:26.318635 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:52:26.318614 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod4fb8f8ef_2f2c_46f7_b585_75551d1b136c.slice/crio-2da650030f163d26b6c20129814f2e84b8346b0bc82afdab698c6d136a1d6b93 WatchSource:0}: Error finding container 2da650030f163d26b6c20129814f2e84b8346b0bc82afdab698c6d136a1d6b93: Status 404 returned error can't find the container with id 2da650030f163d26b6c20129814f2e84b8346b0bc82afdab698c6d136a1d6b93 Jul 15 04:52:26.481696 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:52:26.481670 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7455-140321046990688" Jul 15 04:52:26.481864 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:52:26.481713 2581 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="1e8bea9d27b4fa1139b4f57e96b3fe53f1c6dc3b6c355a4cc8c31e0a3769ce6d" Jul 15 04:52:26.483011 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:52:26.482980 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/test-curl-7455-140321047113280" event={"ID":"4fb8f8ef-2f2c-46f7-b585-75551d1b136c","Type":"ContainerStarted","Data":"2da650030f163d26b6c20129814f2e84b8346b0bc82afdab698c6d136a1d6b93"} Jul 15 04:52:26.492262 ip-10-0-128-222 kubenswrapper[2581]: E0715 04:52:26.492238 2581 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7455-140321046990688\" is forbidden: User \"system:node:ip-10-0-128-222.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-ingress\": no relationship found between node 'ip-10-0-128-222.ec2.internal' and this object" podUID="89bba7b3-ad00-42e8-a6a4-bec9c42a6c19" pod="openshift-ingress/test-curl-7455-140321046990688" Jul 15 04:52:26.989689 ip-10-0-128-222 kubenswrapper[2581]: E0715 04:52:26.989595 2581 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7455-140321046990688\" is forbidden: User \"system:node:ip-10-0-128-222.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-ingress\": no relationship found between node 'ip-10-0-128-222.ec2.internal' and this object" podUID="89bba7b3-ad00-42e8-a6a4-bec9c42a6c19" pod="openshift-ingress/test-curl-7455-140321046990688" Jul 15 04:52:26.991632 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:52:26.991609 2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="89bba7b3-ad00-42e8-a6a4-bec9c42a6c19" path="/var/lib/kubelet/pods/89bba7b3-ad00-42e8-a6a4-bec9c42a6c19/volumes" Jul 15 04:52:27.491765 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:52:27.491730 2581 generic.go:356] "Generic (PLEG): container finished" podID="4fb8f8ef-2f2c-46f7-b585-75551d1b136c" containerID="5288d7f663547e76b1b754f6c1dd1eb4251d18d61868941d8716783f10a6eb58" exitCode=0 Jul 15 04:52:27.491961 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:52:27.491777 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/test-curl-7455-140321047113280" event={"ID":"4fb8f8ef-2f2c-46f7-b585-75551d1b136c","Type":"ContainerDied","Data":"5288d7f663547e76b1b754f6c1dd1eb4251d18d61868941d8716783f10a6eb58"} Jul 15 04:52:28.645958 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:52:28.645936 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7455-140321047113280" Jul 15 04:52:28.678230 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:52:28.678188 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_test-curl-7455-140321047113280_4fb8f8ef-2f2c-46f7-b585-75551d1b136c/test-curl-7455-140321047113280/0.log" Jul 15 04:52:28.716223 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:52:28.716186 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/test-curl-7455-140321047113280"] Jul 15 04:52:28.720599 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:52:28.720572 2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/test-curl-7455-140321047113280"] Jul 15 04:52:28.731016 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:52:28.730991 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qmc8r\" (UniqueName: \"kubernetes.io/projected/4fb8f8ef-2f2c-46f7-b585-75551d1b136c-kube-api-access-qmc8r\") pod \"4fb8f8ef-2f2c-46f7-b585-75551d1b136c\" (UID: \"4fb8f8ef-2f2c-46f7-b585-75551d1b136c\") " Jul 15 04:52:28.733009 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:52:28.732988 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4fb8f8ef-2f2c-46f7-b585-75551d1b136c-kube-api-access-qmc8r" (OuterVolumeSpecName: "kube-api-access-qmc8r") pod "4fb8f8ef-2f2c-46f7-b585-75551d1b136c" (UID: "4fb8f8ef-2f2c-46f7-b585-75551d1b136c"). InnerVolumeSpecName "kube-api-access-qmc8r". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 15 04:52:28.832813 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:52:28.832730 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qmc8r\" (UniqueName: \"kubernetes.io/projected/4fb8f8ef-2f2c-46f7-b585-75551d1b136c-kube-api-access-qmc8r\") on node \"ip-10-0-128-222.ec2.internal\" DevicePath \"\"" Jul 15 04:52:28.850330 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:52:28.850303 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/test-curl-7455-140321047113280"] Jul 15 04:52:28.850754 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:52:28.850740 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4fb8f8ef-2f2c-46f7-b585-75551d1b136c" containerName="test-curl-7455-140321047113280" Jul 15 04:52:28.850794 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:52:28.850756 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="4fb8f8ef-2f2c-46f7-b585-75551d1b136c" containerName="test-curl-7455-140321047113280" Jul 15 04:52:28.850874 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:52:28.850865 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="4fb8f8ef-2f2c-46f7-b585-75551d1b136c" containerName="test-curl-7455-140321047113280" Jul 15 04:52:28.853891 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:52:28.853876 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7455-140321047113280" Jul 15 04:52:28.863013 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:52:28.862991 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/test-curl-7455-140321047113280"] Jul 15 04:52:28.933718 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:52:28.933670 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fqfzf\" (UniqueName: \"kubernetes.io/projected/8c8113f7-a2b6-4666-a2ac-d043157b9407-kube-api-access-fqfzf\") pod \"test-curl-7455-140321047113280\" (UID: \"8c8113f7-a2b6-4666-a2ac-d043157b9407\") " pod="openshift-ingress/test-curl-7455-140321047113280" Jul 15 04:52:28.991216 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:52:28.991181 2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4fb8f8ef-2f2c-46f7-b585-75551d1b136c" path="/var/lib/kubelet/pods/4fb8f8ef-2f2c-46f7-b585-75551d1b136c/volumes" Jul 15 04:52:29.034713 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:52:29.034681 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fqfzf\" (UniqueName: \"kubernetes.io/projected/8c8113f7-a2b6-4666-a2ac-d043157b9407-kube-api-access-fqfzf\") pod \"test-curl-7455-140321047113280\" (UID: \"8c8113f7-a2b6-4666-a2ac-d043157b9407\") " pod="openshift-ingress/test-curl-7455-140321047113280" Jul 15 04:52:29.044239 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:52:29.044213 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fqfzf\" (UniqueName: \"kubernetes.io/projected/8c8113f7-a2b6-4666-a2ac-d043157b9407-kube-api-access-fqfzf\") pod \"test-curl-7455-140321047113280\" (UID: \"8c8113f7-a2b6-4666-a2ac-d043157b9407\") " pod="openshift-ingress/test-curl-7455-140321047113280" Jul 15 04:52:29.164095 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:52:29.164063 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7455-140321047113280" Jul 15 04:52:29.316525 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:52:29.316491 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/test-curl-7455-140321047113280"] Jul 15 04:52:29.317716 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:52:29.317689 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod8c8113f7_a2b6_4666_a2ac_d043157b9407.slice/crio-a7cf949cf2fd80275ac39475fe1417353af5aa93f79e764a5d7d353ce14b1857 WatchSource:0}: Error finding container a7cf949cf2fd80275ac39475fe1417353af5aa93f79e764a5d7d353ce14b1857: Status 404 returned error can't find the container with id a7cf949cf2fd80275ac39475fe1417353af5aa93f79e764a5d7d353ce14b1857 Jul 15 04:52:29.504853 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:52:29.504763 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7455-140321047113280" Jul 15 04:52:29.504853 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:52:29.504783 2581 scope.go:117] "RemoveContainer" containerID="5288d7f663547e76b1b754f6c1dd1eb4251d18d61868941d8716783f10a6eb58" Jul 15 04:52:29.506293 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:52:29.506263 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/test-curl-7455-140321047113280" event={"ID":"8c8113f7-a2b6-4666-a2ac-d043157b9407","Type":"ContainerStarted","Data":"a7cf949cf2fd80275ac39475fe1417353af5aa93f79e764a5d7d353ce14b1857"} Jul 15 04:52:30.517448 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:52:30.517414 2581 generic.go:356] "Generic (PLEG): container finished" podID="8c8113f7-a2b6-4666-a2ac-d043157b9407" containerID="c3b5cd5db99ab508a9d55e9b2012ca57d65becd30889391a9cb06076e487f764" exitCode=0 Jul 15 04:52:30.517832 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:52:30.517503 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/test-curl-7455-140321047113280" event={"ID":"8c8113f7-a2b6-4666-a2ac-d043157b9407","Type":"ContainerDied","Data":"c3b5cd5db99ab508a9d55e9b2012ca57d65becd30889391a9cb06076e487f764"} Jul 15 04:52:31.686699 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:52:31.686670 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7455-140321047113280" Jul 15 04:52:31.716631 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:52:31.716599 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_test-curl-7455-140321047113280_8c8113f7-a2b6-4666-a2ac-d043157b9407/test-curl-7455-140321047113280/0.log" Jul 15 04:52:31.747504 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:52:31.747464 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/test-curl-7455-140321047113280"] Jul 15 04:52:31.752095 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:52:31.752069 2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/test-curl-7455-140321047113280"] Jul 15 04:52:31.763533 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:52:31.763511 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fqfzf\" (UniqueName: \"kubernetes.io/projected/8c8113f7-a2b6-4666-a2ac-d043157b9407-kube-api-access-fqfzf\") pod \"8c8113f7-a2b6-4666-a2ac-d043157b9407\" (UID: \"8c8113f7-a2b6-4666-a2ac-d043157b9407\") " Jul 15 04:52:31.773949 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:52:31.773920 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8c8113f7-a2b6-4666-a2ac-d043157b9407-kube-api-access-fqfzf" (OuterVolumeSpecName: "kube-api-access-fqfzf") pod "8c8113f7-a2b6-4666-a2ac-d043157b9407" (UID: "8c8113f7-a2b6-4666-a2ac-d043157b9407"). InnerVolumeSpecName "kube-api-access-fqfzf". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 15 04:52:31.864860 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:52:31.864830 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fqfzf\" (UniqueName: \"kubernetes.io/projected/8c8113f7-a2b6-4666-a2ac-d043157b9407-kube-api-access-fqfzf\") on node \"ip-10-0-128-222.ec2.internal\" DevicePath \"\"" Jul 15 04:52:32.468111 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:52:32.468067 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:52:32.538597 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:52:32.538562 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7455-140321047113280" Jul 15 04:52:32.538597 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:52:32.538592 2581 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a7cf949cf2fd80275ac39475fe1417353af5aa93f79e764a5d7d353ce14b1857" Jul 15 04:52:32.548539 ip-10-0-128-222 kubenswrapper[2581]: E0715 04:52:32.548511 2581 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7455-140321047113280\" is forbidden: User \"system:node:ip-10-0-128-222.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-ingress\": no relationship found between node 'ip-10-0-128-222.ec2.internal' and this object" podUID="8c8113f7-a2b6-4666-a2ac-d043157b9407" pod="openshift-ingress/test-curl-7455-140321047113280" Jul 15 04:52:32.575515 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:52:32.575484 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:52:32.991929 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:52:32.991898 2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8c8113f7-a2b6-4666-a2ac-d043157b9407" path="/var/lib/kubelet/pods/8c8113f7-a2b6-4666-a2ac-d043157b9407/volumes" Jul 15 04:52:42.618273 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:52:42.618231 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:52:46.194951 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:52:46.194917 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2txpt"] Jul 15 04:52:47.060041 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:52:47.060004 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:52:52.818877 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:52:52.818843 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:52:52.919743 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:52:52.919697 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:52:57.775422 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:52:57.775388 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:52:58.027034 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:52:58.026946 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:52:58.686700 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:52:58.686665 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:52:58.787397 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:52:58.787356 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:53:08.754645 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:53:08.754605 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:53:12.084303 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:53:12.084260 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2txpt"] Jul 15 04:53:13.251881 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:53:13.251849 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:53:19.304730 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:53:19.304659 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:53:19.404769 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:53:19.404735 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:53:21.706349 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:53:21.706304 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:53:23.962960 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:53:23.962926 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:53:24.209864 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:53:24.209825 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:53:33.662926 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:53:33.662890 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-7s7wv_25756405-68e2-4f3d-aa52-30c5dc2e3060/manager/0.log" Jul 15 04:53:33.797290 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:53:33.797258 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-f89sq_50d1b2bc-4e32-423e-8e77-2f7027e456c5/manager/0.log" Jul 15 04:53:34.205921 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:53:34.205880 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-w5vhc_07fbebee-5fcc-461a-872c-3c59aba1c9f1/manager/0.log" Jul 15 04:53:34.587362 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:53:34.587284 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6dddd85b7f-vwqvs_fe24ce39-5cd7-4fc7-b16d-4e02a57c251e/copy-manifests/0.log" Jul 15 04:53:34.594638 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:53:34.594610 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6dddd85b7f-vwqvs_fe24ce39-5cd7-4fc7-b16d-4e02a57c251e/manager/0.log" Jul 15 04:53:37.483614 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:53:37.483572 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75944x6x_0b04d00f-dd42-4963-a0f4-c918108f00b7/util/0.log" Jul 15 04:53:37.489934 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:53:37.489903 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75944x6x_0b04d00f-dd42-4963-a0f4-c918108f00b7/pull/0.log" Jul 15 04:53:37.495654 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:53:37.495631 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75944x6x_0b04d00f-dd42-4963-a0f4-c918108f00b7/extract/0.log" Jul 15 04:53:37.617755 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:53:37.617722 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0g6k94_8835dd52-5c60-4e96-a90d-af88132ed1f6/extract/0.log" Jul 15 04:53:37.623729 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:53:37.623706 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0g6k94_8835dd52-5c60-4e96-a90d-af88132ed1f6/util/0.log" Jul 15 04:53:37.629421 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:53:37.629402 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0g6k94_8835dd52-5c60-4e96-a90d-af88132ed1f6/pull/0.log" Jul 15 04:53:37.748672 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:53:37.748599 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73jqkd7_e20a831e-673b-4307-89f4-bca058be431a/util/0.log" Jul 15 04:53:37.755476 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:53:37.755448 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73jqkd7_e20a831e-673b-4307-89f4-bca058be431a/pull/0.log" Jul 15 04:53:37.762194 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:53:37.762172 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73jqkd7_e20a831e-673b-4307-89f4-bca058be431a/extract/0.log" Jul 15 04:53:37.884350 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:53:37.884324 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1kwr9g_09c03cbd-de94-45a0-8292-a85da4332b2c/util/0.log" Jul 15 04:53:37.890366 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:53:37.890347 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1kwr9g_09c03cbd-de94-45a0-8292-a85da4332b2c/pull/0.log" Jul 15 04:53:37.896220 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:53:37.896205 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1kwr9g_09c03cbd-de94-45a0-8292-a85da4332b2c/extract/0.log" Jul 15 04:53:38.154439 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:53:38.154410 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-sjs8b_e0a2895a-efba-492d-95fe-3dc052d95cc1/manager/0.log" Jul 15 04:53:38.269070 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:53:38.269039 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-5rfbz_a631b1b8-3bca-4899-a430-f267246be43b/manager/0.log" Jul 15 04:53:38.508698 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:53:38.508614 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-7b868_edc31297-37f5-4239-bd8d-44c9b65ac162/registry-server/0.log" Jul 15 04:53:38.642882 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:53:38.642851 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-9xjcq_e53e2e89-dbe4-4095-8f2f-8efafc1d31de/manager/0.log" Jul 15 04:53:38.765709 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:53:38.765625 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-2txpt_65f76998-7615-4f88-b841-d97da32326b7/limitador/0.log" Jul 15 04:53:38.894710 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:53:38.894678 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-vmfcs_2a600a19-ed24-4ac6-8d6d-8bb10876188e/manager/0.log" Jul 15 04:53:39.267781 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:53:39.267752 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf47shcm_66fe008f-fec7-48e3-9961-d2182009e784/istio-proxy/0.log" Jul 15 04:53:39.512200 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:53:39.512162 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-b8bc8694c-cvv52_fe15406b-86ed-4c2e-afc7-4a1cb0c13379/kube-auth-proxy/0.log" Jul 15 04:53:39.756453 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:53:39.756425 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-mwc8f_8b83a502-4967-479d-b3e6-dbdffd64638a/istio-proxy/1.log" Jul 15 04:53:40.119767 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:53:40.119738 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-64997dd578-n79tf_a0a40e9b-cf54-4ae2-a584-ca5cadf85733/router/0.log" Jul 15 04:53:40.846192 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:53:40.846161 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbk2vf8_39c3fba6-aa9c-4c05-8aa2-0962a43da278/main/0.log" Jul 15 04:53:40.967229 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:53:40.967200 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-74b68447df-5dxzh_1dac2ac6-b47f-44d4-b745-c39fc3b4a04c/main/0.log" Jul 15 04:53:45.541310 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:53:45.541270 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:53:46.781251 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:53:46.781214 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" limit=1024 Jul 15 04:53:48.403852 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:53:48.403814 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-kz7p2_6616446d-4bdb-4867-a2f8-c39ed74908b9/global-pull-secret-syncer/0.log" Jul 15 04:53:48.499376 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:53:48.499342 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-cvjv6_cd97c7ca-8e2d-4d45-86cb-1006fcc3f6be/konnectivity-agent/0.log" Jul 15 04:53:48.586102 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:53:48.586071 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-128-222.ec2.internal_843258bd2137f5699fadd3ee328bb5bf/haproxy/0.log" Jul 15 04:53:53.696029 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:53:53.695990 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75944x6x_0b04d00f-dd42-4963-a0f4-c918108f00b7/extract/0.log" Jul 15 04:53:53.715854 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:53:53.715827 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75944x6x_0b04d00f-dd42-4963-a0f4-c918108f00b7/util/0.log" Jul 15 04:53:53.739099 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:53:53.739060 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75944x6x_0b04d00f-dd42-4963-a0f4-c918108f00b7/pull/0.log" Jul 15 04:53:53.765605 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:53:53.765564 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0g6k94_8835dd52-5c60-4e96-a90d-af88132ed1f6/extract/0.log" Jul 15 04:53:53.788704 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:53:53.788676 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0g6k94_8835dd52-5c60-4e96-a90d-af88132ed1f6/util/0.log" Jul 15 04:53:53.808609 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:53:53.808576 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0g6k94_8835dd52-5c60-4e96-a90d-af88132ed1f6/pull/0.log" Jul 15 04:53:53.834973 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:53:53.834944 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73jqkd7_e20a831e-673b-4307-89f4-bca058be431a/extract/0.log" Jul 15 04:53:53.853926 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:53:53.853899 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73jqkd7_e20a831e-673b-4307-89f4-bca058be431a/util/0.log" Jul 15 04:53:53.873574 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:53:53.873535 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73jqkd7_e20a831e-673b-4307-89f4-bca058be431a/pull/0.log" Jul 15 04:53:53.897611 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:53:53.897579 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1kwr9g_09c03cbd-de94-45a0-8292-a85da4332b2c/extract/0.log" Jul 15 04:53:53.916927 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:53:53.916898 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1kwr9g_09c03cbd-de94-45a0-8292-a85da4332b2c/util/0.log" Jul 15 04:53:53.937447 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:53:53.937413 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1kwr9g_09c03cbd-de94-45a0-8292-a85da4332b2c/pull/0.log" Jul 15 04:53:54.379959 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:53:54.379925 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-sjs8b_e0a2895a-efba-492d-95fe-3dc052d95cc1/manager/0.log" Jul 15 04:53:54.406841 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:53:54.406817 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-5rfbz_a631b1b8-3bca-4899-a430-f267246be43b/manager/0.log" Jul 15 04:53:54.483548 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:53:54.483514 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-7b868_edc31297-37f5-4239-bd8d-44c9b65ac162/registry-server/0.log" Jul 15 04:53:54.649560 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:53:54.649439 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-9xjcq_e53e2e89-dbe4-4095-8f2f-8efafc1d31de/manager/0.log" Jul 15 04:53:54.680348 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:53:54.680321 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-2txpt_65f76998-7615-4f88-b841-d97da32326b7/limitador/0.log" Jul 15 04:53:54.776688 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:53:54.776649 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-vmfcs_2a600a19-ed24-4ac6-8d6d-8bb10876188e/manager/0.log" Jul 15 04:53:56.237994 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:53:56.237966 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_98f58506-f9c5-4cf3-9c18-fe1cb6197e02/alertmanager/0.log" Jul 15 04:53:56.258233 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:53:56.258193 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_98f58506-f9c5-4cf3-9c18-fe1cb6197e02/config-reloader/0.log" Jul 15 04:53:56.277689 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:53:56.277665 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_98f58506-f9c5-4cf3-9c18-fe1cb6197e02/kube-rbac-proxy-web/0.log" Jul 15 04:53:56.300547 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:53:56.300494 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_98f58506-f9c5-4cf3-9c18-fe1cb6197e02/kube-rbac-proxy/0.log" Jul 15 04:53:56.319060 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:53:56.319034 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_98f58506-f9c5-4cf3-9c18-fe1cb6197e02/kube-rbac-proxy-metric/0.log" Jul 15 04:53:56.337638 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:53:56.337620 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_98f58506-f9c5-4cf3-9c18-fe1cb6197e02/prom-label-proxy/0.log" Jul 15 04:53:56.362392 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:53:56.362368 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_98f58506-f9c5-4cf3-9c18-fe1cb6197e02/init-config-reloader/0.log" Jul 15 04:53:56.418474 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:53:56.418450 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-5f7f494dd4-n29ck_b46dec59-62a8-45be-a415-049fa148fcdd/cluster-monitoring-operator/0.log" Jul 15 04:53:56.445250 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:53:56.445223 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-785778ff74-bnbjl_c1adb7b7-2826-4431-b154-636573627417/kube-state-metrics/0.log" Jul 15 04:53:56.460796 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:53:56.460770 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-785778ff74-bnbjl_c1adb7b7-2826-4431-b154-636573627417/kube-rbac-proxy-main/0.log" Jul 15 04:53:56.485631 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:53:56.485606 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-785778ff74-bnbjl_c1adb7b7-2826-4431-b154-636573627417/kube-rbac-proxy-self/0.log" Jul 15 04:53:56.513474 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:53:56.513412 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-77bc8bcdf5-cmdd5_ba24f9e9-e5da-40b8-9812-a5fe45ed111b/metrics-server/0.log" Jul 15 04:53:56.534441 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:53:56.534417 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-5f68df7f58-fcdhg_f622f33d-9069-4b94-a5d5-a4e67feafff0/monitoring-plugin/0.log" Jul 15 04:53:56.564694 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:53:56.564671 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-4jt5z_03d9ee76-91a7-40fd-8200-c16c2aa5d6f3/node-exporter/0.log" Jul 15 04:53:56.582790 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:53:56.582772 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-4jt5z_03d9ee76-91a7-40fd-8200-c16c2aa5d6f3/kube-rbac-proxy/0.log" Jul 15 04:53:56.606398 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:53:56.606380 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-4jt5z_03d9ee76-91a7-40fd-8200-c16c2aa5d6f3/init-textfile/0.log" Jul 15 04:53:56.781869 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:53:56.781776 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-84bd68b896-7pv89_6b8dd87f-c467-4042-bbc4-d4e11f8c0532/kube-rbac-proxy-main/0.log" Jul 15 04:53:56.801559 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:53:56.801536 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-84bd68b896-7pv89_6b8dd87f-c467-4042-bbc4-d4e11f8c0532/kube-rbac-proxy-self/0.log" Jul 15 04:53:56.829681 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:53:56.829653 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-84bd68b896-7pv89_6b8dd87f-c467-4042-bbc4-d4e11f8c0532/openshift-state-metrics/0.log" Jul 15 04:53:57.109012 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:53:57.108987 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-7b46d6974c-hnn78_a0a7afe1-49e5-4ba7-afc5-c1911aac011c/telemeter-client/0.log" Jul 15 04:53:57.129412 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:53:57.129382 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-7b46d6974c-hnn78_a0a7afe1-49e5-4ba7-afc5-c1911aac011c/reload/0.log" Jul 15 04:53:57.147741 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:53:57.147712 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-7b46d6974c-hnn78_a0a7afe1-49e5-4ba7-afc5-c1911aac011c/kube-rbac-proxy/0.log" Jul 15 04:53:57.967596 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:53:57.967562 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-lg2gg/perf-node-gather-daemonset-tfkpc"] Jul 15 04:53:57.968237 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:53:57.968217 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8c8113f7-a2b6-4666-a2ac-d043157b9407" containerName="test-curl-7455-140321047113280" Jul 15 04:53:57.968237 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:53:57.968239 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="8c8113f7-a2b6-4666-a2ac-d043157b9407" containerName="test-curl-7455-140321047113280" Jul 15 04:53:57.968394 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:53:57.968365 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="8c8113f7-a2b6-4666-a2ac-d043157b9407" containerName="test-curl-7455-140321047113280" Jul 15 04:53:57.971619 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:53:57.971597 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-lg2gg/perf-node-gather-daemonset-tfkpc" Jul 15 04:53:57.974227 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:53:57.974201 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-lg2gg\"/\"openshift-service-ca.crt\"" Jul 15 04:53:57.974227 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:53:57.974227 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-lg2gg\"/\"default-dockercfg-j6wft\"" Jul 15 04:53:57.974422 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:53:57.974258 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-lg2gg\"/\"kube-root-ca.crt\"" Jul 15 04:53:57.978524 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:53:57.978501 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-lg2gg/perf-node-gather-daemonset-tfkpc"] Jul 15 04:53:58.097765 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:53:58.097734 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/5e005aeb-54b9-4c93-8095-14da857d019f-proc\") pod \"perf-node-gather-daemonset-tfkpc\" (UID: \"5e005aeb-54b9-4c93-8095-14da857d019f\") " pod="openshift-must-gather-lg2gg/perf-node-gather-daemonset-tfkpc" Jul 15 04:53:58.097976 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:53:58.097786 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/5e005aeb-54b9-4c93-8095-14da857d019f-podres\") pod \"perf-node-gather-daemonset-tfkpc\" (UID: \"5e005aeb-54b9-4c93-8095-14da857d019f\") " pod="openshift-must-gather-lg2gg/perf-node-gather-daemonset-tfkpc" Jul 15 04:53:58.097976 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:53:58.097894 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wqfjg\" (UniqueName: \"kubernetes.io/projected/5e005aeb-54b9-4c93-8095-14da857d019f-kube-api-access-wqfjg\") pod \"perf-node-gather-daemonset-tfkpc\" (UID: \"5e005aeb-54b9-4c93-8095-14da857d019f\") " pod="openshift-must-gather-lg2gg/perf-node-gather-daemonset-tfkpc" Jul 15 04:53:58.097976 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:53:58.097968 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5e005aeb-54b9-4c93-8095-14da857d019f-sys\") pod \"perf-node-gather-daemonset-tfkpc\" (UID: \"5e005aeb-54b9-4c93-8095-14da857d019f\") " pod="openshift-must-gather-lg2gg/perf-node-gather-daemonset-tfkpc" Jul 15 04:53:58.098108 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:53:58.098030 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/5e005aeb-54b9-4c93-8095-14da857d019f-lib-modules\") pod \"perf-node-gather-daemonset-tfkpc\" (UID: \"5e005aeb-54b9-4c93-8095-14da857d019f\") " pod="openshift-must-gather-lg2gg/perf-node-gather-daemonset-tfkpc" Jul 15 04:53:58.199266 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:53:58.199227 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/5e005aeb-54b9-4c93-8095-14da857d019f-proc\") pod \"perf-node-gather-daemonset-tfkpc\" (UID: \"5e005aeb-54b9-4c93-8095-14da857d019f\") " pod="openshift-must-gather-lg2gg/perf-node-gather-daemonset-tfkpc" Jul 15 04:53:58.199545 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:53:58.199274 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/5e005aeb-54b9-4c93-8095-14da857d019f-podres\") pod \"perf-node-gather-daemonset-tfkpc\" (UID: \"5e005aeb-54b9-4c93-8095-14da857d019f\") " pod="openshift-must-gather-lg2gg/perf-node-gather-daemonset-tfkpc" Jul 15 04:53:58.199545 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:53:58.199318 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wqfjg\" (UniqueName: \"kubernetes.io/projected/5e005aeb-54b9-4c93-8095-14da857d019f-kube-api-access-wqfjg\") pod \"perf-node-gather-daemonset-tfkpc\" (UID: \"5e005aeb-54b9-4c93-8095-14da857d019f\") " pod="openshift-must-gather-lg2gg/perf-node-gather-daemonset-tfkpc" Jul 15 04:53:58.199545 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:53:58.199343 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5e005aeb-54b9-4c93-8095-14da857d019f-sys\") pod \"perf-node-gather-daemonset-tfkpc\" (UID: \"5e005aeb-54b9-4c93-8095-14da857d019f\") " pod="openshift-must-gather-lg2gg/perf-node-gather-daemonset-tfkpc" Jul 15 04:53:58.199545 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:53:58.199364 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/5e005aeb-54b9-4c93-8095-14da857d019f-proc\") pod \"perf-node-gather-daemonset-tfkpc\" (UID: \"5e005aeb-54b9-4c93-8095-14da857d019f\") " pod="openshift-must-gather-lg2gg/perf-node-gather-daemonset-tfkpc" Jul 15 04:53:58.199545 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:53:58.199415 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/5e005aeb-54b9-4c93-8095-14da857d019f-lib-modules\") pod \"perf-node-gather-daemonset-tfkpc\" (UID: \"5e005aeb-54b9-4c93-8095-14da857d019f\") " pod="openshift-must-gather-lg2gg/perf-node-gather-daemonset-tfkpc" Jul 15 04:53:58.199545 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:53:58.199478 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/5e005aeb-54b9-4c93-8095-14da857d019f-podres\") pod \"perf-node-gather-daemonset-tfkpc\" (UID: \"5e005aeb-54b9-4c93-8095-14da857d019f\") " pod="openshift-must-gather-lg2gg/perf-node-gather-daemonset-tfkpc" Jul 15 04:53:58.199545 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:53:58.199529 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5e005aeb-54b9-4c93-8095-14da857d019f-sys\") pod \"perf-node-gather-daemonset-tfkpc\" (UID: \"5e005aeb-54b9-4c93-8095-14da857d019f\") " pod="openshift-must-gather-lg2gg/perf-node-gather-daemonset-tfkpc" Jul 15 04:53:58.199785 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:53:58.199558 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/5e005aeb-54b9-4c93-8095-14da857d019f-lib-modules\") pod \"perf-node-gather-daemonset-tfkpc\" (UID: \"5e005aeb-54b9-4c93-8095-14da857d019f\") " pod="openshift-must-gather-lg2gg/perf-node-gather-daemonset-tfkpc" Jul 15 04:53:58.206843 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:53:58.206817 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wqfjg\" (UniqueName: \"kubernetes.io/projected/5e005aeb-54b9-4c93-8095-14da857d019f-kube-api-access-wqfjg\") pod \"perf-node-gather-daemonset-tfkpc\" (UID: \"5e005aeb-54b9-4c93-8095-14da857d019f\") " pod="openshift-must-gather-lg2gg/perf-node-gather-daemonset-tfkpc" Jul 15 04:53:58.283934 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:53:58.283847 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-lg2gg/perf-node-gather-daemonset-tfkpc" Jul 15 04:53:58.427043 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:53:58.426933 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-lg2gg/perf-node-gather-daemonset-tfkpc"] Jul 15 04:53:58.430522 ip-10-0-128-222 kubenswrapper[2581]: W0715 04:53:58.430489 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod5e005aeb_54b9_4c93_8095_14da857d019f.slice/crio-8f6d84bd637359b747a533c6c428a5eb6015779885aa986ca85e9f3ac5117e09 WatchSource:0}: Error finding container 8f6d84bd637359b747a533c6c428a5eb6015779885aa986ca85e9f3ac5117e09: Status 404 returned error can't find the container with id 8f6d84bd637359b747a533c6c428a5eb6015779885aa986ca85e9f3ac5117e09 Jul 15 04:53:58.439408 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:53:58.439380 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-6cf856758c-cvvj2_d8a85153-9c3e-4ef3-934d-d69f03973e3d/networking-console-plugin/0.log" Jul 15 04:53:59.004945 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:53:59.004913 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-8kt5p_2db78c13-2384-4015-a886-14377224f4cd/console-operator/1.log" Jul 15 04:53:59.014658 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:53:59.014626 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-8kt5p_2db78c13-2384-4015-a886-14377224f4cd/console-operator/2.log" Jul 15 04:53:59.065136 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:53:59.065097 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-lg2gg/perf-node-gather-daemonset-tfkpc" event={"ID":"5e005aeb-54b9-4c93-8095-14da857d019f","Type":"ContainerStarted","Data":"c5def66c0b8ce31023b130f8677844701fedd5e167dc1e728e0a68863cc5ad6f"} Jul 15 04:53:59.065312 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:53:59.065177 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-lg2gg/perf-node-gather-daemonset-tfkpc" event={"ID":"5e005aeb-54b9-4c93-8095-14da857d019f","Type":"ContainerStarted","Data":"8f6d84bd637359b747a533c6c428a5eb6015779885aa986ca85e9f3ac5117e09"} Jul 15 04:53:59.065312 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:53:59.065281 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-lg2gg/perf-node-gather-daemonset-tfkpc" Jul 15 04:53:59.079698 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:53:59.079617 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-lg2gg/perf-node-gather-daemonset-tfkpc" podStartSLOduration=2.079598857 podStartE2EDuration="2.079598857s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 04:53:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 04:53:59.079388076 +0000 UTC m=+2872.606189092" watchObservedRunningTime="2026-07-15 04:53:59.079598857 +0000 UTC m=+2872.606399873" Jul 15 04:54:00.041284 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:54:00.041249 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-78495597f6-k6gt6_51a3888c-8a01-4735-a6c8-fff84102b6fc/volume-data-source-validator/0.log" Jul 15 04:54:01.145392 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:54:01.145361 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-hvcwt_d1ca6cbf-d937-4892-bc3b-ec5bb57a6734/dns/0.log" Jul 15 04:54:01.165646 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:54:01.165621 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-hvcwt_d1ca6cbf-d937-4892-bc3b-ec5bb57a6734/kube-rbac-proxy/0.log" Jul 15 04:54:01.214313 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:54:01.214284 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-lf5rb_e302da62-33bc-44ff-a188-8d409325e38f/dns-node-resolver/0.log" Jul 15 04:54:01.813855 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:54:01.813820 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-9kvf6_be62ee25-74cc-4b6d-83ed-7639d75d9e0b/node-ca/0.log" Jul 15 04:54:02.756443 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:54:02.756405 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf47shcm_66fe008f-fec7-48e3-9961-d2182009e784/istio-proxy/0.log" Jul 15 04:54:02.890675 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:54:02.890646 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-b8bc8694c-cvv52_fe15406b-86ed-4c2e-afc7-4a1cb0c13379/kube-auth-proxy/0.log" Jul 15 04:54:02.945488 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:54:02.945452 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-mwc8f_8b83a502-4967-479d-b3e6-dbdffd64638a/istio-proxy/0.log" Jul 15 04:54:03.003228 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:54:03.003195 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-mwc8f_8b83a502-4967-479d-b3e6-dbdffd64638a/istio-proxy/1.log" Jul 15 04:54:03.088023 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:54:03.087897 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-64997dd578-n79tf_a0a40e9b-cf54-4ae2-a584-ca5cadf85733/router/0.log" Jul 15 04:54:03.818368 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:54:03.818327 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-mptrm_419f1d13-f9de-4b4a-ad52-a977ee3b7ef2/serve-healthcheck-canary/0.log" Jul 15 04:54:04.301051 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:54:04.301019 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-68d9dd94cf-tr2rw_81a32cdd-cc66-4a2b-9d86-08b37f285ca2/insights-operator/0.log" Jul 15 04:54:04.302093 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:54:04.302072 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-68d9dd94cf-tr2rw_81a32cdd-cc66-4a2b-9d86-08b37f285ca2/insights-operator/1.log" Jul 15 04:54:04.456899 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:54:04.456858 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-z49zm_7ff4b72e-814e-4fc3-bb51-80bbf1749dbf/kube-rbac-proxy/0.log" Jul 15 04:54:04.476971 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:54:04.476946 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-z49zm_7ff4b72e-814e-4fc3-bb51-80bbf1749dbf/exporter/0.log" Jul 15 04:54:04.497657 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:54:04.497627 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-z49zm_7ff4b72e-814e-4fc3-bb51-80bbf1749dbf/extractor/0.log" Jul 15 04:54:05.080678 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:54:05.080654 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-lg2gg/perf-node-gather-daemonset-tfkpc" Jul 15 04:54:06.612202 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:54:06.612176 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-7s7wv_25756405-68e2-4f3d-aa52-30c5dc2e3060/manager/0.log" Jul 15 04:54:06.862772 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:54:06.862743 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-f89sq_50d1b2bc-4e32-423e-8e77-2f7027e456c5/manager/0.log" Jul 15 04:54:07.106991 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:54:07.106911 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-w5vhc_07fbebee-5fcc-461a-872c-3c59aba1c9f1/manager/0.log" Jul 15 04:54:07.299752 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:54:07.299722 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6dddd85b7f-vwqvs_fe24ce39-5cd7-4fc7-b16d-4e02a57c251e/manager/0.log" Jul 15 04:54:07.322797 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:54:07.322770 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6dddd85b7f-vwqvs_fe24ce39-5cd7-4fc7-b16d-4e02a57c251e/copy-manifests/0.log" Jul 15 04:54:08.303260 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:54:08.303175 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf47shcm_66fe008f-fec7-48e3-9961-d2182009e784/istio-proxy/0.log" Jul 15 04:54:08.415858 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:54:08.415833 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-b8bc8694c-cvv52_fe15406b-86ed-4c2e-afc7-4a1cb0c13379/kube-auth-proxy/0.log" Jul 15 04:54:08.451101 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:54:08.451072 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-mwc8f_8b83a502-4967-479d-b3e6-dbdffd64638a/istio-proxy/0.log" Jul 15 04:54:08.509482 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:54:08.509444 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-mwc8f_8b83a502-4967-479d-b3e6-dbdffd64638a/istio-proxy/1.log" Jul 15 04:54:08.565056 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:54:08.564972 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-64997dd578-n79tf_a0a40e9b-cf54-4ae2-a584-ca5cadf85733/router/0.log" Jul 15 04:54:09.841389 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:54:09.841355 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf47shcm_66fe008f-fec7-48e3-9961-d2182009e784/istio-proxy/0.log" Jul 15 04:54:09.967958 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:54:09.967874 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-b8bc8694c-cvv52_fe15406b-86ed-4c2e-afc7-4a1cb0c13379/kube-auth-proxy/0.log" Jul 15 04:54:10.009508 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:54:10.009466 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-mwc8f_8b83a502-4967-479d-b3e6-dbdffd64638a/istio-proxy/0.log" Jul 15 04:54:10.066080 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:54:10.066050 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-mwc8f_8b83a502-4967-479d-b3e6-dbdffd64638a/istio-proxy/1.log" Jul 15 04:54:10.125264 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:54:10.125227 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-64997dd578-n79tf_a0a40e9b-cf54-4ae2-a584-ca5cadf85733/router/0.log" Jul 15 04:54:13.845939 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:54:13.845906 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-799cb7f958-xgz4r_aa52afbe-abd9-45ea-9f98-6a66b50b07b7/kube-storage-version-migrator-operator/1.log" Jul 15 04:54:13.847742 ip-10-0-128-222 kubenswrapper[2581]: I0715 04:54:13.847715 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-799cb7f958-xgz4r_aa52afbe-abd9-45ea-9f98-6a66b50b07b7/kube-storage-version-migrator-operator/0.log"