Jul 25 01:09:55.353328 ip-10-0-129-35 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Jul 25 01:09:55.353339 ip-10-0-129-35 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Jul 25 01:09:55.353346 ip-10-0-129-35 systemd[1]: kubelet.service: Failed with result 'resources'. Jul 25 01:09:55.353571 ip-10-0-129-35 systemd[1]: Failed to start Kubernetes Kubelet. Jul 25 01:10:04.896704 ip-10-0-129-35 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. Jul 25 01:10:04.896718 ip-10-0-129-35 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot 9ec21b4d75df47e2b245d0716ffd2bbd -- Jul 25 01:11:54.193659 ip-10-0-129-35 systemd[1]: Starting Kubernetes Kubelet... Jul 25 01:11:54.573329 ip-10-0-129-35 kubenswrapper[2567]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 25 01:11:54.573329 ip-10-0-129-35 kubenswrapper[2567]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 25 01:11:54.573329 ip-10-0-129-35 kubenswrapper[2567]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 25 01:11:54.573329 ip-10-0-129-35 kubenswrapper[2567]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 25 01:11:54.573329 ip-10-0-129-35 kubenswrapper[2567]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 25 01:11:54.574004 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:54.573329 2567 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 25 01:11:54.579098 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:11:54.579076 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 25 01:11:54.579098 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:11:54.579094 2567 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 25 01:11:54.579098 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:11:54.579098 2567 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 25 01:11:54.579098 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:11:54.579101 2567 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 25 01:11:54.579098 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:11:54.579104 2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 25 01:11:54.579292 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:11:54.579107 2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 25 01:11:54.579292 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:11:54.579110 2567 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 25 01:11:54.579292 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:11:54.579113 2567 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 25 01:11:54.579292 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:11:54.579116 2567 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 25 01:11:54.579292 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:11:54.579118 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 25 01:11:54.579292 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:11:54.579121 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 25 01:11:54.579292 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:11:54.579124 2567 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 25 01:11:54.579292 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:11:54.579127 2567 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 25 01:11:54.579292 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:11:54.579130 2567 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 25 01:11:54.579292 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:11:54.579133 2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 25 01:11:54.579292 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:11:54.579136 2567 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 25 01:11:54.579292 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:11:54.579138 2567 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 25 01:11:54.579292 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:11:54.579141 2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 25 01:11:54.579292 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:11:54.579144 2567 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 25 01:11:54.579292 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:11:54.579146 2567 feature_gate.go:328] unrecognized feature gate: Example Jul 25 01:11:54.579292 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:11:54.579149 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 25 01:11:54.579292 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:11:54.579151 2567 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 25 01:11:54.579292 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:11:54.579154 2567 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 25 01:11:54.579292 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:11:54.579156 2567 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 25 01:11:54.579292 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:11:54.579159 2567 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 25 01:11:54.579784 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:11:54.579161 2567 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 25 01:11:54.579784 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:11:54.579164 2567 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 25 01:11:54.579784 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:11:54.579166 2567 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 25 01:11:54.579784 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:11:54.579169 2567 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 25 01:11:54.579784 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:11:54.579171 2567 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 25 01:11:54.579784 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:11:54.579174 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 25 01:11:54.579784 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:11:54.579178 2567 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 25 01:11:54.579784 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:11:54.579182 2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 25 01:11:54.579784 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:11:54.579185 2567 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 25 01:11:54.579784 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:11:54.579187 2567 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 25 01:11:54.579784 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:11:54.579190 2567 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 25 01:11:54.579784 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:11:54.579192 2567 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 25 01:11:54.579784 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:11:54.579195 2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 25 01:11:54.579784 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:11:54.579198 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 25 01:11:54.579784 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:11:54.579200 2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 25 01:11:54.579784 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:11:54.579203 2567 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 25 01:11:54.579784 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:11:54.579205 2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 25 01:11:54.579784 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:11:54.579208 2567 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 25 01:11:54.579784 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:11:54.579211 2567 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 25 01:11:54.579784 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:11:54.579213 2567 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 25 01:11:54.580298 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:11:54.579216 2567 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 25 01:11:54.580298 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:11:54.579218 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 25 01:11:54.580298 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:11:54.579221 2567 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 25 01:11:54.580298 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:11:54.579223 2567 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 25 01:11:54.580298 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:11:54.579226 2567 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 25 01:11:54.580298 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:11:54.579229 2567 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 25 01:11:54.580298 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:11:54.579231 2567 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 25 01:11:54.580298 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:11:54.579234 2567 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 25 01:11:54.580298 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:11:54.579237 2567 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 25 01:11:54.580298 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:11:54.579239 2567 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 25 01:11:54.580298 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:11:54.579242 2567 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 25 01:11:54.580298 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:11:54.579251 2567 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 25 01:11:54.580298 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:11:54.579255 2567 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 25 01:11:54.580298 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:11:54.579258 2567 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 25 01:11:54.580298 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:11:54.579260 2567 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 25 01:11:54.580298 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:11:54.579263 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 25 01:11:54.580298 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:11:54.579266 2567 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 25 01:11:54.580298 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:11:54.579269 2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 25 01:11:54.580298 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:11:54.579271 2567 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 25 01:11:54.580298 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:11:54.579274 2567 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 25 01:11:54.580793 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:11:54.579277 2567 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 25 01:11:54.580793 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:11:54.579279 2567 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 25 01:11:54.580793 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:11:54.579282 2567 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 25 01:11:54.580793 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:11:54.579285 2567 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 25 01:11:54.580793 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:11:54.579289 2567 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 25 01:11:54.580793 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:11:54.579293 2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 25 01:11:54.580793 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:11:54.579296 2567 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 25 01:11:54.580793 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:11:54.579299 2567 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 25 01:11:54.580793 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:11:54.579302 2567 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 25 01:11:54.580793 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:11:54.579305 2567 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 25 01:11:54.580793 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:11:54.579308 2567 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 25 01:11:54.580793 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:11:54.579311 2567 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 25 01:11:54.580793 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:11:54.579313 2567 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 25 01:11:54.580793 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:11:54.579315 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 25 01:11:54.580793 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:11:54.579318 2567 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 25 01:11:54.580793 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:11:54.579321 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 25 01:11:54.580793 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:11:54.579324 2567 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 25 01:11:54.580793 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:11:54.579327 2567 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 25 01:11:54.580793 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:11:54.579330 2567 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 25 01:11:54.581256 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:11:54.579333 2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 25 01:11:54.581256 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:11:54.579335 2567 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 25 01:11:54.581256 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:11:54.579338 2567 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 25 01:11:54.581256 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:11:54.579340 2567 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 25 01:11:54.581256 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:11:54.579343 2567 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 25 01:11:54.581256 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:11:54.579345 2567 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 25 01:11:54.581256 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:11:54.579348 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 25 01:11:54.581256 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:11:54.579350 2567 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 25 01:11:54.581256 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:11:54.579353 2567 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 25 01:11:54.581256 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:11:54.579355 2567 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 25 01:11:54.581256 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:11:54.579358 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 25 01:11:54.581256 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:11:54.579360 2567 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 25 01:11:54.581256 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:11:54.579363 2567 feature_gate.go:328] unrecognized feature gate: Example2 Jul 25 01:11:54.581256 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:11:54.579365 2567 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 25 01:11:54.581256 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:11:54.579368 2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 25 01:11:54.581256 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:11:54.580037 2567 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 25 01:11:54.581256 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:11:54.580043 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 25 01:11:54.581256 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:11:54.580048 2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 25 01:11:54.581256 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:11:54.580052 2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 25 01:11:54.581256 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:11:54.580055 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 25 01:11:54.581749 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:11:54.580058 2567 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 25 01:11:54.581749 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:11:54.580061 2567 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 25 01:11:54.581749 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:11:54.580064 2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 25 01:11:54.581749 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:11:54.580068 2567 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 25 01:11:54.581749 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:11:54.580072 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 25 01:11:54.581749 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:11:54.580075 2567 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 25 01:11:54.581749 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:11:54.580078 2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 25 01:11:54.581749 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:11:54.580081 2567 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 25 01:11:54.581749 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:11:54.580084 2567 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 25 01:11:54.581749 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:11:54.580088 2567 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 25 01:11:54.581749 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:11:54.580092 2567 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 25 01:11:54.581749 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:11:54.580095 2567 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 25 01:11:54.581749 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:11:54.580098 2567 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 25 01:11:54.581749 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:11:54.580101 2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 25 01:11:54.581749 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:11:54.580103 2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 25 01:11:54.581749 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:11:54.580106 2567 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 25 01:11:54.581749 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:11:54.580109 2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 25 01:11:54.581749 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:11:54.580112 2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 25 01:11:54.581749 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:11:54.580114 2567 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 25 01:11:54.582206 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:11:54.580117 2567 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 25 01:11:54.582206 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:11:54.580120 2567 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 25 01:11:54.582206 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:11:54.580123 2567 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 25 01:11:54.582206 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:11:54.580126 2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 25 01:11:54.582206 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:11:54.580128 2567 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 25 01:11:54.582206 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:11:54.580131 2567 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 25 01:11:54.582206 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:11:54.580133 2567 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 25 01:11:54.582206 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:11:54.580136 2567 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 25 01:11:54.582206 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:11:54.580138 2567 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 25 01:11:54.582206 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:11:54.580142 2567 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 25 01:11:54.582206 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:11:54.580145 2567 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 25 01:11:54.582206 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:11:54.580149 2567 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 25 01:11:54.582206 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:11:54.580151 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 25 01:11:54.582206 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:11:54.580154 2567 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 25 01:11:54.582206 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:11:54.580156 2567 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 25 01:11:54.582206 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:11:54.580159 2567 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 25 01:11:54.582206 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:11:54.580161 2567 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 25 01:11:54.582206 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:11:54.580164 2567 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 25 01:11:54.582206 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:11:54.580167 2567 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 25 01:11:54.582206 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:11:54.580169 2567 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 25 01:11:54.582717 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:11:54.580171 2567 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 25 01:11:54.582717 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:11:54.580174 2567 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 25 01:11:54.582717 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:11:54.580176 2567 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 25 01:11:54.582717 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:11:54.580179 2567 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 25 01:11:54.582717 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:11:54.580181 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 25 01:11:54.582717 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:11:54.580184 2567 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 25 01:11:54.582717 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:11:54.580187 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 25 01:11:54.582717 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:11:54.580189 2567 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 25 01:11:54.582717 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:11:54.580192 2567 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 25 01:11:54.582717 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:11:54.580195 2567 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 25 01:11:54.582717 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:11:54.580197 2567 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 25 01:11:54.582717 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:11:54.580200 2567 feature_gate.go:328] unrecognized feature gate: Example Jul 25 01:11:54.582717 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:11:54.580203 2567 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 25 01:11:54.582717 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:11:54.580205 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 25 01:11:54.582717 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:11:54.580208 2567 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 25 01:11:54.582717 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:11:54.580210 2567 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 25 01:11:54.582717 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:11:54.580213 2567 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 25 01:11:54.582717 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:11:54.580215 2567 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 25 01:11:54.582717 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:11:54.580217 2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 25 01:11:54.582717 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:11:54.580220 2567 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 25 01:11:54.583231 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:11:54.580222 2567 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 25 01:11:54.583231 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:11:54.580226 2567 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 25 01:11:54.583231 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:11:54.580228 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 25 01:11:54.583231 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:11:54.580231 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 25 01:11:54.583231 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:11:54.580233 2567 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 25 01:11:54.583231 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:11:54.580236 2567 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 25 01:11:54.583231 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:11:54.580238 2567 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 25 01:11:54.583231 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:11:54.580241 2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 25 01:11:54.583231 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:11:54.580243 2567 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 25 01:11:54.583231 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:11:54.580246 2567 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 25 01:11:54.583231 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:11:54.580248 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 25 01:11:54.583231 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:11:54.580251 2567 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 25 01:11:54.583231 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:11:54.580253 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 25 01:11:54.583231 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:11:54.580256 2567 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 25 01:11:54.583231 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:11:54.580258 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 25 01:11:54.583231 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:11:54.580261 2567 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 25 01:11:54.583231 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:11:54.580263 2567 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 25 01:11:54.583231 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:11:54.580265 2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 25 01:11:54.583231 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:11:54.580268 2567 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 25 01:11:54.583706 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:11:54.580270 2567 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 25 01:11:54.583706 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:11:54.580273 2567 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 25 01:11:54.583706 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:11:54.580275 2567 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 25 01:11:54.583706 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:11:54.580278 2567 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 25 01:11:54.583706 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:11:54.580281 2567 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 25 01:11:54.583706 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:11:54.580283 2567 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 25 01:11:54.583706 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:11:54.580286 2567 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 25 01:11:54.583706 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:11:54.580288 2567 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 25 01:11:54.583706 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:11:54.580291 2567 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 25 01:11:54.583706 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:11:54.580293 2567 feature_gate.go:328] unrecognized feature gate: Example2 Jul 25 01:11:54.583706 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:11:54.580296 2567 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 25 01:11:54.583706 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:11:54.580298 2567 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 25 01:11:54.583706 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:11:54.580301 2567 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 25 01:11:54.583706 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:11:54.580304 2567 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 25 01:11:54.583706 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:11:54.580307 2567 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 25 01:11:54.583706 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:11:54.580309 2567 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 25 01:11:54.583706 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:11:54.580666 2567 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 25 01:11:54.583706 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:11:54.580671 2567 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 25 01:11:54.583706 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:11:54.580674 2567 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 25 01:11:54.583706 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:11:54.580676 2567 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 25 01:11:54.584179 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:11:54.580679 2567 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 25 01:11:54.584179 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:11:54.580682 2567 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 25 01:11:54.584179 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:11:54.580685 2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 25 01:11:54.584179 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:11:54.580687 2567 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 25 01:11:54.584179 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:11:54.580690 2567 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 25 01:11:54.584179 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:11:54.580692 2567 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 25 01:11:54.584179 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:11:54.580695 2567 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 25 01:11:54.584179 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:11:54.580699 2567 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 25 01:11:54.584179 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:11:54.580703 2567 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 25 01:11:54.584179 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:11:54.580706 2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 25 01:11:54.584179 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:11:54.580708 2567 feature_gate.go:328] unrecognized feature gate: Example Jul 25 01:11:54.584179 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:11:54.580711 2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 25 01:11:54.584179 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:11:54.580714 2567 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 25 01:11:54.584179 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:11:54.580717 2567 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 25 01:11:54.584179 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:11:54.580719 2567 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 25 01:11:54.584179 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:11:54.580722 2567 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 25 01:11:54.584179 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:11:54.580727 2567 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 25 01:11:54.584179 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:11:54.580729 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 25 01:11:54.584179 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:11:54.580731 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 25 01:11:54.584661 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:11:54.580734 2567 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 25 01:11:54.584661 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:11:54.580736 2567 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 25 01:11:54.584661 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:11:54.580739 2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 25 01:11:54.584661 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:11:54.580742 2567 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 25 01:11:54.584661 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:11:54.580744 2567 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 25 01:11:54.584661 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:11:54.580746 2567 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 25 01:11:54.584661 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:11:54.580749 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 25 01:11:54.584661 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:11:54.580751 2567 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 25 01:11:54.584661 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:11:54.580755 2567 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 25 01:11:54.584661 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:11:54.580758 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 25 01:11:54.584661 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:11:54.580761 2567 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 25 01:11:54.584661 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:11:54.580763 2567 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 25 01:11:54.584661 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:11:54.580766 2567 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 25 01:11:54.584661 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:11:54.580769 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 25 01:11:54.584661 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:11:54.580771 2567 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 25 01:11:54.584661 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:11:54.580774 2567 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 25 01:11:54.584661 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:11:54.580776 2567 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 25 01:11:54.584661 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:11:54.580779 2567 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 25 01:11:54.584661 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:11:54.580781 2567 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 25 01:11:54.585117 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:11:54.580784 2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 25 01:11:54.585117 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:11:54.580786 2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 25 01:11:54.585117 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:11:54.580788 2567 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 25 01:11:54.585117 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:11:54.580791 2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 25 01:11:54.585117 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:11:54.580793 2567 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 25 01:11:54.585117 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:11:54.580796 2567 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 25 01:11:54.585117 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:11:54.580799 2567 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 25 01:11:54.585117 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:11:54.580802 2567 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 25 01:11:54.585117 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:11:54.580804 2567 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 25 01:11:54.585117 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:11:54.580807 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 25 01:11:54.585117 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:11:54.580811 2567 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 25 01:11:54.585117 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:11:54.580813 2567 feature_gate.go:328] unrecognized feature gate: Example2 Jul 25 01:11:54.585117 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:11:54.580816 2567 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 25 01:11:54.585117 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:11:54.580818 2567 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 25 01:11:54.585117 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:11:54.580821 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 25 01:11:54.585117 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:11:54.580823 2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 25 01:11:54.585117 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:11:54.580825 2567 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 25 01:11:54.585117 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:11:54.580828 2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 25 01:11:54.585117 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:11:54.580830 2567 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 25 01:11:54.585117 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:11:54.580833 2567 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 25 01:11:54.585616 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:11:54.580835 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 25 01:11:54.585616 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:11:54.580839 2567 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 25 01:11:54.585616 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:11:54.580841 2567 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 25 01:11:54.585616 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:11:54.580843 2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 25 01:11:54.585616 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:11:54.580846 2567 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 25 01:11:54.585616 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:11:54.580848 2567 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 25 01:11:54.585616 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:11:54.580851 2567 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 25 01:11:54.585616 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:11:54.580853 2567 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 25 01:11:54.585616 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:11:54.580856 2567 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 25 01:11:54.585616 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:11:54.580858 2567 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 25 01:11:54.585616 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:11:54.580861 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 25 01:11:54.585616 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:11:54.580864 2567 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 25 01:11:54.585616 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:11:54.580866 2567 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 25 01:11:54.585616 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:11:54.580868 2567 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 25 01:11:54.585616 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:11:54.580871 2567 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 25 01:11:54.585616 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:11:54.580873 2567 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 25 01:11:54.585616 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:11:54.580876 2567 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 25 01:11:54.585616 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:11:54.580878 2567 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 25 01:11:54.585616 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:11:54.580881 2567 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 25 01:11:54.585616 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:11:54.580883 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 25 01:11:54.586093 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:11:54.580886 2567 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 25 01:11:54.586093 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:11:54.580888 2567 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 25 01:11:54.586093 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:11:54.580892 2567 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 25 01:11:54.586093 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:11:54.580895 2567 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 25 01:11:54.586093 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:11:54.580900 2567 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 25 01:11:54.586093 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:11:54.580903 2567 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 25 01:11:54.586093 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:11:54.580906 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 25 01:11:54.586093 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:11:54.580909 2567 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 25 01:11:54.586093 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:11:54.580912 2567 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 25 01:11:54.586093 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:11:54.580915 2567 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 25 01:11:54.586093 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:11:54.580917 2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 25 01:11:54.586093 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:11:54.580920 2567 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 25 01:11:54.586093 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:11:54.580922 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 25 01:11:54.586093 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:11:54.580926 2567 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 25 01:11:54.586093 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:11:54.580928 2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 25 01:11:54.586093 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:11:54.580930 2567 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 25 01:11:54.586093 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:11:54.580933 2567 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 25 01:11:54.586093 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:54.581013 2567 flags.go:64] FLAG: --address="0.0.0.0" Jul 25 01:11:54.586093 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:54.581022 2567 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 25 01:11:54.586093 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:54.581031 2567 flags.go:64] FLAG: --anonymous-auth="true" Jul 25 01:11:54.586614 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:54.581037 2567 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 25 01:11:54.586614 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:54.581042 2567 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 25 01:11:54.586614 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:54.581047 2567 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 25 01:11:54.586614 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:54.581052 2567 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 25 01:11:54.586614 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:54.581056 2567 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 25 01:11:54.586614 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:54.581059 2567 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 25 01:11:54.586614 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:54.581062 2567 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 25 01:11:54.586614 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:54.581065 2567 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 25 01:11:54.586614 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:54.581068 2567 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 25 01:11:54.586614 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:54.581071 2567 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 25 01:11:54.586614 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:54.581074 2567 flags.go:64] FLAG: --cgroup-root="" Jul 25 01:11:54.586614 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:54.581077 2567 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 25 01:11:54.586614 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:54.581080 2567 flags.go:64] FLAG: --client-ca-file="" Jul 25 01:11:54.586614 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:54.581083 2567 flags.go:64] FLAG: --cloud-provider="external" Jul 25 01:11:54.586614 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:54.581088 2567 flags.go:64] FLAG: --cluster-dns="[]" Jul 25 01:11:54.586614 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:54.581092 2567 flags.go:64] FLAG: --cluster-domain="" Jul 25 01:11:54.586614 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:54.581095 2567 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 25 01:11:54.586614 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:54.581098 2567 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 25 01:11:54.586614 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:54.581101 2567 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 25 01:11:54.586614 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:54.581104 2567 flags.go:64] FLAG: --container-log-max-files="5" Jul 25 01:11:54.586614 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:54.581108 2567 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 25 01:11:54.586614 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:54.581111 2567 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 25 01:11:54.586614 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:54.581114 2567 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 25 01:11:54.587481 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:54.581116 2567 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 25 01:11:54.587481 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:54.581119 2567 flags.go:64] FLAG: --contention-profiling="false" Jul 25 01:11:54.587481 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:54.581123 2567 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 25 01:11:54.587481 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:54.581126 2567 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 25 01:11:54.587481 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:54.581129 2567 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 25 01:11:54.587481 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:54.581132 2567 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 25 01:11:54.587481 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:54.581136 2567 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 25 01:11:54.587481 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:54.581139 2567 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 25 01:11:54.587481 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:54.581142 2567 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 25 01:11:54.587481 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:54.581145 2567 flags.go:64] FLAG: --enable-load-reader="false" Jul 25 01:11:54.587481 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:54.581147 2567 flags.go:64] FLAG: --enable-server="true" Jul 25 01:11:54.587481 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:54.581150 2567 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 25 01:11:54.587481 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:54.581154 2567 flags.go:64] FLAG: --event-burst="100" Jul 25 01:11:54.587481 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:54.581157 2567 flags.go:64] FLAG: --event-qps="50" Jul 25 01:11:54.587481 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:54.581160 2567 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 25 01:11:54.587481 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:54.581163 2567 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 25 01:11:54.587481 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:54.581166 2567 flags.go:64] FLAG: --eviction-hard="" Jul 25 01:11:54.587481 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:54.581169 2567 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 25 01:11:54.587481 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:54.581172 2567 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 25 01:11:54.587481 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:54.581175 2567 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 25 01:11:54.587481 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:54.581177 2567 flags.go:64] FLAG: --eviction-soft="" Jul 25 01:11:54.587481 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:54.581180 2567 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 25 01:11:54.587481 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:54.581183 2567 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 25 01:11:54.587481 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:54.581187 2567 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 25 01:11:54.587481 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:54.581190 2567 flags.go:64] FLAG: --experimental-mounter-path="" Jul 25 01:11:54.588592 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:54.581193 2567 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 25 01:11:54.588592 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:54.581196 2567 flags.go:64] FLAG: --fail-swap-on="true" Jul 25 01:11:54.588592 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:54.581198 2567 flags.go:64] FLAG: --feature-gates="" Jul 25 01:11:54.588592 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:54.581202 2567 flags.go:64] FLAG: --file-check-frequency="20s" Jul 25 01:11:54.588592 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:54.581205 2567 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 25 01:11:54.588592 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:54.581208 2567 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 25 01:11:54.588592 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:54.581210 2567 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 25 01:11:54.588592 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:54.581214 2567 flags.go:64] FLAG: --healthz-port="10248" Jul 25 01:11:54.588592 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:54.581216 2567 flags.go:64] FLAG: --help="false" Jul 25 01:11:54.588592 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:54.581220 2567 flags.go:64] FLAG: --hostname-override="ip-10-0-129-35.ec2.internal" Jul 25 01:11:54.588592 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:54.581223 2567 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 25 01:11:54.588592 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:54.581226 2567 flags.go:64] FLAG: --http-check-frequency="20s" Jul 25 01:11:54.588592 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:54.581229 2567 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 25 01:11:54.588592 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:54.581232 2567 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 25 01:11:54.588592 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:54.581235 2567 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 25 01:11:54.588592 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:54.581239 2567 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 25 01:11:54.588592 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:54.581241 2567 flags.go:64] FLAG: --image-service-endpoint="" Jul 25 01:11:54.588592 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:54.581244 2567 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 25 01:11:54.588592 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:54.581247 2567 flags.go:64] FLAG: --kube-api-burst="100" Jul 25 01:11:54.588592 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:54.581250 2567 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 25 01:11:54.588592 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:54.581253 2567 flags.go:64] FLAG: --kube-api-qps="50" Jul 25 01:11:54.588592 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:54.581256 2567 flags.go:64] FLAG: --kube-reserved="" Jul 25 01:11:54.588592 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:54.581259 2567 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 25 01:11:54.588592 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:54.581262 2567 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 25 01:11:54.589435 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:54.581265 2567 flags.go:64] FLAG: --kubelet-cgroups="" Jul 25 01:11:54.589435 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:54.581268 2567 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 25 01:11:54.589435 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:54.581271 2567 flags.go:64] FLAG: --lock-file="" Jul 25 01:11:54.589435 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:54.581274 2567 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 25 01:11:54.589435 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:54.581276 2567 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 25 01:11:54.589435 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:54.581279 2567 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 25 01:11:54.589435 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:54.581285 2567 flags.go:64] FLAG: --log-json-split-stream="false" Jul 25 01:11:54.589435 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:54.581289 2567 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 25 01:11:54.589435 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:54.581291 2567 flags.go:64] FLAG: --log-text-split-stream="false" Jul 25 01:11:54.589435 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:54.581294 2567 flags.go:64] FLAG: --logging-format="text" Jul 25 01:11:54.589435 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:54.581297 2567 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 25 01:11:54.589435 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:54.581300 2567 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 25 01:11:54.589435 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:54.581303 2567 flags.go:64] FLAG: --manifest-url="" Jul 25 01:11:54.589435 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:54.581306 2567 flags.go:64] FLAG: --manifest-url-header="" Jul 25 01:11:54.589435 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:54.581309 2567 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 25 01:11:54.589435 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:54.581312 2567 flags.go:64] FLAG: --max-open-files="1000000" Jul 25 01:11:54.589435 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:54.581316 2567 flags.go:64] FLAG: --max-pods="110" Jul 25 01:11:54.589435 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:54.581320 2567 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 25 01:11:54.589435 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:54.581322 2567 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 25 01:11:54.589435 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:54.581325 2567 flags.go:64] FLAG: --memory-manager-policy="None" Jul 25 01:11:54.589435 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:54.581328 2567 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 25 01:11:54.589435 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:54.581331 2567 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 25 01:11:54.589435 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:54.581334 2567 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 25 01:11:54.589435 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:54.581336 2567 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 25 01:11:54.589435 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:54.581343 2567 flags.go:64] FLAG: --node-status-max-images="50" Jul 25 01:11:54.590284 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:54.581346 2567 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 25 01:11:54.590284 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:54.581349 2567 flags.go:64] FLAG: --oom-score-adj="-999" Jul 25 01:11:54.590284 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:54.581351 2567 flags.go:64] FLAG: --pod-cidr="" Jul 25 01:11:54.590284 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:54.581354 2567 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7505336a406394b8c1c77d14d890a9f628aa4cfff172312179cb9af8c28c30bb" Jul 25 01:11:54.590284 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:54.581359 2567 flags.go:64] FLAG: --pod-manifest-path="" Jul 25 01:11:54.590284 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:54.581361 2567 flags.go:64] FLAG: --pod-max-pids="-1" Jul 25 01:11:54.590284 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:54.581364 2567 flags.go:64] FLAG: --pods-per-core="0" Jul 25 01:11:54.590284 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:54.581367 2567 flags.go:64] FLAG: --port="10250" Jul 25 01:11:54.590284 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:54.581370 2567 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 25 01:11:54.590284 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:54.581388 2567 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-078f0b179cb42f902" Jul 25 01:11:54.590284 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:54.581394 2567 flags.go:64] FLAG: --qos-reserved="" Jul 25 01:11:54.590284 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:54.581398 2567 flags.go:64] FLAG: --read-only-port="10255" Jul 25 01:11:54.590284 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:54.581402 2567 flags.go:64] FLAG: --register-node="true" Jul 25 01:11:54.590284 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:54.581407 2567 flags.go:64] FLAG: --register-with-taints="" Jul 25 01:11:54.590284 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:54.581413 2567 flags.go:64] FLAG: --registry-burst="10" Jul 25 01:11:54.590284 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:54.581416 2567 flags.go:64] FLAG: --registry-qps="5" Jul 25 01:11:54.590284 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:54.581419 2567 flags.go:64] FLAG: --reserved-cpus="" Jul 25 01:11:54.590284 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:54.581422 2567 flags.go:64] FLAG: --reserved-memory="" Jul 25 01:11:54.590284 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:54.581425 2567 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 25 01:11:54.590284 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:54.581428 2567 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 25 01:11:54.590284 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:54.581431 2567 flags.go:64] FLAG: --rotate-certificates="false" Jul 25 01:11:54.590284 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:54.581433 2567 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 25 01:11:54.590284 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:54.581436 2567 flags.go:64] FLAG: --runonce="false" Jul 25 01:11:54.590284 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:54.581439 2567 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 25 01:11:54.590284 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:54.581442 2567 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 25 01:11:54.591327 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:54.581445 2567 flags.go:64] FLAG: --seccomp-default="false" Jul 25 01:11:54.591327 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:54.581448 2567 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 25 01:11:54.591327 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:54.581450 2567 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 25 01:11:54.591327 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:54.581453 2567 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 25 01:11:54.591327 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:54.581456 2567 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 25 01:11:54.591327 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:54.581459 2567 flags.go:64] FLAG: --storage-driver-password="root" Jul 25 01:11:54.591327 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:54.581462 2567 flags.go:64] FLAG: --storage-driver-secure="false" Jul 25 01:11:54.591327 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:54.581464 2567 flags.go:64] FLAG: --storage-driver-table="stats" Jul 25 01:11:54.591327 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:54.581467 2567 flags.go:64] FLAG: --storage-driver-user="root" Jul 25 01:11:54.591327 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:54.581470 2567 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 25 01:11:54.591327 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:54.581473 2567 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 25 01:11:54.591327 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:54.581475 2567 flags.go:64] FLAG: --system-cgroups="" Jul 25 01:11:54.591327 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:54.581478 2567 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 25 01:11:54.591327 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:54.581483 2567 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 25 01:11:54.591327 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:54.581486 2567 flags.go:64] FLAG: --tls-cert-file="" Jul 25 01:11:54.591327 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:54.581489 2567 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 25 01:11:54.591327 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:54.581493 2567 flags.go:64] FLAG: --tls-min-version="" Jul 25 01:11:54.591327 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:54.581495 2567 flags.go:64] FLAG: --tls-private-key-file="" Jul 25 01:11:54.591327 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:54.581498 2567 flags.go:64] FLAG: --topology-manager-policy="none" Jul 25 01:11:54.591327 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:54.581501 2567 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 25 01:11:54.591327 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:54.581504 2567 flags.go:64] FLAG: --topology-manager-scope="container" Jul 25 01:11:54.591327 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:54.581506 2567 flags.go:64] FLAG: --v="2" Jul 25 01:11:54.591327 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:54.581510 2567 flags.go:64] FLAG: --version="false" Jul 25 01:11:54.591327 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:54.581514 2567 flags.go:64] FLAG: --vmodule="" Jul 25 01:11:54.591327 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:54.581518 2567 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 25 01:11:54.592405 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:54.581521 2567 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 25 01:11:54.592405 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:11:54.581632 2567 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 25 01:11:54.592405 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:11:54.581636 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 25 01:11:54.592405 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:11:54.581640 2567 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 25 01:11:54.592405 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:11:54.581643 2567 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 25 01:11:54.592405 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:11:54.581646 2567 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 25 01:11:54.592405 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:11:54.581649 2567 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 25 01:11:54.592405 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:11:54.581652 2567 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 25 01:11:54.592405 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:11:54.581655 2567 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 25 01:11:54.592405 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:11:54.581657 2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 25 01:11:54.592405 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:11:54.581660 2567 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 25 01:11:54.592405 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:11:54.581664 2567 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 25 01:11:54.592405 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:11:54.581667 2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 25 01:11:54.592405 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:11:54.581670 2567 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 25 01:11:54.592405 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:11:54.581674 2567 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 25 01:11:54.592405 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:11:54.581677 2567 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 25 01:11:54.592405 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:11:54.581680 2567 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 25 01:11:54.592405 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:11:54.581683 2567 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 25 01:11:54.592405 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:11:54.581686 2567 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 25 01:11:54.592868 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:11:54.581689 2567 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 25 01:11:54.592868 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:11:54.581691 2567 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 25 01:11:54.592868 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:11:54.581694 2567 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 25 01:11:54.592868 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:11:54.581696 2567 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 25 01:11:54.592868 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:11:54.581699 2567 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 25 01:11:54.592868 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:11:54.581701 2567 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 25 01:11:54.592868 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:11:54.581703 2567 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 25 01:11:54.592868 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:11:54.581706 2567 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 25 01:11:54.592868 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:11:54.581708 2567 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 25 01:11:54.592868 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:11:54.581710 2567 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 25 01:11:54.592868 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:11:54.581713 2567 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 25 01:11:54.592868 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:11:54.581715 2567 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 25 01:11:54.592868 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:11:54.581718 2567 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 25 01:11:54.592868 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:11:54.581720 2567 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 25 01:11:54.592868 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:11:54.581722 2567 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 25 01:11:54.592868 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:11:54.581725 2567 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 25 01:11:54.592868 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:11:54.581727 2567 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 25 01:11:54.592868 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:11:54.581729 2567 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 25 01:11:54.592868 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:11:54.581732 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 25 01:11:54.592868 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:11:54.581734 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 25 01:11:54.593632 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:11:54.581737 2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 25 01:11:54.593632 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:11:54.581739 2567 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 25 01:11:54.593632 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:11:54.581741 2567 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 25 01:11:54.593632 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:11:54.581744 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 25 01:11:54.593632 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:11:54.581746 2567 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 25 01:11:54.593632 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:11:54.581748 2567 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 25 01:11:54.593632 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:11:54.581751 2567 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 25 01:11:54.593632 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:11:54.581753 2567 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 25 01:11:54.593632 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:11:54.581756 2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 25 01:11:54.593632 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:11:54.581758 2567 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 25 01:11:54.593632 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:11:54.581761 2567 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 25 01:11:54.593632 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:11:54.581764 2567 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 25 01:11:54.593632 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:11:54.581766 2567 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 25 01:11:54.593632 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:11:54.581769 2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 25 01:11:54.593632 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:11:54.581771 2567 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 25 01:11:54.593632 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:11:54.581774 2567 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 25 01:11:54.593632 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:11:54.581776 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 25 01:11:54.593632 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:11:54.581779 2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 25 01:11:54.593632 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:11:54.581781 2567 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 25 01:11:54.593632 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:11:54.581783 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 25 01:11:54.594219 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:11:54.581787 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 25 01:11:54.594219 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:11:54.581790 2567 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 25 01:11:54.594219 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:11:54.581792 2567 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 25 01:11:54.594219 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:11:54.581794 2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 25 01:11:54.594219 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:11:54.581797 2567 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 25 01:11:54.594219 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:11:54.581800 2567 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 25 01:11:54.594219 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:11:54.581803 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 25 01:11:54.594219 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:11:54.581806 2567 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 25 01:11:54.594219 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:11:54.581809 2567 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 25 01:11:54.594219 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:11:54.581812 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 25 01:11:54.594219 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:11:54.581814 2567 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 25 01:11:54.594219 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:11:54.581818 2567 feature_gate.go:328] unrecognized feature gate: Example Jul 25 01:11:54.594219 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:11:54.581820 2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 25 01:11:54.594219 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:11:54.581823 2567 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 25 01:11:54.594219 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:11:54.581825 2567 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 25 01:11:54.594219 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:11:54.581828 2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 25 01:11:54.594219 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:11:54.581830 2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 25 01:11:54.594219 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:11:54.581833 2567 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 25 01:11:54.594219 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:11:54.581835 2567 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 25 01:11:54.594869 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:11:54.581837 2567 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 25 01:11:54.594869 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:11:54.581840 2567 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 25 01:11:54.594869 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:11:54.581842 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 25 01:11:54.594869 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:11:54.581845 2567 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 25 01:11:54.594869 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:11:54.581848 2567 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 25 01:11:54.594869 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:11:54.581850 2567 feature_gate.go:328] unrecognized feature gate: Example2 Jul 25 01:11:54.594869 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:11:54.581852 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 25 01:11:54.594869 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:11:54.581855 2567 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 25 01:11:54.594869 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:11:54.581857 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 25 01:11:54.594869 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:11:54.581859 2567 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 25 01:11:54.594869 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:11:54.581862 2567 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 25 01:11:54.594869 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:11:54.581864 2567 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 25 01:11:54.594869 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:11:54.581867 2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 25 01:11:54.594869 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:11:54.581870 2567 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 25 01:11:54.594869 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:11:54.581873 2567 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 25 01:11:54.594869 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:11:54.581875 2567 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 25 01:11:54.594869 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:11:54.581878 2567 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 25 01:11:54.594869 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:11:54.581880 2567 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 25 01:11:54.594869 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:11:54.581883 2567 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 25 01:11:54.594869 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:11:54.581886 2567 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 25 01:11:54.595398 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:11:54.581888 2567 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 25 01:11:54.595398 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:11:54.581891 2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 25 01:11:54.595398 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:54.581896 2567 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 25 01:11:54.595398 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:54.589067 2567 server.go:529] "Kubelet version" kubeletVersion="v1.34.9" Jul 25 01:11:54.595398 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:54.589086 2567 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 25 01:11:54.595398 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:54.589744 2567 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 25 01:11:54.595398 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:54.589757 2567 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 25 01:11:54.595398 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:11:54.589843 2567 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 25 01:11:54.595398 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:11:54.589851 2567 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 25 01:11:54.595398 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:11:54.589856 2567 feature_gate.go:328] unrecognized feature gate: Example2 Jul 25 01:11:54.595398 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:11:54.589861 2567 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 25 01:11:54.595398 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:11:54.589866 2567 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 25 01:11:54.595398 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:11:54.589871 2567 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 25 01:11:54.595398 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:11:54.589876 2567 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 25 01:11:54.595398 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:11:54.589881 2567 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 25 01:11:54.595781 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:11:54.589885 2567 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 25 01:11:54.595781 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:11:54.589889 2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 25 01:11:54.595781 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:11:54.589893 2567 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 25 01:11:54.595781 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:11:54.589897 2567 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 25 01:11:54.595781 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:11:54.589901 2567 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 25 01:11:54.595781 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:11:54.589905 2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 25 01:11:54.595781 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:11:54.589909 2567 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 25 01:11:54.595781 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:11:54.589913 2567 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 25 01:11:54.595781 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:11:54.589918 2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 25 01:11:54.595781 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:11:54.589922 2567 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 25 01:11:54.595781 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:11:54.589926 2567 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 25 01:11:54.595781 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:11:54.589930 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 25 01:11:54.595781 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:11:54.589934 2567 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 25 01:11:54.595781 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:11:54.589939 2567 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 25 01:11:54.595781 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:11:54.589943 2567 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 25 01:11:54.595781 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:11:54.589947 2567 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 25 01:11:54.595781 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:11:54.589951 2567 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 25 01:11:54.595781 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:11:54.589955 2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 25 01:11:54.595781 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:11:54.589959 2567 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 25 01:11:54.595781 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:11:54.589963 2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 25 01:11:54.596281 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:11:54.589968 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 25 01:11:54.596281 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:11:54.589974 2567 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 25 01:11:54.596281 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:11:54.589979 2567 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 25 01:11:54.596281 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:11:54.589983 2567 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 25 01:11:54.596281 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:11:54.589989 2567 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 25 01:11:54.596281 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:11:54.589996 2567 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 25 01:11:54.596281 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:11:54.590002 2567 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 25 01:11:54.596281 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:11:54.590007 2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 25 01:11:54.596281 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:11:54.590011 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 25 01:11:54.596281 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:11:54.590016 2567 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 25 01:11:54.596281 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:11:54.590020 2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 25 01:11:54.596281 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:11:54.590025 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 25 01:11:54.596281 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:11:54.590029 2567 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 25 01:11:54.596281 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:11:54.590034 2567 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 25 01:11:54.596281 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:11:54.590038 2567 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 25 01:11:54.596281 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:11:54.590043 2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 25 01:11:54.596281 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:11:54.590047 2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 25 01:11:54.596281 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:11:54.590051 2567 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 25 01:11:54.596281 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:11:54.590056 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 25 01:11:54.596776 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:11:54.590060 2567 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 25 01:11:54.596776 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:11:54.590064 2567 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 25 01:11:54.596776 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:11:54.590068 2567 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 25 01:11:54.596776 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:11:54.590072 2567 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 25 01:11:54.596776 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:11:54.590076 2567 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 25 01:11:54.596776 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:11:54.590081 2567 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 25 01:11:54.596776 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:11:54.590085 2567 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 25 01:11:54.596776 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:11:54.590089 2567 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 25 01:11:54.596776 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:11:54.590093 2567 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 25 01:11:54.596776 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:11:54.590097 2567 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 25 01:11:54.596776 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:11:54.590101 2567 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 25 01:11:54.596776 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:11:54.590106 2567 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 25 01:11:54.596776 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:11:54.590110 2567 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 25 01:11:54.596776 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:11:54.590114 2567 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 25 01:11:54.596776 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:11:54.590119 2567 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 25 01:11:54.596776 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:11:54.590124 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 25 01:11:54.596776 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:11:54.590129 2567 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 25 01:11:54.596776 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:11:54.590133 2567 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 25 01:11:54.596776 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:11:54.590137 2567 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 25 01:11:54.596776 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:11:54.590141 2567 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 25 01:11:54.597305 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:11:54.590145 2567 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 25 01:11:54.597305 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:11:54.590149 2567 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 25 01:11:54.597305 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:11:54.590153 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 25 01:11:54.597305 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:11:54.590157 2567 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 25 01:11:54.597305 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:11:54.590161 2567 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 25 01:11:54.597305 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:11:54.590165 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 25 01:11:54.597305 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:11:54.590169 2567 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 25 01:11:54.597305 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:11:54.590173 2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 25 01:11:54.597305 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:11:54.590178 2567 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 25 01:11:54.597305 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:11:54.590182 2567 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 25 01:11:54.597305 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:11:54.590186 2567 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 25 01:11:54.597305 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:11:54.590190 2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 25 01:11:54.597305 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:11:54.590194 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 25 01:11:54.597305 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:11:54.590201 2567 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 25 01:11:54.597305 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:11:54.590206 2567 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 25 01:11:54.597305 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:11:54.590211 2567 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 25 01:11:54.597305 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:11:54.590215 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 25 01:11:54.597305 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:11:54.590221 2567 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 25 01:11:54.597305 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:11:54.590225 2567 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 25 01:11:54.597845 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:11:54.590229 2567 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 25 01:11:54.597845 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:11:54.590233 2567 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 25 01:11:54.597845 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:11:54.590237 2567 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 25 01:11:54.597845 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:11:54.590241 2567 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 25 01:11:54.597845 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:11:54.590245 2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 25 01:11:54.597845 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:11:54.590249 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 25 01:11:54.597845 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:11:54.590254 2567 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 25 01:11:54.597845 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:11:54.590258 2567 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 25 01:11:54.597845 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:11:54.590262 2567 feature_gate.go:328] unrecognized feature gate: Example Jul 25 01:11:54.597845 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:11:54.590267 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 25 01:11:54.597845 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:11:54.590271 2567 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 25 01:11:54.597845 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:11:54.590275 2567 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 25 01:11:54.597845 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:11:54.590279 2567 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 25 01:11:54.597845 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:54.590286 2567 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 25 01:11:54.597845 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:11:54.590529 2567 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 25 01:11:54.597845 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:11:54.590539 2567 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 25 01:11:54.598283 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:11:54.590544 2567 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 25 01:11:54.598283 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:11:54.590548 2567 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 25 01:11:54.598283 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:11:54.590553 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 25 01:11:54.598283 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:11:54.590557 2567 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 25 01:11:54.598283 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:11:54.590562 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 25 01:11:54.598283 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:11:54.590566 2567 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 25 01:11:54.598283 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:11:54.590571 2567 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 25 01:11:54.598283 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:11:54.590575 2567 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 25 01:11:54.598283 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:11:54.590580 2567 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 25 01:11:54.598283 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:11:54.590584 2567 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 25 01:11:54.598283 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:11:54.590588 2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 25 01:11:54.598283 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:11:54.590592 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 25 01:11:54.598283 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:11:54.590596 2567 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 25 01:11:54.598283 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:11:54.590600 2567 feature_gate.go:328] unrecognized feature gate: Example2 Jul 25 01:11:54.598283 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:11:54.590604 2567 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 25 01:11:54.598283 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:11:54.590608 2567 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 25 01:11:54.598283 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:11:54.590613 2567 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 25 01:11:54.598283 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:11:54.590616 2567 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 25 01:11:54.598283 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:11:54.590620 2567 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 25 01:11:54.598283 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:11:54.590624 2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 25 01:11:54.598804 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:11:54.590629 2567 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 25 01:11:54.598804 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:11:54.590633 2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 25 01:11:54.598804 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:11:54.590637 2567 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 25 01:11:54.598804 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:11:54.590641 2567 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 25 01:11:54.598804 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:11:54.590645 2567 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 25 01:11:54.598804 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:11:54.590649 2567 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 25 01:11:54.598804 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:11:54.590654 2567 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 25 01:11:54.598804 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:11:54.590658 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 25 01:11:54.598804 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:11:54.590662 2567 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 25 01:11:54.598804 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:11:54.590667 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 25 01:11:54.598804 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:11:54.590671 2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 25 01:11:54.598804 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:11:54.590674 2567 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 25 01:11:54.598804 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:11:54.590678 2567 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 25 01:11:54.598804 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:11:54.590682 2567 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 25 01:11:54.598804 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:11:54.590686 2567 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 25 01:11:54.598804 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:11:54.590690 2567 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 25 01:11:54.598804 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:11:54.590695 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 25 01:11:54.598804 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:11:54.590698 2567 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 25 01:11:54.598804 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:11:54.590703 2567 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 25 01:11:54.598804 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:11:54.590707 2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 25 01:11:54.599559 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:11:54.590711 2567 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 25 01:11:54.599559 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:11:54.590714 2567 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 25 01:11:54.599559 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:11:54.590721 2567 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 25 01:11:54.599559 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:11:54.590727 2567 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 25 01:11:54.599559 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:11:54.590732 2567 feature_gate.go:328] unrecognized feature gate: Example Jul 25 01:11:54.599559 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:11:54.590736 2567 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 25 01:11:54.599559 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:11:54.590740 2567 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 25 01:11:54.599559 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:11:54.590745 2567 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 25 01:11:54.599559 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:11:54.590749 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 25 01:11:54.599559 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:11:54.590753 2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 25 01:11:54.599559 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:11:54.590757 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 25 01:11:54.599559 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:11:54.590761 2567 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 25 01:11:54.599559 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:11:54.590765 2567 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 25 01:11:54.599559 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:11:54.590769 2567 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 25 01:11:54.599559 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:11:54.590773 2567 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 25 01:11:54.599559 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:11:54.590778 2567 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 25 01:11:54.599559 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:11:54.590782 2567 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 25 01:11:54.599559 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:11:54.590786 2567 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 25 01:11:54.599559 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:11:54.590790 2567 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 25 01:11:54.600084 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:11:54.590794 2567 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 25 01:11:54.600084 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:11:54.590799 2567 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 25 01:11:54.600084 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:11:54.590803 2567 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 25 01:11:54.600084 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:11:54.590807 2567 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 25 01:11:54.600084 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:11:54.590811 2567 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 25 01:11:54.600084 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:11:54.590815 2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 25 01:11:54.600084 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:11:54.590819 2567 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 25 01:11:54.600084 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:11:54.590823 2567 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 25 01:11:54.600084 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:11:54.590830 2567 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 25 01:11:54.600084 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:11:54.590835 2567 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 25 01:11:54.600084 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:11:54.590839 2567 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 25 01:11:54.600084 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:11:54.590843 2567 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 25 01:11:54.600084 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:11:54.590847 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 25 01:11:54.600084 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:11:54.590851 2567 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 25 01:11:54.600084 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:11:54.590855 2567 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 25 01:11:54.600084 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:11:54.590859 2567 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 25 01:11:54.600084 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:11:54.590863 2567 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 25 01:11:54.600084 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:11:54.590867 2567 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 25 01:11:54.600084 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:11:54.590871 2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 25 01:11:54.600084 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:11:54.590875 2567 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 25 01:11:54.600910 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:11:54.590879 2567 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 25 01:11:54.600910 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:11:54.590884 2567 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 25 01:11:54.600910 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:11:54.590887 2567 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 25 01:11:54.600910 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:11:54.590892 2567 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 25 01:11:54.600910 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:11:54.590896 2567 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 25 01:11:54.600910 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:11:54.590899 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 25 01:11:54.600910 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:11:54.590904 2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 25 01:11:54.600910 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:11:54.590908 2567 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 25 01:11:54.600910 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:11:54.590912 2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 25 01:11:54.600910 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:11:54.590916 2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 25 01:11:54.600910 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:11:54.590920 2567 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 25 01:11:54.600910 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:11:54.590924 2567 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 25 01:11:54.600910 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:11:54.590928 2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 25 01:11:54.600910 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:11:54.590932 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 25 01:11:54.600910 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:11:54.590937 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 25 01:11:54.600910 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:11:54.590941 2567 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 25 01:11:54.600910 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:11:54.590947 2567 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 25 01:11:54.600910 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:11:54.590953 2567 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 25 01:11:54.601529 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:54.590961 2567 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 25 01:11:54.601529 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:54.591101 2567 server.go:962] "Client rotation is on, will bootstrap in background" Jul 25 01:11:54.601529 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:54.594708 2567 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 25 01:11:54.601529 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:54.596766 2567 server.go:1019] "Starting client certificate rotation" Jul 25 01:11:54.601529 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:54.596873 2567 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 25 01:11:54.601529 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:54.596913 2567 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 25 01:11:54.601529 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:54.600165 2567 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 25 01:11:54.603418 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:54.603398 2567 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 25 01:11:54.612074 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:54.612060 2567 log.go:25] "Validated CRI v1 runtime API" Jul 25 01:11:54.615800 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:54.615782 2567 log.go:25] "Validated CRI v1 image API" Jul 25 01:11:54.616519 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:54.616501 2567 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 25 01:11:54.618920 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:54.618893 2567 fs.go:135] Filesystem UUIDs: map[47e99f55-00da-491d-b831-b9734daa7288:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 9082b583-f0cc-43d9-be77-0142f6f07126:/dev/nvme0n1p3] Jul 25 01:11:54.618994 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:54.618919 2567 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 25 01:11:54.623750 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:54.623638 2567 manager.go:216] Machine: {Timestamp:2026-07-25 01:11:54.622475432 +0000 UTC m=+0.315569841 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3092135 MemoryCapacity:32812175360 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec20d0345f338489e56ff908d2ee76c4 SystemUUID:ec20d034-5f33-8489-e56f-f908d2ee76c4 BootID:9ec21b4d-75df-47e2-b245-d0716ffd2bbd Filesystems:[{Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406089728 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406085632 Type:vfs Inodes:4005392 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562435072 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:93:87:c3:63:e1 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:93:87:c3:63:e1 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:4a:03:12:7b:24:52 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812175360 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 25 01:11:54.623750 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:54.623739 2567 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 25 01:11:54.623905 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:54.623832 2567 manager.go:232] Version: {KernelVersion:5.14.0-570.129.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260717-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 25 01:11:54.626229 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:54.626212 2567 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 25 01:11:54.626795 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:54.626768 2567 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 25 01:11:54.626958 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:54.626802 2567 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-129-35.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 25 01:11:54.627555 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:54.627544 2567 topology_manager.go:138] "Creating topology manager with none policy" Jul 25 01:11:54.627608 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:54.627561 2567 container_manager_linux.go:309] "Creating device plugin manager" Jul 25 01:11:54.627608 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:54.627572 2567 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 25 01:11:54.628246 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:54.628234 2567 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 25 01:11:54.629055 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:54.629044 2567 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 25 01:11:54.631036 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:54.631022 2567 state_mem.go:36] "Initialized new in-memory state store" Jul 25 01:11:54.631192 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:54.631180 2567 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 25 01:11:54.631248 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:54.631218 2567 kubelet.go:486] "Attempting to sync node with API server" Jul 25 01:11:54.631248 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:54.631239 2567 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 25 01:11:54.631334 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:54.631258 2567 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 25 01:11:54.631334 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:54.631271 2567 kubelet.go:398] "Adding apiserver pod source" Jul 25 01:11:54.631334 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:54.631285 2567 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 25 01:11:54.631660 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:54.631646 2567 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 25 01:11:54.631721 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:54.631670 2567 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 25 01:11:54.633641 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:54.633620 2567 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1" Jul 25 01:11:54.635881 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:54.635805 2567 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 25 01:11:54.635975 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:54.635910 2567 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 25 01:11:54.637509 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:54.637492 2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 25 01:11:54.637588 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:54.637517 2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 25 01:11:54.637588 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:54.637537 2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 25 01:11:54.637588 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:54.637547 2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 25 01:11:54.637588 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:54.637585 2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 25 01:11:54.637705 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:54.637594 2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 25 01:11:54.637705 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:54.637603 2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 25 01:11:54.637705 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:54.637609 2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 25 01:11:54.637705 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:54.637621 2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 25 01:11:54.637705 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:54.637631 2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 25 01:11:54.637705 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:54.637640 2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 25 01:11:54.637705 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:54.637645 2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 25 01:11:54.638546 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:54.638530 2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 25 01:11:54.638767 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:54.638754 2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 25 01:11:54.641336 ip-10-0-129-35 kubenswrapper[2567]: E0725 01:11:54.641316 2567 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-129-35.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 25 01:11:54.641336 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:54.641326 2567 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-129-35.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 25 01:11:54.641336 ip-10-0-129-35 kubenswrapper[2567]: E0725 01:11:54.641318 2567 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 25 01:11:54.641904 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:54.641890 2567 server.go:1268] "Started kubelet" Jul 25 01:11:54.641978 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:54.641950 2567 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 25 01:11:54.642077 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:54.642026 2567 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 25 01:11:54.642142 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:54.642096 2567 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 25 01:11:54.642795 ip-10-0-129-35 systemd[1]: Started Kubernetes Kubelet. Jul 25 01:11:54.643005 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:54.642988 2567 server.go:310] "Adding debug handlers to kubelet server" Jul 25 01:11:54.643770 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:54.643753 2567 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 25 01:11:54.647851 ip-10-0-129-35 kubenswrapper[2567]: E0725 01:11:54.647832 2567 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 25 01:11:54.649583 ip-10-0-129-35 kubenswrapper[2567]: E0725 01:11:54.648759 2567 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-129-35.ec2.internal.18c56336deef1383 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-129-35.ec2.internal,UID:ip-10-0-129-35.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-129-35.ec2.internal,},FirstTimestamp:2026-07-25 01:11:54.641863555 +0000 UTC m=+0.334957964,LastTimestamp:2026-07-25 01:11:54.641863555 +0000 UTC m=+0.334957964,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-129-35.ec2.internal,}" Jul 25 01:11:54.649816 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:54.649795 2567 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 25 01:11:54.649816 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:54.649809 2567 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 25 01:11:54.649962 ip-10-0-129-35 kubenswrapper[2567]: E0725 01:11:54.649948 2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-35.ec2.internal\" not found" Jul 25 01:11:54.650485 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:54.650370 2567 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 25 01:11:54.650485 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:54.650408 2567 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 25 01:11:54.650485 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:54.650419 2567 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 25 01:11:54.650692 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:54.650544 2567 reconstruct.go:97] "Volume reconstruction finished" Jul 25 01:11:54.650692 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:54.650556 2567 reconciler.go:29] "Reconciler: start to sync state" Jul 25 01:11:54.651527 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:54.651245 2567 factory.go:55] Registering systemd factory Jul 25 01:11:54.651527 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:54.651265 2567 factory.go:223] Registration of the systemd container factory successfully Jul 25 01:11:54.652137 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:54.651663 2567 factory.go:153] Registering CRI-O factory Jul 25 01:11:54.652137 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:54.651679 2567 factory.go:223] Registration of the crio container factory successfully Jul 25 01:11:54.652137 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:54.651737 2567 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 25 01:11:54.652137 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:54.651765 2567 factory.go:103] Registering Raw factory Jul 25 01:11:54.652137 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:54.651782 2567 manager.go:1196] Started watching for new ooms in manager Jul 25 01:11:54.652424 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:54.652332 2567 manager.go:349] Starting recovery of all containers Jul 25 01:11:54.656678 ip-10-0-129-35 kubenswrapper[2567]: E0725 01:11:54.656654 2567 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jul 25 01:11:54.656800 ip-10-0-129-35 kubenswrapper[2567]: E0725 01:11:54.656780 2567 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-129-35.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jul 25 01:11:54.665578 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:54.665561 2567 manager.go:354] Recovery completed Jul 25 01:11:54.669367 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:54.669356 2567 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 25 01:11:54.671710 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:54.671684 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-35.ec2.internal" event="NodeHasSufficientMemory" Jul 25 01:11:54.671773 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:54.671726 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-35.ec2.internal" event="NodeHasNoDiskPressure" Jul 25 01:11:54.671773 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:54.671738 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-35.ec2.internal" event="NodeHasSufficientPID" Jul 25 01:11:54.672241 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:54.672225 2567 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 25 01:11:54.672241 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:54.672239 2567 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 25 01:11:54.672336 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:54.672253 2567 state_mem.go:36] "Initialized new in-memory state store" Jul 25 01:11:54.672336 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:54.672294 2567 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 25 01:11:54.672853 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:54.672838 2567 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-qxs5v" Jul 25 01:11:54.673018 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:54.673000 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-35.ec2.internal" event="NodeHasSufficientMemory" Jul 25 01:11:54.673078 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:54.673027 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-35.ec2.internal" event="NodeHasNoDiskPressure" Jul 25 01:11:54.673078 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:54.673036 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-35.ec2.internal" event="NodeHasSufficientPID" Jul 25 01:11:54.673948 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:54.673933 2567 policy_none.go:49] "None policy: Start" Jul 25 01:11:54.673948 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:54.673950 2567 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 25 01:11:54.674096 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:54.673960 2567 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 25 01:11:54.674096 ip-10-0-129-35 kubenswrapper[2567]: E0725 01:11:54.674024 2567 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-129-35.ec2.internal.18c56336e0b67bfc default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-129-35.ec2.internal,UID:ip-10-0-129-35.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-129-35.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-129-35.ec2.internal,},FirstTimestamp:2026-07-25 01:11:54.67170918 +0000 UTC m=+0.364803590,LastTimestamp:2026-07-25 01:11:54.67170918 +0000 UTC m=+0.364803590,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-129-35.ec2.internal,}" Jul 25 01:11:54.674950 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:54.674938 2567 policy_none.go:47] "Start" Jul 25 01:11:54.678342 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:54.678231 2567 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-qxs5v" Jul 25 01:11:54.682984 ip-10-0-129-35 kubenswrapper[2567]: E0725 01:11:54.682902 2567 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-129-35.ec2.internal.18c56336e0b6d56a default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-129-35.ec2.internal,UID:ip-10-0-129-35.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-129-35.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-129-35.ec2.internal,},FirstTimestamp:2026-07-25 01:11:54.671732074 +0000 UTC m=+0.364826483,LastTimestamp:2026-07-25 01:11:54.671732074 +0000 UTC m=+0.364826483,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-129-35.ec2.internal,}" Jul 25 01:11:54.703951 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:54.703934 2567 manager.go:337] "Starting Device Plugin manager" Jul 25 01:11:54.704025 ip-10-0-129-35 kubenswrapper[2567]: E0725 01:11:54.703971 2567 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 25 01:11:54.704025 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:54.703980 2567 server.go:87] "Starting device plugin registration server" Jul 25 01:11:54.704199 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:54.704187 2567 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 25 01:11:54.704249 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:54.704203 2567 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 25 01:11:54.704312 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:54.704288 2567 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 25 01:11:54.704369 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:54.704358 2567 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 25 01:11:54.704470 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:54.704371 2567 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 25 01:11:54.704911 ip-10-0-129-35 kubenswrapper[2567]: E0725 01:11:54.704880 2567 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 25 01:11:54.705010 ip-10-0-129-35 kubenswrapper[2567]: E0725 01:11:54.704936 2567 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-129-35.ec2.internal\" not found" Jul 25 01:11:54.778605 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:54.778578 2567 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 25 01:11:54.779948 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:54.779930 2567 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 25 01:11:54.780034 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:54.779967 2567 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 25 01:11:54.780034 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:54.779989 2567 kubelet.go:2448] "Starting kubelet main sync loop" Jul 25 01:11:54.780034 ip-10-0-129-35 kubenswrapper[2567]: E0725 01:11:54.780021 2567 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jul 25 01:11:54.782184 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:54.782165 2567 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 25 01:11:54.805063 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:54.805045 2567 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 25 01:11:54.805799 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:54.805781 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-35.ec2.internal" event="NodeHasSufficientMemory" Jul 25 01:11:54.805880 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:54.805810 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-35.ec2.internal" event="NodeHasNoDiskPressure" Jul 25 01:11:54.805880 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:54.805820 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-35.ec2.internal" event="NodeHasSufficientPID" Jul 25 01:11:54.805880 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:54.805841 2567 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-129-35.ec2.internal" Jul 25 01:11:54.814956 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:54.814940 2567 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-129-35.ec2.internal" Jul 25 01:11:54.815034 ip-10-0-129-35 kubenswrapper[2567]: E0725 01:11:54.814963 2567 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-129-35.ec2.internal\": node \"ip-10-0-129-35.ec2.internal\" not found" Jul 25 01:11:54.841724 ip-10-0-129-35 kubenswrapper[2567]: E0725 01:11:54.841677 2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-35.ec2.internal\" not found" Jul 25 01:11:54.880441 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:54.880418 2567 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-35.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-129-35.ec2.internal"] Jul 25 01:11:54.880521 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:54.880473 2567 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 25 01:11:54.881189 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:54.881176 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-35.ec2.internal" event="NodeHasSufficientMemory" Jul 25 01:11:54.881251 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:54.881200 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-35.ec2.internal" event="NodeHasNoDiskPressure" Jul 25 01:11:54.881251 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:54.881209 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-35.ec2.internal" event="NodeHasSufficientPID" Jul 25 01:11:54.882440 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:54.882428 2567 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 25 01:11:54.882571 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:54.882558 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-35.ec2.internal" Jul 25 01:11:54.882608 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:54.882586 2567 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 25 01:11:54.883135 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:54.883109 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-35.ec2.internal" event="NodeHasSufficientMemory" Jul 25 01:11:54.883226 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:54.883144 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-35.ec2.internal" event="NodeHasNoDiskPressure" Jul 25 01:11:54.883226 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:54.883158 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-35.ec2.internal" event="NodeHasSufficientPID" Jul 25 01:11:54.883226 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:54.883169 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-35.ec2.internal" event="NodeHasSufficientMemory" Jul 25 01:11:54.883226 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:54.883189 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-35.ec2.internal" event="NodeHasNoDiskPressure" Jul 25 01:11:54.883226 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:54.883203 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-35.ec2.internal" event="NodeHasSufficientPID" Jul 25 01:11:54.884461 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:54.884447 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-35.ec2.internal" Jul 25 01:11:54.884515 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:54.884472 2567 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 25 01:11:54.885096 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:54.885081 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-35.ec2.internal" event="NodeHasSufficientMemory" Jul 25 01:11:54.885096 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:54.885101 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-35.ec2.internal" event="NodeHasNoDiskPressure" Jul 25 01:11:54.885096 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:54.885110 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-35.ec2.internal" event="NodeHasSufficientPID" Jul 25 01:11:54.908987 ip-10-0-129-35 kubenswrapper[2567]: E0725 01:11:54.908964 2567 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-129-35.ec2.internal\" not found" node="ip-10-0-129-35.ec2.internal" Jul 25 01:11:54.913297 ip-10-0-129-35 kubenswrapper[2567]: E0725 01:11:54.913281 2567 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-129-35.ec2.internal\" not found" node="ip-10-0-129-35.ec2.internal" Jul 25 01:11:54.942253 ip-10-0-129-35 kubenswrapper[2567]: E0725 01:11:54.942231 2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-35.ec2.internal\" not found" Jul 25 01:11:55.043282 ip-10-0-129-35 kubenswrapper[2567]: E0725 01:11:55.043261 2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-35.ec2.internal\" not found" Jul 25 01:11:55.051544 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:55.051528 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8059162027cf288a28b55e705fcd1fe4-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-129-35.ec2.internal\" (UID: \"8059162027cf288a28b55e705fcd1fe4\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-35.ec2.internal" Jul 25 01:11:55.051624 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:55.051556 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/edf34879cf3c142ca7dc5154417bf1b1-config\") pod \"kube-apiserver-proxy-ip-10-0-129-35.ec2.internal\" (UID: \"edf34879cf3c142ca7dc5154417bf1b1\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-129-35.ec2.internal" Jul 25 01:11:55.051624 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:55.051585 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/8059162027cf288a28b55e705fcd1fe4-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-129-35.ec2.internal\" (UID: \"8059162027cf288a28b55e705fcd1fe4\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-35.ec2.internal" Jul 25 01:11:55.143978 ip-10-0-129-35 kubenswrapper[2567]: E0725 01:11:55.143922 2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-35.ec2.internal\" not found" Jul 25 01:11:55.152294 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:55.152276 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/edf34879cf3c142ca7dc5154417bf1b1-config\") pod \"kube-apiserver-proxy-ip-10-0-129-35.ec2.internal\" (UID: \"edf34879cf3c142ca7dc5154417bf1b1\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-129-35.ec2.internal" Jul 25 01:11:55.152340 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:55.152299 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/8059162027cf288a28b55e705fcd1fe4-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-129-35.ec2.internal\" (UID: \"8059162027cf288a28b55e705fcd1fe4\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-35.ec2.internal" Jul 25 01:11:55.152340 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:55.152315 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8059162027cf288a28b55e705fcd1fe4-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-129-35.ec2.internal\" (UID: \"8059162027cf288a28b55e705fcd1fe4\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-35.ec2.internal" Jul 25 01:11:55.152433 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:55.152346 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8059162027cf288a28b55e705fcd1fe4-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-129-35.ec2.internal\" (UID: \"8059162027cf288a28b55e705fcd1fe4\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-35.ec2.internal" Jul 25 01:11:55.152433 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:55.152365 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/edf34879cf3c142ca7dc5154417bf1b1-config\") pod \"kube-apiserver-proxy-ip-10-0-129-35.ec2.internal\" (UID: \"edf34879cf3c142ca7dc5154417bf1b1\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-129-35.ec2.internal" Jul 25 01:11:55.152433 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:55.152396 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/8059162027cf288a28b55e705fcd1fe4-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-129-35.ec2.internal\" (UID: \"8059162027cf288a28b55e705fcd1fe4\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-35.ec2.internal" Jul 25 01:11:55.212446 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:55.212425 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-35.ec2.internal" Jul 25 01:11:55.217142 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:55.217126 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-35.ec2.internal" Jul 25 01:11:55.244279 ip-10-0-129-35 kubenswrapper[2567]: E0725 01:11:55.244259 2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-35.ec2.internal\" not found" Jul 25 01:11:55.344773 ip-10-0-129-35 kubenswrapper[2567]: E0725 01:11:55.344748 2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-35.ec2.internal\" not found" Jul 25 01:11:55.445272 ip-10-0-129-35 kubenswrapper[2567]: E0725 01:11:55.445223 2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-35.ec2.internal\" not found" Jul 25 01:11:55.531955 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:55.531936 2567 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 25 01:11:55.550850 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:55.550830 2567 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-35.ec2.internal" Jul 25 01:11:55.564013 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:55.563996 2567 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 25 01:11:55.565530 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:55.565518 2567 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-35.ec2.internal" Jul 25 01:11:55.573470 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:55.573454 2567 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 25 01:11:55.595593 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:55.595569 2567 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 25 01:11:55.595746 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:55.595693 2567 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 25 01:11:55.595746 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:55.595712 2567 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 25 01:11:55.631884 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:55.631865 2567 apiserver.go:52] "Watching apiserver" Jul 25 01:11:55.647895 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:55.647873 2567 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 25 01:11:55.648750 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:55.648720 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-multus/network-metrics-daemon-5nl9g","kube-system/konnectivity-agent-t4x2l","kube-system/kube-apiserver-proxy-ip-10-0-129-35.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mk9n9","openshift-cluster-node-tuning-operator/tuned-npgl4","openshift-multus/multus-additional-cni-plugins-llm4x","openshift-network-diagnostics/network-check-target-znlzb","openshift-network-operator/iptables-alerter-bhdhw","openshift-ovn-kubernetes/ovnkube-node-8hgk8","kube-system/global-pull-secret-syncer-mktch","openshift-dns/node-resolver-8cd2m","openshift-image-registry/node-ca-c42rd","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-35.ec2.internal","openshift-multus/multus-w88gj"] Jul 25 01:11:55.649982 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:55.649958 2567 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 25 01:11:55.650070 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:55.650052 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5nl9g" Jul 25 01:11:55.650132 ip-10-0-129-35 kubenswrapper[2567]: E0725 01:11:55.650114 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5nl9g" podUID="b8bf4790-0739-471e-9b16-1c2e448a8b6a" Jul 25 01:11:55.651398 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:55.651366 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-w88gj" Jul 25 01:11:55.652601 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:55.652583 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-8hgk8" Jul 25 01:11:55.653577 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:55.653556 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 25 01:11:55.653736 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:55.653668 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 25 01:11:55.653813 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:55.653738 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 25 01:11:55.653813 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:55.653761 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3143c435-082e-462b-a075-5f973501e27c-system-cni-dir\") pod \"multus-w88gj\" (UID: \"3143c435-082e-462b-a075-5f973501e27c\") " pod="openshift-multus/multus-w88gj" Jul 25 01:11:55.653813 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:55.653791 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-pjstm\"" Jul 25 01:11:55.653966 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:55.653793 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3143c435-082e-462b-a075-5f973501e27c-multus-cni-dir\") pod \"multus-w88gj\" (UID: \"3143c435-082e-462b-a075-5f973501e27c\") " pod="openshift-multus/multus-w88gj" Jul 25 01:11:55.653966 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:55.653839 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 25 01:11:55.653966 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:55.653845 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3143c435-082e-462b-a075-5f973501e27c-host-var-lib-kubelet\") pod \"multus-w88gj\" (UID: \"3143c435-082e-462b-a075-5f973501e27c\") " pod="openshift-multus/multus-w88gj" Jul 25 01:11:55.653966 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:55.653929 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/3143c435-082e-462b-a075-5f973501e27c-multus-daemon-config\") pod \"multus-w88gj\" (UID: \"3143c435-082e-462b-a075-5f973501e27c\") " pod="openshift-multus/multus-w88gj" Jul 25 01:11:55.653966 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:55.653959 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-28vs8\" (UniqueName: \"kubernetes.io/projected/b8bf4790-0739-471e-9b16-1c2e448a8b6a-kube-api-access-28vs8\") pod \"network-metrics-daemon-5nl9g\" (UID: \"b8bf4790-0739-471e-9b16-1c2e448a8b6a\") " pod="openshift-multus/network-metrics-daemon-5nl9g" Jul 25 01:11:55.654128 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:55.653980 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/3143c435-082e-462b-a075-5f973501e27c-multus-conf-dir\") pod \"multus-w88gj\" (UID: \"3143c435-082e-462b-a075-5f973501e27c\") " pod="openshift-multus/multus-w88gj" Jul 25 01:11:55.654128 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:55.654004 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/3143c435-082e-462b-a075-5f973501e27c-host-run-multus-certs\") pod \"multus-w88gj\" (UID: \"3143c435-082e-462b-a075-5f973501e27c\") " pod="openshift-multus/multus-w88gj" Jul 25 01:11:55.654128 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:55.654038 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5c8nd\" (UniqueName: \"kubernetes.io/projected/3143c435-082e-462b-a075-5f973501e27c-kube-api-access-5c8nd\") pod \"multus-w88gj\" (UID: \"3143c435-082e-462b-a075-5f973501e27c\") " pod="openshift-multus/multus-w88gj" Jul 25 01:11:55.654128 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:55.654068 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b8bf4790-0739-471e-9b16-1c2e448a8b6a-metrics-certs\") pod \"network-metrics-daemon-5nl9g\" (UID: \"b8bf4790-0739-471e-9b16-1c2e448a8b6a\") " pod="openshift-multus/network-metrics-daemon-5nl9g" Jul 25 01:11:55.654128 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:55.654110 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/3143c435-082e-462b-a075-5f973501e27c-cnibin\") pod \"multus-w88gj\" (UID: \"3143c435-082e-462b-a075-5f973501e27c\") " pod="openshift-multus/multus-w88gj" Jul 25 01:11:55.654128 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:55.654123 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/3143c435-082e-462b-a075-5f973501e27c-os-release\") pod \"multus-w88gj\" (UID: \"3143c435-082e-462b-a075-5f973501e27c\") " pod="openshift-multus/multus-w88gj" Jul 25 01:11:55.654416 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:55.654137 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/3143c435-082e-462b-a075-5f973501e27c-cni-binary-copy\") pod \"multus-w88gj\" (UID: \"3143c435-082e-462b-a075-5f973501e27c\") " pod="openshift-multus/multus-w88gj" Jul 25 01:11:55.654416 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:55.654151 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/3143c435-082e-462b-a075-5f973501e27c-host-var-lib-cni-multus\") pod \"multus-w88gj\" (UID: \"3143c435-082e-462b-a075-5f973501e27c\") " pod="openshift-multus/multus-w88gj" Jul 25 01:11:55.654416 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:55.654176 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/3143c435-082e-462b-a075-5f973501e27c-hostroot\") pod \"multus-w88gj\" (UID: \"3143c435-082e-462b-a075-5f973501e27c\") " pod="openshift-multus/multus-w88gj" Jul 25 01:11:55.654416 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:55.654197 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/3143c435-082e-462b-a075-5f973501e27c-multus-socket-dir-parent\") pod \"multus-w88gj\" (UID: \"3143c435-082e-462b-a075-5f973501e27c\") " pod="openshift-multus/multus-w88gj" Jul 25 01:11:55.654416 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:55.654222 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/3143c435-082e-462b-a075-5f973501e27c-host-run-k8s-cni-cncf-io\") pod \"multus-w88gj\" (UID: \"3143c435-082e-462b-a075-5f973501e27c\") " pod="openshift-multus/multus-w88gj" Jul 25 01:11:55.654416 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:55.654242 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/3143c435-082e-462b-a075-5f973501e27c-host-run-netns\") pod \"multus-w88gj\" (UID: \"3143c435-082e-462b-a075-5f973501e27c\") " pod="openshift-multus/multus-w88gj" Jul 25 01:11:55.654416 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:55.654256 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/3143c435-082e-462b-a075-5f973501e27c-host-var-lib-cni-bin\") pod \"multus-w88gj\" (UID: \"3143c435-082e-462b-a075-5f973501e27c\") " pod="openshift-multus/multus-w88gj" Jul 25 01:11:55.654416 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:55.654268 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3143c435-082e-462b-a075-5f973501e27c-etc-kubernetes\") pod \"multus-w88gj\" (UID: \"3143c435-082e-462b-a075-5f973501e27c\") " pod="openshift-multus/multus-w88gj" Jul 25 01:11:55.654924 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:55.654877 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mk9n9" Jul 25 01:11:55.655016 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:55.654943 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 25 01:11:55.655016 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:55.655000 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 25 01:11:55.655948 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:55.655927 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 25 01:11:55.656027 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:55.655992 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 25 01:11:55.656027 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:55.655930 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 25 01:11:55.656108 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:55.656038 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-n9k86\"" Jul 25 01:11:55.656108 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:55.656044 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 25 01:11:55.656234 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:55.656219 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-bhdhw" Jul 25 01:11:55.656950 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:55.656936 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 25 01:11:55.657017 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:55.656961 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 25 01:11:55.657126 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:55.657114 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 25 01:11:55.657515 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:55.657504 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-znlzb" Jul 25 01:11:55.657563 ip-10-0-129-35 kubenswrapper[2567]: E0725 01:11:55.657549 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-znlzb" podUID="8748d129-9ec1-44d6-8a95-88e0da2df4b3" Jul 25 01:11:55.658609 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:55.658501 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-jwrfm\"" Jul 25 01:11:55.658700 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:55.658658 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 25 01:11:55.658819 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:55.658802 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 25 01:11:55.658883 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:55.658802 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 25 01:11:55.658883 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:55.658834 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-fbkn2\"" Jul 25 01:11:55.658979 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:55.658953 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-llm4x" Jul 25 01:11:55.660362 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:55.660348 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-npgl4" Jul 25 01:11:55.661886 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:55.661857 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 25 01:11:55.661989 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:55.661924 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mktch" Jul 25 01:11:55.661989 ip-10-0-129-35 kubenswrapper[2567]: E0725 01:11:55.661976 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mktch" podUID="5ada1026-5182-4a3e-9937-68258c8f240d" Jul 25 01:11:55.662101 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:55.662030 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-bgpx6\"" Jul 25 01:11:55.662101 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:55.662052 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 25 01:11:55.662686 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:55.662665 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 25 01:11:55.662808 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:55.662792 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 25 01:11:55.662949 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:55.662931 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-ds68h\"" Jul 25 01:11:55.663448 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:55.663430 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-8cd2m" Jul 25 01:11:55.663943 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:55.663921 2567 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 25 01:11:55.665045 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:55.665027 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-c42rd" Jul 25 01:11:55.665618 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:55.665601 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 25 01:11:55.665708 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:55.665608 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-bnqsg\"" Jul 25 01:11:55.665708 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:55.665645 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 25 01:11:55.666566 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:55.666547 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-t4x2l" Jul 25 01:11:55.667076 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:55.666992 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 25 01:11:55.667175 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:55.667161 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 25 01:11:55.667223 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:55.667165 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 25 01:11:55.667723 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:55.667710 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-l5jpd\"" Jul 25 01:11:55.668782 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:55.668606 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 25 01:11:55.670759 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:55.669130 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-xqwf7\"" Jul 25 01:11:55.670759 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:55.669239 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 25 01:11:55.674398 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:55.674368 2567 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 25 01:11:55.680419 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:11:55.680386 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8059162027cf288a28b55e705fcd1fe4.slice/crio-113ff31750edcbc3bfa12413dbc4012a5148e56471f178ac17dc425bfeaac0e4 WatchSource:0}: Error finding container 113ff31750edcbc3bfa12413dbc4012a5148e56471f178ac17dc425bfeaac0e4: Status 404 returned error can't find the container with id 113ff31750edcbc3bfa12413dbc4012a5148e56471f178ac17dc425bfeaac0e4 Jul 25 01:11:55.680684 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:11:55.680668 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podedf34879cf3c142ca7dc5154417bf1b1.slice/crio-2ca2c809c9c4136ea308af7547a4709fee99a2b2cb44a560ea4895d4e57736f6 WatchSource:0}: Error finding container 2ca2c809c9c4136ea308af7547a4709fee99a2b2cb44a560ea4895d4e57736f6: Status 404 returned error can't find the container with id 2ca2c809c9c4136ea308af7547a4709fee99a2b2cb44a560ea4895d4e57736f6 Jul 25 01:11:55.682917 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:55.682875 2567 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-24 01:06:55 +0000 UTC" deadline="2028-03-24 15:06:06.350184617 +0000 UTC" Jul 25 01:11:55.682917 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:55.682913 2567 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14605h54m10.667274247s" Jul 25 01:11:55.687213 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:55.687189 2567 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 25 01:11:55.708468 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:55.708431 2567 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-dbbnq" Jul 25 01:11:55.722313 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:55.722297 2567 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-dbbnq" Jul 25 01:11:55.751288 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:55.751273 2567 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 25 01:11:55.755214 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:55.755200 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/b287c5c8-d5c4-4685-a19e-6aada1237305-etc-tuned\") pod \"tuned-npgl4\" (UID: \"b287c5c8-d5c4-4685-a19e-6aada1237305\") " pod="openshift-cluster-node-tuning-operator/tuned-npgl4" Jul 25 01:11:55.755293 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:55.755242 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3143c435-082e-462b-a075-5f973501e27c-multus-cni-dir\") pod \"multus-w88gj\" (UID: \"3143c435-082e-462b-a075-5f973501e27c\") " pod="openshift-multus/multus-w88gj" Jul 25 01:11:55.755293 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:55.755260 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/3143c435-082e-462b-a075-5f973501e27c-multus-daemon-config\") pod \"multus-w88gj\" (UID: \"3143c435-082e-462b-a075-5f973501e27c\") " pod="openshift-multus/multus-w88gj" Jul 25 01:11:55.755293 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:55.755285 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4rqml\" (UniqueName: \"kubernetes.io/projected/9ea66485-c377-4229-b4df-c91ec571cca5-kube-api-access-4rqml\") pod \"node-resolver-8cd2m\" (UID: \"9ea66485-c377-4229-b4df-c91ec571cca5\") " pod="openshift-dns/node-resolver-8cd2m" Jul 25 01:11:55.755442 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:55.755302 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/14185786-ac81-4de0-b023-a79592965e8b-var-lib-openvswitch\") pod \"ovnkube-node-8hgk8\" (UID: \"14185786-ac81-4de0-b023-a79592965e8b\") " pod="openshift-ovn-kubernetes/ovnkube-node-8hgk8" Jul 25 01:11:55.755442 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:55.755318 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5rvfn\" (UniqueName: \"kubernetes.io/projected/14185786-ac81-4de0-b023-a79592965e8b-kube-api-access-5rvfn\") pod \"ovnkube-node-8hgk8\" (UID: \"14185786-ac81-4de0-b023-a79592965e8b\") " pod="openshift-ovn-kubernetes/ovnkube-node-8hgk8" Jul 25 01:11:55.755442 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:55.755332 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/5ada1026-5182-4a3e-9937-68258c8f240d-dbus\") pod \"global-pull-secret-syncer-mktch\" (UID: \"5ada1026-5182-4a3e-9937-68258c8f240d\") " pod="kube-system/global-pull-secret-syncer-mktch" Jul 25 01:11:55.755442 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:55.755346 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b287c5c8-d5c4-4685-a19e-6aada1237305-etc-kubernetes\") pod \"tuned-npgl4\" (UID: \"b287c5c8-d5c4-4685-a19e-6aada1237305\") " pod="openshift-cluster-node-tuning-operator/tuned-npgl4" Jul 25 01:11:55.755442 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:55.755371 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b287c5c8-d5c4-4685-a19e-6aada1237305-var-lib-kubelet\") pod \"tuned-npgl4\" (UID: \"b287c5c8-d5c4-4685-a19e-6aada1237305\") " pod="openshift-cluster-node-tuning-operator/tuned-npgl4" Jul 25 01:11:55.755442 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:55.755388 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/3143c435-082e-462b-a075-5f973501e27c-cnibin\") pod \"multus-w88gj\" (UID: \"3143c435-082e-462b-a075-5f973501e27c\") " pod="openshift-multus/multus-w88gj" Jul 25 01:11:55.755442 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:55.755428 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3143c435-082e-462b-a075-5f973501e27c-multus-cni-dir\") pod \"multus-w88gj\" (UID: \"3143c435-082e-462b-a075-5f973501e27c\") " pod="openshift-multus/multus-w88gj" Jul 25 01:11:55.755835 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:55.755451 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/3143c435-082e-462b-a075-5f973501e27c-cni-binary-copy\") pod \"multus-w88gj\" (UID: \"3143c435-082e-462b-a075-5f973501e27c\") " pod="openshift-multus/multus-w88gj" Jul 25 01:11:55.755835 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:55.755493 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/3143c435-082e-462b-a075-5f973501e27c-cnibin\") pod \"multus-w88gj\" (UID: \"3143c435-082e-462b-a075-5f973501e27c\") " pod="openshift-multus/multus-w88gj" Jul 25 01:11:55.755835 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:55.755508 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/14185786-ac81-4de0-b023-a79592965e8b-run-openvswitch\") pod \"ovnkube-node-8hgk8\" (UID: \"14185786-ac81-4de0-b023-a79592965e8b\") " pod="openshift-ovn-kubernetes/ovnkube-node-8hgk8" Jul 25 01:11:55.755835 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:55.755536 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/14185786-ac81-4de0-b023-a79592965e8b-ovnkube-script-lib\") pod \"ovnkube-node-8hgk8\" (UID: \"14185786-ac81-4de0-b023-a79592965e8b\") " pod="openshift-ovn-kubernetes/ovnkube-node-8hgk8" Jul 25 01:11:55.755835 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:55.755563 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/bcda8758-c770-452e-8290-b5c19cb5ae6e-etc-selinux\") pod \"aws-ebs-csi-driver-node-mk9n9\" (UID: \"bcda8758-c770-452e-8290-b5c19cb5ae6e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mk9n9" Jul 25 01:11:55.755835 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:55.755588 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/799cf0dd-1f0a-455f-ac0e-d303f0360de2-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-llm4x\" (UID: \"799cf0dd-1f0a-455f-ac0e-d303f0360de2\") " pod="openshift-multus/multus-additional-cni-plugins-llm4x" Jul 25 01:11:55.755835 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:55.755621 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/b287c5c8-d5c4-4685-a19e-6aada1237305-run\") pod \"tuned-npgl4\" (UID: \"b287c5c8-d5c4-4685-a19e-6aada1237305\") " pod="openshift-cluster-node-tuning-operator/tuned-npgl4" Jul 25 01:11:55.755835 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:55.755647 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/14185786-ac81-4de0-b023-a79592965e8b-node-log\") pod \"ovnkube-node-8hgk8\" (UID: \"14185786-ac81-4de0-b023-a79592965e8b\") " pod="openshift-ovn-kubernetes/ovnkube-node-8hgk8" Jul 25 01:11:55.755835 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:55.755672 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/14185786-ac81-4de0-b023-a79592965e8b-log-socket\") pod \"ovnkube-node-8hgk8\" (UID: \"14185786-ac81-4de0-b023-a79592965e8b\") " pod="openshift-ovn-kubernetes/ovnkube-node-8hgk8" Jul 25 01:11:55.755835 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:55.755694 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/bcda8758-c770-452e-8290-b5c19cb5ae6e-sys-fs\") pod \"aws-ebs-csi-driver-node-mk9n9\" (UID: \"bcda8758-c770-452e-8290-b5c19cb5ae6e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mk9n9" Jul 25 01:11:55.755835 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:55.755721 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3143c435-082e-462b-a075-5f973501e27c-system-cni-dir\") pod \"multus-w88gj\" (UID: \"3143c435-082e-462b-a075-5f973501e27c\") " pod="openshift-multus/multus-w88gj" Jul 25 01:11:55.755835 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:55.755748 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9qp24\" (UniqueName: \"kubernetes.io/projected/4a3b7c62-05b6-4e7f-9c84-249de675af87-kube-api-access-9qp24\") pod \"node-ca-c42rd\" (UID: \"4a3b7c62-05b6-4e7f-9c84-249de675af87\") " pod="openshift-image-registry/node-ca-c42rd" Jul 25 01:11:55.755835 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:55.755773 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/506f2c8c-d134-4671-969c-b5d70acadef0-konnectivity-ca\") pod \"konnectivity-agent-t4x2l\" (UID: \"506f2c8c-d134-4671-969c-b5d70acadef0\") " pod="kube-system/konnectivity-agent-t4x2l" Jul 25 01:11:55.755835 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:55.755799 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/14185786-ac81-4de0-b023-a79592965e8b-host-kubelet\") pod \"ovnkube-node-8hgk8\" (UID: \"14185786-ac81-4de0-b023-a79592965e8b\") " pod="openshift-ovn-kubernetes/ovnkube-node-8hgk8" Jul 25 01:11:55.755835 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:55.755825 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/bcda8758-c770-452e-8290-b5c19cb5ae6e-kubelet-dir\") pod \"aws-ebs-csi-driver-node-mk9n9\" (UID: \"bcda8758-c770-452e-8290-b5c19cb5ae6e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mk9n9" Jul 25 01:11:55.755835 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:55.755832 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3143c435-082e-462b-a075-5f973501e27c-system-cni-dir\") pod \"multus-w88gj\" (UID: \"3143c435-082e-462b-a075-5f973501e27c\") " pod="openshift-multus/multus-w88gj" Jul 25 01:11:55.756618 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:55.755848 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/799cf0dd-1f0a-455f-ac0e-d303f0360de2-cnibin\") pod \"multus-additional-cni-plugins-llm4x\" (UID: \"799cf0dd-1f0a-455f-ac0e-d303f0360de2\") " pod="openshift-multus/multus-additional-cni-plugins-llm4x" Jul 25 01:11:55.756618 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:55.755875 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/799cf0dd-1f0a-455f-ac0e-d303f0360de2-cni-binary-copy\") pod \"multus-additional-cni-plugins-llm4x\" (UID: \"799cf0dd-1f0a-455f-ac0e-d303f0360de2\") " pod="openshift-multus/multus-additional-cni-plugins-llm4x" Jul 25 01:11:55.756618 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:55.755902 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/3143c435-082e-462b-a075-5f973501e27c-multus-conf-dir\") pod \"multus-w88gj\" (UID: \"3143c435-082e-462b-a075-5f973501e27c\") " pod="openshift-multus/multus-w88gj" Jul 25 01:11:55.756618 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:55.755929 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/3143c435-082e-462b-a075-5f973501e27c-multus-daemon-config\") pod \"multus-w88gj\" (UID: \"3143c435-082e-462b-a075-5f973501e27c\") " pod="openshift-multus/multus-w88gj" Jul 25 01:11:55.756618 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:55.755928 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/3143c435-082e-462b-a075-5f973501e27c-host-run-multus-certs\") pod \"multus-w88gj\" (UID: \"3143c435-082e-462b-a075-5f973501e27c\") " pod="openshift-multus/multus-w88gj" Jul 25 01:11:55.756618 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:55.755955 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/3143c435-082e-462b-a075-5f973501e27c-cni-binary-copy\") pod \"multus-w88gj\" (UID: \"3143c435-082e-462b-a075-5f973501e27c\") " pod="openshift-multus/multus-w88gj" Jul 25 01:11:55.756618 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:55.755971 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5c8nd\" (UniqueName: \"kubernetes.io/projected/3143c435-082e-462b-a075-5f973501e27c-kube-api-access-5c8nd\") pod \"multus-w88gj\" (UID: \"3143c435-082e-462b-a075-5f973501e27c\") " pod="openshift-multus/multus-w88gj" Jul 25 01:11:55.756618 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:55.755989 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/3143c435-082e-462b-a075-5f973501e27c-multus-conf-dir\") pod \"multus-w88gj\" (UID: \"3143c435-082e-462b-a075-5f973501e27c\") " pod="openshift-multus/multus-w88gj" Jul 25 01:11:55.756618 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:55.755998 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/737a005c-a25e-4fda-ae48-eb59c37914d0-host-slash\") pod \"iptables-alerter-bhdhw\" (UID: \"737a005c-a25e-4fda-ae48-eb59c37914d0\") " pod="openshift-network-operator/iptables-alerter-bhdhw" Jul 25 01:11:55.756618 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:55.756003 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/3143c435-082e-462b-a075-5f973501e27c-host-run-multus-certs\") pod \"multus-w88gj\" (UID: \"3143c435-082e-462b-a075-5f973501e27c\") " pod="openshift-multus/multus-w88gj" Jul 25 01:11:55.756618 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:55.756023 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/b287c5c8-d5c4-4685-a19e-6aada1237305-etc-sysctl-d\") pod \"tuned-npgl4\" (UID: \"b287c5c8-d5c4-4685-a19e-6aada1237305\") " pod="openshift-cluster-node-tuning-operator/tuned-npgl4" Jul 25 01:11:55.756618 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:55.756048 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d4nh2\" (UniqueName: \"kubernetes.io/projected/b287c5c8-d5c4-4685-a19e-6aada1237305-kube-api-access-d4nh2\") pod \"tuned-npgl4\" (UID: \"b287c5c8-d5c4-4685-a19e-6aada1237305\") " pod="openshift-cluster-node-tuning-operator/tuned-npgl4" Jul 25 01:11:55.756618 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:55.756084 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/14185786-ac81-4de0-b023-a79592965e8b-systemd-units\") pod \"ovnkube-node-8hgk8\" (UID: \"14185786-ac81-4de0-b023-a79592965e8b\") " pod="openshift-ovn-kubernetes/ovnkube-node-8hgk8" Jul 25 01:11:55.756618 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:55.756111 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/14185786-ac81-4de0-b023-a79592965e8b-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-8hgk8\" (UID: \"14185786-ac81-4de0-b023-a79592965e8b\") " pod="openshift-ovn-kubernetes/ovnkube-node-8hgk8" Jul 25 01:11:55.756618 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:55.756145 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b8bf4790-0739-471e-9b16-1c2e448a8b6a-metrics-certs\") pod \"network-metrics-daemon-5nl9g\" (UID: \"b8bf4790-0739-471e-9b16-1c2e448a8b6a\") " pod="openshift-multus/network-metrics-daemon-5nl9g" Jul 25 01:11:55.756618 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:55.756171 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/3143c435-082e-462b-a075-5f973501e27c-host-var-lib-cni-multus\") pod \"multus-w88gj\" (UID: \"3143c435-082e-462b-a075-5f973501e27c\") " pod="openshift-multus/multus-w88gj" Jul 25 01:11:55.756618 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:55.756214 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/3143c435-082e-462b-a075-5f973501e27c-hostroot\") pod \"multus-w88gj\" (UID: \"3143c435-082e-462b-a075-5f973501e27c\") " pod="openshift-multus/multus-w88gj" Jul 25 01:11:55.756618 ip-10-0-129-35 kubenswrapper[2567]: E0725 01:11:55.756244 2567 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 25 01:11:55.757327 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:55.756252 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/4a3b7c62-05b6-4e7f-9c84-249de675af87-serviceca\") pod \"node-ca-c42rd\" (UID: \"4a3b7c62-05b6-4e7f-9c84-249de675af87\") " pod="openshift-image-registry/node-ca-c42rd" Jul 25 01:11:55.757327 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:55.756279 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/14185786-ac81-4de0-b023-a79592965e8b-host-cni-netd\") pod \"ovnkube-node-8hgk8\" (UID: \"14185786-ac81-4de0-b023-a79592965e8b\") " pod="openshift-ovn-kubernetes/ovnkube-node-8hgk8" Jul 25 01:11:55.757327 ip-10-0-129-35 kubenswrapper[2567]: E0725 01:11:55.756289 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b8bf4790-0739-471e-9b16-1c2e448a8b6a-metrics-certs podName:b8bf4790-0739-471e-9b16-1c2e448a8b6a nodeName:}" failed. No retries permitted until 2026-07-25 01:11:56.256273542 +0000 UTC m=+1.949367941 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b8bf4790-0739-471e-9b16-1c2e448a8b6a-metrics-certs") pod "network-metrics-daemon-5nl9g" (UID: "b8bf4790-0739-471e-9b16-1c2e448a8b6a") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 25 01:11:55.757327 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:55.756305 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/3143c435-082e-462b-a075-5f973501e27c-hostroot\") pod \"multus-w88gj\" (UID: \"3143c435-082e-462b-a075-5f973501e27c\") " pod="openshift-multus/multus-w88gj" Jul 25 01:11:55.757327 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:55.756317 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/3143c435-082e-462b-a075-5f973501e27c-host-var-lib-cni-multus\") pod \"multus-w88gj\" (UID: \"3143c435-082e-462b-a075-5f973501e27c\") " pod="openshift-multus/multus-w88gj" Jul 25 01:11:55.757327 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:55.756328 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5ada1026-5182-4a3e-9937-68258c8f240d-original-pull-secret\") pod \"global-pull-secret-syncer-mktch\" (UID: \"5ada1026-5182-4a3e-9937-68258c8f240d\") " pod="kube-system/global-pull-secret-syncer-mktch" Jul 25 01:11:55.757327 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:55.756354 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/14185786-ac81-4de0-b023-a79592965e8b-host-run-netns\") pod \"ovnkube-node-8hgk8\" (UID: \"14185786-ac81-4de0-b023-a79592965e8b\") " pod="openshift-ovn-kubernetes/ovnkube-node-8hgk8" Jul 25 01:11:55.757327 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:55.756371 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/14185786-ac81-4de0-b023-a79592965e8b-run-systemd\") pod \"ovnkube-node-8hgk8\" (UID: \"14185786-ac81-4de0-b023-a79592965e8b\") " pod="openshift-ovn-kubernetes/ovnkube-node-8hgk8" Jul 25 01:11:55.757327 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:55.756392 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/3143c435-082e-462b-a075-5f973501e27c-host-run-netns\") pod \"multus-w88gj\" (UID: \"3143c435-082e-462b-a075-5f973501e27c\") " pod="openshift-multus/multus-w88gj" Jul 25 01:11:55.757327 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:55.756426 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/b287c5c8-d5c4-4685-a19e-6aada1237305-etc-sysconfig\") pod \"tuned-npgl4\" (UID: \"b287c5c8-d5c4-4685-a19e-6aada1237305\") " pod="openshift-cluster-node-tuning-operator/tuned-npgl4" Jul 25 01:11:55.757327 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:55.756444 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b287c5c8-d5c4-4685-a19e-6aada1237305-lib-modules\") pod \"tuned-npgl4\" (UID: \"b287c5c8-d5c4-4685-a19e-6aada1237305\") " pod="openshift-cluster-node-tuning-operator/tuned-npgl4" Jul 25 01:11:55.757327 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:55.756446 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/3143c435-082e-462b-a075-5f973501e27c-host-run-netns\") pod \"multus-w88gj\" (UID: \"3143c435-082e-462b-a075-5f973501e27c\") " pod="openshift-multus/multus-w88gj" Jul 25 01:11:55.757327 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:55.756472 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k8qbc\" (UniqueName: \"kubernetes.io/projected/bcda8758-c770-452e-8290-b5c19cb5ae6e-kube-api-access-k8qbc\") pod \"aws-ebs-csi-driver-node-mk9n9\" (UID: \"bcda8758-c770-452e-8290-b5c19cb5ae6e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mk9n9" Jul 25 01:11:55.757327 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:55.756492 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3143c435-082e-462b-a075-5f973501e27c-host-var-lib-kubelet\") pod \"multus-w88gj\" (UID: \"3143c435-082e-462b-a075-5f973501e27c\") " pod="openshift-multus/multus-w88gj" Jul 25 01:11:55.757327 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:55.756506 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b287c5c8-d5c4-4685-a19e-6aada1237305-host\") pod \"tuned-npgl4\" (UID: \"b287c5c8-d5c4-4685-a19e-6aada1237305\") " pod="openshift-cluster-node-tuning-operator/tuned-npgl4" Jul 25 01:11:55.757327 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:55.756520 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/14185786-ac81-4de0-b023-a79592965e8b-host-slash\") pod \"ovnkube-node-8hgk8\" (UID: \"14185786-ac81-4de0-b023-a79592965e8b\") " pod="openshift-ovn-kubernetes/ovnkube-node-8hgk8" Jul 25 01:11:55.757832 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:55.756547 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3143c435-082e-462b-a075-5f973501e27c-host-var-lib-kubelet\") pod \"multus-w88gj\" (UID: \"3143c435-082e-462b-a075-5f973501e27c\") " pod="openshift-multus/multus-w88gj" Jul 25 01:11:55.757832 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:55.756544 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/799cf0dd-1f0a-455f-ac0e-d303f0360de2-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-llm4x\" (UID: \"799cf0dd-1f0a-455f-ac0e-d303f0360de2\") " pod="openshift-multus/multus-additional-cni-plugins-llm4x" Jul 25 01:11:55.757832 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:55.756579 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/737a005c-a25e-4fda-ae48-eb59c37914d0-iptables-alerter-script\") pod \"iptables-alerter-bhdhw\" (UID: \"737a005c-a25e-4fda-ae48-eb59c37914d0\") " pod="openshift-network-operator/iptables-alerter-bhdhw" Jul 25 01:11:55.757832 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:55.756595 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/4a3b7c62-05b6-4e7f-9c84-249de675af87-host\") pod \"node-ca-c42rd\" (UID: \"4a3b7c62-05b6-4e7f-9c84-249de675af87\") " pod="openshift-image-registry/node-ca-c42rd" Jul 25 01:11:55.757832 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:55.756610 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/14185786-ac81-4de0-b023-a79592965e8b-etc-openvswitch\") pod \"ovnkube-node-8hgk8\" (UID: \"14185786-ac81-4de0-b023-a79592965e8b\") " pod="openshift-ovn-kubernetes/ovnkube-node-8hgk8" Jul 25 01:11:55.757832 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:55.756625 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/14185786-ac81-4de0-b023-a79592965e8b-host-run-ovn-kubernetes\") pod \"ovnkube-node-8hgk8\" (UID: \"14185786-ac81-4de0-b023-a79592965e8b\") " pod="openshift-ovn-kubernetes/ovnkube-node-8hgk8" Jul 25 01:11:55.757832 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:55.756641 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s9qxj\" (UniqueName: \"kubernetes.io/projected/799cf0dd-1f0a-455f-ac0e-d303f0360de2-kube-api-access-s9qxj\") pod \"multus-additional-cni-plugins-llm4x\" (UID: \"799cf0dd-1f0a-455f-ac0e-d303f0360de2\") " pod="openshift-multus/multus-additional-cni-plugins-llm4x" Jul 25 01:11:55.757832 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:55.756655 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/b287c5c8-d5c4-4685-a19e-6aada1237305-etc-sysctl-conf\") pod \"tuned-npgl4\" (UID: \"b287c5c8-d5c4-4685-a19e-6aada1237305\") " pod="openshift-cluster-node-tuning-operator/tuned-npgl4" Jul 25 01:11:55.757832 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:55.756669 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/9ea66485-c377-4229-b4df-c91ec571cca5-hosts-file\") pod \"node-resolver-8cd2m\" (UID: \"9ea66485-c377-4229-b4df-c91ec571cca5\") " pod="openshift-dns/node-resolver-8cd2m" Jul 25 01:11:55.757832 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:55.756685 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/14185786-ac81-4de0-b023-a79592965e8b-run-ovn\") pod \"ovnkube-node-8hgk8\" (UID: \"14185786-ac81-4de0-b023-a79592965e8b\") " pod="openshift-ovn-kubernetes/ovnkube-node-8hgk8" Jul 25 01:11:55.757832 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:55.756699 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/14185786-ac81-4de0-b023-a79592965e8b-ovnkube-config\") pod \"ovnkube-node-8hgk8\" (UID: \"14185786-ac81-4de0-b023-a79592965e8b\") " pod="openshift-ovn-kubernetes/ovnkube-node-8hgk8" Jul 25 01:11:55.757832 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:55.756716 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/bcda8758-c770-452e-8290-b5c19cb5ae6e-socket-dir\") pod \"aws-ebs-csi-driver-node-mk9n9\" (UID: \"bcda8758-c770-452e-8290-b5c19cb5ae6e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mk9n9" Jul 25 01:11:55.757832 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:55.756732 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/799cf0dd-1f0a-455f-ac0e-d303f0360de2-tuning-conf-dir\") pod \"multus-additional-cni-plugins-llm4x\" (UID: \"799cf0dd-1f0a-455f-ac0e-d303f0360de2\") " pod="openshift-multus/multus-additional-cni-plugins-llm4x" Jul 25 01:11:55.757832 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:55.756746 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b287c5c8-d5c4-4685-a19e-6aada1237305-sys\") pod \"tuned-npgl4\" (UID: \"b287c5c8-d5c4-4685-a19e-6aada1237305\") " pod="openshift-cluster-node-tuning-operator/tuned-npgl4" Jul 25 01:11:55.757832 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:55.756760 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9ea66485-c377-4229-b4df-c91ec571cca5-tmp-dir\") pod \"node-resolver-8cd2m\" (UID: \"9ea66485-c377-4229-b4df-c91ec571cca5\") " pod="openshift-dns/node-resolver-8cd2m" Jul 25 01:11:55.757832 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:55.756774 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/14185786-ac81-4de0-b023-a79592965e8b-ovn-node-metrics-cert\") pod \"ovnkube-node-8hgk8\" (UID: \"14185786-ac81-4de0-b023-a79592965e8b\") " pod="openshift-ovn-kubernetes/ovnkube-node-8hgk8" Jul 25 01:11:55.758335 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:55.756818 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/14185786-ac81-4de0-b023-a79592965e8b-host-cni-bin\") pod \"ovnkube-node-8hgk8\" (UID: \"14185786-ac81-4de0-b023-a79592965e8b\") " pod="openshift-ovn-kubernetes/ovnkube-node-8hgk8" Jul 25 01:11:55.758335 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:55.756841 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/14185786-ac81-4de0-b023-a79592965e8b-env-overrides\") pod \"ovnkube-node-8hgk8\" (UID: \"14185786-ac81-4de0-b023-a79592965e8b\") " pod="openshift-ovn-kubernetes/ovnkube-node-8hgk8" Jul 25 01:11:55.758335 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:55.756855 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/bcda8758-c770-452e-8290-b5c19cb5ae6e-registration-dir\") pod \"aws-ebs-csi-driver-node-mk9n9\" (UID: \"bcda8758-c770-452e-8290-b5c19cb5ae6e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mk9n9" Jul 25 01:11:55.758335 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:55.756872 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/5ada1026-5182-4a3e-9937-68258c8f240d-kubelet-config\") pod \"global-pull-secret-syncer-mktch\" (UID: \"5ada1026-5182-4a3e-9937-68258c8f240d\") " pod="kube-system/global-pull-secret-syncer-mktch" Jul 25 01:11:55.758335 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:55.756893 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-28vs8\" (UniqueName: \"kubernetes.io/projected/b8bf4790-0739-471e-9b16-1c2e448a8b6a-kube-api-access-28vs8\") pod \"network-metrics-daemon-5nl9g\" (UID: \"b8bf4790-0739-471e-9b16-1c2e448a8b6a\") " pod="openshift-multus/network-metrics-daemon-5nl9g" Jul 25 01:11:55.758335 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:55.756911 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/b287c5c8-d5c4-4685-a19e-6aada1237305-etc-modprobe-d\") pod \"tuned-npgl4\" (UID: \"b287c5c8-d5c4-4685-a19e-6aada1237305\") " pod="openshift-cluster-node-tuning-operator/tuned-npgl4" Jul 25 01:11:55.758335 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:55.756925 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b287c5c8-d5c4-4685-a19e-6aada1237305-tmp\") pod \"tuned-npgl4\" (UID: \"b287c5c8-d5c4-4685-a19e-6aada1237305\") " pod="openshift-cluster-node-tuning-operator/tuned-npgl4" Jul 25 01:11:55.758335 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:55.756942 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/506f2c8c-d134-4671-969c-b5d70acadef0-agent-certs\") pod \"konnectivity-agent-t4x2l\" (UID: \"506f2c8c-d134-4671-969c-b5d70acadef0\") " pod="kube-system/konnectivity-agent-t4x2l" Jul 25 01:11:55.758335 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:55.756963 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/bcda8758-c770-452e-8290-b5c19cb5ae6e-device-dir\") pod \"aws-ebs-csi-driver-node-mk9n9\" (UID: \"bcda8758-c770-452e-8290-b5c19cb5ae6e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mk9n9" Jul 25 01:11:55.758335 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:55.756984 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-884lb\" (UniqueName: \"kubernetes.io/projected/8748d129-9ec1-44d6-8a95-88e0da2df4b3-kube-api-access-884lb\") pod \"network-check-target-znlzb\" (UID: \"8748d129-9ec1-44d6-8a95-88e0da2df4b3\") " pod="openshift-network-diagnostics/network-check-target-znlzb" Jul 25 01:11:55.758335 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:55.756999 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/799cf0dd-1f0a-455f-ac0e-d303f0360de2-system-cni-dir\") pod \"multus-additional-cni-plugins-llm4x\" (UID: \"799cf0dd-1f0a-455f-ac0e-d303f0360de2\") " pod="openshift-multus/multus-additional-cni-plugins-llm4x" Jul 25 01:11:55.758335 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:55.757013 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/799cf0dd-1f0a-455f-ac0e-d303f0360de2-os-release\") pod \"multus-additional-cni-plugins-llm4x\" (UID: \"799cf0dd-1f0a-455f-ac0e-d303f0360de2\") " pod="openshift-multus/multus-additional-cni-plugins-llm4x" Jul 25 01:11:55.758335 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:55.757034 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/3143c435-082e-462b-a075-5f973501e27c-os-release\") pod \"multus-w88gj\" (UID: \"3143c435-082e-462b-a075-5f973501e27c\") " pod="openshift-multus/multus-w88gj" Jul 25 01:11:55.758335 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:55.757058 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dkmfl\" (UniqueName: \"kubernetes.io/projected/737a005c-a25e-4fda-ae48-eb59c37914d0-kube-api-access-dkmfl\") pod \"iptables-alerter-bhdhw\" (UID: \"737a005c-a25e-4fda-ae48-eb59c37914d0\") " pod="openshift-network-operator/iptables-alerter-bhdhw" Jul 25 01:11:55.758335 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:55.757073 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/b287c5c8-d5c4-4685-a19e-6aada1237305-etc-systemd\") pod \"tuned-npgl4\" (UID: \"b287c5c8-d5c4-4685-a19e-6aada1237305\") " pod="openshift-cluster-node-tuning-operator/tuned-npgl4" Jul 25 01:11:55.758335 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:55.757098 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/3143c435-082e-462b-a075-5f973501e27c-multus-socket-dir-parent\") pod \"multus-w88gj\" (UID: \"3143c435-082e-462b-a075-5f973501e27c\") " pod="openshift-multus/multus-w88gj" Jul 25 01:11:55.758823 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:55.757116 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/3143c435-082e-462b-a075-5f973501e27c-host-run-k8s-cni-cncf-io\") pod \"multus-w88gj\" (UID: \"3143c435-082e-462b-a075-5f973501e27c\") " pod="openshift-multus/multus-w88gj" Jul 25 01:11:55.758823 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:55.757141 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/3143c435-082e-462b-a075-5f973501e27c-host-var-lib-cni-bin\") pod \"multus-w88gj\" (UID: \"3143c435-082e-462b-a075-5f973501e27c\") " pod="openshift-multus/multus-w88gj" Jul 25 01:11:55.758823 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:55.757154 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/3143c435-082e-462b-a075-5f973501e27c-os-release\") pod \"multus-w88gj\" (UID: \"3143c435-082e-462b-a075-5f973501e27c\") " pod="openshift-multus/multus-w88gj" Jul 25 01:11:55.758823 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:55.757157 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3143c435-082e-462b-a075-5f973501e27c-etc-kubernetes\") pod \"multus-w88gj\" (UID: \"3143c435-082e-462b-a075-5f973501e27c\") " pod="openshift-multus/multus-w88gj" Jul 25 01:11:55.758823 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:55.757162 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/3143c435-082e-462b-a075-5f973501e27c-multus-socket-dir-parent\") pod \"multus-w88gj\" (UID: \"3143c435-082e-462b-a075-5f973501e27c\") " pod="openshift-multus/multus-w88gj" Jul 25 01:11:55.758823 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:55.757182 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3143c435-082e-462b-a075-5f973501e27c-etc-kubernetes\") pod \"multus-w88gj\" (UID: \"3143c435-082e-462b-a075-5f973501e27c\") " pod="openshift-multus/multus-w88gj" Jul 25 01:11:55.758823 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:55.757227 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/3143c435-082e-462b-a075-5f973501e27c-host-run-k8s-cni-cncf-io\") pod \"multus-w88gj\" (UID: \"3143c435-082e-462b-a075-5f973501e27c\") " pod="openshift-multus/multus-w88gj" Jul 25 01:11:55.758823 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:55.757261 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/3143c435-082e-462b-a075-5f973501e27c-host-var-lib-cni-bin\") pod \"multus-w88gj\" (UID: \"3143c435-082e-462b-a075-5f973501e27c\") " pod="openshift-multus/multus-w88gj" Jul 25 01:11:55.762428 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:55.762410 2567 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 25 01:11:55.765667 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:55.765641 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-28vs8\" (UniqueName: \"kubernetes.io/projected/b8bf4790-0739-471e-9b16-1c2e448a8b6a-kube-api-access-28vs8\") pod \"network-metrics-daemon-5nl9g\" (UID: \"b8bf4790-0739-471e-9b16-1c2e448a8b6a\") " pod="openshift-multus/network-metrics-daemon-5nl9g" Jul 25 01:11:55.765745 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:55.765723 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5c8nd\" (UniqueName: \"kubernetes.io/projected/3143c435-082e-462b-a075-5f973501e27c-kube-api-access-5c8nd\") pod \"multus-w88gj\" (UID: \"3143c435-082e-462b-a075-5f973501e27c\") " pod="openshift-multus/multus-w88gj" Jul 25 01:11:55.784952 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:55.784906 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-35.ec2.internal" event={"ID":"edf34879cf3c142ca7dc5154417bf1b1","Type":"ContainerStarted","Data":"2ca2c809c9c4136ea308af7547a4709fee99a2b2cb44a560ea4895d4e57736f6"} Jul 25 01:11:55.785902 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:55.785883 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-35.ec2.internal" event={"ID":"8059162027cf288a28b55e705fcd1fe4","Type":"ContainerStarted","Data":"113ff31750edcbc3bfa12413dbc4012a5148e56471f178ac17dc425bfeaac0e4"} Jul 25 01:11:55.858015 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:55.857990 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dkmfl\" (UniqueName: \"kubernetes.io/projected/737a005c-a25e-4fda-ae48-eb59c37914d0-kube-api-access-dkmfl\") pod \"iptables-alerter-bhdhw\" (UID: \"737a005c-a25e-4fda-ae48-eb59c37914d0\") " pod="openshift-network-operator/iptables-alerter-bhdhw" Jul 25 01:11:55.858127 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:55.858028 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/b287c5c8-d5c4-4685-a19e-6aada1237305-etc-systemd\") pod \"tuned-npgl4\" (UID: \"b287c5c8-d5c4-4685-a19e-6aada1237305\") " pod="openshift-cluster-node-tuning-operator/tuned-npgl4" Jul 25 01:11:55.858127 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:55.858054 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/b287c5c8-d5c4-4685-a19e-6aada1237305-etc-tuned\") pod \"tuned-npgl4\" (UID: \"b287c5c8-d5c4-4685-a19e-6aada1237305\") " pod="openshift-cluster-node-tuning-operator/tuned-npgl4" Jul 25 01:11:55.858127 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:55.858079 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4rqml\" (UniqueName: \"kubernetes.io/projected/9ea66485-c377-4229-b4df-c91ec571cca5-kube-api-access-4rqml\") pod \"node-resolver-8cd2m\" (UID: \"9ea66485-c377-4229-b4df-c91ec571cca5\") " pod="openshift-dns/node-resolver-8cd2m" Jul 25 01:11:55.858127 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:55.858103 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/14185786-ac81-4de0-b023-a79592965e8b-var-lib-openvswitch\") pod \"ovnkube-node-8hgk8\" (UID: \"14185786-ac81-4de0-b023-a79592965e8b\") " pod="openshift-ovn-kubernetes/ovnkube-node-8hgk8" Jul 25 01:11:55.858344 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:55.858124 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/b287c5c8-d5c4-4685-a19e-6aada1237305-etc-systemd\") pod \"tuned-npgl4\" (UID: \"b287c5c8-d5c4-4685-a19e-6aada1237305\") " pod="openshift-cluster-node-tuning-operator/tuned-npgl4" Jul 25 01:11:55.858344 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:55.858126 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5rvfn\" (UniqueName: \"kubernetes.io/projected/14185786-ac81-4de0-b023-a79592965e8b-kube-api-access-5rvfn\") pod \"ovnkube-node-8hgk8\" (UID: \"14185786-ac81-4de0-b023-a79592965e8b\") " pod="openshift-ovn-kubernetes/ovnkube-node-8hgk8" Jul 25 01:11:55.858344 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:55.858163 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/5ada1026-5182-4a3e-9937-68258c8f240d-dbus\") pod \"global-pull-secret-syncer-mktch\" (UID: \"5ada1026-5182-4a3e-9937-68258c8f240d\") " pod="kube-system/global-pull-secret-syncer-mktch" Jul 25 01:11:55.858344 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:55.858185 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b287c5c8-d5c4-4685-a19e-6aada1237305-etc-kubernetes\") pod \"tuned-npgl4\" (UID: \"b287c5c8-d5c4-4685-a19e-6aada1237305\") " pod="openshift-cluster-node-tuning-operator/tuned-npgl4" Jul 25 01:11:55.858344 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:55.858213 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b287c5c8-d5c4-4685-a19e-6aada1237305-var-lib-kubelet\") pod \"tuned-npgl4\" (UID: \"b287c5c8-d5c4-4685-a19e-6aada1237305\") " pod="openshift-cluster-node-tuning-operator/tuned-npgl4" Jul 25 01:11:55.858344 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:55.858232 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/14185786-ac81-4de0-b023-a79592965e8b-var-lib-openvswitch\") pod \"ovnkube-node-8hgk8\" (UID: \"14185786-ac81-4de0-b023-a79592965e8b\") " pod="openshift-ovn-kubernetes/ovnkube-node-8hgk8" Jul 25 01:11:55.858344 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:55.858241 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/14185786-ac81-4de0-b023-a79592965e8b-run-openvswitch\") pod \"ovnkube-node-8hgk8\" (UID: \"14185786-ac81-4de0-b023-a79592965e8b\") " pod="openshift-ovn-kubernetes/ovnkube-node-8hgk8" Jul 25 01:11:55.858344 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:55.858267 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b287c5c8-d5c4-4685-a19e-6aada1237305-etc-kubernetes\") pod \"tuned-npgl4\" (UID: \"b287c5c8-d5c4-4685-a19e-6aada1237305\") " pod="openshift-cluster-node-tuning-operator/tuned-npgl4" Jul 25 01:11:55.858344 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:55.858280 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/14185786-ac81-4de0-b023-a79592965e8b-ovnkube-script-lib\") pod \"ovnkube-node-8hgk8\" (UID: \"14185786-ac81-4de0-b023-a79592965e8b\") " pod="openshift-ovn-kubernetes/ovnkube-node-8hgk8" Jul 25 01:11:55.858344 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:55.858287 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/14185786-ac81-4de0-b023-a79592965e8b-run-openvswitch\") pod \"ovnkube-node-8hgk8\" (UID: \"14185786-ac81-4de0-b023-a79592965e8b\") " pod="openshift-ovn-kubernetes/ovnkube-node-8hgk8" Jul 25 01:11:55.858344 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:55.858294 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b287c5c8-d5c4-4685-a19e-6aada1237305-var-lib-kubelet\") pod \"tuned-npgl4\" (UID: \"b287c5c8-d5c4-4685-a19e-6aada1237305\") " pod="openshift-cluster-node-tuning-operator/tuned-npgl4" Jul 25 01:11:55.858344 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:55.858297 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/5ada1026-5182-4a3e-9937-68258c8f240d-dbus\") pod \"global-pull-secret-syncer-mktch\" (UID: \"5ada1026-5182-4a3e-9937-68258c8f240d\") " pod="kube-system/global-pull-secret-syncer-mktch" Jul 25 01:11:55.858344 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:55.858321 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/bcda8758-c770-452e-8290-b5c19cb5ae6e-etc-selinux\") pod \"aws-ebs-csi-driver-node-mk9n9\" (UID: \"bcda8758-c770-452e-8290-b5c19cb5ae6e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mk9n9" Jul 25 01:11:55.858344 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:55.858351 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/799cf0dd-1f0a-455f-ac0e-d303f0360de2-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-llm4x\" (UID: \"799cf0dd-1f0a-455f-ac0e-d303f0360de2\") " pod="openshift-multus/multus-additional-cni-plugins-llm4x" Jul 25 01:11:55.859093 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:55.858371 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/b287c5c8-d5c4-4685-a19e-6aada1237305-run\") pod \"tuned-npgl4\" (UID: \"b287c5c8-d5c4-4685-a19e-6aada1237305\") " pod="openshift-cluster-node-tuning-operator/tuned-npgl4" Jul 25 01:11:55.859093 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:55.858396 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/14185786-ac81-4de0-b023-a79592965e8b-node-log\") pod \"ovnkube-node-8hgk8\" (UID: \"14185786-ac81-4de0-b023-a79592965e8b\") " pod="openshift-ovn-kubernetes/ovnkube-node-8hgk8" Jul 25 01:11:55.859093 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:55.858433 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/bcda8758-c770-452e-8290-b5c19cb5ae6e-etc-selinux\") pod \"aws-ebs-csi-driver-node-mk9n9\" (UID: \"bcda8758-c770-452e-8290-b5c19cb5ae6e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mk9n9" Jul 25 01:11:55.859093 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:55.858448 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/14185786-ac81-4de0-b023-a79592965e8b-log-socket\") pod \"ovnkube-node-8hgk8\" (UID: \"14185786-ac81-4de0-b023-a79592965e8b\") " pod="openshift-ovn-kubernetes/ovnkube-node-8hgk8" Jul 25 01:11:55.859093 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:55.858470 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/14185786-ac81-4de0-b023-a79592965e8b-node-log\") pod \"ovnkube-node-8hgk8\" (UID: \"14185786-ac81-4de0-b023-a79592965e8b\") " pod="openshift-ovn-kubernetes/ovnkube-node-8hgk8" Jul 25 01:11:55.859093 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:55.858473 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/bcda8758-c770-452e-8290-b5c19cb5ae6e-sys-fs\") pod \"aws-ebs-csi-driver-node-mk9n9\" (UID: \"bcda8758-c770-452e-8290-b5c19cb5ae6e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mk9n9" Jul 25 01:11:55.859093 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:55.858510 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9qp24\" (UniqueName: \"kubernetes.io/projected/4a3b7c62-05b6-4e7f-9c84-249de675af87-kube-api-access-9qp24\") pod \"node-ca-c42rd\" (UID: \"4a3b7c62-05b6-4e7f-9c84-249de675af87\") " pod="openshift-image-registry/node-ca-c42rd" Jul 25 01:11:55.859093 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:55.858536 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/b287c5c8-d5c4-4685-a19e-6aada1237305-run\") pod \"tuned-npgl4\" (UID: \"b287c5c8-d5c4-4685-a19e-6aada1237305\") " pod="openshift-cluster-node-tuning-operator/tuned-npgl4" Jul 25 01:11:55.859093 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:55.858538 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/506f2c8c-d134-4671-969c-b5d70acadef0-konnectivity-ca\") pod \"konnectivity-agent-t4x2l\" (UID: \"506f2c8c-d134-4671-969c-b5d70acadef0\") " pod="kube-system/konnectivity-agent-t4x2l" Jul 25 01:11:55.859093 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:55.858595 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/14185786-ac81-4de0-b023-a79592965e8b-host-kubelet\") pod \"ovnkube-node-8hgk8\" (UID: \"14185786-ac81-4de0-b023-a79592965e8b\") " pod="openshift-ovn-kubernetes/ovnkube-node-8hgk8" Jul 25 01:11:55.859093 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:55.858612 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/bcda8758-c770-452e-8290-b5c19cb5ae6e-kubelet-dir\") pod \"aws-ebs-csi-driver-node-mk9n9\" (UID: \"bcda8758-c770-452e-8290-b5c19cb5ae6e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mk9n9" Jul 25 01:11:55.859093 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:55.858643 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/799cf0dd-1f0a-455f-ac0e-d303f0360de2-cnibin\") pod \"multus-additional-cni-plugins-llm4x\" (UID: \"799cf0dd-1f0a-455f-ac0e-d303f0360de2\") " pod="openshift-multus/multus-additional-cni-plugins-llm4x" Jul 25 01:11:55.859093 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:55.858625 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/bcda8758-c770-452e-8290-b5c19cb5ae6e-sys-fs\") pod \"aws-ebs-csi-driver-node-mk9n9\" (UID: \"bcda8758-c770-452e-8290-b5c19cb5ae6e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mk9n9" Jul 25 01:11:55.859093 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:55.858701 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/799cf0dd-1f0a-455f-ac0e-d303f0360de2-cnibin\") pod \"multus-additional-cni-plugins-llm4x\" (UID: \"799cf0dd-1f0a-455f-ac0e-d303f0360de2\") " pod="openshift-multus/multus-additional-cni-plugins-llm4x" Jul 25 01:11:55.859093 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:55.858702 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/bcda8758-c770-452e-8290-b5c19cb5ae6e-kubelet-dir\") pod \"aws-ebs-csi-driver-node-mk9n9\" (UID: \"bcda8758-c770-452e-8290-b5c19cb5ae6e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mk9n9" Jul 25 01:11:55.859093 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:55.858719 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/14185786-ac81-4de0-b023-a79592965e8b-log-socket\") pod \"ovnkube-node-8hgk8\" (UID: \"14185786-ac81-4de0-b023-a79592965e8b\") " pod="openshift-ovn-kubernetes/ovnkube-node-8hgk8" Jul 25 01:11:55.859093 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:55.858847 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/799cf0dd-1f0a-455f-ac0e-d303f0360de2-cni-binary-copy\") pod \"multus-additional-cni-plugins-llm4x\" (UID: \"799cf0dd-1f0a-455f-ac0e-d303f0360de2\") " pod="openshift-multus/multus-additional-cni-plugins-llm4x" Jul 25 01:11:55.860020 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:55.858860 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/14185786-ac81-4de0-b023-a79592965e8b-host-kubelet\") pod \"ovnkube-node-8hgk8\" (UID: \"14185786-ac81-4de0-b023-a79592965e8b\") " pod="openshift-ovn-kubernetes/ovnkube-node-8hgk8" Jul 25 01:11:55.860020 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:55.858880 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/737a005c-a25e-4fda-ae48-eb59c37914d0-host-slash\") pod \"iptables-alerter-bhdhw\" (UID: \"737a005c-a25e-4fda-ae48-eb59c37914d0\") " pod="openshift-network-operator/iptables-alerter-bhdhw" Jul 25 01:11:55.860020 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:55.858907 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/b287c5c8-d5c4-4685-a19e-6aada1237305-etc-sysctl-d\") pod \"tuned-npgl4\" (UID: \"b287c5c8-d5c4-4685-a19e-6aada1237305\") " pod="openshift-cluster-node-tuning-operator/tuned-npgl4" Jul 25 01:11:55.860020 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:55.858909 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/799cf0dd-1f0a-455f-ac0e-d303f0360de2-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-llm4x\" (UID: \"799cf0dd-1f0a-455f-ac0e-d303f0360de2\") " pod="openshift-multus/multus-additional-cni-plugins-llm4x" Jul 25 01:11:55.860020 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:55.858932 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d4nh2\" (UniqueName: \"kubernetes.io/projected/b287c5c8-d5c4-4685-a19e-6aada1237305-kube-api-access-d4nh2\") pod \"tuned-npgl4\" (UID: \"b287c5c8-d5c4-4685-a19e-6aada1237305\") " pod="openshift-cluster-node-tuning-operator/tuned-npgl4" Jul 25 01:11:55.860020 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:55.858964 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/737a005c-a25e-4fda-ae48-eb59c37914d0-host-slash\") pod \"iptables-alerter-bhdhw\" (UID: \"737a005c-a25e-4fda-ae48-eb59c37914d0\") " pod="openshift-network-operator/iptables-alerter-bhdhw" Jul 25 01:11:55.860020 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:55.858958 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/14185786-ac81-4de0-b023-a79592965e8b-systemd-units\") pod \"ovnkube-node-8hgk8\" (UID: \"14185786-ac81-4de0-b023-a79592965e8b\") " pod="openshift-ovn-kubernetes/ovnkube-node-8hgk8" Jul 25 01:11:55.860020 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:55.859004 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/14185786-ac81-4de0-b023-a79592965e8b-systemd-units\") pod \"ovnkube-node-8hgk8\" (UID: \"14185786-ac81-4de0-b023-a79592965e8b\") " pod="openshift-ovn-kubernetes/ovnkube-node-8hgk8" Jul 25 01:11:55.860020 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:55.859006 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/14185786-ac81-4de0-b023-a79592965e8b-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-8hgk8\" (UID: \"14185786-ac81-4de0-b023-a79592965e8b\") " pod="openshift-ovn-kubernetes/ovnkube-node-8hgk8" Jul 25 01:11:55.860020 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:55.859019 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/b287c5c8-d5c4-4685-a19e-6aada1237305-etc-sysctl-d\") pod \"tuned-npgl4\" (UID: \"b287c5c8-d5c4-4685-a19e-6aada1237305\") " pod="openshift-cluster-node-tuning-operator/tuned-npgl4" Jul 25 01:11:55.860020 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:55.858909 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/14185786-ac81-4de0-b023-a79592965e8b-ovnkube-script-lib\") pod \"ovnkube-node-8hgk8\" (UID: \"14185786-ac81-4de0-b023-a79592965e8b\") " pod="openshift-ovn-kubernetes/ovnkube-node-8hgk8" Jul 25 01:11:55.860020 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:55.859039 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/14185786-ac81-4de0-b023-a79592965e8b-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-8hgk8\" (UID: \"14185786-ac81-4de0-b023-a79592965e8b\") " pod="openshift-ovn-kubernetes/ovnkube-node-8hgk8" Jul 25 01:11:55.860020 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:55.859058 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/4a3b7c62-05b6-4e7f-9c84-249de675af87-serviceca\") pod \"node-ca-c42rd\" (UID: \"4a3b7c62-05b6-4e7f-9c84-249de675af87\") " pod="openshift-image-registry/node-ca-c42rd" Jul 25 01:11:55.860020 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:55.859083 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/14185786-ac81-4de0-b023-a79592965e8b-host-cni-netd\") pod \"ovnkube-node-8hgk8\" (UID: \"14185786-ac81-4de0-b023-a79592965e8b\") " pod="openshift-ovn-kubernetes/ovnkube-node-8hgk8" Jul 25 01:11:55.860020 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:55.859101 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5ada1026-5182-4a3e-9937-68258c8f240d-original-pull-secret\") pod \"global-pull-secret-syncer-mktch\" (UID: \"5ada1026-5182-4a3e-9937-68258c8f240d\") " pod="kube-system/global-pull-secret-syncer-mktch" Jul 25 01:11:55.860020 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:55.859135 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/14185786-ac81-4de0-b023-a79592965e8b-host-run-netns\") pod \"ovnkube-node-8hgk8\" (UID: \"14185786-ac81-4de0-b023-a79592965e8b\") " pod="openshift-ovn-kubernetes/ovnkube-node-8hgk8" Jul 25 01:11:55.860020 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:55.859168 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/14185786-ac81-4de0-b023-a79592965e8b-run-systemd\") pod \"ovnkube-node-8hgk8\" (UID: \"14185786-ac81-4de0-b023-a79592965e8b\") " pod="openshift-ovn-kubernetes/ovnkube-node-8hgk8" Jul 25 01:11:55.860894 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:55.859177 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/14185786-ac81-4de0-b023-a79592965e8b-host-cni-netd\") pod \"ovnkube-node-8hgk8\" (UID: \"14185786-ac81-4de0-b023-a79592965e8b\") " pod="openshift-ovn-kubernetes/ovnkube-node-8hgk8" Jul 25 01:11:55.860894 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:55.859210 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/b287c5c8-d5c4-4685-a19e-6aada1237305-etc-sysconfig\") pod \"tuned-npgl4\" (UID: \"b287c5c8-d5c4-4685-a19e-6aada1237305\") " pod="openshift-cluster-node-tuning-operator/tuned-npgl4" Jul 25 01:11:55.860894 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:55.859220 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/14185786-ac81-4de0-b023-a79592965e8b-run-systemd\") pod \"ovnkube-node-8hgk8\" (UID: \"14185786-ac81-4de0-b023-a79592965e8b\") " pod="openshift-ovn-kubernetes/ovnkube-node-8hgk8" Jul 25 01:11:55.860894 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:55.859234 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b287c5c8-d5c4-4685-a19e-6aada1237305-lib-modules\") pod \"tuned-npgl4\" (UID: \"b287c5c8-d5c4-4685-a19e-6aada1237305\") " pod="openshift-cluster-node-tuning-operator/tuned-npgl4" Jul 25 01:11:55.860894 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:55.859181 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/14185786-ac81-4de0-b023-a79592965e8b-host-run-netns\") pod \"ovnkube-node-8hgk8\" (UID: \"14185786-ac81-4de0-b023-a79592965e8b\") " pod="openshift-ovn-kubernetes/ovnkube-node-8hgk8" Jul 25 01:11:55.860894 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:55.859262 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k8qbc\" (UniqueName: \"kubernetes.io/projected/bcda8758-c770-452e-8290-b5c19cb5ae6e-kube-api-access-k8qbc\") pod \"aws-ebs-csi-driver-node-mk9n9\" (UID: \"bcda8758-c770-452e-8290-b5c19cb5ae6e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mk9n9" Jul 25 01:11:55.860894 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:55.859286 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/b287c5c8-d5c4-4685-a19e-6aada1237305-etc-sysconfig\") pod \"tuned-npgl4\" (UID: \"b287c5c8-d5c4-4685-a19e-6aada1237305\") " pod="openshift-cluster-node-tuning-operator/tuned-npgl4" Jul 25 01:11:55.860894 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:55.859287 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b287c5c8-d5c4-4685-a19e-6aada1237305-host\") pod \"tuned-npgl4\" (UID: \"b287c5c8-d5c4-4685-a19e-6aada1237305\") " pod="openshift-cluster-node-tuning-operator/tuned-npgl4" Jul 25 01:11:55.860894 ip-10-0-129-35 kubenswrapper[2567]: E0725 01:11:55.859296 2567 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 25 01:11:55.860894 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:55.859318 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/14185786-ac81-4de0-b023-a79592965e8b-host-slash\") pod \"ovnkube-node-8hgk8\" (UID: \"14185786-ac81-4de0-b023-a79592965e8b\") " pod="openshift-ovn-kubernetes/ovnkube-node-8hgk8" Jul 25 01:11:55.860894 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:55.859325 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b287c5c8-d5c4-4685-a19e-6aada1237305-host\") pod \"tuned-npgl4\" (UID: \"b287c5c8-d5c4-4685-a19e-6aada1237305\") " pod="openshift-cluster-node-tuning-operator/tuned-npgl4" Jul 25 01:11:55.860894 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:55.859342 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/799cf0dd-1f0a-455f-ac0e-d303f0360de2-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-llm4x\" (UID: \"799cf0dd-1f0a-455f-ac0e-d303f0360de2\") " pod="openshift-multus/multus-additional-cni-plugins-llm4x" Jul 25 01:11:55.860894 ip-10-0-129-35 kubenswrapper[2567]: E0725 01:11:55.859376 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5ada1026-5182-4a3e-9937-68258c8f240d-original-pull-secret podName:5ada1026-5182-4a3e-9937-68258c8f240d nodeName:}" failed. No retries permitted until 2026-07-25 01:11:56.359358916 +0000 UTC m=+2.052453319 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/5ada1026-5182-4a3e-9937-68258c8f240d-original-pull-secret") pod "global-pull-secret-syncer-mktch" (UID: "5ada1026-5182-4a3e-9937-68258c8f240d") : object "kube-system"/"original-pull-secret" not registered Jul 25 01:11:55.860894 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:55.859414 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/737a005c-a25e-4fda-ae48-eb59c37914d0-iptables-alerter-script\") pod \"iptables-alerter-bhdhw\" (UID: \"737a005c-a25e-4fda-ae48-eb59c37914d0\") " pod="openshift-network-operator/iptables-alerter-bhdhw" Jul 25 01:11:55.860894 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:55.859418 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/799cf0dd-1f0a-455f-ac0e-d303f0360de2-cni-binary-copy\") pod \"multus-additional-cni-plugins-llm4x\" (UID: \"799cf0dd-1f0a-455f-ac0e-d303f0360de2\") " pod="openshift-multus/multus-additional-cni-plugins-llm4x" Jul 25 01:11:55.860894 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:55.859442 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/4a3b7c62-05b6-4e7f-9c84-249de675af87-host\") pod \"node-ca-c42rd\" (UID: \"4a3b7c62-05b6-4e7f-9c84-249de675af87\") " pod="openshift-image-registry/node-ca-c42rd" Jul 25 01:11:55.860894 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:55.859447 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b287c5c8-d5c4-4685-a19e-6aada1237305-lib-modules\") pod \"tuned-npgl4\" (UID: \"b287c5c8-d5c4-4685-a19e-6aada1237305\") " pod="openshift-cluster-node-tuning-operator/tuned-npgl4" Jul 25 01:11:55.861493 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:55.859452 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/14185786-ac81-4de0-b023-a79592965e8b-host-slash\") pod \"ovnkube-node-8hgk8\" (UID: \"14185786-ac81-4de0-b023-a79592965e8b\") " pod="openshift-ovn-kubernetes/ovnkube-node-8hgk8" Jul 25 01:11:55.861493 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:55.859477 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/14185786-ac81-4de0-b023-a79592965e8b-etc-openvswitch\") pod \"ovnkube-node-8hgk8\" (UID: \"14185786-ac81-4de0-b023-a79592965e8b\") " pod="openshift-ovn-kubernetes/ovnkube-node-8hgk8" Jul 25 01:11:55.861493 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:55.859482 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/4a3b7c62-05b6-4e7f-9c84-249de675af87-host\") pod \"node-ca-c42rd\" (UID: \"4a3b7c62-05b6-4e7f-9c84-249de675af87\") " pod="openshift-image-registry/node-ca-c42rd" Jul 25 01:11:55.861493 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:55.859504 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/14185786-ac81-4de0-b023-a79592965e8b-host-run-ovn-kubernetes\") pod \"ovnkube-node-8hgk8\" (UID: \"14185786-ac81-4de0-b023-a79592965e8b\") " pod="openshift-ovn-kubernetes/ovnkube-node-8hgk8" Jul 25 01:11:55.861493 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:55.859529 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s9qxj\" (UniqueName: \"kubernetes.io/projected/799cf0dd-1f0a-455f-ac0e-d303f0360de2-kube-api-access-s9qxj\") pod \"multus-additional-cni-plugins-llm4x\" (UID: \"799cf0dd-1f0a-455f-ac0e-d303f0360de2\") " pod="openshift-multus/multus-additional-cni-plugins-llm4x" Jul 25 01:11:55.861493 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:55.859558 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/b287c5c8-d5c4-4685-a19e-6aada1237305-etc-sysctl-conf\") pod \"tuned-npgl4\" (UID: \"b287c5c8-d5c4-4685-a19e-6aada1237305\") " pod="openshift-cluster-node-tuning-operator/tuned-npgl4" Jul 25 01:11:55.861493 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:55.859581 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/9ea66485-c377-4229-b4df-c91ec571cca5-hosts-file\") pod \"node-resolver-8cd2m\" (UID: \"9ea66485-c377-4229-b4df-c91ec571cca5\") " pod="openshift-dns/node-resolver-8cd2m" Jul 25 01:11:55.861493 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:55.859618 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/14185786-ac81-4de0-b023-a79592965e8b-run-ovn\") pod \"ovnkube-node-8hgk8\" (UID: \"14185786-ac81-4de0-b023-a79592965e8b\") " pod="openshift-ovn-kubernetes/ovnkube-node-8hgk8" Jul 25 01:11:55.861493 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:55.859641 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/4a3b7c62-05b6-4e7f-9c84-249de675af87-serviceca\") pod \"node-ca-c42rd\" (UID: \"4a3b7c62-05b6-4e7f-9c84-249de675af87\") " pod="openshift-image-registry/node-ca-c42rd" Jul 25 01:11:55.861493 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:55.859667 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/506f2c8c-d134-4671-969c-b5d70acadef0-konnectivity-ca\") pod \"konnectivity-agent-t4x2l\" (UID: \"506f2c8c-d134-4671-969c-b5d70acadef0\") " pod="kube-system/konnectivity-agent-t4x2l" Jul 25 01:11:55.861493 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:55.859705 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/14185786-ac81-4de0-b023-a79592965e8b-ovnkube-config\") pod \"ovnkube-node-8hgk8\" (UID: \"14185786-ac81-4de0-b023-a79592965e8b\") " pod="openshift-ovn-kubernetes/ovnkube-node-8hgk8" Jul 25 01:11:55.861493 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:55.859747 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/bcda8758-c770-452e-8290-b5c19cb5ae6e-socket-dir\") pod \"aws-ebs-csi-driver-node-mk9n9\" (UID: \"bcda8758-c770-452e-8290-b5c19cb5ae6e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mk9n9" Jul 25 01:11:55.861493 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:55.859803 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/14185786-ac81-4de0-b023-a79592965e8b-run-ovn\") pod \"ovnkube-node-8hgk8\" (UID: \"14185786-ac81-4de0-b023-a79592965e8b\") " pod="openshift-ovn-kubernetes/ovnkube-node-8hgk8" Jul 25 01:11:55.861493 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:55.859843 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/799cf0dd-1f0a-455f-ac0e-d303f0360de2-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-llm4x\" (UID: \"799cf0dd-1f0a-455f-ac0e-d303f0360de2\") " pod="openshift-multus/multus-additional-cni-plugins-llm4x" Jul 25 01:11:55.861493 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:55.859857 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/bcda8758-c770-452e-8290-b5c19cb5ae6e-socket-dir\") pod \"aws-ebs-csi-driver-node-mk9n9\" (UID: \"bcda8758-c770-452e-8290-b5c19cb5ae6e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mk9n9" Jul 25 01:11:55.861493 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:55.859890 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/14185786-ac81-4de0-b023-a79592965e8b-host-run-ovn-kubernetes\") pod \"ovnkube-node-8hgk8\" (UID: \"14185786-ac81-4de0-b023-a79592965e8b\") " pod="openshift-ovn-kubernetes/ovnkube-node-8hgk8" Jul 25 01:11:55.861493 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:55.859973 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/9ea66485-c377-4229-b4df-c91ec571cca5-hosts-file\") pod \"node-resolver-8cd2m\" (UID: \"9ea66485-c377-4229-b4df-c91ec571cca5\") " pod="openshift-dns/node-resolver-8cd2m" Jul 25 01:11:55.862072 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:55.860008 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/14185786-ac81-4de0-b023-a79592965e8b-etc-openvswitch\") pod \"ovnkube-node-8hgk8\" (UID: \"14185786-ac81-4de0-b023-a79592965e8b\") " pod="openshift-ovn-kubernetes/ovnkube-node-8hgk8" Jul 25 01:11:55.862072 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:55.860008 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/b287c5c8-d5c4-4685-a19e-6aada1237305-etc-sysctl-conf\") pod \"tuned-npgl4\" (UID: \"b287c5c8-d5c4-4685-a19e-6aada1237305\") " pod="openshift-cluster-node-tuning-operator/tuned-npgl4" Jul 25 01:11:55.862072 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:55.860032 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/799cf0dd-1f0a-455f-ac0e-d303f0360de2-tuning-conf-dir\") pod \"multus-additional-cni-plugins-llm4x\" (UID: \"799cf0dd-1f0a-455f-ac0e-d303f0360de2\") " pod="openshift-multus/multus-additional-cni-plugins-llm4x" Jul 25 01:11:55.862072 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:55.860057 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b287c5c8-d5c4-4685-a19e-6aada1237305-sys\") pod \"tuned-npgl4\" (UID: \"b287c5c8-d5c4-4685-a19e-6aada1237305\") " pod="openshift-cluster-node-tuning-operator/tuned-npgl4" Jul 25 01:11:55.862072 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:55.860073 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9ea66485-c377-4229-b4df-c91ec571cca5-tmp-dir\") pod \"node-resolver-8cd2m\" (UID: \"9ea66485-c377-4229-b4df-c91ec571cca5\") " pod="openshift-dns/node-resolver-8cd2m" Jul 25 01:11:55.862072 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:55.860088 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/14185786-ac81-4de0-b023-a79592965e8b-ovn-node-metrics-cert\") pod \"ovnkube-node-8hgk8\" (UID: \"14185786-ac81-4de0-b023-a79592965e8b\") " pod="openshift-ovn-kubernetes/ovnkube-node-8hgk8" Jul 25 01:11:55.862072 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:55.860109 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/14185786-ac81-4de0-b023-a79592965e8b-host-cni-bin\") pod \"ovnkube-node-8hgk8\" (UID: \"14185786-ac81-4de0-b023-a79592965e8b\") " pod="openshift-ovn-kubernetes/ovnkube-node-8hgk8" Jul 25 01:11:55.862072 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:55.860131 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/737a005c-a25e-4fda-ae48-eb59c37914d0-iptables-alerter-script\") pod \"iptables-alerter-bhdhw\" (UID: \"737a005c-a25e-4fda-ae48-eb59c37914d0\") " pod="openshift-network-operator/iptables-alerter-bhdhw" Jul 25 01:11:55.862072 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:55.860151 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/14185786-ac81-4de0-b023-a79592965e8b-host-cni-bin\") pod \"ovnkube-node-8hgk8\" (UID: \"14185786-ac81-4de0-b023-a79592965e8b\") " pod="openshift-ovn-kubernetes/ovnkube-node-8hgk8" Jul 25 01:11:55.862072 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:55.860196 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b287c5c8-d5c4-4685-a19e-6aada1237305-sys\") pod \"tuned-npgl4\" (UID: \"b287c5c8-d5c4-4685-a19e-6aada1237305\") " pod="openshift-cluster-node-tuning-operator/tuned-npgl4" Jul 25 01:11:55.862072 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:55.860232 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/799cf0dd-1f0a-455f-ac0e-d303f0360de2-tuning-conf-dir\") pod \"multus-additional-cni-plugins-llm4x\" (UID: \"799cf0dd-1f0a-455f-ac0e-d303f0360de2\") " pod="openshift-multus/multus-additional-cni-plugins-llm4x" Jul 25 01:11:55.862072 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:55.860246 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/14185786-ac81-4de0-b023-a79592965e8b-env-overrides\") pod \"ovnkube-node-8hgk8\" (UID: \"14185786-ac81-4de0-b023-a79592965e8b\") " pod="openshift-ovn-kubernetes/ovnkube-node-8hgk8" Jul 25 01:11:55.862072 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:55.860278 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/bcda8758-c770-452e-8290-b5c19cb5ae6e-registration-dir\") pod \"aws-ebs-csi-driver-node-mk9n9\" (UID: \"bcda8758-c770-452e-8290-b5c19cb5ae6e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mk9n9" Jul 25 01:11:55.862072 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:55.860305 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/5ada1026-5182-4a3e-9937-68258c8f240d-kubelet-config\") pod \"global-pull-secret-syncer-mktch\" (UID: \"5ada1026-5182-4a3e-9937-68258c8f240d\") " pod="kube-system/global-pull-secret-syncer-mktch" Jul 25 01:11:55.862072 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:55.860331 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/b287c5c8-d5c4-4685-a19e-6aada1237305-etc-modprobe-d\") pod \"tuned-npgl4\" (UID: \"b287c5c8-d5c4-4685-a19e-6aada1237305\") " pod="openshift-cluster-node-tuning-operator/tuned-npgl4" Jul 25 01:11:55.862072 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:55.860335 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/bcda8758-c770-452e-8290-b5c19cb5ae6e-registration-dir\") pod \"aws-ebs-csi-driver-node-mk9n9\" (UID: \"bcda8758-c770-452e-8290-b5c19cb5ae6e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mk9n9" Jul 25 01:11:55.862072 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:55.860355 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b287c5c8-d5c4-4685-a19e-6aada1237305-tmp\") pod \"tuned-npgl4\" (UID: \"b287c5c8-d5c4-4685-a19e-6aada1237305\") " pod="openshift-cluster-node-tuning-operator/tuned-npgl4" Jul 25 01:11:55.862676 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:55.860383 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/506f2c8c-d134-4671-969c-b5d70acadef0-agent-certs\") pod \"konnectivity-agent-t4x2l\" (UID: \"506f2c8c-d134-4671-969c-b5d70acadef0\") " pod="kube-system/konnectivity-agent-t4x2l" Jul 25 01:11:55.862676 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:55.860424 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9ea66485-c377-4229-b4df-c91ec571cca5-tmp-dir\") pod \"node-resolver-8cd2m\" (UID: \"9ea66485-c377-4229-b4df-c91ec571cca5\") " pod="openshift-dns/node-resolver-8cd2m" Jul 25 01:11:55.862676 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:55.860435 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/bcda8758-c770-452e-8290-b5c19cb5ae6e-device-dir\") pod \"aws-ebs-csi-driver-node-mk9n9\" (UID: \"bcda8758-c770-452e-8290-b5c19cb5ae6e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mk9n9" Jul 25 01:11:55.862676 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:55.860278 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/14185786-ac81-4de0-b023-a79592965e8b-ovnkube-config\") pod \"ovnkube-node-8hgk8\" (UID: \"14185786-ac81-4de0-b023-a79592965e8b\") " pod="openshift-ovn-kubernetes/ovnkube-node-8hgk8" Jul 25 01:11:55.862676 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:55.860437 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/5ada1026-5182-4a3e-9937-68258c8f240d-kubelet-config\") pod \"global-pull-secret-syncer-mktch\" (UID: \"5ada1026-5182-4a3e-9937-68258c8f240d\") " pod="kube-system/global-pull-secret-syncer-mktch" Jul 25 01:11:55.862676 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:55.860451 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/b287c5c8-d5c4-4685-a19e-6aada1237305-etc-modprobe-d\") pod \"tuned-npgl4\" (UID: \"b287c5c8-d5c4-4685-a19e-6aada1237305\") " pod="openshift-cluster-node-tuning-operator/tuned-npgl4" Jul 25 01:11:55.862676 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:55.860483 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-884lb\" (UniqueName: \"kubernetes.io/projected/8748d129-9ec1-44d6-8a95-88e0da2df4b3-kube-api-access-884lb\") pod \"network-check-target-znlzb\" (UID: \"8748d129-9ec1-44d6-8a95-88e0da2df4b3\") " pod="openshift-network-diagnostics/network-check-target-znlzb" Jul 25 01:11:55.862676 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:55.860513 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/799cf0dd-1f0a-455f-ac0e-d303f0360de2-system-cni-dir\") pod \"multus-additional-cni-plugins-llm4x\" (UID: \"799cf0dd-1f0a-455f-ac0e-d303f0360de2\") " pod="openshift-multus/multus-additional-cni-plugins-llm4x" Jul 25 01:11:55.862676 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:55.860536 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/799cf0dd-1f0a-455f-ac0e-d303f0360de2-os-release\") pod \"multus-additional-cni-plugins-llm4x\" (UID: \"799cf0dd-1f0a-455f-ac0e-d303f0360de2\") " pod="openshift-multus/multus-additional-cni-plugins-llm4x" Jul 25 01:11:55.862676 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:55.860537 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/bcda8758-c770-452e-8290-b5c19cb5ae6e-device-dir\") pod \"aws-ebs-csi-driver-node-mk9n9\" (UID: \"bcda8758-c770-452e-8290-b5c19cb5ae6e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mk9n9" Jul 25 01:11:55.862676 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:55.860578 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/799cf0dd-1f0a-455f-ac0e-d303f0360de2-system-cni-dir\") pod \"multus-additional-cni-plugins-llm4x\" (UID: \"799cf0dd-1f0a-455f-ac0e-d303f0360de2\") " pod="openshift-multus/multus-additional-cni-plugins-llm4x" Jul 25 01:11:55.862676 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:55.860640 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/14185786-ac81-4de0-b023-a79592965e8b-env-overrides\") pod \"ovnkube-node-8hgk8\" (UID: \"14185786-ac81-4de0-b023-a79592965e8b\") " pod="openshift-ovn-kubernetes/ovnkube-node-8hgk8" Jul 25 01:11:55.862676 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:55.860645 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/799cf0dd-1f0a-455f-ac0e-d303f0360de2-os-release\") pod \"multus-additional-cni-plugins-llm4x\" (UID: \"799cf0dd-1f0a-455f-ac0e-d303f0360de2\") " pod="openshift-multus/multus-additional-cni-plugins-llm4x" Jul 25 01:11:55.862676 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:55.860763 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/b287c5c8-d5c4-4685-a19e-6aada1237305-etc-tuned\") pod \"tuned-npgl4\" (UID: \"b287c5c8-d5c4-4685-a19e-6aada1237305\") " pod="openshift-cluster-node-tuning-operator/tuned-npgl4" Jul 25 01:11:55.862676 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:55.862302 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/14185786-ac81-4de0-b023-a79592965e8b-ovn-node-metrics-cert\") pod \"ovnkube-node-8hgk8\" (UID: \"14185786-ac81-4de0-b023-a79592965e8b\") " pod="openshift-ovn-kubernetes/ovnkube-node-8hgk8" Jul 25 01:11:55.862676 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:55.862477 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b287c5c8-d5c4-4685-a19e-6aada1237305-tmp\") pod \"tuned-npgl4\" (UID: \"b287c5c8-d5c4-4685-a19e-6aada1237305\") " pod="openshift-cluster-node-tuning-operator/tuned-npgl4" Jul 25 01:11:55.863424 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:55.863406 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/506f2c8c-d134-4671-969c-b5d70acadef0-agent-certs\") pod \"konnectivity-agent-t4x2l\" (UID: \"506f2c8c-d134-4671-969c-b5d70acadef0\") " pod="kube-system/konnectivity-agent-t4x2l" Jul 25 01:11:55.868049 ip-10-0-129-35 kubenswrapper[2567]: E0725 01:11:55.868027 2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 25 01:11:55.868122 ip-10-0-129-35 kubenswrapper[2567]: E0725 01:11:55.868058 2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 25 01:11:55.868122 ip-10-0-129-35 kubenswrapper[2567]: E0725 01:11:55.868072 2567 projected.go:196] Error preparing data for projected volume kube-api-access-884lb for pod openshift-network-diagnostics/network-check-target-znlzb: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 25 01:11:55.868204 ip-10-0-129-35 kubenswrapper[2567]: E0725 01:11:55.868136 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8748d129-9ec1-44d6-8a95-88e0da2df4b3-kube-api-access-884lb podName:8748d129-9ec1-44d6-8a95-88e0da2df4b3 nodeName:}" failed. No retries permitted until 2026-07-25 01:11:56.368117346 +0000 UTC m=+2.061211766 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-884lb" (UniqueName: "kubernetes.io/projected/8748d129-9ec1-44d6-8a95-88e0da2df4b3-kube-api-access-884lb") pod "network-check-target-znlzb" (UID: "8748d129-9ec1-44d6-8a95-88e0da2df4b3") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 25 01:11:55.868959 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:55.868930 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dkmfl\" (UniqueName: \"kubernetes.io/projected/737a005c-a25e-4fda-ae48-eb59c37914d0-kube-api-access-dkmfl\") pod \"iptables-alerter-bhdhw\" (UID: \"737a005c-a25e-4fda-ae48-eb59c37914d0\") " pod="openshift-network-operator/iptables-alerter-bhdhw" Jul 25 01:11:55.870916 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:55.870884 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d4nh2\" (UniqueName: \"kubernetes.io/projected/b287c5c8-d5c4-4685-a19e-6aada1237305-kube-api-access-d4nh2\") pod \"tuned-npgl4\" (UID: \"b287c5c8-d5c4-4685-a19e-6aada1237305\") " pod="openshift-cluster-node-tuning-operator/tuned-npgl4" Jul 25 01:11:55.871111 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:55.871095 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4rqml\" (UniqueName: \"kubernetes.io/projected/9ea66485-c377-4229-b4df-c91ec571cca5-kube-api-access-4rqml\") pod \"node-resolver-8cd2m\" (UID: \"9ea66485-c377-4229-b4df-c91ec571cca5\") " pod="openshift-dns/node-resolver-8cd2m" Jul 25 01:11:55.871224 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:55.871201 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9qp24\" (UniqueName: \"kubernetes.io/projected/4a3b7c62-05b6-4e7f-9c84-249de675af87-kube-api-access-9qp24\") pod \"node-ca-c42rd\" (UID: \"4a3b7c62-05b6-4e7f-9c84-249de675af87\") " pod="openshift-image-registry/node-ca-c42rd" Jul 25 01:11:55.871341 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:55.871317 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k8qbc\" (UniqueName: \"kubernetes.io/projected/bcda8758-c770-452e-8290-b5c19cb5ae6e-kube-api-access-k8qbc\") pod \"aws-ebs-csi-driver-node-mk9n9\" (UID: \"bcda8758-c770-452e-8290-b5c19cb5ae6e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mk9n9" Jul 25 01:11:55.871703 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:55.871686 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s9qxj\" (UniqueName: \"kubernetes.io/projected/799cf0dd-1f0a-455f-ac0e-d303f0360de2-kube-api-access-s9qxj\") pod \"multus-additional-cni-plugins-llm4x\" (UID: \"799cf0dd-1f0a-455f-ac0e-d303f0360de2\") " pod="openshift-multus/multus-additional-cni-plugins-llm4x" Jul 25 01:11:55.871766 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:55.871735 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5rvfn\" (UniqueName: \"kubernetes.io/projected/14185786-ac81-4de0-b023-a79592965e8b-kube-api-access-5rvfn\") pod \"ovnkube-node-8hgk8\" (UID: \"14185786-ac81-4de0-b023-a79592965e8b\") " pod="openshift-ovn-kubernetes/ovnkube-node-8hgk8" Jul 25 01:11:55.872736 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:55.872721 2567 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 25 01:11:55.989493 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:55.989434 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-w88gj" Jul 25 01:11:55.995803 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:55.995784 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-8hgk8" Jul 25 01:11:55.997974 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:11:55.997955 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3143c435_082e_462b_a075_5f973501e27c.slice/crio-6754701303e41a0b25ff61602856e64019d84b4b3e02b92901f17d0401b96d1f WatchSource:0}: Error finding container 6754701303e41a0b25ff61602856e64019d84b4b3e02b92901f17d0401b96d1f: Status 404 returned error can't find the container with id 6754701303e41a0b25ff61602856e64019d84b4b3e02b92901f17d0401b96d1f Jul 25 01:11:56.003132 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:56.003114 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mk9n9" Jul 25 01:11:56.004914 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:11:56.004852 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod14185786_ac81_4de0_b023_a79592965e8b.slice/crio-4c885ea78d535ceb185f0f52ce2615558497dff2c6eb6c5f24055d09eaf76ce1 WatchSource:0}: Error finding container 4c885ea78d535ceb185f0f52ce2615558497dff2c6eb6c5f24055d09eaf76ce1: Status 404 returned error can't find the container with id 4c885ea78d535ceb185f0f52ce2615558497dff2c6eb6c5f24055d09eaf76ce1 Jul 25 01:11:56.007360 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:56.007297 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-bhdhw" Jul 25 01:11:56.013248 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:56.013229 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-llm4x" Jul 25 01:11:56.013412 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:11:56.013395 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbcda8758_c770_452e_8290_b5c19cb5ae6e.slice/crio-2b9780631b82ced9bc7b1b87c3dc864aab7812b52108c93d5d8b63d996114da1 WatchSource:0}: Error finding container 2b9780631b82ced9bc7b1b87c3dc864aab7812b52108c93d5d8b63d996114da1: Status 404 returned error can't find the container with id 2b9780631b82ced9bc7b1b87c3dc864aab7812b52108c93d5d8b63d996114da1 Jul 25 01:11:56.017238 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:11:56.017218 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod737a005c_a25e_4fda_ae48_eb59c37914d0.slice/crio-e8e32015802ec69dbcbfab012f9a68ccca4732e69104a7a00c789ff25ba43fd0 WatchSource:0}: Error finding container e8e32015802ec69dbcbfab012f9a68ccca4732e69104a7a00c789ff25ba43fd0: Status 404 returned error can't find the container with id e8e32015802ec69dbcbfab012f9a68ccca4732e69104a7a00c789ff25ba43fd0 Jul 25 01:11:56.019257 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:56.019240 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-npgl4" Jul 25 01:11:56.022637 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:11:56.022618 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod799cf0dd_1f0a_455f_ac0e_d303f0360de2.slice/crio-8dc419649605106f1a13db23821ecb97607bbf9bbd7e44a5506a0d5099fcdf8d WatchSource:0}: Error finding container 8dc419649605106f1a13db23821ecb97607bbf9bbd7e44a5506a0d5099fcdf8d: Status 404 returned error can't find the container with id 8dc419649605106f1a13db23821ecb97607bbf9bbd7e44a5506a0d5099fcdf8d Jul 25 01:11:56.025611 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:56.025595 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-8cd2m" Jul 25 01:11:56.028407 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:11:56.028375 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb287c5c8_d5c4_4685_a19e_6aada1237305.slice/crio-4964deb9ddcc0fd1f9860014248e0a3d2fbde51b489328776699d5b850ed3cb8 WatchSource:0}: Error finding container 4964deb9ddcc0fd1f9860014248e0a3d2fbde51b489328776699d5b850ed3cb8: Status 404 returned error can't find the container with id 4964deb9ddcc0fd1f9860014248e0a3d2fbde51b489328776699d5b850ed3cb8 Jul 25 01:11:56.030925 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:56.030898 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-c42rd" Jul 25 01:11:56.035896 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:56.035874 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-t4x2l" Jul 25 01:11:56.036349 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:11:56.036328 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9ea66485_c377_4229_b4df_c91ec571cca5.slice/crio-e8b36915f5e6cfd7517e9dce22cc869fe6b0874463763e878d0c5e654beb8261 WatchSource:0}: Error finding container e8b36915f5e6cfd7517e9dce22cc869fe6b0874463763e878d0c5e654beb8261: Status 404 returned error can't find the container with id e8b36915f5e6cfd7517e9dce22cc869fe6b0874463763e878d0c5e654beb8261 Jul 25 01:11:56.039332 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:11:56.039306 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4a3b7c62_05b6_4e7f_9c84_249de675af87.slice/crio-47cd81054c960f68dc1bcb68e2cae923e6e67298fa478cfe05ce0db54cd78a6d WatchSource:0}: Error finding container 47cd81054c960f68dc1bcb68e2cae923e6e67298fa478cfe05ce0db54cd78a6d: Status 404 returned error can't find the container with id 47cd81054c960f68dc1bcb68e2cae923e6e67298fa478cfe05ce0db54cd78a6d Jul 25 01:11:56.044605 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:11:56.044585 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod506f2c8c_d134_4671_969c_b5d70acadef0.slice/crio-d089e9a8979adadab11fddf875c550e157e0112c41a0558905aaeb893517b389 WatchSource:0}: Error finding container d089e9a8979adadab11fddf875c550e157e0112c41a0558905aaeb893517b389: Status 404 returned error can't find the container with id d089e9a8979adadab11fddf875c550e157e0112c41a0558905aaeb893517b389 Jul 25 01:11:56.264867 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:56.264704 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b8bf4790-0739-471e-9b16-1c2e448a8b6a-metrics-certs\") pod \"network-metrics-daemon-5nl9g\" (UID: \"b8bf4790-0739-471e-9b16-1c2e448a8b6a\") " pod="openshift-multus/network-metrics-daemon-5nl9g" Jul 25 01:11:56.264867 ip-10-0-129-35 kubenswrapper[2567]: E0725 01:11:56.264853 2567 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 25 01:11:56.265085 ip-10-0-129-35 kubenswrapper[2567]: E0725 01:11:56.264927 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b8bf4790-0739-471e-9b16-1c2e448a8b6a-metrics-certs podName:b8bf4790-0739-471e-9b16-1c2e448a8b6a nodeName:}" failed. No retries permitted until 2026-07-25 01:11:57.264906532 +0000 UTC m=+2.958000946 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b8bf4790-0739-471e-9b16-1c2e448a8b6a-metrics-certs") pod "network-metrics-daemon-5nl9g" (UID: "b8bf4790-0739-471e-9b16-1c2e448a8b6a") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 25 01:11:56.365345 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:56.365310 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5ada1026-5182-4a3e-9937-68258c8f240d-original-pull-secret\") pod \"global-pull-secret-syncer-mktch\" (UID: \"5ada1026-5182-4a3e-9937-68258c8f240d\") " pod="kube-system/global-pull-secret-syncer-mktch" Jul 25 01:11:56.365576 ip-10-0-129-35 kubenswrapper[2567]: E0725 01:11:56.365497 2567 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 25 01:11:56.365576 ip-10-0-129-35 kubenswrapper[2567]: E0725 01:11:56.365559 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5ada1026-5182-4a3e-9937-68258c8f240d-original-pull-secret podName:5ada1026-5182-4a3e-9937-68258c8f240d nodeName:}" failed. No retries permitted until 2026-07-25 01:11:57.365539282 +0000 UTC m=+3.058633708 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/5ada1026-5182-4a3e-9937-68258c8f240d-original-pull-secret") pod "global-pull-secret-syncer-mktch" (UID: "5ada1026-5182-4a3e-9937-68258c8f240d") : object "kube-system"/"original-pull-secret" not registered Jul 25 01:11:56.466707 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:56.466671 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-884lb\" (UniqueName: \"kubernetes.io/projected/8748d129-9ec1-44d6-8a95-88e0da2df4b3-kube-api-access-884lb\") pod \"network-check-target-znlzb\" (UID: \"8748d129-9ec1-44d6-8a95-88e0da2df4b3\") " pod="openshift-network-diagnostics/network-check-target-znlzb" Jul 25 01:11:56.466870 ip-10-0-129-35 kubenswrapper[2567]: E0725 01:11:56.466836 2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 25 01:11:56.466870 ip-10-0-129-35 kubenswrapper[2567]: E0725 01:11:56.466862 2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 25 01:11:56.466991 ip-10-0-129-35 kubenswrapper[2567]: E0725 01:11:56.466875 2567 projected.go:196] Error preparing data for projected volume kube-api-access-884lb for pod openshift-network-diagnostics/network-check-target-znlzb: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 25 01:11:56.466991 ip-10-0-129-35 kubenswrapper[2567]: E0725 01:11:56.466934 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8748d129-9ec1-44d6-8a95-88e0da2df4b3-kube-api-access-884lb podName:8748d129-9ec1-44d6-8a95-88e0da2df4b3 nodeName:}" failed. No retries permitted until 2026-07-25 01:11:57.466913723 +0000 UTC m=+3.160008125 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-884lb" (UniqueName: "kubernetes.io/projected/8748d129-9ec1-44d6-8a95-88e0da2df4b3-kube-api-access-884lb") pod "network-check-target-znlzb" (UID: "8748d129-9ec1-44d6-8a95-88e0da2df4b3") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 25 01:11:56.586349 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:56.586191 2567 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 25 01:11:56.729170 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:56.729058 2567 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-24 01:06:56 +0000 UTC" deadline="2028-03-30 23:37:50.320220119 +0000 UTC" Jul 25 01:11:56.729170 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:56.729118 2567 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14758h25m53.591106379s" Jul 25 01:11:56.825807 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:56.825764 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-t4x2l" event={"ID":"506f2c8c-d134-4671-969c-b5d70acadef0","Type":"ContainerStarted","Data":"d089e9a8979adadab11fddf875c550e157e0112c41a0558905aaeb893517b389"} Jul 25 01:11:56.854028 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:56.853892 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-bhdhw" event={"ID":"737a005c-a25e-4fda-ae48-eb59c37914d0","Type":"ContainerStarted","Data":"e8e32015802ec69dbcbfab012f9a68ccca4732e69104a7a00c789ff25ba43fd0"} Jul 25 01:11:56.862683 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:56.862649 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mk9n9" event={"ID":"bcda8758-c770-452e-8290-b5c19cb5ae6e","Type":"ContainerStarted","Data":"2b9780631b82ced9bc7b1b87c3dc864aab7812b52108c93d5d8b63d996114da1"} Jul 25 01:11:56.877226 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:56.877183 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-w88gj" event={"ID":"3143c435-082e-462b-a075-5f973501e27c","Type":"ContainerStarted","Data":"6754701303e41a0b25ff61602856e64019d84b4b3e02b92901f17d0401b96d1f"} Jul 25 01:11:56.899123 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:56.899091 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-c42rd" event={"ID":"4a3b7c62-05b6-4e7f-9c84-249de675af87","Type":"ContainerStarted","Data":"47cd81054c960f68dc1bcb68e2cae923e6e67298fa478cfe05ce0db54cd78a6d"} Jul 25 01:11:56.909886 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:56.909856 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-8cd2m" event={"ID":"9ea66485-c377-4229-b4df-c91ec571cca5","Type":"ContainerStarted","Data":"e8b36915f5e6cfd7517e9dce22cc869fe6b0874463763e878d0c5e654beb8261"} Jul 25 01:11:56.919370 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:56.919312 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-npgl4" event={"ID":"b287c5c8-d5c4-4685-a19e-6aada1237305","Type":"ContainerStarted","Data":"4964deb9ddcc0fd1f9860014248e0a3d2fbde51b489328776699d5b850ed3cb8"} Jul 25 01:11:56.931948 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:56.931852 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-llm4x" event={"ID":"799cf0dd-1f0a-455f-ac0e-d303f0360de2","Type":"ContainerStarted","Data":"8dc419649605106f1a13db23821ecb97607bbf9bbd7e44a5506a0d5099fcdf8d"} Jul 25 01:11:56.934112 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:56.934084 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-8hgk8" event={"ID":"14185786-ac81-4de0-b023-a79592965e8b","Type":"ContainerStarted","Data":"4c885ea78d535ceb185f0f52ce2615558497dff2c6eb6c5f24055d09eaf76ce1"} Jul 25 01:11:57.274537 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:57.273760 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b8bf4790-0739-471e-9b16-1c2e448a8b6a-metrics-certs\") pod \"network-metrics-daemon-5nl9g\" (UID: \"b8bf4790-0739-471e-9b16-1c2e448a8b6a\") " pod="openshift-multus/network-metrics-daemon-5nl9g" Jul 25 01:11:57.274537 ip-10-0-129-35 kubenswrapper[2567]: E0725 01:11:57.273924 2567 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 25 01:11:57.274537 ip-10-0-129-35 kubenswrapper[2567]: E0725 01:11:57.273989 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b8bf4790-0739-471e-9b16-1c2e448a8b6a-metrics-certs podName:b8bf4790-0739-471e-9b16-1c2e448a8b6a nodeName:}" failed. No retries permitted until 2026-07-25 01:11:59.273968677 +0000 UTC m=+4.967063093 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b8bf4790-0739-471e-9b16-1c2e448a8b6a-metrics-certs") pod "network-metrics-daemon-5nl9g" (UID: "b8bf4790-0739-471e-9b16-1c2e448a8b6a") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 25 01:11:57.374140 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:57.374103 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5ada1026-5182-4a3e-9937-68258c8f240d-original-pull-secret\") pod \"global-pull-secret-syncer-mktch\" (UID: \"5ada1026-5182-4a3e-9937-68258c8f240d\") " pod="kube-system/global-pull-secret-syncer-mktch" Jul 25 01:11:57.374330 ip-10-0-129-35 kubenswrapper[2567]: E0725 01:11:57.374305 2567 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 25 01:11:57.374399 ip-10-0-129-35 kubenswrapper[2567]: E0725 01:11:57.374368 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5ada1026-5182-4a3e-9937-68258c8f240d-original-pull-secret podName:5ada1026-5182-4a3e-9937-68258c8f240d nodeName:}" failed. No retries permitted until 2026-07-25 01:11:59.3743492 +0000 UTC m=+5.067443616 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/5ada1026-5182-4a3e-9937-68258c8f240d-original-pull-secret") pod "global-pull-secret-syncer-mktch" (UID: "5ada1026-5182-4a3e-9937-68258c8f240d") : object "kube-system"/"original-pull-secret" not registered Jul 25 01:11:57.475267 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:57.475232 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-884lb\" (UniqueName: \"kubernetes.io/projected/8748d129-9ec1-44d6-8a95-88e0da2df4b3-kube-api-access-884lb\") pod \"network-check-target-znlzb\" (UID: \"8748d129-9ec1-44d6-8a95-88e0da2df4b3\") " pod="openshift-network-diagnostics/network-check-target-znlzb" Jul 25 01:11:57.475486 ip-10-0-129-35 kubenswrapper[2567]: E0725 01:11:57.475467 2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 25 01:11:57.475582 ip-10-0-129-35 kubenswrapper[2567]: E0725 01:11:57.475497 2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 25 01:11:57.475582 ip-10-0-129-35 kubenswrapper[2567]: E0725 01:11:57.475510 2567 projected.go:196] Error preparing data for projected volume kube-api-access-884lb for pod openshift-network-diagnostics/network-check-target-znlzb: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 25 01:11:57.475582 ip-10-0-129-35 kubenswrapper[2567]: E0725 01:11:57.475567 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8748d129-9ec1-44d6-8a95-88e0da2df4b3-kube-api-access-884lb podName:8748d129-9ec1-44d6-8a95-88e0da2df4b3 nodeName:}" failed. No retries permitted until 2026-07-25 01:11:59.475547181 +0000 UTC m=+5.168641595 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-884lb" (UniqueName: "kubernetes.io/projected/8748d129-9ec1-44d6-8a95-88e0da2df4b3-kube-api-access-884lb") pod "network-check-target-znlzb" (UID: "8748d129-9ec1-44d6-8a95-88e0da2df4b3") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 25 01:11:57.729779 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:57.729660 2567 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-24 01:06:56 +0000 UTC" deadline="2028-01-21 17:59:35.734827909 +0000 UTC" Jul 25 01:11:57.729779 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:57.729699 2567 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13096h47m38.005133532s" Jul 25 01:11:57.781177 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:57.781147 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5nl9g" Jul 25 01:11:57.781350 ip-10-0-129-35 kubenswrapper[2567]: E0725 01:11:57.781271 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5nl9g" podUID="b8bf4790-0739-471e-9b16-1c2e448a8b6a" Jul 25 01:11:57.781732 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:57.781712 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-znlzb" Jul 25 01:11:57.781837 ip-10-0-129-35 kubenswrapper[2567]: E0725 01:11:57.781810 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-znlzb" podUID="8748d129-9ec1-44d6-8a95-88e0da2df4b3" Jul 25 01:11:57.781897 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:57.781875 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mktch" Jul 25 01:11:57.781991 ip-10-0-129-35 kubenswrapper[2567]: E0725 01:11:57.781952 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mktch" podUID="5ada1026-5182-4a3e-9937-68258c8f240d" Jul 25 01:11:57.968567 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:57.968538 2567 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 25 01:11:59.290953 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:59.290918 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b8bf4790-0739-471e-9b16-1c2e448a8b6a-metrics-certs\") pod \"network-metrics-daemon-5nl9g\" (UID: \"b8bf4790-0739-471e-9b16-1c2e448a8b6a\") " pod="openshift-multus/network-metrics-daemon-5nl9g" Jul 25 01:11:59.291441 ip-10-0-129-35 kubenswrapper[2567]: E0725 01:11:59.291100 2567 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 25 01:11:59.291441 ip-10-0-129-35 kubenswrapper[2567]: E0725 01:11:59.291168 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b8bf4790-0739-471e-9b16-1c2e448a8b6a-metrics-certs podName:b8bf4790-0739-471e-9b16-1c2e448a8b6a nodeName:}" failed. No retries permitted until 2026-07-25 01:12:03.291144684 +0000 UTC m=+8.984239086 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b8bf4790-0739-471e-9b16-1c2e448a8b6a-metrics-certs") pod "network-metrics-daemon-5nl9g" (UID: "b8bf4790-0739-471e-9b16-1c2e448a8b6a") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 25 01:11:59.391955 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:59.391919 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5ada1026-5182-4a3e-9937-68258c8f240d-original-pull-secret\") pod \"global-pull-secret-syncer-mktch\" (UID: \"5ada1026-5182-4a3e-9937-68258c8f240d\") " pod="kube-system/global-pull-secret-syncer-mktch" Jul 25 01:11:59.392153 ip-10-0-129-35 kubenswrapper[2567]: E0725 01:11:59.392136 2567 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 25 01:11:59.392227 ip-10-0-129-35 kubenswrapper[2567]: E0725 01:11:59.392204 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5ada1026-5182-4a3e-9937-68258c8f240d-original-pull-secret podName:5ada1026-5182-4a3e-9937-68258c8f240d nodeName:}" failed. No retries permitted until 2026-07-25 01:12:03.392183888 +0000 UTC m=+9.085278290 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/5ada1026-5182-4a3e-9937-68258c8f240d-original-pull-secret") pod "global-pull-secret-syncer-mktch" (UID: "5ada1026-5182-4a3e-9937-68258c8f240d") : object "kube-system"/"original-pull-secret" not registered Jul 25 01:11:59.493351 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:59.493313 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-884lb\" (UniqueName: \"kubernetes.io/projected/8748d129-9ec1-44d6-8a95-88e0da2df4b3-kube-api-access-884lb\") pod \"network-check-target-znlzb\" (UID: \"8748d129-9ec1-44d6-8a95-88e0da2df4b3\") " pod="openshift-network-diagnostics/network-check-target-znlzb" Jul 25 01:11:59.493599 ip-10-0-129-35 kubenswrapper[2567]: E0725 01:11:59.493566 2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 25 01:11:59.493599 ip-10-0-129-35 kubenswrapper[2567]: E0725 01:11:59.493591 2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 25 01:11:59.493732 ip-10-0-129-35 kubenswrapper[2567]: E0725 01:11:59.493604 2567 projected.go:196] Error preparing data for projected volume kube-api-access-884lb for pod openshift-network-diagnostics/network-check-target-znlzb: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 25 01:11:59.493732 ip-10-0-129-35 kubenswrapper[2567]: E0725 01:11:59.493662 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8748d129-9ec1-44d6-8a95-88e0da2df4b3-kube-api-access-884lb podName:8748d129-9ec1-44d6-8a95-88e0da2df4b3 nodeName:}" failed. No retries permitted until 2026-07-25 01:12:03.493644006 +0000 UTC m=+9.186738407 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-884lb" (UniqueName: "kubernetes.io/projected/8748d129-9ec1-44d6-8a95-88e0da2df4b3-kube-api-access-884lb") pod "network-check-target-znlzb" (UID: "8748d129-9ec1-44d6-8a95-88e0da2df4b3") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 25 01:11:59.780274 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:59.780204 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5nl9g" Jul 25 01:11:59.780445 ip-10-0-129-35 kubenswrapper[2567]: E0725 01:11:59.780335 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5nl9g" podUID="b8bf4790-0739-471e-9b16-1c2e448a8b6a" Jul 25 01:11:59.780793 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:59.780774 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-znlzb" Jul 25 01:11:59.780894 ip-10-0-129-35 kubenswrapper[2567]: E0725 01:11:59.780876 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-znlzb" podUID="8748d129-9ec1-44d6-8a95-88e0da2df4b3" Jul 25 01:11:59.780963 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:11:59.780928 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mktch" Jul 25 01:11:59.781027 ip-10-0-129-35 kubenswrapper[2567]: E0725 01:11:59.781006 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mktch" podUID="5ada1026-5182-4a3e-9937-68258c8f240d" Jul 25 01:12:01.780898 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:12:01.780858 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5nl9g" Jul 25 01:12:01.781374 ip-10-0-129-35 kubenswrapper[2567]: E0725 01:12:01.781006 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5nl9g" podUID="b8bf4790-0739-471e-9b16-1c2e448a8b6a" Jul 25 01:12:01.781374 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:12:01.781107 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mktch" Jul 25 01:12:01.781374 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:12:01.781129 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-znlzb" Jul 25 01:12:01.781374 ip-10-0-129-35 kubenswrapper[2567]: E0725 01:12:01.781198 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mktch" podUID="5ada1026-5182-4a3e-9937-68258c8f240d" Jul 25 01:12:01.781374 ip-10-0-129-35 kubenswrapper[2567]: E0725 01:12:01.781262 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-znlzb" podUID="8748d129-9ec1-44d6-8a95-88e0da2df4b3" Jul 25 01:12:03.331825 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:12:03.331744 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b8bf4790-0739-471e-9b16-1c2e448a8b6a-metrics-certs\") pod \"network-metrics-daemon-5nl9g\" (UID: \"b8bf4790-0739-471e-9b16-1c2e448a8b6a\") " pod="openshift-multus/network-metrics-daemon-5nl9g" Jul 25 01:12:03.332289 ip-10-0-129-35 kubenswrapper[2567]: E0725 01:12:03.331910 2567 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 25 01:12:03.332289 ip-10-0-129-35 kubenswrapper[2567]: E0725 01:12:03.331978 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b8bf4790-0739-471e-9b16-1c2e448a8b6a-metrics-certs podName:b8bf4790-0739-471e-9b16-1c2e448a8b6a nodeName:}" failed. No retries permitted until 2026-07-25 01:12:11.331957222 +0000 UTC m=+17.025051625 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b8bf4790-0739-471e-9b16-1c2e448a8b6a-metrics-certs") pod "network-metrics-daemon-5nl9g" (UID: "b8bf4790-0739-471e-9b16-1c2e448a8b6a") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 25 01:12:03.432478 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:12:03.432428 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5ada1026-5182-4a3e-9937-68258c8f240d-original-pull-secret\") pod \"global-pull-secret-syncer-mktch\" (UID: \"5ada1026-5182-4a3e-9937-68258c8f240d\") " pod="kube-system/global-pull-secret-syncer-mktch" Jul 25 01:12:03.432673 ip-10-0-129-35 kubenswrapper[2567]: E0725 01:12:03.432606 2567 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 25 01:12:03.432749 ip-10-0-129-35 kubenswrapper[2567]: E0725 01:12:03.432685 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5ada1026-5182-4a3e-9937-68258c8f240d-original-pull-secret podName:5ada1026-5182-4a3e-9937-68258c8f240d nodeName:}" failed. No retries permitted until 2026-07-25 01:12:11.432663556 +0000 UTC m=+17.125757973 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/5ada1026-5182-4a3e-9937-68258c8f240d-original-pull-secret") pod "global-pull-secret-syncer-mktch" (UID: "5ada1026-5182-4a3e-9937-68258c8f240d") : object "kube-system"/"original-pull-secret" not registered Jul 25 01:12:03.533025 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:12:03.532950 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-884lb\" (UniqueName: \"kubernetes.io/projected/8748d129-9ec1-44d6-8a95-88e0da2df4b3-kube-api-access-884lb\") pod \"network-check-target-znlzb\" (UID: \"8748d129-9ec1-44d6-8a95-88e0da2df4b3\") " pod="openshift-network-diagnostics/network-check-target-znlzb" Jul 25 01:12:03.533198 ip-10-0-129-35 kubenswrapper[2567]: E0725 01:12:03.533149 2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 25 01:12:03.533198 ip-10-0-129-35 kubenswrapper[2567]: E0725 01:12:03.533171 2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 25 01:12:03.533198 ip-10-0-129-35 kubenswrapper[2567]: E0725 01:12:03.533191 2567 projected.go:196] Error preparing data for projected volume kube-api-access-884lb for pod openshift-network-diagnostics/network-check-target-znlzb: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 25 01:12:03.533391 ip-10-0-129-35 kubenswrapper[2567]: E0725 01:12:03.533244 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8748d129-9ec1-44d6-8a95-88e0da2df4b3-kube-api-access-884lb podName:8748d129-9ec1-44d6-8a95-88e0da2df4b3 nodeName:}" failed. No retries permitted until 2026-07-25 01:12:11.533229745 +0000 UTC m=+17.226324144 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-884lb" (UniqueName: "kubernetes.io/projected/8748d129-9ec1-44d6-8a95-88e0da2df4b3-kube-api-access-884lb") pod "network-check-target-znlzb" (UID: "8748d129-9ec1-44d6-8a95-88e0da2df4b3") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 25 01:12:03.781256 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:12:03.781174 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5nl9g" Jul 25 01:12:03.781256 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:12:03.781218 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mktch" Jul 25 01:12:03.781490 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:12:03.781185 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-znlzb" Jul 25 01:12:03.781490 ip-10-0-129-35 kubenswrapper[2567]: E0725 01:12:03.781327 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5nl9g" podUID="b8bf4790-0739-471e-9b16-1c2e448a8b6a" Jul 25 01:12:03.781490 ip-10-0-129-35 kubenswrapper[2567]: E0725 01:12:03.781450 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-znlzb" podUID="8748d129-9ec1-44d6-8a95-88e0da2df4b3" Jul 25 01:12:03.781613 ip-10-0-129-35 kubenswrapper[2567]: E0725 01:12:03.781538 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mktch" podUID="5ada1026-5182-4a3e-9937-68258c8f240d" Jul 25 01:12:05.780725 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:12:05.780690 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mktch" Jul 25 01:12:05.781168 ip-10-0-129-35 kubenswrapper[2567]: E0725 01:12:05.780831 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mktch" podUID="5ada1026-5182-4a3e-9937-68258c8f240d" Jul 25 01:12:05.781266 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:12:05.781246 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5nl9g" Jul 25 01:12:05.781383 ip-10-0-129-35 kubenswrapper[2567]: E0725 01:12:05.781361 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5nl9g" podUID="b8bf4790-0739-471e-9b16-1c2e448a8b6a" Jul 25 01:12:05.781452 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:12:05.781424 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-znlzb" Jul 25 01:12:05.781537 ip-10-0-129-35 kubenswrapper[2567]: E0725 01:12:05.781517 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-znlzb" podUID="8748d129-9ec1-44d6-8a95-88e0da2df4b3" Jul 25 01:12:07.780361 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:12:07.780320 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5nl9g" Jul 25 01:12:07.780361 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:12:07.780361 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-znlzb" Jul 25 01:12:07.780932 ip-10-0-129-35 kubenswrapper[2567]: E0725 01:12:07.780485 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5nl9g" podUID="b8bf4790-0739-471e-9b16-1c2e448a8b6a" Jul 25 01:12:07.780932 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:12:07.780531 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mktch" Jul 25 01:12:07.780932 ip-10-0-129-35 kubenswrapper[2567]: E0725 01:12:07.780610 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mktch" podUID="5ada1026-5182-4a3e-9937-68258c8f240d" Jul 25 01:12:07.781096 ip-10-0-129-35 kubenswrapper[2567]: E0725 01:12:07.781061 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-znlzb" podUID="8748d129-9ec1-44d6-8a95-88e0da2df4b3" Jul 25 01:12:09.780956 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:12:09.780925 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5nl9g" Jul 25 01:12:09.780956 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:12:09.780961 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mktch" Jul 25 01:12:09.781499 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:12:09.780963 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-znlzb" Jul 25 01:12:09.781499 ip-10-0-129-35 kubenswrapper[2567]: E0725 01:12:09.781057 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5nl9g" podUID="b8bf4790-0739-471e-9b16-1c2e448a8b6a" Jul 25 01:12:09.781499 ip-10-0-129-35 kubenswrapper[2567]: E0725 01:12:09.781110 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mktch" podUID="5ada1026-5182-4a3e-9937-68258c8f240d" Jul 25 01:12:09.781499 ip-10-0-129-35 kubenswrapper[2567]: E0725 01:12:09.781199 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-znlzb" podUID="8748d129-9ec1-44d6-8a95-88e0da2df4b3" Jul 25 01:12:11.392320 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:12:11.392288 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b8bf4790-0739-471e-9b16-1c2e448a8b6a-metrics-certs\") pod \"network-metrics-daemon-5nl9g\" (UID: \"b8bf4790-0739-471e-9b16-1c2e448a8b6a\") " pod="openshift-multus/network-metrics-daemon-5nl9g" Jul 25 01:12:11.392810 ip-10-0-129-35 kubenswrapper[2567]: E0725 01:12:11.392467 2567 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 25 01:12:11.392810 ip-10-0-129-35 kubenswrapper[2567]: E0725 01:12:11.392547 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b8bf4790-0739-471e-9b16-1c2e448a8b6a-metrics-certs podName:b8bf4790-0739-471e-9b16-1c2e448a8b6a nodeName:}" failed. No retries permitted until 2026-07-25 01:12:27.392524283 +0000 UTC m=+33.085618728 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b8bf4790-0739-471e-9b16-1c2e448a8b6a-metrics-certs") pod "network-metrics-daemon-5nl9g" (UID: "b8bf4790-0739-471e-9b16-1c2e448a8b6a") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 25 01:12:11.493500 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:12:11.493464 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5ada1026-5182-4a3e-9937-68258c8f240d-original-pull-secret\") pod \"global-pull-secret-syncer-mktch\" (UID: \"5ada1026-5182-4a3e-9937-68258c8f240d\") " pod="kube-system/global-pull-secret-syncer-mktch" Jul 25 01:12:11.493651 ip-10-0-129-35 kubenswrapper[2567]: E0725 01:12:11.493602 2567 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 25 01:12:11.493699 ip-10-0-129-35 kubenswrapper[2567]: E0725 01:12:11.493660 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5ada1026-5182-4a3e-9937-68258c8f240d-original-pull-secret podName:5ada1026-5182-4a3e-9937-68258c8f240d nodeName:}" failed. No retries permitted until 2026-07-25 01:12:27.493646303 +0000 UTC m=+33.186740703 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/5ada1026-5182-4a3e-9937-68258c8f240d-original-pull-secret") pod "global-pull-secret-syncer-mktch" (UID: "5ada1026-5182-4a3e-9937-68258c8f240d") : object "kube-system"/"original-pull-secret" not registered Jul 25 01:12:11.594260 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:12:11.594224 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-884lb\" (UniqueName: \"kubernetes.io/projected/8748d129-9ec1-44d6-8a95-88e0da2df4b3-kube-api-access-884lb\") pod \"network-check-target-znlzb\" (UID: \"8748d129-9ec1-44d6-8a95-88e0da2df4b3\") " pod="openshift-network-diagnostics/network-check-target-znlzb" Jul 25 01:12:11.594417 ip-10-0-129-35 kubenswrapper[2567]: E0725 01:12:11.594398 2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 25 01:12:11.594465 ip-10-0-129-35 kubenswrapper[2567]: E0725 01:12:11.594425 2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 25 01:12:11.594465 ip-10-0-129-35 kubenswrapper[2567]: E0725 01:12:11.594437 2567 projected.go:196] Error preparing data for projected volume kube-api-access-884lb for pod openshift-network-diagnostics/network-check-target-znlzb: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 25 01:12:11.594533 ip-10-0-129-35 kubenswrapper[2567]: E0725 01:12:11.594496 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8748d129-9ec1-44d6-8a95-88e0da2df4b3-kube-api-access-884lb podName:8748d129-9ec1-44d6-8a95-88e0da2df4b3 nodeName:}" failed. No retries permitted until 2026-07-25 01:12:27.594478382 +0000 UTC m=+33.287572780 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-884lb" (UniqueName: "kubernetes.io/projected/8748d129-9ec1-44d6-8a95-88e0da2df4b3-kube-api-access-884lb") pod "network-check-target-znlzb" (UID: "8748d129-9ec1-44d6-8a95-88e0da2df4b3") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 25 01:12:11.781032 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:12:11.780941 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mktch" Jul 25 01:12:11.781032 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:12:11.780976 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-znlzb" Jul 25 01:12:11.781227 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:12:11.780949 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5nl9g" Jul 25 01:12:11.781227 ip-10-0-129-35 kubenswrapper[2567]: E0725 01:12:11.781059 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mktch" podUID="5ada1026-5182-4a3e-9937-68258c8f240d" Jul 25 01:12:11.781227 ip-10-0-129-35 kubenswrapper[2567]: E0725 01:12:11.781129 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5nl9g" podUID="b8bf4790-0739-471e-9b16-1c2e448a8b6a" Jul 25 01:12:11.781227 ip-10-0-129-35 kubenswrapper[2567]: E0725 01:12:11.781197 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-znlzb" podUID="8748d129-9ec1-44d6-8a95-88e0da2df4b3" Jul 25 01:12:13.781658 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:12:13.781183 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5nl9g" Jul 25 01:12:13.781658 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:12:13.781197 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-znlzb" Jul 25 01:12:13.781658 ip-10-0-129-35 kubenswrapper[2567]: E0725 01:12:13.781315 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5nl9g" podUID="b8bf4790-0739-471e-9b16-1c2e448a8b6a" Jul 25 01:12:13.781658 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:12:13.781397 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mktch" Jul 25 01:12:13.781658 ip-10-0-129-35 kubenswrapper[2567]: E0725 01:12:13.781476 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-znlzb" podUID="8748d129-9ec1-44d6-8a95-88e0da2df4b3" Jul 25 01:12:13.781658 ip-10-0-129-35 kubenswrapper[2567]: E0725 01:12:13.781594 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mktch" podUID="5ada1026-5182-4a3e-9937-68258c8f240d" Jul 25 01:12:15.780541 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:12:15.780503 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5nl9g" Jul 25 01:12:15.780541 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:12:15.780545 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mktch" Jul 25 01:12:15.781015 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:12:15.780503 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-znlzb" Jul 25 01:12:15.781015 ip-10-0-129-35 kubenswrapper[2567]: E0725 01:12:15.780707 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5nl9g" podUID="b8bf4790-0739-471e-9b16-1c2e448a8b6a" Jul 25 01:12:15.781015 ip-10-0-129-35 kubenswrapper[2567]: E0725 01:12:15.780837 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mktch" podUID="5ada1026-5182-4a3e-9937-68258c8f240d" Jul 25 01:12:15.781015 ip-10-0-129-35 kubenswrapper[2567]: E0725 01:12:15.780905 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-znlzb" podUID="8748d129-9ec1-44d6-8a95-88e0da2df4b3" Jul 25 01:12:17.780782 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:12:17.780491 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5nl9g" Jul 25 01:12:17.781427 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:12:17.780542 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mktch" Jul 25 01:12:17.781427 ip-10-0-129-35 kubenswrapper[2567]: E0725 01:12:17.780865 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5nl9g" podUID="b8bf4790-0739-471e-9b16-1c2e448a8b6a" Jul 25 01:12:17.781427 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:12:17.780541 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-znlzb" Jul 25 01:12:17.781427 ip-10-0-129-35 kubenswrapper[2567]: E0725 01:12:17.780930 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mktch" podUID="5ada1026-5182-4a3e-9937-68258c8f240d" Jul 25 01:12:17.781427 ip-10-0-129-35 kubenswrapper[2567]: E0725 01:12:17.780992 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-znlzb" podUID="8748d129-9ec1-44d6-8a95-88e0da2df4b3" Jul 25 01:12:17.989014 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:12:17.988949 2567 generic.go:356] "Generic (PLEG): container finished" podID="8059162027cf288a28b55e705fcd1fe4" containerID="214583186f4bae41cc12580e754a0e68e5e24f2438a43b2089635daf50fe1e21" exitCode=0 Jul 25 01:12:17.989154 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:12:17.989026 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-35.ec2.internal" event={"ID":"8059162027cf288a28b55e705fcd1fe4","Type":"ContainerDied","Data":"214583186f4bae41cc12580e754a0e68e5e24f2438a43b2089635daf50fe1e21"} Jul 25 01:12:17.990512 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:12:17.990488 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-c42rd" event={"ID":"4a3b7c62-05b6-4e7f-9c84-249de675af87","Type":"ContainerStarted","Data":"041f8a652268883b59871299b39f488cfd93a291ee02f51127076d20be873f2a"} Jul 25 01:12:17.991888 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:12:17.991867 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-8cd2m" event={"ID":"9ea66485-c377-4229-b4df-c91ec571cca5","Type":"ContainerStarted","Data":"3088d2b840e971355b128149b787424c3e2f0ccec41d08bd78e6e7192a77f754"} Jul 25 01:12:17.993359 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:12:17.993341 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-npgl4" event={"ID":"b287c5c8-d5c4-4685-a19e-6aada1237305","Type":"ContainerStarted","Data":"4634e1f0f42e51f46cb136e249f4d4518b8abdf16936c1bfc1fb3fffa65eeac7"} Jul 25 01:12:17.994725 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:12:17.994708 2567 generic.go:356] "Generic (PLEG): container finished" podID="799cf0dd-1f0a-455f-ac0e-d303f0360de2" containerID="ef04757318ff7e1e03f9facc13d36f534cb02fb4c55ffa30b281eea6af3a1533" exitCode=0 Jul 25 01:12:17.994808 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:12:17.994769 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-llm4x" event={"ID":"799cf0dd-1f0a-455f-ac0e-d303f0360de2","Type":"ContainerDied","Data":"ef04757318ff7e1e03f9facc13d36f534cb02fb4c55ffa30b281eea6af3a1533"} Jul 25 01:12:17.998704 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:12:17.998687 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-8hgk8" event={"ID":"14185786-ac81-4de0-b023-a79592965e8b","Type":"ContainerStarted","Data":"083df3f15cb1d6cec38d74717077d2b7687086acce6351fc697bb8622491ac32"} Jul 25 01:12:17.998760 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:12:17.998746 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-8hgk8" event={"ID":"14185786-ac81-4de0-b023-a79592965e8b","Type":"ContainerStarted","Data":"cc29e86916e9785107e3e7f242f025cd2562b3c35c6d77e48a9abbed22a8d583"} Jul 25 01:12:17.998795 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:12:17.998789 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-8hgk8" event={"ID":"14185786-ac81-4de0-b023-a79592965e8b","Type":"ContainerStarted","Data":"e39a033e8dafd1e19c4621b7998fd81b37e730bc5a4075a53a2f3db1487c96e9"} Jul 25 01:12:17.998840 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:12:17.998829 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-8hgk8" event={"ID":"14185786-ac81-4de0-b023-a79592965e8b","Type":"ContainerStarted","Data":"0079ed2e8c509711f232fde3e80c8ea6699b864e7294bd144ffa0cb077487216"} Jul 25 01:12:17.998874 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:12:17.998865 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-8hgk8" event={"ID":"14185786-ac81-4de0-b023-a79592965e8b","Type":"ContainerStarted","Data":"c35e394284ca08c6bd5445bb556c37b3631081509c20b4197df48bbcbec18c37"} Jul 25 01:12:17.998923 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:12:17.998910 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-8hgk8" event={"ID":"14185786-ac81-4de0-b023-a79592965e8b","Type":"ContainerStarted","Data":"852b8360fdaa5cfb6f410743890c7c18395af18d04cf5d180fb82ba57cc721d2"} Jul 25 01:12:18.000239 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:12:18.000220 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-35.ec2.internal" event={"ID":"edf34879cf3c142ca7dc5154417bf1b1","Type":"ContainerStarted","Data":"888a8decf3d8bbf87bfab0fa6293309970628f62b83a04a0b4c25489d2bb8f5d"} Jul 25 01:12:18.001542 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:12:18.001521 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-t4x2l" event={"ID":"506f2c8c-d134-4671-969c-b5d70acadef0","Type":"ContainerStarted","Data":"c0954de424ae1b0378a2f7d9cf18a24ce6d0c9253c65d8c48ad6b2eabeb750ed"} Jul 25 01:12:18.003185 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:12:18.003165 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mk9n9" event={"ID":"bcda8758-c770-452e-8290-b5c19cb5ae6e","Type":"ContainerStarted","Data":"f53d7bb8adcf966d069033b6c132623dff12b1c792a6f2c8d7cc24ce640c70bb"} Jul 25 01:12:18.004392 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:12:18.004358 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-w88gj" event={"ID":"3143c435-082e-462b-a075-5f973501e27c","Type":"ContainerStarted","Data":"5d428d08eadc01d9064208e79c388951b00bbf8f84a089cf6068bc9bdb5e653c"} Jul 25 01:12:18.020274 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:12:18.020233 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-npgl4" podStartSLOduration=1.154119581 podStartE2EDuration="22.020220755s" totalImagesPullingTime="20.866101174s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-25 01:11:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-25 01:12:18.020143615 +0000 UTC m=+23.713238033" watchObservedRunningTime="2026-07-25 01:12:18.020220755 +0000 UTC m=+23.713315173" Jul 25 01:12:18.065072 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:12:18.064905 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-8cd2m" podStartSLOduration=1.207303072 podStartE2EDuration="22.064891959s" totalImagesPullingTime="20.857588887s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-25 01:11:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-25 01:12:18.064412675 +0000 UTC m=+23.757507094" watchObservedRunningTime="2026-07-25 01:12:18.064891959 +0000 UTC m=+23.757986369" Jul 25 01:12:18.086584 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:12:18.086542 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-c42rd" podStartSLOduration=1.2568443550000001 podStartE2EDuration="22.086527716s" totalImagesPullingTime="20.829683361s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-25 01:11:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-25 01:12:18.086081945 +0000 UTC m=+23.779176365" watchObservedRunningTime="2026-07-25 01:12:18.086527716 +0000 UTC m=+23.779622134" Jul 25 01:12:18.103299 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:12:18.103252 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-35.ec2.internal" podStartSLOduration=22.103233891 podStartE2EDuration="22.103233891s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-25 01:11:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-25 01:12:18.103075494 +0000 UTC m=+23.796169915" watchObservedRunningTime="2026-07-25 01:12:18.103233891 +0000 UTC m=+23.796328311" Jul 25 01:12:18.122232 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:12:18.122196 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-t4x2l" podStartSLOduration=1.276897473 podStartE2EDuration="22.122181914s" totalImagesPullingTime="20.845284441s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-25 01:11:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-25 01:12:18.120936607 +0000 UTC m=+23.814031036" watchObservedRunningTime="2026-07-25 01:12:18.122181914 +0000 UTC m=+23.815276332" Jul 25 01:12:18.149188 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:12:18.149146 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-w88gj" podStartSLOduration=2.245504297 podStartE2EDuration="23.149133527s" totalImagesPullingTime="20.90362923s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-25 01:11:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-25 01:12:18.148633383 +0000 UTC m=+23.841727802" watchObservedRunningTime="2026-07-25 01:12:18.149133527 +0000 UTC m=+23.842227945" Jul 25 01:12:18.498612 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:12:18.498588 2567 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 25 01:12:18.723432 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:12:18.723233 2567 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-25T01:12:18.498606018Z","UUID":"1deccbe7-d489-40e5-81c2-c9d30c5f4e0e","Handler":null,"Name":"","Endpoint":""} Jul 25 01:12:18.724988 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:12:18.724965 2567 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 25 01:12:18.725110 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:12:18.725005 2567 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 25 01:12:19.009092 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:12:19.009006 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-35.ec2.internal" event={"ID":"8059162027cf288a28b55e705fcd1fe4","Type":"ContainerStarted","Data":"efd8871a889371c787dee5ca6e7eb039dd8dc0cedbdd4921f77d40f68a3f546b"} Jul 25 01:12:19.010733 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:12:19.010702 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-bhdhw" event={"ID":"737a005c-a25e-4fda-ae48-eb59c37914d0","Type":"ContainerStarted","Data":"ee2f9bdeefeeb764ba6925a65fa183b039c7f0133de32d7d6ad1f57c27d5818b"} Jul 25 01:12:19.012843 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:12:19.012803 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mk9n9" event={"ID":"bcda8758-c770-452e-8290-b5c19cb5ae6e","Type":"ContainerStarted","Data":"d9200c58b2fd9b6a9f026aa766215857ad63bd2e71726d08d31ffc064583eb96"} Jul 25 01:12:19.023553 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:12:19.023506 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-35.ec2.internal" podStartSLOduration=23.02348838 podStartE2EDuration="23.02348838s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-25 01:11:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-25 01:12:19.023367992 +0000 UTC m=+24.716462411" watchObservedRunningTime="2026-07-25 01:12:19.02348838 +0000 UTC m=+24.716582802" Jul 25 01:12:19.036092 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:12:19.036049 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-bhdhw" podStartSLOduration=3.184125616 podStartE2EDuration="24.036024991s" totalImagesPullingTime="20.851899375s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-25 01:11:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-25 01:12:19.035748606 +0000 UTC m=+24.728843025" watchObservedRunningTime="2026-07-25 01:12:19.036024991 +0000 UTC m=+24.729119412" Jul 25 01:12:19.697368 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:12:19.697339 2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-t4x2l" Jul 25 01:12:19.697996 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:12:19.697972 2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-t4x2l" Jul 25 01:12:19.781084 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:12:19.781061 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-znlzb" Jul 25 01:12:19.781182 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:12:19.781060 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5nl9g" Jul 25 01:12:19.781250 ip-10-0-129-35 kubenswrapper[2567]: E0725 01:12:19.781185 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-znlzb" podUID="8748d129-9ec1-44d6-8a95-88e0da2df4b3" Jul 25 01:12:19.781316 ip-10-0-129-35 kubenswrapper[2567]: E0725 01:12:19.781289 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5nl9g" podUID="b8bf4790-0739-471e-9b16-1c2e448a8b6a" Jul 25 01:12:19.781549 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:12:19.781533 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mktch" Jul 25 01:12:19.781673 ip-10-0-129-35 kubenswrapper[2567]: E0725 01:12:19.781630 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mktch" podUID="5ada1026-5182-4a3e-9937-68258c8f240d" Jul 25 01:12:20.019427 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:12:20.019328 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-8hgk8" event={"ID":"14185786-ac81-4de0-b023-a79592965e8b","Type":"ContainerStarted","Data":"4414abcf62f639b72d205fa299672699dc45ee72be1b252f3aa22e9e7603a663"} Jul 25 01:12:20.022543 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:12:20.022518 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mk9n9" event={"ID":"bcda8758-c770-452e-8290-b5c19cb5ae6e","Type":"ContainerStarted","Data":"d2e4f74ddb3f03c61f97b5d2dc6d6a72ddd9843a02764e7104a6c36d6792a9d5"} Jul 25 01:12:20.022657 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:12:20.022575 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-t4x2l" Jul 25 01:12:20.023539 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:12:20.023524 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-t4x2l" Jul 25 01:12:20.038902 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:12:20.038863 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mk9n9" podStartSLOduration=2.012717205 podStartE2EDuration="25.038846257s" totalImagesPullingTime="23.026129052s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-25 01:11:55 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-25 01:12:20.038325047 +0000 UTC m=+25.731419468" watchObservedRunningTime="2026-07-25 01:12:20.038846257 +0000 UTC m=+25.731940675" Jul 25 01:12:21.780604 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:12:21.780569 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mktch" Jul 25 01:12:21.780604 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:12:21.780603 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5nl9g" Jul 25 01:12:21.781117 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:12:21.780571 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-znlzb" Jul 25 01:12:21.781117 ip-10-0-129-35 kubenswrapper[2567]: E0725 01:12:21.780672 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mktch" podUID="5ada1026-5182-4a3e-9937-68258c8f240d" Jul 25 01:12:21.781117 ip-10-0-129-35 kubenswrapper[2567]: E0725 01:12:21.780765 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-znlzb" podUID="8748d129-9ec1-44d6-8a95-88e0da2df4b3" Jul 25 01:12:21.781117 ip-10-0-129-35 kubenswrapper[2567]: E0725 01:12:21.780851 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5nl9g" podUID="b8bf4790-0739-471e-9b16-1c2e448a8b6a" Jul 25 01:12:22.032190 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:12:22.031935 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-8hgk8" event={"ID":"14185786-ac81-4de0-b023-a79592965e8b","Type":"ContainerStarted","Data":"93459ebd916b5c17ec1469506484231fff38dd9fe2e7d731c85c46f36233b3c8"} Jul 25 01:12:22.060237 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:12:22.057954 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-8hgk8" podStartSLOduration=6.066988084 podStartE2EDuration="27.057940136s" totalImagesPullingTime="20.990952052s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-25 01:11:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-25 01:12:22.056127828 +0000 UTC m=+27.749222240" watchObservedRunningTime="2026-07-25 01:12:22.057940136 +0000 UTC m=+27.751034569" Jul 25 01:12:23.035950 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:12:23.035867 2567 generic.go:356] "Generic (PLEG): container finished" podID="799cf0dd-1f0a-455f-ac0e-d303f0360de2" containerID="26e89579f30dfa22f5b8b9c0eaab086c91c9b6c26361ddb5d3589bbcfc09d775" exitCode=0 Jul 25 01:12:23.036683 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:12:23.035963 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-llm4x" event={"ID":"799cf0dd-1f0a-455f-ac0e-d303f0360de2","Type":"ContainerDied","Data":"26e89579f30dfa22f5b8b9c0eaab086c91c9b6c26361ddb5d3589bbcfc09d775"} Jul 25 01:12:23.036683 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:12:23.036424 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-8hgk8" Jul 25 01:12:23.036683 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:12:23.036493 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-8hgk8" Jul 25 01:12:23.036683 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:12:23.036526 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-8hgk8" Jul 25 01:12:23.052947 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:12:23.052926 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-8hgk8" Jul 25 01:12:23.053224 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:12:23.053210 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-8hgk8" Jul 25 01:12:23.780463 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:12:23.780436 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mktch" Jul 25 01:12:23.780690 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:12:23.780436 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5nl9g" Jul 25 01:12:23.780690 ip-10-0-129-35 kubenswrapper[2567]: E0725 01:12:23.780566 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mktch" podUID="5ada1026-5182-4a3e-9937-68258c8f240d" Jul 25 01:12:23.780690 ip-10-0-129-35 kubenswrapper[2567]: E0725 01:12:23.780618 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5nl9g" podUID="b8bf4790-0739-471e-9b16-1c2e448a8b6a" Jul 25 01:12:23.780690 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:12:23.780439 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-znlzb" Jul 25 01:12:23.780889 ip-10-0-129-35 kubenswrapper[2567]: E0725 01:12:23.780690 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-znlzb" podUID="8748d129-9ec1-44d6-8a95-88e0da2df4b3" Jul 25 01:12:24.209456 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:12:24.209431 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-mktch"] Jul 25 01:12:24.209869 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:12:24.209546 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mktch" Jul 25 01:12:24.209869 ip-10-0-129-35 kubenswrapper[2567]: E0725 01:12:24.209658 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mktch" podUID="5ada1026-5182-4a3e-9937-68258c8f240d" Jul 25 01:12:24.212444 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:12:24.212425 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-znlzb"] Jul 25 01:12:24.212540 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:12:24.212496 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-znlzb" Jul 25 01:12:24.212588 ip-10-0-129-35 kubenswrapper[2567]: E0725 01:12:24.212568 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-znlzb" podUID="8748d129-9ec1-44d6-8a95-88e0da2df4b3" Jul 25 01:12:24.225431 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:12:24.225410 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-5nl9g"] Jul 25 01:12:24.225524 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:12:24.225488 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5nl9g" Jul 25 01:12:24.225595 ip-10-0-129-35 kubenswrapper[2567]: E0725 01:12:24.225579 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5nl9g" podUID="b8bf4790-0739-471e-9b16-1c2e448a8b6a" Jul 25 01:12:25.041614 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:12:25.041435 2567 generic.go:356] "Generic (PLEG): container finished" podID="799cf0dd-1f0a-455f-ac0e-d303f0360de2" containerID="3e673a11f72a508f029c716d2b4aa9f9a48175d0777839e53286dcb7f31e91b6" exitCode=0 Jul 25 01:12:25.041614 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:12:25.041522 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-llm4x" event={"ID":"799cf0dd-1f0a-455f-ac0e-d303f0360de2","Type":"ContainerDied","Data":"3e673a11f72a508f029c716d2b4aa9f9a48175d0777839e53286dcb7f31e91b6"} Jul 25 01:12:25.780566 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:12:25.780538 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5nl9g" Jul 25 01:12:25.781025 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:12:25.780538 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-znlzb" Jul 25 01:12:25.781025 ip-10-0-129-35 kubenswrapper[2567]: E0725 01:12:25.780659 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5nl9g" podUID="b8bf4790-0739-471e-9b16-1c2e448a8b6a" Jul 25 01:12:25.781025 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:12:25.780538 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mktch" Jul 25 01:12:25.781025 ip-10-0-129-35 kubenswrapper[2567]: E0725 01:12:25.780726 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-znlzb" podUID="8748d129-9ec1-44d6-8a95-88e0da2df4b3" Jul 25 01:12:25.781025 ip-10-0-129-35 kubenswrapper[2567]: E0725 01:12:25.780843 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mktch" podUID="5ada1026-5182-4a3e-9937-68258c8f240d" Jul 25 01:12:27.048349 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:12:27.048320 2567 generic.go:356] "Generic (PLEG): container finished" podID="799cf0dd-1f0a-455f-ac0e-d303f0360de2" containerID="7d8d05f601145e5e57612cc900fb248dd4101677f57d873b006aacf8bfcd6ca7" exitCode=0 Jul 25 01:12:27.048736 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:12:27.048390 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-llm4x" event={"ID":"799cf0dd-1f0a-455f-ac0e-d303f0360de2","Type":"ContainerDied","Data":"7d8d05f601145e5e57612cc900fb248dd4101677f57d873b006aacf8bfcd6ca7"} Jul 25 01:12:27.418413 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:12:27.418319 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b8bf4790-0739-471e-9b16-1c2e448a8b6a-metrics-certs\") pod \"network-metrics-daemon-5nl9g\" (UID: \"b8bf4790-0739-471e-9b16-1c2e448a8b6a\") " pod="openshift-multus/network-metrics-daemon-5nl9g" Jul 25 01:12:27.418547 ip-10-0-129-35 kubenswrapper[2567]: E0725 01:12:27.418464 2567 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 25 01:12:27.418547 ip-10-0-129-35 kubenswrapper[2567]: E0725 01:12:27.418528 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b8bf4790-0739-471e-9b16-1c2e448a8b6a-metrics-certs podName:b8bf4790-0739-471e-9b16-1c2e448a8b6a nodeName:}" failed. No retries permitted until 2026-07-25 01:12:59.418510226 +0000 UTC m=+65.111604624 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b8bf4790-0739-471e-9b16-1c2e448a8b6a-metrics-certs") pod "network-metrics-daemon-5nl9g" (UID: "b8bf4790-0739-471e-9b16-1c2e448a8b6a") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 25 01:12:27.519173 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:12:27.519133 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5ada1026-5182-4a3e-9937-68258c8f240d-original-pull-secret\") pod \"global-pull-secret-syncer-mktch\" (UID: \"5ada1026-5182-4a3e-9937-68258c8f240d\") " pod="kube-system/global-pull-secret-syncer-mktch" Jul 25 01:12:27.519309 ip-10-0-129-35 kubenswrapper[2567]: E0725 01:12:27.519261 2567 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 25 01:12:27.519369 ip-10-0-129-35 kubenswrapper[2567]: E0725 01:12:27.519322 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5ada1026-5182-4a3e-9937-68258c8f240d-original-pull-secret podName:5ada1026-5182-4a3e-9937-68258c8f240d nodeName:}" failed. No retries permitted until 2026-07-25 01:12:59.519306387 +0000 UTC m=+65.212400788 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/5ada1026-5182-4a3e-9937-68258c8f240d-original-pull-secret") pod "global-pull-secret-syncer-mktch" (UID: "5ada1026-5182-4a3e-9937-68258c8f240d") : object "kube-system"/"original-pull-secret" not registered Jul 25 01:12:27.620028 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:12:27.619988 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-884lb\" (UniqueName: \"kubernetes.io/projected/8748d129-9ec1-44d6-8a95-88e0da2df4b3-kube-api-access-884lb\") pod \"network-check-target-znlzb\" (UID: \"8748d129-9ec1-44d6-8a95-88e0da2df4b3\") " pod="openshift-network-diagnostics/network-check-target-znlzb" Jul 25 01:12:27.620210 ip-10-0-129-35 kubenswrapper[2567]: E0725 01:12:27.620137 2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 25 01:12:27.620210 ip-10-0-129-35 kubenswrapper[2567]: E0725 01:12:27.620158 2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 25 01:12:27.620210 ip-10-0-129-35 kubenswrapper[2567]: E0725 01:12:27.620171 2567 projected.go:196] Error preparing data for projected volume kube-api-access-884lb for pod openshift-network-diagnostics/network-check-target-znlzb: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 25 01:12:27.620359 ip-10-0-129-35 kubenswrapper[2567]: E0725 01:12:27.620230 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8748d129-9ec1-44d6-8a95-88e0da2df4b3-kube-api-access-884lb podName:8748d129-9ec1-44d6-8a95-88e0da2df4b3 nodeName:}" failed. No retries permitted until 2026-07-25 01:12:59.620211009 +0000 UTC m=+65.313305407 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-884lb" (UniqueName: "kubernetes.io/projected/8748d129-9ec1-44d6-8a95-88e0da2df4b3-kube-api-access-884lb") pod "network-check-target-znlzb" (UID: "8748d129-9ec1-44d6-8a95-88e0da2df4b3") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 25 01:12:27.780726 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:12:27.780645 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-znlzb" Jul 25 01:12:27.780726 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:12:27.780671 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mktch" Jul 25 01:12:27.780936 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:12:27.780661 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5nl9g" Jul 25 01:12:27.780936 ip-10-0-129-35 kubenswrapper[2567]: E0725 01:12:27.780759 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-znlzb" podUID="8748d129-9ec1-44d6-8a95-88e0da2df4b3" Jul 25 01:12:27.780936 ip-10-0-129-35 kubenswrapper[2567]: E0725 01:12:27.780851 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mktch" podUID="5ada1026-5182-4a3e-9937-68258c8f240d" Jul 25 01:12:27.781069 ip-10-0-129-35 kubenswrapper[2567]: E0725 01:12:27.780955 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5nl9g" podUID="b8bf4790-0739-471e-9b16-1c2e448a8b6a" Jul 25 01:12:29.561156 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:12:29.561128 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-35.ec2.internal" event="NodeReady" Jul 25 01:12:29.561571 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:12:29.561279 2567 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 25 01:12:29.596857 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:12:29.596825 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-6b68768447-slrxh"] Jul 25 01:12:29.600268 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:12:29.600245 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-25d96"] Jul 25 01:12:29.600416 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:12:29.600397 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6b68768447-slrxh" Jul 25 01:12:29.602474 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:12:29.602450 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-25d96" Jul 25 01:12:29.603789 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:12:29.603578 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jul 25 01:12:29.603789 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:12:29.603685 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-g77zs\"" Jul 25 01:12:29.603977 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:12:29.603901 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jul 25 01:12:29.604166 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:12:29.604148 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jul 25 01:12:29.604605 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:12:29.604586 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\"" Jul 25 01:12:29.605063 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:12:29.605047 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\"" Jul 25 01:12:29.605546 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:12:29.605532 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-5csrw\"" Jul 25 01:12:29.613880 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:12:29.613853 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d6c75f84f-5j29m"] Jul 25 01:12:29.614886 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:12:29.614863 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jul 25 01:12:29.617037 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:12:29.616613 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-5j29m" Jul 25 01:12:29.618678 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:12:29.618660 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\"" Jul 25 01:12:29.618996 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:12:29.618976 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\"" Jul 25 01:12:29.619194 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:12:29.619180 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\"" Jul 25 01:12:29.620205 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:12:29.620182 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\"" Jul 25 01:12:29.622951 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:12:29.622933 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-cvvhk\"" Jul 25 01:12:29.623585 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:12:29.623570 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-25d96"] Jul 25 01:12:29.624343 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:12:29.624324 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-29jjm"] Jul 25 01:12:29.626258 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:12:29.626240 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-6b68768447-slrxh"] Jul 25 01:12:29.626357 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:12:29.626266 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-6748489656-bp82d"] Jul 25 01:12:29.626472 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:12:29.626433 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-29jjm" Jul 25 01:12:29.628405 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:12:29.628368 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-548b489cb8-f5tvk"] Jul 25 01:12:29.628512 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:12:29.628495 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-bp82d" Jul 25 01:12:29.629547 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:12:29.629528 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 25 01:12:29.629637 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:12:29.629533 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 25 01:12:29.629637 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:12:29.629537 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-fxvm2\"" Jul 25 01:12:29.630303 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:12:29.630285 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-584dcb6b54-s5tbd"] Jul 25 01:12:29.630425 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:12:29.630410 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-f5tvk" Jul 25 01:12:29.631310 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:12:29.631293 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\"" Jul 25 01:12:29.631421 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:12:29.631396 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\"" Jul 25 01:12:29.631787 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:12:29.631771 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\"" Jul 25 01:12:29.631902 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:12:29.631884 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-ndhbz\"" Jul 25 01:12:29.632650 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:12:29.632631 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-5885fdb759-kq9tj"] Jul 25 01:12:29.632768 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:12:29.632753 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-584dcb6b54-s5tbd" Jul 25 01:12:29.635300 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:12:29.634436 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-27qc8"] Jul 25 01:12:29.635300 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:12:29.634625 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5885fdb759-kq9tj" Jul 25 01:12:29.636283 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:12:29.636265 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 25 01:12:29.636503 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:12:29.636487 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 25 01:12:29.636618 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:12:29.636601 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d6c75f84f-5j29m"] Jul 25 01:12:29.636733 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:12:29.636719 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-27qc8" Jul 25 01:12:29.636788 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:12:29.636735 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-lr6d9\"" Jul 25 01:12:29.636958 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:12:29.636941 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\"" Jul 25 01:12:29.637450 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:12:29.637432 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\"" Jul 25 01:12:29.637665 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:12:29.637647 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\"" Jul 25 01:12:29.637871 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:12:29.637855 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-6748489656-bp82d"] Jul 25 01:12:29.638430 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:12:29.637966 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\"" Jul 25 01:12:29.638430 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:12:29.638402 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-29jjm"] Jul 25 01:12:29.638715 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:12:29.638695 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\"" Jul 25 01:12:29.641518 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:12:29.641496 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\"" Jul 25 01:12:29.641727 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:12:29.641710 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 25 01:12:29.641826 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:12:29.641713 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\"" Jul 25 01:12:29.642086 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:12:29.642062 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-7k5cp\"" Jul 25 01:12:29.642179 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:12:29.642087 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\"" Jul 25 01:12:29.642179 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:12:29.642148 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\"" Jul 25 01:12:29.642654 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:12:29.642596 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\"" Jul 25 01:12:29.642654 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:12:29.642622 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\"" Jul 25 01:12:29.642654 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:12:29.642647 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 25 01:12:29.642851 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:12:29.642793 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-6qrg6"] Jul 25 01:12:29.642907 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:12:29.642888 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\"" Jul 25 01:12:29.644421 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:12:29.643254 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-m5222\"" Jul 25 01:12:29.644421 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:12:29.643479 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-jxnvw\"" Jul 25 01:12:29.645033 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:12:29.645014 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-74c9f884b7-hnxdh"] Jul 25 01:12:29.645163 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:12:29.645147 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-6qrg6" Jul 25 01:12:29.650745 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:12:29.650725 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 25 01:12:29.651146 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:12:29.651130 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-7d88cb55d8-d4tds"] Jul 25 01:12:29.653251 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:12:29.652722 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-74c9f884b7-hnxdh" Jul 25 01:12:29.659411 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:12:29.653891 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-d4tds" Jul 25 01:12:29.659411 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:12:29.655427 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\"" Jul 25 01:12:29.659411 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:12:29.658359 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 25 01:12:29.659411 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:12:29.658689 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 25 01:12:29.659411 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:12:29.659103 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-krsnh\"" Jul 25 01:12:29.659411 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:12:29.659360 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 25 01:12:29.659720 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:12:29.659428 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\"" Jul 25 01:12:29.660177 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:12:29.659998 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\"" Jul 25 01:12:29.660177 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:12:29.660138 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\"" Jul 25 01:12:29.661690 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:12:29.661024 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-p7l2f\"" Jul 25 01:12:29.661831 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:12:29.661806 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5885fdb759-kq9tj"] Jul 25 01:12:29.662365 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:12:29.662199 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-gxmss\"" Jul 25 01:12:29.662365 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:12:29.662273 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 25 01:12:29.662824 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:12:29.662805 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-54fd59887f-g5zgr"] Jul 25 01:12:29.665595 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:12:29.665568 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-27qc8"] Jul 25 01:12:29.665681 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:12:29.665624 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-584dcb6b54-s5tbd"] Jul 25 01:12:29.665743 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:12:29.665711 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-54fd59887f-g5zgr" Jul 25 01:12:29.666484 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:12:29.666461 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-6qrg6"] Jul 25 01:12:29.668175 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:12:29.667344 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-548b489cb8-f5tvk"] Jul 25 01:12:29.668390 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:12:29.668355 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jul 25 01:12:29.668502 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:12:29.668488 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-7d88cb55d8-d4tds"] Jul 25 01:12:29.668594 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:12:29.668576 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\"" Jul 25 01:12:29.668762 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:12:29.668268 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\"" Jul 25 01:12:29.669009 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:12:29.668991 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\"" Jul 25 01:12:29.669095 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:12:29.669007 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-74c9f884b7-hnxdh"] Jul 25 01:12:29.669244 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:12:29.669222 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jul 25 01:12:29.669315 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:12:29.669305 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\"" Jul 25 01:12:29.669368 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:12:29.669353 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-9g7r8\"" Jul 25 01:12:29.670525 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:12:29.670507 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-54fd59887f-g5zgr"] Jul 25 01:12:29.738855 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:12:29.738826 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/59f19017-9df8-47ee-820e-fd8e02c1178f-config-volume\") pod \"dns-default-29jjm\" (UID: \"59f19017-9df8-47ee-820e-fd8e02c1178f\") " pod="openshift-dns/dns-default-29jjm" Jul 25 01:12:29.738971 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:12:29.738859 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/9a0cf75d-3421-4485-afd7-e555f06ba176-config\") pod \"service-ca-operator-5d6c75f84f-5j29m\" (UID: \"9a0cf75d-3421-4485-afd7-e555f06ba176\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-5j29m" Jul 25 01:12:29.738971 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:12:29.738892 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/2a898496-0e3c-490b-94a6-0e05946b0313-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-hnxdh\" (UID: \"2a898496-0e3c-490b-94a6-0e05946b0313\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-hnxdh" Jul 25 01:12:29.738971 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:12:29.738915 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/59f19017-9df8-47ee-820e-fd8e02c1178f-metrics-tls\") pod \"dns-default-29jjm\" (UID: \"59f19017-9df8-47ee-820e-fd8e02c1178f\") " pod="openshift-dns/dns-default-29jjm" Jul 25 01:12:29.738971 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:12:29.738940 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/9cb28390-ddda-4bf0-85e5-59c3702123bd-ca-trust-extracted\") pod \"image-registry-6b68768447-slrxh\" (UID: \"9cb28390-ddda-4bf0-85e5-59c3702123bd\") " pod="openshift-image-registry/image-registry-6b68768447-slrxh" Jul 25 01:12:29.738971 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:12:29.738960 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g2nwb\" (UniqueName: \"kubernetes.io/projected/9cb28390-ddda-4bf0-85e5-59c3702123bd-kube-api-access-g2nwb\") pod \"image-registry-6b68768447-slrxh\" (UID: \"9cb28390-ddda-4bf0-85e5-59c3702123bd\") " pod="openshift-image-registry/image-registry-6b68768447-slrxh" Jul 25 01:12:29.739178 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:12:29.738984 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5cgl4\" (UniqueName: \"kubernetes.io/projected/a9cb9aa9-8f43-4b32-a7b7-4eb9afb05c90-kube-api-access-5cgl4\") pod \"console-operator-584dcb6b54-s5tbd\" (UID: \"a9cb9aa9-8f43-4b32-a7b7-4eb9afb05c90\") " pod="openshift-console-operator/console-operator-584dcb6b54-s5tbd" Jul 25 01:12:29.739178 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:12:29.739009 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g4vfk\" (UniqueName: \"kubernetes.io/projected/59f19017-9df8-47ee-820e-fd8e02c1178f-kube-api-access-g4vfk\") pod \"dns-default-29jjm\" (UID: \"59f19017-9df8-47ee-820e-fd8e02c1178f\") " pod="openshift-dns/dns-default-29jjm" Jul 25 01:12:29.739178 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:12:29.739034 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/eecc300f-3388-493d-a229-4ba749887922-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-f5tvk\" (UID: \"eecc300f-3388-493d-a229-4ba749887922\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-f5tvk" Jul 25 01:12:29.739178 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:12:29.739050 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/9cb28390-ddda-4bf0-85e5-59c3702123bd-registry-certificates\") pod \"image-registry-6b68768447-slrxh\" (UID: \"9cb28390-ddda-4bf0-85e5-59c3702123bd\") " pod="openshift-image-registry/image-registry-6b68768447-slrxh" Jul 25 01:12:29.739178 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:12:29.739102 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/9cb28390-ddda-4bf0-85e5-59c3702123bd-image-registry-private-configuration\") pod \"image-registry-6b68768447-slrxh\" (UID: \"9cb28390-ddda-4bf0-85e5-59c3702123bd\") " pod="openshift-image-registry/image-registry-6b68768447-slrxh" Jul 25 01:12:29.739178 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:12:29.739143 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/a9cb9aa9-8f43-4b32-a7b7-4eb9afb05c90-config\") pod \"console-operator-584dcb6b54-s5tbd\" (UID: \"a9cb9aa9-8f43-4b32-a7b7-4eb9afb05c90\") " pod="openshift-console-operator/console-operator-584dcb6b54-s5tbd" Jul 25 01:12:29.739178 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:12:29.739173 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e456d8b2-d6d4-4b00-bc45-e046481d15bb-trusted-ca-bundle\") pod \"insights-operator-5885fdb759-kq9tj\" (UID: \"e456d8b2-d6d4-4b00-bc45-e046481d15bb\") " pod="openshift-insights/insights-operator-5885fdb759-kq9tj" Jul 25 01:12:29.739454 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:12:29.739202 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9cb28390-ddda-4bf0-85e5-59c3702123bd-registry-tls\") pod \"image-registry-6b68768447-slrxh\" (UID: \"9cb28390-ddda-4bf0-85e5-59c3702123bd\") " pod="openshift-image-registry/image-registry-6b68768447-slrxh" Jul 25 01:12:29.739454 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:12:29.739227 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/9cb28390-ddda-4bf0-85e5-59c3702123bd-bound-sa-token\") pod \"image-registry-6b68768447-slrxh\" (UID: \"9cb28390-ddda-4bf0-85e5-59c3702123bd\") " pod="openshift-image-registry/image-registry-6b68768447-slrxh" Jul 25 01:12:29.739454 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:12:29.739251 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/e1d86a8c-ea94-4770-8136-8448f268d6d1-config\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-27qc8\" (UID: \"e1d86a8c-ea94-4770-8136-8448f268d6d1\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-27qc8" Jul 25 01:12:29.739454 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:12:29.739316 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/eecc300f-3388-493d-a229-4ba749887922-telemetry-config\") pod \"cluster-monitoring-operator-548b489cb8-f5tvk\" (UID: \"eecc300f-3388-493d-a229-4ba749887922\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-f5tvk" Jul 25 01:12:29.739454 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:12:29.739364 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/e456d8b2-d6d4-4b00-bc45-e046481d15bb-snapshots\") pod \"insights-operator-5885fdb759-kq9tj\" (UID: \"e456d8b2-d6d4-4b00-bc45-e046481d15bb\") " pod="openshift-insights/insights-operator-5885fdb759-kq9tj" Jul 25 01:12:29.739454 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:12:29.739414 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e456d8b2-d6d4-4b00-bc45-e046481d15bb-service-ca-bundle\") pod \"insights-operator-5885fdb759-kq9tj\" (UID: \"e456d8b2-d6d4-4b00-bc45-e046481d15bb\") " pod="openshift-insights/insights-operator-5885fdb759-kq9tj" Jul 25 01:12:29.739454 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:12:29.739441 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q6h2f\" (UniqueName: \"kubernetes.io/projected/9706e509-f401-465c-b9e3-4d7495439d6d-kube-api-access-q6h2f\") pod \"volume-data-source-validator-549c6d54cf-25d96\" (UID: \"9706e509-f401-465c-b9e3-4d7495439d6d\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-25d96" Jul 25 01:12:29.739704 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:12:29.739465 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/9cb28390-ddda-4bf0-85e5-59c3702123bd-trusted-ca\") pod \"image-registry-6b68768447-slrxh\" (UID: \"9cb28390-ddda-4bf0-85e5-59c3702123bd\") " pod="openshift-image-registry/image-registry-6b68768447-slrxh" Jul 25 01:12:29.739704 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:12:29.739484 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/9a0cf75d-3421-4485-afd7-e555f06ba176-serving-cert\") pod \"service-ca-operator-5d6c75f84f-5j29m\" (UID: \"9a0cf75d-3421-4485-afd7-e555f06ba176\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-5j29m" Jul 25 01:12:29.739704 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:12:29.739521 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-97h2v\" (UniqueName: \"kubernetes.io/projected/76e646a1-4d05-4518-8d13-21d3fa3bbf7d-kube-api-access-97h2v\") pod \"ingress-canary-6qrg6\" (UID: \"76e646a1-4d05-4518-8d13-21d3fa3bbf7d\") " pod="openshift-ingress-canary/ingress-canary-6qrg6" Jul 25 01:12:29.739704 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:12:29.739550 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qzdlt\" (UniqueName: \"kubernetes.io/projected/eecc300f-3388-493d-a229-4ba749887922-kube-api-access-qzdlt\") pod \"cluster-monitoring-operator-548b489cb8-f5tvk\" (UID: \"eecc300f-3388-493d-a229-4ba749887922\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-f5tvk" Jul 25 01:12:29.739704 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:12:29.739580 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/e456d8b2-d6d4-4b00-bc45-e046481d15bb-serving-cert\") pod \"insights-operator-5885fdb759-kq9tj\" (UID: \"e456d8b2-d6d4-4b00-bc45-e046481d15bb\") " pod="openshift-insights/insights-operator-5885fdb759-kq9tj" Jul 25 01:12:29.739704 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:12:29.739623 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/a9cb9aa9-8f43-4b32-a7b7-4eb9afb05c90-trusted-ca\") pod \"console-operator-584dcb6b54-s5tbd\" (UID: \"a9cb9aa9-8f43-4b32-a7b7-4eb9afb05c90\") " pod="openshift-console-operator/console-operator-584dcb6b54-s5tbd" Jul 25 01:12:29.739704 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:12:29.739648 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/e1d86a8c-ea94-4770-8136-8448f268d6d1-serving-cert\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-27qc8\" (UID: \"e1d86a8c-ea94-4770-8136-8448f268d6d1\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-27qc8" Jul 25 01:12:29.739704 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:12:29.739674 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/5aed6b57-4e4c-45f2-975c-8776d87fe328-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-bp82d\" (UID: \"5aed6b57-4e4c-45f2-975c-8776d87fe328\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-bp82d" Jul 25 01:12:29.739977 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:12:29.739713 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/76e646a1-4d05-4518-8d13-21d3fa3bbf7d-cert\") pod \"ingress-canary-6qrg6\" (UID: \"76e646a1-4d05-4518-8d13-21d3fa3bbf7d\") " pod="openshift-ingress-canary/ingress-canary-6qrg6" Jul 25 01:12:29.739977 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:12:29.739744 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5k8tf\" (UniqueName: \"kubernetes.io/projected/9a0cf75d-3421-4485-afd7-e555f06ba176-kube-api-access-5k8tf\") pod \"service-ca-operator-5d6c75f84f-5j29m\" (UID: \"9a0cf75d-3421-4485-afd7-e555f06ba176\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-5j29m" Jul 25 01:12:29.739977 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:12:29.739778 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fnthh\" (UniqueName: \"kubernetes.io/projected/5aed6b57-4e4c-45f2-975c-8776d87fe328-kube-api-access-fnthh\") pod \"cluster-samples-operator-6748489656-bp82d\" (UID: \"5aed6b57-4e4c-45f2-975c-8776d87fe328\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-bp82d" Jul 25 01:12:29.739977 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:12:29.739805 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x6hzf\" (UniqueName: \"kubernetes.io/projected/e1d86a8c-ea94-4770-8136-8448f268d6d1-kube-api-access-x6hzf\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-27qc8\" (UID: \"e1d86a8c-ea94-4770-8136-8448f268d6d1\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-27qc8" Jul 25 01:12:29.739977 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:12:29.739833 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wxwsx\" (UniqueName: \"kubernetes.io/projected/e456d8b2-d6d4-4b00-bc45-e046481d15bb-kube-api-access-wxwsx\") pod \"insights-operator-5885fdb759-kq9tj\" (UID: \"e456d8b2-d6d4-4b00-bc45-e046481d15bb\") " pod="openshift-insights/insights-operator-5885fdb759-kq9tj" Jul 25 01:12:29.739977 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:12:29.739855 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e456d8b2-d6d4-4b00-bc45-e046481d15bb-tmp\") pod \"insights-operator-5885fdb759-kq9tj\" (UID: \"e456d8b2-d6d4-4b00-bc45-e046481d15bb\") " pod="openshift-insights/insights-operator-5885fdb759-kq9tj" Jul 25 01:12:29.739977 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:12:29.739883 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/59f19017-9df8-47ee-820e-fd8e02c1178f-tmp-dir\") pod \"dns-default-29jjm\" (UID: \"59f19017-9df8-47ee-820e-fd8e02c1178f\") " pod="openshift-dns/dns-default-29jjm" Jul 25 01:12:29.739977 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:12:29.739909 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/2a898496-0e3c-490b-94a6-0e05946b0313-nginx-conf\") pod \"networking-console-plugin-74c9f884b7-hnxdh\" (UID: \"2a898496-0e3c-490b-94a6-0e05946b0313\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-hnxdh" Jul 25 01:12:29.739977 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:12:29.739939 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/9cb28390-ddda-4bf0-85e5-59c3702123bd-installation-pull-secrets\") pod \"image-registry-6b68768447-slrxh\" (UID: \"9cb28390-ddda-4bf0-85e5-59c3702123bd\") " pod="openshift-image-registry/image-registry-6b68768447-slrxh" Jul 25 01:12:29.739977 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:12:29.739974 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/a9cb9aa9-8f43-4b32-a7b7-4eb9afb05c90-serving-cert\") pod \"console-operator-584dcb6b54-s5tbd\" (UID: \"a9cb9aa9-8f43-4b32-a7b7-4eb9afb05c90\") " pod="openshift-console-operator/console-operator-584dcb6b54-s5tbd" Jul 25 01:12:29.740321 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:12:29.739993 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-txvnw\" (UniqueName: \"kubernetes.io/projected/73053a18-b359-4bf1-b0a5-373b07d1de9f-kube-api-access-txvnw\") pod \"network-check-source-7d88cb55d8-d4tds\" (UID: \"73053a18-b359-4bf1-b0a5-373b07d1de9f\") " pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-d4tds" Jul 25 01:12:29.781286 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:12:29.781253 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mktch" Jul 25 01:12:29.781286 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:12:29.781267 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-znlzb" Jul 25 01:12:29.781479 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:12:29.781259 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5nl9g" Jul 25 01:12:29.783512 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:12:29.783490 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 25 01:12:29.783628 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:12:29.783513 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-2flvd\"" Jul 25 01:12:29.783628 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:12:29.783517 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-2rr8l\"" Jul 25 01:12:29.783628 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:12:29.783494 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 25 01:12:29.840458 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:12:29.840426 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e456d8b2-d6d4-4b00-bc45-e046481d15bb-tmp\") pod \"insights-operator-5885fdb759-kq9tj\" (UID: \"e456d8b2-d6d4-4b00-bc45-e046481d15bb\") " pod="openshift-insights/insights-operator-5885fdb759-kq9tj" Jul 25 01:12:29.840458 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:12:29.840457 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/59f19017-9df8-47ee-820e-fd8e02c1178f-tmp-dir\") pod \"dns-default-29jjm\" (UID: \"59f19017-9df8-47ee-820e-fd8e02c1178f\") " pod="openshift-dns/dns-default-29jjm" Jul 25 01:12:29.840629 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:12:29.840481 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/2a898496-0e3c-490b-94a6-0e05946b0313-nginx-conf\") pod \"networking-console-plugin-74c9f884b7-hnxdh\" (UID: \"2a898496-0e3c-490b-94a6-0e05946b0313\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-hnxdh" Jul 25 01:12:29.840629 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:12:29.840512 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/9cb28390-ddda-4bf0-85e5-59c3702123bd-installation-pull-secrets\") pod \"image-registry-6b68768447-slrxh\" (UID: \"9cb28390-ddda-4bf0-85e5-59c3702123bd\") " pod="openshift-image-registry/image-registry-6b68768447-slrxh" Jul 25 01:12:29.840629 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:12:29.840558 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/a9cb9aa9-8f43-4b32-a7b7-4eb9afb05c90-serving-cert\") pod \"console-operator-584dcb6b54-s5tbd\" (UID: \"a9cb9aa9-8f43-4b32-a7b7-4eb9afb05c90\") " pod="openshift-console-operator/console-operator-584dcb6b54-s5tbd" Jul 25 01:12:29.840629 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:12:29.840584 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-txvnw\" (UniqueName: \"kubernetes.io/projected/73053a18-b359-4bf1-b0a5-373b07d1de9f-kube-api-access-txvnw\") pod \"network-check-source-7d88cb55d8-d4tds\" (UID: \"73053a18-b359-4bf1-b0a5-373b07d1de9f\") " pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-d4tds" Jul 25 01:12:29.840629 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:12:29.840611 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/a8cb1021-bc16-4dfc-9252-3773f7aaea5b-default-certificate\") pod \"router-default-54fd59887f-g5zgr\" (UID: \"a8cb1021-bc16-4dfc-9252-3773f7aaea5b\") " pod="openshift-ingress/router-default-54fd59887f-g5zgr" Jul 25 01:12:29.840903 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:12:29.840636 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/59f19017-9df8-47ee-820e-fd8e02c1178f-config-volume\") pod \"dns-default-29jjm\" (UID: \"59f19017-9df8-47ee-820e-fd8e02c1178f\") " pod="openshift-dns/dns-default-29jjm" Jul 25 01:12:29.840903 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:12:29.840657 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/9a0cf75d-3421-4485-afd7-e555f06ba176-config\") pod \"service-ca-operator-5d6c75f84f-5j29m\" (UID: \"9a0cf75d-3421-4485-afd7-e555f06ba176\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-5j29m" Jul 25 01:12:29.840903 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:12:29.840698 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/2a898496-0e3c-490b-94a6-0e05946b0313-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-hnxdh\" (UID: \"2a898496-0e3c-490b-94a6-0e05946b0313\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-hnxdh" Jul 25 01:12:29.840903 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:12:29.840724 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/59f19017-9df8-47ee-820e-fd8e02c1178f-metrics-tls\") pod \"dns-default-29jjm\" (UID: \"59f19017-9df8-47ee-820e-fd8e02c1178f\") " pod="openshift-dns/dns-default-29jjm" Jul 25 01:12:29.840903 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:12:29.840754 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/9cb28390-ddda-4bf0-85e5-59c3702123bd-ca-trust-extracted\") pod \"image-registry-6b68768447-slrxh\" (UID: \"9cb28390-ddda-4bf0-85e5-59c3702123bd\") " pod="openshift-image-registry/image-registry-6b68768447-slrxh" Jul 25 01:12:29.840903 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:12:29.840779 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g2nwb\" (UniqueName: \"kubernetes.io/projected/9cb28390-ddda-4bf0-85e5-59c3702123bd-kube-api-access-g2nwb\") pod \"image-registry-6b68768447-slrxh\" (UID: \"9cb28390-ddda-4bf0-85e5-59c3702123bd\") " pod="openshift-image-registry/image-registry-6b68768447-slrxh" Jul 25 01:12:29.840903 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:12:29.840785 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/59f19017-9df8-47ee-820e-fd8e02c1178f-tmp-dir\") pod \"dns-default-29jjm\" (UID: \"59f19017-9df8-47ee-820e-fd8e02c1178f\") " pod="openshift-dns/dns-default-29jjm" Jul 25 01:12:29.840903 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:12:29.840805 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5cgl4\" (UniqueName: \"kubernetes.io/projected/a9cb9aa9-8f43-4b32-a7b7-4eb9afb05c90-kube-api-access-5cgl4\") pod \"console-operator-584dcb6b54-s5tbd\" (UID: \"a9cb9aa9-8f43-4b32-a7b7-4eb9afb05c90\") " pod="openshift-console-operator/console-operator-584dcb6b54-s5tbd" Jul 25 01:12:29.840903 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:12:29.840830 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g4vfk\" (UniqueName: \"kubernetes.io/projected/59f19017-9df8-47ee-820e-fd8e02c1178f-kube-api-access-g4vfk\") pod \"dns-default-29jjm\" (UID: \"59f19017-9df8-47ee-820e-fd8e02c1178f\") " pod="openshift-dns/dns-default-29jjm" Jul 25 01:12:29.840903 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:12:29.840874 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/eecc300f-3388-493d-a229-4ba749887922-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-f5tvk\" (UID: \"eecc300f-3388-493d-a229-4ba749887922\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-f5tvk" Jul 25 01:12:29.840903 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:12:29.840900 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/9cb28390-ddda-4bf0-85e5-59c3702123bd-registry-certificates\") pod \"image-registry-6b68768447-slrxh\" (UID: \"9cb28390-ddda-4bf0-85e5-59c3702123bd\") " pod="openshift-image-registry/image-registry-6b68768447-slrxh" Jul 25 01:12:29.841341 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:12:29.840924 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/9cb28390-ddda-4bf0-85e5-59c3702123bd-image-registry-private-configuration\") pod \"image-registry-6b68768447-slrxh\" (UID: \"9cb28390-ddda-4bf0-85e5-59c3702123bd\") " pod="openshift-image-registry/image-registry-6b68768447-slrxh" Jul 25 01:12:29.841341 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:12:29.840952 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/a9cb9aa9-8f43-4b32-a7b7-4eb9afb05c90-config\") pod \"console-operator-584dcb6b54-s5tbd\" (UID: \"a9cb9aa9-8f43-4b32-a7b7-4eb9afb05c90\") " pod="openshift-console-operator/console-operator-584dcb6b54-s5tbd" Jul 25 01:12:29.841341 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:12:29.840976 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e456d8b2-d6d4-4b00-bc45-e046481d15bb-trusted-ca-bundle\") pod \"insights-operator-5885fdb759-kq9tj\" (UID: \"e456d8b2-d6d4-4b00-bc45-e046481d15bb\") " pod="openshift-insights/insights-operator-5885fdb759-kq9tj" Jul 25 01:12:29.841341 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:12:29.841004 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9cb28390-ddda-4bf0-85e5-59c3702123bd-registry-tls\") pod \"image-registry-6b68768447-slrxh\" (UID: \"9cb28390-ddda-4bf0-85e5-59c3702123bd\") " pod="openshift-image-registry/image-registry-6b68768447-slrxh" Jul 25 01:12:29.841341 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:12:29.841032 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/9cb28390-ddda-4bf0-85e5-59c3702123bd-bound-sa-token\") pod \"image-registry-6b68768447-slrxh\" (UID: \"9cb28390-ddda-4bf0-85e5-59c3702123bd\") " pod="openshift-image-registry/image-registry-6b68768447-slrxh" Jul 25 01:12:29.841341 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:12:29.841059 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/e1d86a8c-ea94-4770-8136-8448f268d6d1-config\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-27qc8\" (UID: \"e1d86a8c-ea94-4770-8136-8448f268d6d1\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-27qc8" Jul 25 01:12:29.841341 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:12:29.841098 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/eecc300f-3388-493d-a229-4ba749887922-telemetry-config\") pod \"cluster-monitoring-operator-548b489cb8-f5tvk\" (UID: \"eecc300f-3388-493d-a229-4ba749887922\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-f5tvk" Jul 25 01:12:29.841341 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:12:29.841120 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/e456d8b2-d6d4-4b00-bc45-e046481d15bb-snapshots\") pod \"insights-operator-5885fdb759-kq9tj\" (UID: \"e456d8b2-d6d4-4b00-bc45-e046481d15bb\") " pod="openshift-insights/insights-operator-5885fdb759-kq9tj" Jul 25 01:12:29.841341 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:12:29.841144 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e456d8b2-d6d4-4b00-bc45-e046481d15bb-service-ca-bundle\") pod \"insights-operator-5885fdb759-kq9tj\" (UID: \"e456d8b2-d6d4-4b00-bc45-e046481d15bb\") " pod="openshift-insights/insights-operator-5885fdb759-kq9tj" Jul 25 01:12:29.841341 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:12:29.841169 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q6h2f\" (UniqueName: \"kubernetes.io/projected/9706e509-f401-465c-b9e3-4d7495439d6d-kube-api-access-q6h2f\") pod \"volume-data-source-validator-549c6d54cf-25d96\" (UID: \"9706e509-f401-465c-b9e3-4d7495439d6d\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-25d96" Jul 25 01:12:29.841341 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:12:29.841183 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/9a0cf75d-3421-4485-afd7-e555f06ba176-config\") pod \"service-ca-operator-5d6c75f84f-5j29m\" (UID: \"9a0cf75d-3421-4485-afd7-e555f06ba176\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-5j29m" Jul 25 01:12:29.841341 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:12:29.841195 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/9cb28390-ddda-4bf0-85e5-59c3702123bd-trusted-ca\") pod \"image-registry-6b68768447-slrxh\" (UID: \"9cb28390-ddda-4bf0-85e5-59c3702123bd\") " pod="openshift-image-registry/image-registry-6b68768447-slrxh" Jul 25 01:12:29.841341 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:12:29.841201 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/2a898496-0e3c-490b-94a6-0e05946b0313-nginx-conf\") pod \"networking-console-plugin-74c9f884b7-hnxdh\" (UID: \"2a898496-0e3c-490b-94a6-0e05946b0313\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-hnxdh" Jul 25 01:12:29.841341 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:12:29.841230 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/9a0cf75d-3421-4485-afd7-e555f06ba176-serving-cert\") pod \"service-ca-operator-5d6c75f84f-5j29m\" (UID: \"9a0cf75d-3421-4485-afd7-e555f06ba176\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-5j29m" Jul 25 01:12:29.841341 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:12:29.841253 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a8cb1021-bc16-4dfc-9252-3773f7aaea5b-service-ca-bundle\") pod \"router-default-54fd59887f-g5zgr\" (UID: \"a8cb1021-bc16-4dfc-9252-3773f7aaea5b\") " pod="openshift-ingress/router-default-54fd59887f-g5zgr" Jul 25 01:12:29.841341 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:12:29.841279 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-97h2v\" (UniqueName: \"kubernetes.io/projected/76e646a1-4d05-4518-8d13-21d3fa3bbf7d-kube-api-access-97h2v\") pod \"ingress-canary-6qrg6\" (UID: \"76e646a1-4d05-4518-8d13-21d3fa3bbf7d\") " pod="openshift-ingress-canary/ingress-canary-6qrg6" Jul 25 01:12:29.841942 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:12:29.841302 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qzdlt\" (UniqueName: \"kubernetes.io/projected/eecc300f-3388-493d-a229-4ba749887922-kube-api-access-qzdlt\") pod \"cluster-monitoring-operator-548b489cb8-f5tvk\" (UID: \"eecc300f-3388-493d-a229-4ba749887922\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-f5tvk" Jul 25 01:12:29.841942 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:12:29.841322 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/e456d8b2-d6d4-4b00-bc45-e046481d15bb-serving-cert\") pod \"insights-operator-5885fdb759-kq9tj\" (UID: \"e456d8b2-d6d4-4b00-bc45-e046481d15bb\") " pod="openshift-insights/insights-operator-5885fdb759-kq9tj" Jul 25 01:12:29.841942 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:12:29.841340 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/a9cb9aa9-8f43-4b32-a7b7-4eb9afb05c90-trusted-ca\") pod \"console-operator-584dcb6b54-s5tbd\" (UID: \"a9cb9aa9-8f43-4b32-a7b7-4eb9afb05c90\") " pod="openshift-console-operator/console-operator-584dcb6b54-s5tbd" Jul 25 01:12:29.841942 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:12:29.841366 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pcm99\" (UniqueName: \"kubernetes.io/projected/a8cb1021-bc16-4dfc-9252-3773f7aaea5b-kube-api-access-pcm99\") pod \"router-default-54fd59887f-g5zgr\" (UID: \"a8cb1021-bc16-4dfc-9252-3773f7aaea5b\") " pod="openshift-ingress/router-default-54fd59887f-g5zgr" Jul 25 01:12:29.841942 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:12:29.841429 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/e1d86a8c-ea94-4770-8136-8448f268d6d1-serving-cert\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-27qc8\" (UID: \"e1d86a8c-ea94-4770-8136-8448f268d6d1\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-27qc8" Jul 25 01:12:29.841942 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:12:29.841472 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/a8cb1021-bc16-4dfc-9252-3773f7aaea5b-stats-auth\") pod \"router-default-54fd59887f-g5zgr\" (UID: \"a8cb1021-bc16-4dfc-9252-3773f7aaea5b\") " pod="openshift-ingress/router-default-54fd59887f-g5zgr" Jul 25 01:12:29.841942 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:12:29.841495 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/5aed6b57-4e4c-45f2-975c-8776d87fe328-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-bp82d\" (UID: \"5aed6b57-4e4c-45f2-975c-8776d87fe328\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-bp82d" Jul 25 01:12:29.841942 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:12:29.841530 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/76e646a1-4d05-4518-8d13-21d3fa3bbf7d-cert\") pod \"ingress-canary-6qrg6\" (UID: \"76e646a1-4d05-4518-8d13-21d3fa3bbf7d\") " pod="openshift-ingress-canary/ingress-canary-6qrg6" Jul 25 01:12:29.841942 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:12:29.841556 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5k8tf\" (UniqueName: \"kubernetes.io/projected/9a0cf75d-3421-4485-afd7-e555f06ba176-kube-api-access-5k8tf\") pod \"service-ca-operator-5d6c75f84f-5j29m\" (UID: \"9a0cf75d-3421-4485-afd7-e555f06ba176\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-5j29m" Jul 25 01:12:29.841942 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:12:29.841583 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fnthh\" (UniqueName: \"kubernetes.io/projected/5aed6b57-4e4c-45f2-975c-8776d87fe328-kube-api-access-fnthh\") pod \"cluster-samples-operator-6748489656-bp82d\" (UID: \"5aed6b57-4e4c-45f2-975c-8776d87fe328\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-bp82d" Jul 25 01:12:29.841942 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:12:29.841611 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x6hzf\" (UniqueName: \"kubernetes.io/projected/e1d86a8c-ea94-4770-8136-8448f268d6d1-kube-api-access-x6hzf\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-27qc8\" (UID: \"e1d86a8c-ea94-4770-8136-8448f268d6d1\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-27qc8" Jul 25 01:12:29.841942 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:12:29.841637 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wxwsx\" (UniqueName: \"kubernetes.io/projected/e456d8b2-d6d4-4b00-bc45-e046481d15bb-kube-api-access-wxwsx\") pod \"insights-operator-5885fdb759-kq9tj\" (UID: \"e456d8b2-d6d4-4b00-bc45-e046481d15bb\") " pod="openshift-insights/insights-operator-5885fdb759-kq9tj" Jul 25 01:12:29.841942 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:12:29.841662 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a8cb1021-bc16-4dfc-9252-3773f7aaea5b-metrics-certs\") pod \"router-default-54fd59887f-g5zgr\" (UID: \"a8cb1021-bc16-4dfc-9252-3773f7aaea5b\") " pod="openshift-ingress/router-default-54fd59887f-g5zgr" Jul 25 01:12:29.842558 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:12:29.842104 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e456d8b2-d6d4-4b00-bc45-e046481d15bb-tmp\") pod \"insights-operator-5885fdb759-kq9tj\" (UID: \"e456d8b2-d6d4-4b00-bc45-e046481d15bb\") " pod="openshift-insights/insights-operator-5885fdb759-kq9tj" Jul 25 01:12:29.842558 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:12:29.842215 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/a9cb9aa9-8f43-4b32-a7b7-4eb9afb05c90-config\") pod \"console-operator-584dcb6b54-s5tbd\" (UID: \"a9cb9aa9-8f43-4b32-a7b7-4eb9afb05c90\") " pod="openshift-console-operator/console-operator-584dcb6b54-s5tbd" Jul 25 01:12:29.842558 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:12:29.842338 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/59f19017-9df8-47ee-820e-fd8e02c1178f-config-volume\") pod \"dns-default-29jjm\" (UID: \"59f19017-9df8-47ee-820e-fd8e02c1178f\") " pod="openshift-dns/dns-default-29jjm" Jul 25 01:12:29.842558 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:12:29.842398 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e456d8b2-d6d4-4b00-bc45-e046481d15bb-trusted-ca-bundle\") pod \"insights-operator-5885fdb759-kq9tj\" (UID: \"e456d8b2-d6d4-4b00-bc45-e046481d15bb\") " pod="openshift-insights/insights-operator-5885fdb759-kq9tj" Jul 25 01:12:29.842558 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:12:29.842421 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/9cb28390-ddda-4bf0-85e5-59c3702123bd-ca-trust-extracted\") pod \"image-registry-6b68768447-slrxh\" (UID: \"9cb28390-ddda-4bf0-85e5-59c3702123bd\") " pod="openshift-image-registry/image-registry-6b68768447-slrxh" Jul 25 01:12:29.843173 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:12:29.843000 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/e1d86a8c-ea94-4770-8136-8448f268d6d1-config\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-27qc8\" (UID: \"e1d86a8c-ea94-4770-8136-8448f268d6d1\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-27qc8" Jul 25 01:12:29.843295 ip-10-0-129-35 kubenswrapper[2567]: E0725 01:12:29.841281 2567 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 25 01:12:29.850554 ip-10-0-129-35 kubenswrapper[2567]: E0725 01:12:29.843900 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2a898496-0e3c-490b-94a6-0e05946b0313-networking-console-plugin-cert podName:2a898496-0e3c-490b-94a6-0e05946b0313 nodeName:}" failed. No retries permitted until 2026-07-25 01:12:30.34386193 +0000 UTC m=+36.036956346 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/2a898496-0e3c-490b-94a6-0e05946b0313-networking-console-plugin-cert") pod "networking-console-plugin-74c9f884b7-hnxdh" (UID: "2a898496-0e3c-490b-94a6-0e05946b0313") : secret "networking-console-plugin-cert" not found Jul 25 01:12:29.850554 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:12:29.844677 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/eecc300f-3388-493d-a229-4ba749887922-telemetry-config\") pod \"cluster-monitoring-operator-548b489cb8-f5tvk\" (UID: \"eecc300f-3388-493d-a229-4ba749887922\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-f5tvk" Jul 25 01:12:29.850554 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:12:29.845434 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/9cb28390-ddda-4bf0-85e5-59c3702123bd-registry-certificates\") pod \"image-registry-6b68768447-slrxh\" (UID: \"9cb28390-ddda-4bf0-85e5-59c3702123bd\") " pod="openshift-image-registry/image-registry-6b68768447-slrxh" Jul 25 01:12:29.850554 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:12:29.845876 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/e456d8b2-d6d4-4b00-bc45-e046481d15bb-snapshots\") pod \"insights-operator-5885fdb759-kq9tj\" (UID: \"e456d8b2-d6d4-4b00-bc45-e046481d15bb\") " pod="openshift-insights/insights-operator-5885fdb759-kq9tj" Jul 25 01:12:29.850554 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:12:29.846193 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/9cb28390-ddda-4bf0-85e5-59c3702123bd-installation-pull-secrets\") pod \"image-registry-6b68768447-slrxh\" (UID: \"9cb28390-ddda-4bf0-85e5-59c3702123bd\") " pod="openshift-image-registry/image-registry-6b68768447-slrxh" Jul 25 01:12:29.850554 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:12:29.846329 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e456d8b2-d6d4-4b00-bc45-e046481d15bb-service-ca-bundle\") pod \"insights-operator-5885fdb759-kq9tj\" (UID: \"e456d8b2-d6d4-4b00-bc45-e046481d15bb\") " pod="openshift-insights/insights-operator-5885fdb759-kq9tj" Jul 25 01:12:29.850554 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:12:29.846501 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/9cb28390-ddda-4bf0-85e5-59c3702123bd-image-registry-private-configuration\") pod \"image-registry-6b68768447-slrxh\" (UID: \"9cb28390-ddda-4bf0-85e5-59c3702123bd\") " pod="openshift-image-registry/image-registry-6b68768447-slrxh" Jul 25 01:12:29.850554 ip-10-0-129-35 kubenswrapper[2567]: E0725 01:12:29.842091 2567 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 25 01:12:29.850554 ip-10-0-129-35 kubenswrapper[2567]: E0725 01:12:29.846626 2567 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 25 01:12:29.850554 ip-10-0-129-35 kubenswrapper[2567]: E0725 01:12:29.846629 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/59f19017-9df8-47ee-820e-fd8e02c1178f-metrics-tls podName:59f19017-9df8-47ee-820e-fd8e02c1178f nodeName:}" failed. No retries permitted until 2026-07-25 01:12:30.346608704 +0000 UTC m=+36.039703115 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/59f19017-9df8-47ee-820e-fd8e02c1178f-metrics-tls") pod "dns-default-29jjm" (UID: "59f19017-9df8-47ee-820e-fd8e02c1178f") : secret "dns-default-metrics-tls" not found Jul 25 01:12:29.850554 ip-10-0-129-35 kubenswrapper[2567]: E0725 01:12:29.842484 2567 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 25 01:12:29.850554 ip-10-0-129-35 kubenswrapper[2567]: E0725 01:12:29.846655 2567 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6b68768447-slrxh: secret "image-registry-tls" not found Jul 25 01:12:29.850554 ip-10-0-129-35 kubenswrapper[2567]: E0725 01:12:29.846695 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9cb28390-ddda-4bf0-85e5-59c3702123bd-registry-tls podName:9cb28390-ddda-4bf0-85e5-59c3702123bd nodeName:}" failed. No retries permitted until 2026-07-25 01:12:30.346677125 +0000 UTC m=+36.039771581 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/9cb28390-ddda-4bf0-85e5-59c3702123bd-registry-tls") pod "image-registry-6b68768447-slrxh" (UID: "9cb28390-ddda-4bf0-85e5-59c3702123bd") : secret "image-registry-tls" not found Jul 25 01:12:29.850554 ip-10-0-129-35 kubenswrapper[2567]: E0725 01:12:29.843016 2567 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 25 01:12:29.850554 ip-10-0-129-35 kubenswrapper[2567]: E0725 01:12:29.846752 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/eecc300f-3388-493d-a229-4ba749887922-cluster-monitoring-operator-tls podName:eecc300f-3388-493d-a229-4ba749887922 nodeName:}" failed. No retries permitted until 2026-07-25 01:12:30.346736494 +0000 UTC m=+36.039830891 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/eecc300f-3388-493d-a229-4ba749887922-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-548b489cb8-f5tvk" (UID: "eecc300f-3388-493d-a229-4ba749887922") : secret "cluster-monitoring-operator-tls" not found Jul 25 01:12:29.850554 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:12:29.846903 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/76e646a1-4d05-4518-8d13-21d3fa3bbf7d-cert\") pod \"ingress-canary-6qrg6\" (UID: \"76e646a1-4d05-4518-8d13-21d3fa3bbf7d\") " pod="openshift-ingress-canary/ingress-canary-6qrg6" Jul 25 01:12:29.851609 ip-10-0-129-35 kubenswrapper[2567]: E0725 01:12:29.846974 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5aed6b57-4e4c-45f2-975c-8776d87fe328-samples-operator-tls podName:5aed6b57-4e4c-45f2-975c-8776d87fe328 nodeName:}" failed. No retries permitted until 2026-07-25 01:12:30.346954742 +0000 UTC m=+36.040049139 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/5aed6b57-4e4c-45f2-975c-8776d87fe328-samples-operator-tls") pod "cluster-samples-operator-6748489656-bp82d" (UID: "5aed6b57-4e4c-45f2-975c-8776d87fe328") : secret "samples-operator-tls" not found Jul 25 01:12:29.851609 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:12:29.847617 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/9cb28390-ddda-4bf0-85e5-59c3702123bd-trusted-ca\") pod \"image-registry-6b68768447-slrxh\" (UID: \"9cb28390-ddda-4bf0-85e5-59c3702123bd\") " pod="openshift-image-registry/image-registry-6b68768447-slrxh" Jul 25 01:12:29.851609 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:12:29.847868 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/a9cb9aa9-8f43-4b32-a7b7-4eb9afb05c90-trusted-ca\") pod \"console-operator-584dcb6b54-s5tbd\" (UID: \"a9cb9aa9-8f43-4b32-a7b7-4eb9afb05c90\") " pod="openshift-console-operator/console-operator-584dcb6b54-s5tbd" Jul 25 01:12:29.851609 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:12:29.850024 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-txvnw\" (UniqueName: \"kubernetes.io/projected/73053a18-b359-4bf1-b0a5-373b07d1de9f-kube-api-access-txvnw\") pod \"network-check-source-7d88cb55d8-d4tds\" (UID: \"73053a18-b359-4bf1-b0a5-373b07d1de9f\") " pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-d4tds" Jul 25 01:12:29.851609 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:12:29.850223 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/e1d86a8c-ea94-4770-8136-8448f268d6d1-serving-cert\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-27qc8\" (UID: \"e1d86a8c-ea94-4770-8136-8448f268d6d1\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-27qc8" Jul 25 01:12:29.851609 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:12:29.850235 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/9a0cf75d-3421-4485-afd7-e555f06ba176-serving-cert\") pod \"service-ca-operator-5d6c75f84f-5j29m\" (UID: \"9a0cf75d-3421-4485-afd7-e555f06ba176\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-5j29m" Jul 25 01:12:29.852177 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:12:29.852113 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/e456d8b2-d6d4-4b00-bc45-e046481d15bb-serving-cert\") pod \"insights-operator-5885fdb759-kq9tj\" (UID: \"e456d8b2-d6d4-4b00-bc45-e046481d15bb\") " pod="openshift-insights/insights-operator-5885fdb759-kq9tj" Jul 25 01:12:29.852807 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:12:29.852685 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5cgl4\" (UniqueName: \"kubernetes.io/projected/a9cb9aa9-8f43-4b32-a7b7-4eb9afb05c90-kube-api-access-5cgl4\") pod \"console-operator-584dcb6b54-s5tbd\" (UID: \"a9cb9aa9-8f43-4b32-a7b7-4eb9afb05c90\") " pod="openshift-console-operator/console-operator-584dcb6b54-s5tbd" Jul 25 01:12:29.853200 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:12:29.853110 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/9cb28390-ddda-4bf0-85e5-59c3702123bd-bound-sa-token\") pod \"image-registry-6b68768447-slrxh\" (UID: \"9cb28390-ddda-4bf0-85e5-59c3702123bd\") " pod="openshift-image-registry/image-registry-6b68768447-slrxh" Jul 25 01:12:29.857116 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:12:29.857095 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/a9cb9aa9-8f43-4b32-a7b7-4eb9afb05c90-serving-cert\") pod \"console-operator-584dcb6b54-s5tbd\" (UID: \"a9cb9aa9-8f43-4b32-a7b7-4eb9afb05c90\") " pod="openshift-console-operator/console-operator-584dcb6b54-s5tbd" Jul 25 01:12:29.857330 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:12:29.857284 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x6hzf\" (UniqueName: \"kubernetes.io/projected/e1d86a8c-ea94-4770-8136-8448f268d6d1-kube-api-access-x6hzf\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-27qc8\" (UID: \"e1d86a8c-ea94-4770-8136-8448f268d6d1\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-27qc8" Jul 25 01:12:29.857846 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:12:29.857824 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g4vfk\" (UniqueName: \"kubernetes.io/projected/59f19017-9df8-47ee-820e-fd8e02c1178f-kube-api-access-g4vfk\") pod \"dns-default-29jjm\" (UID: \"59f19017-9df8-47ee-820e-fd8e02c1178f\") " pod="openshift-dns/dns-default-29jjm" Jul 25 01:12:29.857973 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:12:29.857920 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-97h2v\" (UniqueName: \"kubernetes.io/projected/76e646a1-4d05-4518-8d13-21d3fa3bbf7d-kube-api-access-97h2v\") pod \"ingress-canary-6qrg6\" (UID: \"76e646a1-4d05-4518-8d13-21d3fa3bbf7d\") " pod="openshift-ingress-canary/ingress-canary-6qrg6" Jul 25 01:12:29.858092 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:12:29.858074 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qzdlt\" (UniqueName: \"kubernetes.io/projected/eecc300f-3388-493d-a229-4ba749887922-kube-api-access-qzdlt\") pod \"cluster-monitoring-operator-548b489cb8-f5tvk\" (UID: \"eecc300f-3388-493d-a229-4ba749887922\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-f5tvk" Jul 25 01:12:29.859656 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:12:29.859138 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g2nwb\" (UniqueName: \"kubernetes.io/projected/9cb28390-ddda-4bf0-85e5-59c3702123bd-kube-api-access-g2nwb\") pod \"image-registry-6b68768447-slrxh\" (UID: \"9cb28390-ddda-4bf0-85e5-59c3702123bd\") " pod="openshift-image-registry/image-registry-6b68768447-slrxh" Jul 25 01:12:29.859656 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:12:29.859180 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wxwsx\" (UniqueName: \"kubernetes.io/projected/e456d8b2-d6d4-4b00-bc45-e046481d15bb-kube-api-access-wxwsx\") pod \"insights-operator-5885fdb759-kq9tj\" (UID: \"e456d8b2-d6d4-4b00-bc45-e046481d15bb\") " pod="openshift-insights/insights-operator-5885fdb759-kq9tj" Jul 25 01:12:29.859656 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:12:29.859619 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5k8tf\" (UniqueName: \"kubernetes.io/projected/9a0cf75d-3421-4485-afd7-e555f06ba176-kube-api-access-5k8tf\") pod \"service-ca-operator-5d6c75f84f-5j29m\" (UID: \"9a0cf75d-3421-4485-afd7-e555f06ba176\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-5j29m" Jul 25 01:12:29.859853 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:12:29.859689 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fnthh\" (UniqueName: \"kubernetes.io/projected/5aed6b57-4e4c-45f2-975c-8776d87fe328-kube-api-access-fnthh\") pod \"cluster-samples-operator-6748489656-bp82d\" (UID: \"5aed6b57-4e4c-45f2-975c-8776d87fe328\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-bp82d" Jul 25 01:12:29.860367 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:12:29.860345 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q6h2f\" (UniqueName: \"kubernetes.io/projected/9706e509-f401-465c-b9e3-4d7495439d6d-kube-api-access-q6h2f\") pod \"volume-data-source-validator-549c6d54cf-25d96\" (UID: \"9706e509-f401-465c-b9e3-4d7495439d6d\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-25d96" Jul 25 01:12:29.923599 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:12:29.923574 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-25d96" Jul 25 01:12:29.928947 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:12:29.928930 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-5j29m" Jul 25 01:12:29.942636 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:12:29.942608 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pcm99\" (UniqueName: \"kubernetes.io/projected/a8cb1021-bc16-4dfc-9252-3773f7aaea5b-kube-api-access-pcm99\") pod \"router-default-54fd59887f-g5zgr\" (UID: \"a8cb1021-bc16-4dfc-9252-3773f7aaea5b\") " pod="openshift-ingress/router-default-54fd59887f-g5zgr" Jul 25 01:12:29.942738 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:12:29.942668 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/a8cb1021-bc16-4dfc-9252-3773f7aaea5b-stats-auth\") pod \"router-default-54fd59887f-g5zgr\" (UID: \"a8cb1021-bc16-4dfc-9252-3773f7aaea5b\") " pod="openshift-ingress/router-default-54fd59887f-g5zgr" Jul 25 01:12:29.942738 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:12:29.942717 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a8cb1021-bc16-4dfc-9252-3773f7aaea5b-metrics-certs\") pod \"router-default-54fd59887f-g5zgr\" (UID: \"a8cb1021-bc16-4dfc-9252-3773f7aaea5b\") " pod="openshift-ingress/router-default-54fd59887f-g5zgr" Jul 25 01:12:29.942842 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:12:29.942772 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/a8cb1021-bc16-4dfc-9252-3773f7aaea5b-default-certificate\") pod \"router-default-54fd59887f-g5zgr\" (UID: \"a8cb1021-bc16-4dfc-9252-3773f7aaea5b\") " pod="openshift-ingress/router-default-54fd59887f-g5zgr" Jul 25 01:12:29.942939 ip-10-0-129-35 kubenswrapper[2567]: E0725 01:12:29.942900 2567 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 25 01:12:29.943037 ip-10-0-129-35 kubenswrapper[2567]: E0725 01:12:29.942976 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a8cb1021-bc16-4dfc-9252-3773f7aaea5b-metrics-certs podName:a8cb1021-bc16-4dfc-9252-3773f7aaea5b nodeName:}" failed. No retries permitted until 2026-07-25 01:12:30.442956147 +0000 UTC m=+36.136050558 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a8cb1021-bc16-4dfc-9252-3773f7aaea5b-metrics-certs") pod "router-default-54fd59887f-g5zgr" (UID: "a8cb1021-bc16-4dfc-9252-3773f7aaea5b") : secret "router-metrics-certs-default" not found Jul 25 01:12:29.943037 ip-10-0-129-35 kubenswrapper[2567]: E0725 01:12:29.942998 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/a8cb1021-bc16-4dfc-9252-3773f7aaea5b-service-ca-bundle podName:a8cb1021-bc16-4dfc-9252-3773f7aaea5b nodeName:}" failed. No retries permitted until 2026-07-25 01:12:30.442983324 +0000 UTC m=+36.136077745 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/a8cb1021-bc16-4dfc-9252-3773f7aaea5b-service-ca-bundle") pod "router-default-54fd59887f-g5zgr" (UID: "a8cb1021-bc16-4dfc-9252-3773f7aaea5b") : configmap references non-existent config key: service-ca.crt Jul 25 01:12:29.943037 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:12:29.942900 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a8cb1021-bc16-4dfc-9252-3773f7aaea5b-service-ca-bundle\") pod \"router-default-54fd59887f-g5zgr\" (UID: \"a8cb1021-bc16-4dfc-9252-3773f7aaea5b\") " pod="openshift-ingress/router-default-54fd59887f-g5zgr" Jul 25 01:12:29.945222 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:12:29.945201 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/a8cb1021-bc16-4dfc-9252-3773f7aaea5b-stats-auth\") pod \"router-default-54fd59887f-g5zgr\" (UID: \"a8cb1021-bc16-4dfc-9252-3773f7aaea5b\") " pod="openshift-ingress/router-default-54fd59887f-g5zgr" Jul 25 01:12:29.945397 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:12:29.945350 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/a8cb1021-bc16-4dfc-9252-3773f7aaea5b-default-certificate\") pod \"router-default-54fd59887f-g5zgr\" (UID: \"a8cb1021-bc16-4dfc-9252-3773f7aaea5b\") " pod="openshift-ingress/router-default-54fd59887f-g5zgr" Jul 25 01:12:29.950823 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:12:29.950785 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pcm99\" (UniqueName: \"kubernetes.io/projected/a8cb1021-bc16-4dfc-9252-3773f7aaea5b-kube-api-access-pcm99\") pod \"router-default-54fd59887f-g5zgr\" (UID: \"a8cb1021-bc16-4dfc-9252-3773f7aaea5b\") " pod="openshift-ingress/router-default-54fd59887f-g5zgr" Jul 25 01:12:29.976886 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:12:29.976827 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-584dcb6b54-s5tbd" Jul 25 01:12:29.983529 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:12:29.983514 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5885fdb759-kq9tj" Jul 25 01:12:29.990045 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:12:29.990026 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-27qc8" Jul 25 01:12:29.996601 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:12:29.996583 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-6qrg6" Jul 25 01:12:30.012444 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:12:30.012420 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-d4tds" Jul 25 01:12:30.345610 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:12:30.345573 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/2a898496-0e3c-490b-94a6-0e05946b0313-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-hnxdh\" (UID: \"2a898496-0e3c-490b-94a6-0e05946b0313\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-hnxdh" Jul 25 01:12:30.345856 ip-10-0-129-35 kubenswrapper[2567]: E0725 01:12:30.345831 2567 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 25 01:12:30.345981 ip-10-0-129-35 kubenswrapper[2567]: E0725 01:12:30.345900 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2a898496-0e3c-490b-94a6-0e05946b0313-networking-console-plugin-cert podName:2a898496-0e3c-490b-94a6-0e05946b0313 nodeName:}" failed. No retries permitted until 2026-07-25 01:12:31.345882422 +0000 UTC m=+37.038976844 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/2a898496-0e3c-490b-94a6-0e05946b0313-networking-console-plugin-cert") pod "networking-console-plugin-74c9f884b7-hnxdh" (UID: "2a898496-0e3c-490b-94a6-0e05946b0313") : secret "networking-console-plugin-cert" not found Jul 25 01:12:30.446848 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:12:30.446813 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/5aed6b57-4e4c-45f2-975c-8776d87fe328-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-bp82d\" (UID: \"5aed6b57-4e4c-45f2-975c-8776d87fe328\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-bp82d" Jul 25 01:12:30.446848 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:12:30.446853 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a8cb1021-bc16-4dfc-9252-3773f7aaea5b-metrics-certs\") pod \"router-default-54fd59887f-g5zgr\" (UID: \"a8cb1021-bc16-4dfc-9252-3773f7aaea5b\") " pod="openshift-ingress/router-default-54fd59887f-g5zgr" Jul 25 01:12:30.447044 ip-10-0-129-35 kubenswrapper[2567]: E0725 01:12:30.446959 2567 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 25 01:12:30.447044 ip-10-0-129-35 kubenswrapper[2567]: E0725 01:12:30.446962 2567 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 25 01:12:30.447044 ip-10-0-129-35 kubenswrapper[2567]: E0725 01:12:30.447027 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a8cb1021-bc16-4dfc-9252-3773f7aaea5b-metrics-certs podName:a8cb1021-bc16-4dfc-9252-3773f7aaea5b nodeName:}" failed. No retries permitted until 2026-07-25 01:12:31.447008809 +0000 UTC m=+37.140103207 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a8cb1021-bc16-4dfc-9252-3773f7aaea5b-metrics-certs") pod "router-default-54fd59887f-g5zgr" (UID: "a8cb1021-bc16-4dfc-9252-3773f7aaea5b") : secret "router-metrics-certs-default" not found Jul 25 01:12:30.447185 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:12:30.447047 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/59f19017-9df8-47ee-820e-fd8e02c1178f-metrics-tls\") pod \"dns-default-29jjm\" (UID: \"59f19017-9df8-47ee-820e-fd8e02c1178f\") " pod="openshift-dns/dns-default-29jjm" Jul 25 01:12:30.447185 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:12:30.447089 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/eecc300f-3388-493d-a229-4ba749887922-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-f5tvk\" (UID: \"eecc300f-3388-493d-a229-4ba749887922\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-f5tvk" Jul 25 01:12:30.447185 ip-10-0-129-35 kubenswrapper[2567]: E0725 01:12:30.447137 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5aed6b57-4e4c-45f2-975c-8776d87fe328-samples-operator-tls podName:5aed6b57-4e4c-45f2-975c-8776d87fe328 nodeName:}" failed. No retries permitted until 2026-07-25 01:12:31.447111831 +0000 UTC m=+37.140206244 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/5aed6b57-4e4c-45f2-975c-8776d87fe328-samples-operator-tls") pod "cluster-samples-operator-6748489656-bp82d" (UID: "5aed6b57-4e4c-45f2-975c-8776d87fe328") : secret "samples-operator-tls" not found Jul 25 01:12:30.447185 ip-10-0-129-35 kubenswrapper[2567]: E0725 01:12:30.447162 2567 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 25 01:12:30.447185 ip-10-0-129-35 kubenswrapper[2567]: E0725 01:12:30.447169 2567 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 25 01:12:30.447470 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:12:30.447183 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9cb28390-ddda-4bf0-85e5-59c3702123bd-registry-tls\") pod \"image-registry-6b68768447-slrxh\" (UID: \"9cb28390-ddda-4bf0-85e5-59c3702123bd\") " pod="openshift-image-registry/image-registry-6b68768447-slrxh" Jul 25 01:12:30.447470 ip-10-0-129-35 kubenswrapper[2567]: E0725 01:12:30.447207 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/59f19017-9df8-47ee-820e-fd8e02c1178f-metrics-tls podName:59f19017-9df8-47ee-820e-fd8e02c1178f nodeName:}" failed. No retries permitted until 2026-07-25 01:12:31.447191821 +0000 UTC m=+37.140286221 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/59f19017-9df8-47ee-820e-fd8e02c1178f-metrics-tls") pod "dns-default-29jjm" (UID: "59f19017-9df8-47ee-820e-fd8e02c1178f") : secret "dns-default-metrics-tls" not found Jul 25 01:12:30.447470 ip-10-0-129-35 kubenswrapper[2567]: E0725 01:12:30.447241 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/eecc300f-3388-493d-a229-4ba749887922-cluster-monitoring-operator-tls podName:eecc300f-3388-493d-a229-4ba749887922 nodeName:}" failed. No retries permitted until 2026-07-25 01:12:31.44723011 +0000 UTC m=+37.140324515 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/eecc300f-3388-493d-a229-4ba749887922-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-548b489cb8-f5tvk" (UID: "eecc300f-3388-493d-a229-4ba749887922") : secret "cluster-monitoring-operator-tls" not found Jul 25 01:12:30.447470 ip-10-0-129-35 kubenswrapper[2567]: E0725 01:12:30.447266 2567 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 25 01:12:30.447470 ip-10-0-129-35 kubenswrapper[2567]: E0725 01:12:30.447279 2567 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6b68768447-slrxh: secret "image-registry-tls" not found Jul 25 01:12:30.447470 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:12:30.447282 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a8cb1021-bc16-4dfc-9252-3773f7aaea5b-service-ca-bundle\") pod \"router-default-54fd59887f-g5zgr\" (UID: \"a8cb1021-bc16-4dfc-9252-3773f7aaea5b\") " pod="openshift-ingress/router-default-54fd59887f-g5zgr" Jul 25 01:12:30.447470 ip-10-0-129-35 kubenswrapper[2567]: E0725 01:12:30.447318 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9cb28390-ddda-4bf0-85e5-59c3702123bd-registry-tls podName:9cb28390-ddda-4bf0-85e5-59c3702123bd nodeName:}" failed. No retries permitted until 2026-07-25 01:12:31.447305013 +0000 UTC m=+37.140399432 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/9cb28390-ddda-4bf0-85e5-59c3702123bd-registry-tls") pod "image-registry-6b68768447-slrxh" (UID: "9cb28390-ddda-4bf0-85e5-59c3702123bd") : secret "image-registry-tls" not found Jul 25 01:12:30.447470 ip-10-0-129-35 kubenswrapper[2567]: E0725 01:12:30.447362 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/a8cb1021-bc16-4dfc-9252-3773f7aaea5b-service-ca-bundle podName:a8cb1021-bc16-4dfc-9252-3773f7aaea5b nodeName:}" failed. No retries permitted until 2026-07-25 01:12:31.447349711 +0000 UTC m=+37.140444108 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/a8cb1021-bc16-4dfc-9252-3773f7aaea5b-service-ca-bundle") pod "router-default-54fd59887f-g5zgr" (UID: "a8cb1021-bc16-4dfc-9252-3773f7aaea5b") : configmap references non-existent config key: service-ca.crt Jul 25 01:12:31.251023 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:12:31.249236 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-7d88cb55d8-d4tds"] Jul 25 01:12:31.255387 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:12:31.254714 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod73053a18_b359_4bf1_b0a5_373b07d1de9f.slice/crio-d0e085cba18ff3ee956f5838b999cb6bac0a6d5b4d7c7686632112ad1516fd42 WatchSource:0}: Error finding container d0e085cba18ff3ee956f5838b999cb6bac0a6d5b4d7c7686632112ad1516fd42: Status 404 returned error can't find the container with id d0e085cba18ff3ee956f5838b999cb6bac0a6d5b4d7c7686632112ad1516fd42 Jul 25 01:12:31.282818 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:12:31.282766 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-584dcb6b54-s5tbd"] Jul 25 01:12:31.285649 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:12:31.285624 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5885fdb759-kq9tj"] Jul 25 01:12:31.288321 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:12:31.288295 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-25d96"] Jul 25 01:12:31.295510 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:12:31.295488 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d6c75f84f-5j29m"] Jul 25 01:12:31.298337 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:12:31.298314 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-27qc8"] Jul 25 01:12:31.301621 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:12:31.301600 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-6qrg6"] Jul 25 01:12:31.305863 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:12:31.305817 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode1d86a8c_ea94_4770_8136_8448f268d6d1.slice/crio-3eb26916f9904c46d6577dd221d819a5cfc165b82fc79916bbfe34a68bf75301 WatchSource:0}: Error finding container 3eb26916f9904c46d6577dd221d819a5cfc165b82fc79916bbfe34a68bf75301: Status 404 returned error can't find the container with id 3eb26916f9904c46d6577dd221d819a5cfc165b82fc79916bbfe34a68bf75301 Jul 25 01:12:31.306825 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:12:31.306800 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod76e646a1_4d05_4518_8d13_21d3fa3bbf7d.slice/crio-8f36862867a77cf5e507bceb62f08e1132b33cf2509c731baaf54200a4f16432 WatchSource:0}: Error finding container 8f36862867a77cf5e507bceb62f08e1132b33cf2509c731baaf54200a4f16432: Status 404 returned error can't find the container with id 8f36862867a77cf5e507bceb62f08e1132b33cf2509c731baaf54200a4f16432 Jul 25 01:12:31.307435 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:12:31.307415 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9a0cf75d_3421_4485_afd7_e555f06ba176.slice/crio-6a19b7b529914e4ca3a122dddb280729b6fda710cdad2a9419bff11fe2553c7d WatchSource:0}: Error finding container 6a19b7b529914e4ca3a122dddb280729b6fda710cdad2a9419bff11fe2553c7d: Status 404 returned error can't find the container with id 6a19b7b529914e4ca3a122dddb280729b6fda710cdad2a9419bff11fe2553c7d Jul 25 01:12:31.309031 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:12:31.309001 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9706e509_f401_465c_b9e3_4d7495439d6d.slice/crio-e76308c08333e0af342ade306b31ab71d9dd77033447f49bebb4dfd746cc8c7e WatchSource:0}: Error finding container e76308c08333e0af342ade306b31ab71d9dd77033447f49bebb4dfd746cc8c7e: Status 404 returned error can't find the container with id e76308c08333e0af342ade306b31ab71d9dd77033447f49bebb4dfd746cc8c7e Jul 25 01:12:31.309852 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:12:31.309831 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode456d8b2_d6d4_4b00_bc45_e046481d15bb.slice/crio-141d57e61b0feb0e82d10cce6928e7b3cae35ef6ce623115f504495941eb4f10 WatchSource:0}: Error finding container 141d57e61b0feb0e82d10cce6928e7b3cae35ef6ce623115f504495941eb4f10: Status 404 returned error can't find the container with id 141d57e61b0feb0e82d10cce6928e7b3cae35ef6ce623115f504495941eb4f10 Jul 25 01:12:31.310804 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:12:31.310785 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda9cb9aa9_8f43_4b32_a7b7_4eb9afb05c90.slice/crio-fe53f696b940c02494888d3c37594934071d3c5e139f87235cd9225af8c95809 WatchSource:0}: Error finding container fe53f696b940c02494888d3c37594934071d3c5e139f87235cd9225af8c95809: Status 404 returned error can't find the container with id fe53f696b940c02494888d3c37594934071d3c5e139f87235cd9225af8c95809 Jul 25 01:12:31.359920 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:12:31.359895 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/2a898496-0e3c-490b-94a6-0e05946b0313-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-hnxdh\" (UID: \"2a898496-0e3c-490b-94a6-0e05946b0313\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-hnxdh" Jul 25 01:12:31.360065 ip-10-0-129-35 kubenswrapper[2567]: E0725 01:12:31.360045 2567 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 25 01:12:31.360139 ip-10-0-129-35 kubenswrapper[2567]: E0725 01:12:31.360128 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2a898496-0e3c-490b-94a6-0e05946b0313-networking-console-plugin-cert podName:2a898496-0e3c-490b-94a6-0e05946b0313 nodeName:}" failed. No retries permitted until 2026-07-25 01:12:33.360103709 +0000 UTC m=+39.053198121 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/2a898496-0e3c-490b-94a6-0e05946b0313-networking-console-plugin-cert") pod "networking-console-plugin-74c9f884b7-hnxdh" (UID: "2a898496-0e3c-490b-94a6-0e05946b0313") : secret "networking-console-plugin-cert" not found Jul 25 01:12:31.460968 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:12:31.460936 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/eecc300f-3388-493d-a229-4ba749887922-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-f5tvk\" (UID: \"eecc300f-3388-493d-a229-4ba749887922\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-f5tvk" Jul 25 01:12:31.461085 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:12:31.460974 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9cb28390-ddda-4bf0-85e5-59c3702123bd-registry-tls\") pod \"image-registry-6b68768447-slrxh\" (UID: \"9cb28390-ddda-4bf0-85e5-59c3702123bd\") " pod="openshift-image-registry/image-registry-6b68768447-slrxh" Jul 25 01:12:31.461085 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:12:31.461006 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a8cb1021-bc16-4dfc-9252-3773f7aaea5b-service-ca-bundle\") pod \"router-default-54fd59887f-g5zgr\" (UID: \"a8cb1021-bc16-4dfc-9252-3773f7aaea5b\") " pod="openshift-ingress/router-default-54fd59887f-g5zgr" Jul 25 01:12:31.461085 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:12:31.461036 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/5aed6b57-4e4c-45f2-975c-8776d87fe328-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-bp82d\" (UID: \"5aed6b57-4e4c-45f2-975c-8776d87fe328\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-bp82d" Jul 25 01:12:31.461085 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:12:31.461057 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a8cb1021-bc16-4dfc-9252-3773f7aaea5b-metrics-certs\") pod \"router-default-54fd59887f-g5zgr\" (UID: \"a8cb1021-bc16-4dfc-9252-3773f7aaea5b\") " pod="openshift-ingress/router-default-54fd59887f-g5zgr" Jul 25 01:12:31.461277 ip-10-0-129-35 kubenswrapper[2567]: E0725 01:12:31.461097 2567 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 25 01:12:31.461277 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:12:31.461111 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/59f19017-9df8-47ee-820e-fd8e02c1178f-metrics-tls\") pod \"dns-default-29jjm\" (UID: \"59f19017-9df8-47ee-820e-fd8e02c1178f\") " pod="openshift-dns/dns-default-29jjm" Jul 25 01:12:31.461277 ip-10-0-129-35 kubenswrapper[2567]: E0725 01:12:31.461155 2567 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 25 01:12:31.461277 ip-10-0-129-35 kubenswrapper[2567]: E0725 01:12:31.461100 2567 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 25 01:12:31.461277 ip-10-0-129-35 kubenswrapper[2567]: E0725 01:12:31.461169 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/eecc300f-3388-493d-a229-4ba749887922-cluster-monitoring-operator-tls podName:eecc300f-3388-493d-a229-4ba749887922 nodeName:}" failed. No retries permitted until 2026-07-25 01:12:33.461150865 +0000 UTC m=+39.154245282 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/eecc300f-3388-493d-a229-4ba749887922-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-548b489cb8-f5tvk" (UID: "eecc300f-3388-493d-a229-4ba749887922") : secret "cluster-monitoring-operator-tls" not found Jul 25 01:12:31.461277 ip-10-0-129-35 kubenswrapper[2567]: E0725 01:12:31.461181 2567 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6b68768447-slrxh: secret "image-registry-tls" not found Jul 25 01:12:31.461277 ip-10-0-129-35 kubenswrapper[2567]: E0725 01:12:31.461187 2567 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 25 01:12:31.461277 ip-10-0-129-35 kubenswrapper[2567]: E0725 01:12:31.461190 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/a8cb1021-bc16-4dfc-9252-3773f7aaea5b-service-ca-bundle podName:a8cb1021-bc16-4dfc-9252-3773f7aaea5b nodeName:}" failed. No retries permitted until 2026-07-25 01:12:33.461181188 +0000 UTC m=+39.154275587 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/a8cb1021-bc16-4dfc-9252-3773f7aaea5b-service-ca-bundle") pod "router-default-54fd59887f-g5zgr" (UID: "a8cb1021-bc16-4dfc-9252-3773f7aaea5b") : configmap references non-existent config key: service-ca.crt Jul 25 01:12:31.461277 ip-10-0-129-35 kubenswrapper[2567]: E0725 01:12:31.461188 2567 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 25 01:12:31.461277 ip-10-0-129-35 kubenswrapper[2567]: E0725 01:12:31.461210 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a8cb1021-bc16-4dfc-9252-3773f7aaea5b-metrics-certs podName:a8cb1021-bc16-4dfc-9252-3773f7aaea5b nodeName:}" failed. No retries permitted until 2026-07-25 01:12:33.461200019 +0000 UTC m=+39.154294417 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a8cb1021-bc16-4dfc-9252-3773f7aaea5b-metrics-certs") pod "router-default-54fd59887f-g5zgr" (UID: "a8cb1021-bc16-4dfc-9252-3773f7aaea5b") : secret "router-metrics-certs-default" not found Jul 25 01:12:31.461277 ip-10-0-129-35 kubenswrapper[2567]: E0725 01:12:31.461226 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9cb28390-ddda-4bf0-85e5-59c3702123bd-registry-tls podName:9cb28390-ddda-4bf0-85e5-59c3702123bd nodeName:}" failed. No retries permitted until 2026-07-25 01:12:33.461218609 +0000 UTC m=+39.154313006 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/9cb28390-ddda-4bf0-85e5-59c3702123bd-registry-tls") pod "image-registry-6b68768447-slrxh" (UID: "9cb28390-ddda-4bf0-85e5-59c3702123bd") : secret "image-registry-tls" not found Jul 25 01:12:31.461277 ip-10-0-129-35 kubenswrapper[2567]: E0725 01:12:31.461237 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/59f19017-9df8-47ee-820e-fd8e02c1178f-metrics-tls podName:59f19017-9df8-47ee-820e-fd8e02c1178f nodeName:}" failed. No retries permitted until 2026-07-25 01:12:33.461232228 +0000 UTC m=+39.154326625 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/59f19017-9df8-47ee-820e-fd8e02c1178f-metrics-tls") pod "dns-default-29jjm" (UID: "59f19017-9df8-47ee-820e-fd8e02c1178f") : secret "dns-default-metrics-tls" not found Jul 25 01:12:31.461277 ip-10-0-129-35 kubenswrapper[2567]: E0725 01:12:31.461246 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5aed6b57-4e4c-45f2-975c-8776d87fe328-samples-operator-tls podName:5aed6b57-4e4c-45f2-975c-8776d87fe328 nodeName:}" failed. No retries permitted until 2026-07-25 01:12:33.461241502 +0000 UTC m=+39.154335899 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/5aed6b57-4e4c-45f2-975c-8776d87fe328-samples-operator-tls") pod "cluster-samples-operator-6748489656-bp82d" (UID: "5aed6b57-4e4c-45f2-975c-8776d87fe328") : secret "samples-operator-tls" not found Jul 25 01:12:32.073181 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:12:32.073095 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-6qrg6" event={"ID":"76e646a1-4d05-4518-8d13-21d3fa3bbf7d","Type":"ContainerStarted","Data":"8f36862867a77cf5e507bceb62f08e1132b33cf2509c731baaf54200a4f16432"} Jul 25 01:12:32.078573 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:12:32.078437 2567 generic.go:356] "Generic (PLEG): container finished" podID="799cf0dd-1f0a-455f-ac0e-d303f0360de2" containerID="535481f5b241be9143c17cc64d73b77c6c1f8aa09fd93a36107b1c88606dccd6" exitCode=0 Jul 25 01:12:32.078573 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:12:32.078521 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-llm4x" event={"ID":"799cf0dd-1f0a-455f-ac0e-d303f0360de2","Type":"ContainerDied","Data":"535481f5b241be9143c17cc64d73b77c6c1f8aa09fd93a36107b1c88606dccd6"} Jul 25 01:12:32.085303 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:12:32.084624 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-27qc8" event={"ID":"e1d86a8c-ea94-4770-8136-8448f268d6d1","Type":"ContainerStarted","Data":"3eb26916f9904c46d6577dd221d819a5cfc165b82fc79916bbfe34a68bf75301"} Jul 25 01:12:32.087261 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:12:32.087139 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5885fdb759-kq9tj" event={"ID":"e456d8b2-d6d4-4b00-bc45-e046481d15bb","Type":"ContainerStarted","Data":"141d57e61b0feb0e82d10cce6928e7b3cae35ef6ce623115f504495941eb4f10"} Jul 25 01:12:32.089649 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:12:32.089516 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-584dcb6b54-s5tbd" event={"ID":"a9cb9aa9-8f43-4b32-a7b7-4eb9afb05c90","Type":"ContainerStarted","Data":"fe53f696b940c02494888d3c37594934071d3c5e139f87235cd9225af8c95809"} Jul 25 01:12:32.093804 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:12:32.093771 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-5j29m" event={"ID":"9a0cf75d-3421-4485-afd7-e555f06ba176","Type":"ContainerStarted","Data":"6a19b7b529914e4ca3a122dddb280729b6fda710cdad2a9419bff11fe2553c7d"} Jul 25 01:12:32.099107 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:12:32.099078 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-d4tds" event={"ID":"73053a18-b359-4bf1-b0a5-373b07d1de9f","Type":"ContainerStarted","Data":"d0e085cba18ff3ee956f5838b999cb6bac0a6d5b4d7c7686632112ad1516fd42"} Jul 25 01:12:32.117190 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:12:32.117163 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-25d96" event={"ID":"9706e509-f401-465c-b9e3-4d7495439d6d","Type":"ContainerStarted","Data":"e76308c08333e0af342ade306b31ab71d9dd77033447f49bebb4dfd746cc8c7e"} Jul 25 01:12:33.127603 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:12:33.126914 2567 generic.go:356] "Generic (PLEG): container finished" podID="799cf0dd-1f0a-455f-ac0e-d303f0360de2" containerID="b4093857affbf5ff0c4402f4d6e5db708204d74eb14bbaa797b143f7a90c2931" exitCode=0 Jul 25 01:12:33.127603 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:12:33.126959 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-llm4x" event={"ID":"799cf0dd-1f0a-455f-ac0e-d303f0360de2","Type":"ContainerDied","Data":"b4093857affbf5ff0c4402f4d6e5db708204d74eb14bbaa797b143f7a90c2931"} Jul 25 01:12:33.389989 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:12:33.389901 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/2a898496-0e3c-490b-94a6-0e05946b0313-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-hnxdh\" (UID: \"2a898496-0e3c-490b-94a6-0e05946b0313\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-hnxdh" Jul 25 01:12:33.390174 ip-10-0-129-35 kubenswrapper[2567]: E0725 01:12:33.390156 2567 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 25 01:12:33.390259 ip-10-0-129-35 kubenswrapper[2567]: E0725 01:12:33.390231 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2a898496-0e3c-490b-94a6-0e05946b0313-networking-console-plugin-cert podName:2a898496-0e3c-490b-94a6-0e05946b0313 nodeName:}" failed. No retries permitted until 2026-07-25 01:12:37.390209787 +0000 UTC m=+43.083304185 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/2a898496-0e3c-490b-94a6-0e05946b0313-networking-console-plugin-cert") pod "networking-console-plugin-74c9f884b7-hnxdh" (UID: "2a898496-0e3c-490b-94a6-0e05946b0313") : secret "networking-console-plugin-cert" not found Jul 25 01:12:33.490919 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:12:33.490886 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/5aed6b57-4e4c-45f2-975c-8776d87fe328-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-bp82d\" (UID: \"5aed6b57-4e4c-45f2-975c-8776d87fe328\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-bp82d" Jul 25 01:12:33.491044 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:12:33.490945 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a8cb1021-bc16-4dfc-9252-3773f7aaea5b-metrics-certs\") pod \"router-default-54fd59887f-g5zgr\" (UID: \"a8cb1021-bc16-4dfc-9252-3773f7aaea5b\") " pod="openshift-ingress/router-default-54fd59887f-g5zgr" Jul 25 01:12:33.491104 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:12:33.491060 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/59f19017-9df8-47ee-820e-fd8e02c1178f-metrics-tls\") pod \"dns-default-29jjm\" (UID: \"59f19017-9df8-47ee-820e-fd8e02c1178f\") " pod="openshift-dns/dns-default-29jjm" Jul 25 01:12:33.491104 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:12:33.491096 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/eecc300f-3388-493d-a229-4ba749887922-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-f5tvk\" (UID: \"eecc300f-3388-493d-a229-4ba749887922\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-f5tvk" Jul 25 01:12:33.491202 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:12:33.491131 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9cb28390-ddda-4bf0-85e5-59c3702123bd-registry-tls\") pod \"image-registry-6b68768447-slrxh\" (UID: \"9cb28390-ddda-4bf0-85e5-59c3702123bd\") " pod="openshift-image-registry/image-registry-6b68768447-slrxh" Jul 25 01:12:33.491202 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:12:33.491175 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a8cb1021-bc16-4dfc-9252-3773f7aaea5b-service-ca-bundle\") pod \"router-default-54fd59887f-g5zgr\" (UID: \"a8cb1021-bc16-4dfc-9252-3773f7aaea5b\") " pod="openshift-ingress/router-default-54fd59887f-g5zgr" Jul 25 01:12:33.491348 ip-10-0-129-35 kubenswrapper[2567]: E0725 01:12:33.491320 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/a8cb1021-bc16-4dfc-9252-3773f7aaea5b-service-ca-bundle podName:a8cb1021-bc16-4dfc-9252-3773f7aaea5b nodeName:}" failed. No retries permitted until 2026-07-25 01:12:37.491301759 +0000 UTC m=+43.184396162 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/a8cb1021-bc16-4dfc-9252-3773f7aaea5b-service-ca-bundle") pod "router-default-54fd59887f-g5zgr" (UID: "a8cb1021-bc16-4dfc-9252-3773f7aaea5b") : configmap references non-existent config key: service-ca.crt Jul 25 01:12:33.491713 ip-10-0-129-35 kubenswrapper[2567]: E0725 01:12:33.491697 2567 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 25 01:12:33.491791 ip-10-0-129-35 kubenswrapper[2567]: E0725 01:12:33.491746 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5aed6b57-4e4c-45f2-975c-8776d87fe328-samples-operator-tls podName:5aed6b57-4e4c-45f2-975c-8776d87fe328 nodeName:}" failed. No retries permitted until 2026-07-25 01:12:37.491731303 +0000 UTC m=+43.184825704 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/5aed6b57-4e4c-45f2-975c-8776d87fe328-samples-operator-tls") pod "cluster-samples-operator-6748489656-bp82d" (UID: "5aed6b57-4e4c-45f2-975c-8776d87fe328") : secret "samples-operator-tls" not found Jul 25 01:12:33.491862 ip-10-0-129-35 kubenswrapper[2567]: E0725 01:12:33.491850 2567 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 25 01:12:33.491952 ip-10-0-129-35 kubenswrapper[2567]: E0725 01:12:33.491943 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a8cb1021-bc16-4dfc-9252-3773f7aaea5b-metrics-certs podName:a8cb1021-bc16-4dfc-9252-3773f7aaea5b nodeName:}" failed. No retries permitted until 2026-07-25 01:12:37.491935008 +0000 UTC m=+43.185029405 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a8cb1021-bc16-4dfc-9252-3773f7aaea5b-metrics-certs") pod "router-default-54fd59887f-g5zgr" (UID: "a8cb1021-bc16-4dfc-9252-3773f7aaea5b") : secret "router-metrics-certs-default" not found Jul 25 01:12:33.492008 ip-10-0-129-35 kubenswrapper[2567]: E0725 01:12:33.491995 2567 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 25 01:12:33.492065 ip-10-0-129-35 kubenswrapper[2567]: E0725 01:12:33.492033 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/59f19017-9df8-47ee-820e-fd8e02c1178f-metrics-tls podName:59f19017-9df8-47ee-820e-fd8e02c1178f nodeName:}" failed. No retries permitted until 2026-07-25 01:12:37.492022349 +0000 UTC m=+43.185116746 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/59f19017-9df8-47ee-820e-fd8e02c1178f-metrics-tls") pod "dns-default-29jjm" (UID: "59f19017-9df8-47ee-820e-fd8e02c1178f") : secret "dns-default-metrics-tls" not found Jul 25 01:12:33.492114 ip-10-0-129-35 kubenswrapper[2567]: E0725 01:12:33.492086 2567 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 25 01:12:33.492163 ip-10-0-129-35 kubenswrapper[2567]: E0725 01:12:33.492118 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/eecc300f-3388-493d-a229-4ba749887922-cluster-monitoring-operator-tls podName:eecc300f-3388-493d-a229-4ba749887922 nodeName:}" failed. No retries permitted until 2026-07-25 01:12:37.492108488 +0000 UTC m=+43.185202890 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/eecc300f-3388-493d-a229-4ba749887922-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-548b489cb8-f5tvk" (UID: "eecc300f-3388-493d-a229-4ba749887922") : secret "cluster-monitoring-operator-tls" not found Jul 25 01:12:33.492214 ip-10-0-129-35 kubenswrapper[2567]: E0725 01:12:33.492178 2567 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 25 01:12:33.492214 ip-10-0-129-35 kubenswrapper[2567]: E0725 01:12:33.492188 2567 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6b68768447-slrxh: secret "image-registry-tls" not found Jul 25 01:12:33.492313 ip-10-0-129-35 kubenswrapper[2567]: E0725 01:12:33.492217 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9cb28390-ddda-4bf0-85e5-59c3702123bd-registry-tls podName:9cb28390-ddda-4bf0-85e5-59c3702123bd nodeName:}" failed. No retries permitted until 2026-07-25 01:12:37.492207352 +0000 UTC m=+43.185301769 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/9cb28390-ddda-4bf0-85e5-59c3702123bd-registry-tls") pod "image-registry-6b68768447-slrxh" (UID: "9cb28390-ddda-4bf0-85e5-59c3702123bd") : secret "image-registry-tls" not found Jul 25 01:12:34.135398 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:12:34.134730 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-llm4x" event={"ID":"799cf0dd-1f0a-455f-ac0e-d303f0360de2","Type":"ContainerStarted","Data":"4f02f52fb3e191dd8e2531beff59904e2f48dc7218c72a7a176d7e9d72f5b2f7"} Jul 25 01:12:34.159466 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:12:34.159407 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-llm4x" podStartSLOduration=15.321294021 podStartE2EDuration="38.159358891s" totalImagesPullingTime="22.83806487s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-25 01:11:56 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-25 01:12:34.156964589 +0000 UTC m=+39.850059007" watchObservedRunningTime="2026-07-25 01:12:34.159358891 +0000 UTC m=+39.852453313" Jul 25 01:12:37.429618 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:12:37.429440 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/2a898496-0e3c-490b-94a6-0e05946b0313-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-hnxdh\" (UID: \"2a898496-0e3c-490b-94a6-0e05946b0313\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-hnxdh" Jul 25 01:12:37.430046 ip-10-0-129-35 kubenswrapper[2567]: E0725 01:12:37.429586 2567 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 25 01:12:37.430046 ip-10-0-129-35 kubenswrapper[2567]: E0725 01:12:37.429739 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2a898496-0e3c-490b-94a6-0e05946b0313-networking-console-plugin-cert podName:2a898496-0e3c-490b-94a6-0e05946b0313 nodeName:}" failed. No retries permitted until 2026-07-25 01:12:45.429723826 +0000 UTC m=+51.122818227 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/2a898496-0e3c-490b-94a6-0e05946b0313-networking-console-plugin-cert") pod "networking-console-plugin-74c9f884b7-hnxdh" (UID: "2a898496-0e3c-490b-94a6-0e05946b0313") : secret "networking-console-plugin-cert" not found Jul 25 01:12:37.530454 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:12:37.530430 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/59f19017-9df8-47ee-820e-fd8e02c1178f-metrics-tls\") pod \"dns-default-29jjm\" (UID: \"59f19017-9df8-47ee-820e-fd8e02c1178f\") " pod="openshift-dns/dns-default-29jjm" Jul 25 01:12:37.530587 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:12:37.530467 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/eecc300f-3388-493d-a229-4ba749887922-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-f5tvk\" (UID: \"eecc300f-3388-493d-a229-4ba749887922\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-f5tvk" Jul 25 01:12:37.530587 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:12:37.530490 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9cb28390-ddda-4bf0-85e5-59c3702123bd-registry-tls\") pod \"image-registry-6b68768447-slrxh\" (UID: \"9cb28390-ddda-4bf0-85e5-59c3702123bd\") " pod="openshift-image-registry/image-registry-6b68768447-slrxh" Jul 25 01:12:37.530656 ip-10-0-129-35 kubenswrapper[2567]: E0725 01:12:37.530585 2567 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 25 01:12:37.530656 ip-10-0-129-35 kubenswrapper[2567]: E0725 01:12:37.530589 2567 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 25 01:12:37.530656 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:12:37.530611 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a8cb1021-bc16-4dfc-9252-3773f7aaea5b-service-ca-bundle\") pod \"router-default-54fd59887f-g5zgr\" (UID: \"a8cb1021-bc16-4dfc-9252-3773f7aaea5b\") " pod="openshift-ingress/router-default-54fd59887f-g5zgr" Jul 25 01:12:37.530656 ip-10-0-129-35 kubenswrapper[2567]: E0725 01:12:37.530588 2567 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 25 01:12:37.530656 ip-10-0-129-35 kubenswrapper[2567]: E0725 01:12:37.530637 2567 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6b68768447-slrxh: secret "image-registry-tls" not found Jul 25 01:12:37.530656 ip-10-0-129-35 kubenswrapper[2567]: E0725 01:12:37.530639 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/59f19017-9df8-47ee-820e-fd8e02c1178f-metrics-tls podName:59f19017-9df8-47ee-820e-fd8e02c1178f nodeName:}" failed. No retries permitted until 2026-07-25 01:12:45.530621216 +0000 UTC m=+51.223715632 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/59f19017-9df8-47ee-820e-fd8e02c1178f-metrics-tls") pod "dns-default-29jjm" (UID: "59f19017-9df8-47ee-820e-fd8e02c1178f") : secret "dns-default-metrics-tls" not found Jul 25 01:12:37.530842 ip-10-0-129-35 kubenswrapper[2567]: E0725 01:12:37.530674 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/eecc300f-3388-493d-a229-4ba749887922-cluster-monitoring-operator-tls podName:eecc300f-3388-493d-a229-4ba749887922 nodeName:}" failed. No retries permitted until 2026-07-25 01:12:45.53066148 +0000 UTC m=+51.223755877 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/eecc300f-3388-493d-a229-4ba749887922-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-548b489cb8-f5tvk" (UID: "eecc300f-3388-493d-a229-4ba749887922") : secret "cluster-monitoring-operator-tls" not found Jul 25 01:12:37.530842 ip-10-0-129-35 kubenswrapper[2567]: E0725 01:12:37.530694 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9cb28390-ddda-4bf0-85e5-59c3702123bd-registry-tls podName:9cb28390-ddda-4bf0-85e5-59c3702123bd nodeName:}" failed. No retries permitted until 2026-07-25 01:12:45.530683869 +0000 UTC m=+51.223778268 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/9cb28390-ddda-4bf0-85e5-59c3702123bd-registry-tls") pod "image-registry-6b68768447-slrxh" (UID: "9cb28390-ddda-4bf0-85e5-59c3702123bd") : secret "image-registry-tls" not found Jul 25 01:12:37.530842 ip-10-0-129-35 kubenswrapper[2567]: E0725 01:12:37.530712 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/a8cb1021-bc16-4dfc-9252-3773f7aaea5b-service-ca-bundle podName:a8cb1021-bc16-4dfc-9252-3773f7aaea5b nodeName:}" failed. No retries permitted until 2026-07-25 01:12:45.530704282 +0000 UTC m=+51.223798686 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/a8cb1021-bc16-4dfc-9252-3773f7aaea5b-service-ca-bundle") pod "router-default-54fd59887f-g5zgr" (UID: "a8cb1021-bc16-4dfc-9252-3773f7aaea5b") : configmap references non-existent config key: service-ca.crt Jul 25 01:12:37.530842 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:12:37.530765 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/5aed6b57-4e4c-45f2-975c-8776d87fe328-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-bp82d\" (UID: \"5aed6b57-4e4c-45f2-975c-8776d87fe328\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-bp82d" Jul 25 01:12:37.530842 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:12:37.530798 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a8cb1021-bc16-4dfc-9252-3773f7aaea5b-metrics-certs\") pod \"router-default-54fd59887f-g5zgr\" (UID: \"a8cb1021-bc16-4dfc-9252-3773f7aaea5b\") " pod="openshift-ingress/router-default-54fd59887f-g5zgr" Jul 25 01:12:37.531031 ip-10-0-129-35 kubenswrapper[2567]: E0725 01:12:37.530868 2567 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 25 01:12:37.531031 ip-10-0-129-35 kubenswrapper[2567]: E0725 01:12:37.530893 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5aed6b57-4e4c-45f2-975c-8776d87fe328-samples-operator-tls podName:5aed6b57-4e4c-45f2-975c-8776d87fe328 nodeName:}" failed. No retries permitted until 2026-07-25 01:12:45.530885235 +0000 UTC m=+51.223979632 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/5aed6b57-4e4c-45f2-975c-8776d87fe328-samples-operator-tls") pod "cluster-samples-operator-6748489656-bp82d" (UID: "5aed6b57-4e4c-45f2-975c-8776d87fe328") : secret "samples-operator-tls" not found Jul 25 01:12:37.531031 ip-10-0-129-35 kubenswrapper[2567]: E0725 01:12:37.530948 2567 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 25 01:12:37.531031 ip-10-0-129-35 kubenswrapper[2567]: E0725 01:12:37.530989 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a8cb1021-bc16-4dfc-9252-3773f7aaea5b-metrics-certs podName:a8cb1021-bc16-4dfc-9252-3773f7aaea5b nodeName:}" failed. No retries permitted until 2026-07-25 01:12:45.530975525 +0000 UTC m=+51.224069924 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a8cb1021-bc16-4dfc-9252-3773f7aaea5b-metrics-certs") pod "router-default-54fd59887f-g5zgr" (UID: "a8cb1021-bc16-4dfc-9252-3773f7aaea5b") : secret "router-metrics-certs-default" not found Jul 25 01:12:40.152818 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:12:40.152782 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-6qrg6" event={"ID":"76e646a1-4d05-4518-8d13-21d3fa3bbf7d","Type":"ContainerStarted","Data":"2ac678968e33455d11aba670f4364d08c0c227e3f18bca07e7b2301294b48870"} Jul 25 01:12:40.154665 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:12:40.154638 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-27qc8" event={"ID":"e1d86a8c-ea94-4770-8136-8448f268d6d1","Type":"ContainerStarted","Data":"b904fc172b160b33504cdbdddc4779a3c9ef45fd60001d8c131d8962ad901e7f"} Jul 25 01:12:40.156640 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:12:40.156262 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5885fdb759-kq9tj" event={"ID":"e456d8b2-d6d4-4b00-bc45-e046481d15bb","Type":"ContainerStarted","Data":"a06734b8f62a582d4f7e3b1eafead312ef164a74abbc86d27755d95686935b08"} Jul 25 01:12:40.158316 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:12:40.158294 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-s5tbd_a9cb9aa9-8f43-4b32-a7b7-4eb9afb05c90/console-operator/0.log" Jul 25 01:12:40.158449 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:12:40.158337 2567 generic.go:356] "Generic (PLEG): container finished" podID="a9cb9aa9-8f43-4b32-a7b7-4eb9afb05c90" containerID="a4b1d2ca43b6c5f00879f38c7cff8499f658ae64a12ce09a472b1c8d5a19dd88" exitCode=255 Jul 25 01:12:40.158449 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:12:40.158415 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-584dcb6b54-s5tbd" event={"ID":"a9cb9aa9-8f43-4b32-a7b7-4eb9afb05c90","Type":"ContainerDied","Data":"a4b1d2ca43b6c5f00879f38c7cff8499f658ae64a12ce09a472b1c8d5a19dd88"} Jul 25 01:12:40.158915 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:12:40.158900 2567 scope.go:117] "RemoveContainer" containerID="a4b1d2ca43b6c5f00879f38c7cff8499f658ae64a12ce09a472b1c8d5a19dd88" Jul 25 01:12:40.160979 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:12:40.160957 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-5j29m" event={"ID":"9a0cf75d-3421-4485-afd7-e555f06ba176","Type":"ContainerStarted","Data":"d95c4100d32e47b290d04325914f0165129c3668f04f171923386eda02d36f05"} Jul 25 01:12:40.162919 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:12:40.162896 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-d4tds" event={"ID":"73053a18-b359-4bf1-b0a5-373b07d1de9f","Type":"ContainerStarted","Data":"f952792309d07a0961c967b4652ce63ea38c8ddce9f2ecfadc2d164f47cd9ead"} Jul 25 01:12:40.164680 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:12:40.164659 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-25d96" event={"ID":"9706e509-f401-465c-b9e3-4d7495439d6d","Type":"ContainerStarted","Data":"b355a46503ac1e1481b9197d9fcc89dd6ada6f18ffae860f87e550e434519b19"} Jul 25 01:12:40.170512 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:12:40.170467 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-6qrg6" podStartSLOduration=3.430348957 podStartE2EDuration="11.170449396s" totalImagesPullingTime="7.740100439s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-25 01:12:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-25 01:12:40.168700632 +0000 UTC m=+45.861795052" watchObservedRunningTime="2026-07-25 01:12:40.170449396 +0000 UTC m=+45.863543816" Jul 25 01:12:40.224111 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:12:40.224053 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-25d96" podStartSLOduration=18.535760884 podStartE2EDuration="26.224032121s" totalImagesPullingTime="7.688271237s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-25 01:12:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-25 01:12:40.223667192 +0000 UTC m=+45.916761609" watchObservedRunningTime="2026-07-25 01:12:40.224032121 +0000 UTC m=+45.917126558" Jul 25 01:12:40.225208 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:12:40.225164 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-5885fdb759-kq9tj" podStartSLOduration=18.493490744 podStartE2EDuration="26.22515348s" totalImagesPullingTime="7.731662736s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-25 01:12:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-25 01:12:40.20626794 +0000 UTC m=+45.899362361" watchObservedRunningTime="2026-07-25 01:12:40.22515348 +0000 UTC m=+45.918247899" Jul 25 01:12:40.240969 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:12:40.240929 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-5j29m" podStartSLOduration=18.507791969 podStartE2EDuration="26.240911645s" totalImagesPullingTime="7.733119676s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-25 01:12:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-25 01:12:40.240096041 +0000 UTC m=+45.933190460" watchObservedRunningTime="2026-07-25 01:12:40.240911645 +0000 UTC m=+45.934006063" Jul 25 01:12:40.289284 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:12:40.289054 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-27qc8" podStartSLOduration=18.55363823 podStartE2EDuration="26.289034184s" totalImagesPullingTime="7.735395954s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-25 01:12:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-25 01:12:40.26140029 +0000 UTC m=+45.954494714" watchObservedRunningTime="2026-07-25 01:12:40.289034184 +0000 UTC m=+45.982128607" Jul 25 01:12:41.170354 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:12:41.170325 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-s5tbd_a9cb9aa9-8f43-4b32-a7b7-4eb9afb05c90/console-operator/1.log" Jul 25 01:12:41.170888 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:12:41.170871 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-s5tbd_a9cb9aa9-8f43-4b32-a7b7-4eb9afb05c90/console-operator/0.log" Jul 25 01:12:41.170936 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:12:41.170909 2567 generic.go:356] "Generic (PLEG): container finished" podID="a9cb9aa9-8f43-4b32-a7b7-4eb9afb05c90" containerID="ae04baae1362c8431a835cd18e41be4b5ee53c02bb043d00ba9761f86f6378cf" exitCode=255 Jul 25 01:12:41.171042 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:12:41.171015 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-584dcb6b54-s5tbd" event={"ID":"a9cb9aa9-8f43-4b32-a7b7-4eb9afb05c90","Type":"ContainerDied","Data":"ae04baae1362c8431a835cd18e41be4b5ee53c02bb043d00ba9761f86f6378cf"} Jul 25 01:12:41.171125 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:12:41.171115 2567 scope.go:117] "RemoveContainer" containerID="a4b1d2ca43b6c5f00879f38c7cff8499f658ae64a12ce09a472b1c8d5a19dd88" Jul 25 01:12:41.171223 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:12:41.171205 2567 scope.go:117] "RemoveContainer" containerID="ae04baae1362c8431a835cd18e41be4b5ee53c02bb043d00ba9761f86f6378cf" Jul 25 01:12:41.171447 ip-10-0-129-35 kubenswrapper[2567]: E0725 01:12:41.171413 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-584dcb6b54-s5tbd_openshift-console-operator(a9cb9aa9-8f43-4b32-a7b7-4eb9afb05c90)\"" pod="openshift-console-operator/console-operator-584dcb6b54-s5tbd" podUID="a9cb9aa9-8f43-4b32-a7b7-4eb9afb05c90" Jul 25 01:12:41.188835 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:12:41.186881 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-d4tds" podStartSLOduration=19.094588716 podStartE2EDuration="27.18686324s" totalImagesPullingTime="8.092274524s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-25 01:12:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-25 01:12:40.288924236 +0000 UTC m=+45.982018650" watchObservedRunningTime="2026-07-25 01:12:41.18686324 +0000 UTC m=+46.879957661" Jul 25 01:12:41.188835 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:12:41.188451 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-hbxst"] Jul 25 01:12:41.201608 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:12:41.201583 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-hbxst" Jul 25 01:12:41.202123 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:12:41.202039 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-hbxst"] Jul 25 01:12:41.204589 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:12:41.204154 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 25 01:12:41.204589 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:12:41.204202 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-mmjlg\"" Jul 25 01:12:41.205725 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:12:41.205703 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 25 01:12:41.263630 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:12:41.263605 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/b3afa3df-a0d8-4cd2-822c-d53a8b33ceaa-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-hbxst\" (UID: \"b3afa3df-a0d8-4cd2-822c-d53a8b33ceaa\") " pod="openshift-insights/insights-runtime-extractor-hbxst" Jul 25 01:12:41.264042 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:12:41.264009 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/b3afa3df-a0d8-4cd2-822c-d53a8b33ceaa-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-hbxst\" (UID: \"b3afa3df-a0d8-4cd2-822c-d53a8b33ceaa\") " pod="openshift-insights/insights-runtime-extractor-hbxst" Jul 25 01:12:41.264164 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:12:41.264055 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/b3afa3df-a0d8-4cd2-822c-d53a8b33ceaa-data-volume\") pod \"insights-runtime-extractor-hbxst\" (UID: \"b3afa3df-a0d8-4cd2-822c-d53a8b33ceaa\") " pod="openshift-insights/insights-runtime-extractor-hbxst" Jul 25 01:12:41.264515 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:12:41.264492 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rvbzv\" (UniqueName: \"kubernetes.io/projected/b3afa3df-a0d8-4cd2-822c-d53a8b33ceaa-kube-api-access-rvbzv\") pod \"insights-runtime-extractor-hbxst\" (UID: \"b3afa3df-a0d8-4cd2-822c-d53a8b33ceaa\") " pod="openshift-insights/insights-runtime-extractor-hbxst" Jul 25 01:12:41.264629 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:12:41.264546 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/b3afa3df-a0d8-4cd2-822c-d53a8b33ceaa-crio-socket\") pod \"insights-runtime-extractor-hbxst\" (UID: \"b3afa3df-a0d8-4cd2-822c-d53a8b33ceaa\") " pod="openshift-insights/insights-runtime-extractor-hbxst" Jul 25 01:12:41.365143 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:12:41.365112 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/b3afa3df-a0d8-4cd2-822c-d53a8b33ceaa-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-hbxst\" (UID: \"b3afa3df-a0d8-4cd2-822c-d53a8b33ceaa\") " pod="openshift-insights/insights-runtime-extractor-hbxst" Jul 25 01:12:41.365143 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:12:41.365143 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/b3afa3df-a0d8-4cd2-822c-d53a8b33ceaa-data-volume\") pod \"insights-runtime-extractor-hbxst\" (UID: \"b3afa3df-a0d8-4cd2-822c-d53a8b33ceaa\") " pod="openshift-insights/insights-runtime-extractor-hbxst" Jul 25 01:12:41.365331 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:12:41.365191 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rvbzv\" (UniqueName: \"kubernetes.io/projected/b3afa3df-a0d8-4cd2-822c-d53a8b33ceaa-kube-api-access-rvbzv\") pod \"insights-runtime-extractor-hbxst\" (UID: \"b3afa3df-a0d8-4cd2-822c-d53a8b33ceaa\") " pod="openshift-insights/insights-runtime-extractor-hbxst" Jul 25 01:12:41.365331 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:12:41.365215 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/b3afa3df-a0d8-4cd2-822c-d53a8b33ceaa-crio-socket\") pod \"insights-runtime-extractor-hbxst\" (UID: \"b3afa3df-a0d8-4cd2-822c-d53a8b33ceaa\") " pod="openshift-insights/insights-runtime-extractor-hbxst" Jul 25 01:12:41.365331 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:12:41.365234 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/b3afa3df-a0d8-4cd2-822c-d53a8b33ceaa-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-hbxst\" (UID: \"b3afa3df-a0d8-4cd2-822c-d53a8b33ceaa\") " pod="openshift-insights/insights-runtime-extractor-hbxst" Jul 25 01:12:41.365331 ip-10-0-129-35 kubenswrapper[2567]: E0725 01:12:41.365254 2567 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 25 01:12:41.365331 ip-10-0-129-35 kubenswrapper[2567]: E0725 01:12:41.365329 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b3afa3df-a0d8-4cd2-822c-d53a8b33ceaa-insights-runtime-extractor-tls podName:b3afa3df-a0d8-4cd2-822c-d53a8b33ceaa nodeName:}" failed. No retries permitted until 2026-07-25 01:12:41.865311661 +0000 UTC m=+47.558406063 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/b3afa3df-a0d8-4cd2-822c-d53a8b33ceaa-insights-runtime-extractor-tls") pod "insights-runtime-extractor-hbxst" (UID: "b3afa3df-a0d8-4cd2-822c-d53a8b33ceaa") : secret "insights-runtime-extractor-tls" not found Jul 25 01:12:41.365616 ip-10-0-129-35 kubenswrapper[2567]: E0725 01:12:41.365413 2567 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 25 01:12:41.365616 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:12:41.365432 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/b3afa3df-a0d8-4cd2-822c-d53a8b33ceaa-crio-socket\") pod \"insights-runtime-extractor-hbxst\" (UID: \"b3afa3df-a0d8-4cd2-822c-d53a8b33ceaa\") " pod="openshift-insights/insights-runtime-extractor-hbxst" Jul 25 01:12:41.365616 ip-10-0-129-35 kubenswrapper[2567]: E0725 01:12:41.365477 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/b3afa3df-a0d8-4cd2-822c-d53a8b33ceaa-kube-rbac-proxy-cm podName:b3afa3df-a0d8-4cd2-822c-d53a8b33ceaa nodeName:}" failed. No retries permitted until 2026-07-25 01:12:41.865461538 +0000 UTC m=+47.558555949 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/b3afa3df-a0d8-4cd2-822c-d53a8b33ceaa-kube-rbac-proxy-cm") pod "insights-runtime-extractor-hbxst" (UID: "b3afa3df-a0d8-4cd2-822c-d53a8b33ceaa") : configmap "kube-rbac-proxy" not found Jul 25 01:12:41.365616 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:12:41.365551 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/b3afa3df-a0d8-4cd2-822c-d53a8b33ceaa-data-volume\") pod \"insights-runtime-extractor-hbxst\" (UID: \"b3afa3df-a0d8-4cd2-822c-d53a8b33ceaa\") " pod="openshift-insights/insights-runtime-extractor-hbxst" Jul 25 01:12:41.375505 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:12:41.375482 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rvbzv\" (UniqueName: \"kubernetes.io/projected/b3afa3df-a0d8-4cd2-822c-d53a8b33ceaa-kube-api-access-rvbzv\") pod \"insights-runtime-extractor-hbxst\" (UID: \"b3afa3df-a0d8-4cd2-822c-d53a8b33ceaa\") " pod="openshift-insights/insights-runtime-extractor-hbxst" Jul 25 01:12:41.868394 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:12:41.868350 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/b3afa3df-a0d8-4cd2-822c-d53a8b33ceaa-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-hbxst\" (UID: \"b3afa3df-a0d8-4cd2-822c-d53a8b33ceaa\") " pod="openshift-insights/insights-runtime-extractor-hbxst" Jul 25 01:12:41.868578 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:12:41.868446 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/b3afa3df-a0d8-4cd2-822c-d53a8b33ceaa-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-hbxst\" (UID: \"b3afa3df-a0d8-4cd2-822c-d53a8b33ceaa\") " pod="openshift-insights/insights-runtime-extractor-hbxst" Jul 25 01:12:41.868578 ip-10-0-129-35 kubenswrapper[2567]: E0725 01:12:41.868506 2567 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 25 01:12:41.868578 ip-10-0-129-35 kubenswrapper[2567]: E0725 01:12:41.868513 2567 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 25 01:12:41.868578 ip-10-0-129-35 kubenswrapper[2567]: E0725 01:12:41.868564 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/b3afa3df-a0d8-4cd2-822c-d53a8b33ceaa-kube-rbac-proxy-cm podName:b3afa3df-a0d8-4cd2-822c-d53a8b33ceaa nodeName:}" failed. No retries permitted until 2026-07-25 01:12:42.868550049 +0000 UTC m=+48.561644446 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/b3afa3df-a0d8-4cd2-822c-d53a8b33ceaa-kube-rbac-proxy-cm") pod "insights-runtime-extractor-hbxst" (UID: "b3afa3df-a0d8-4cd2-822c-d53a8b33ceaa") : configmap "kube-rbac-proxy" not found Jul 25 01:12:41.868749 ip-10-0-129-35 kubenswrapper[2567]: E0725 01:12:41.868615 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b3afa3df-a0d8-4cd2-822c-d53a8b33ceaa-insights-runtime-extractor-tls podName:b3afa3df-a0d8-4cd2-822c-d53a8b33ceaa nodeName:}" failed. No retries permitted until 2026-07-25 01:12:42.868598299 +0000 UTC m=+48.561692719 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/b3afa3df-a0d8-4cd2-822c-d53a8b33ceaa-insights-runtime-extractor-tls") pod "insights-runtime-extractor-hbxst" (UID: "b3afa3df-a0d8-4cd2-822c-d53a8b33ceaa") : secret "insights-runtime-extractor-tls" not found Jul 25 01:12:42.174978 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:12:42.174904 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-s5tbd_a9cb9aa9-8f43-4b32-a7b7-4eb9afb05c90/console-operator/1.log" Jul 25 01:12:42.175333 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:12:42.175223 2567 scope.go:117] "RemoveContainer" containerID="ae04baae1362c8431a835cd18e41be4b5ee53c02bb043d00ba9761f86f6378cf" Jul 25 01:12:42.175400 ip-10-0-129-35 kubenswrapper[2567]: E0725 01:12:42.175362 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-584dcb6b54-s5tbd_openshift-console-operator(a9cb9aa9-8f43-4b32-a7b7-4eb9afb05c90)\"" pod="openshift-console-operator/console-operator-584dcb6b54-s5tbd" podUID="a9cb9aa9-8f43-4b32-a7b7-4eb9afb05c90" Jul 25 01:12:42.876311 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:12:42.876281 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/b3afa3df-a0d8-4cd2-822c-d53a8b33ceaa-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-hbxst\" (UID: \"b3afa3df-a0d8-4cd2-822c-d53a8b33ceaa\") " pod="openshift-insights/insights-runtime-extractor-hbxst" Jul 25 01:12:42.876497 ip-10-0-129-35 kubenswrapper[2567]: E0725 01:12:42.876426 2567 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 25 01:12:42.876497 ip-10-0-129-35 kubenswrapper[2567]: E0725 01:12:42.876484 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/b3afa3df-a0d8-4cd2-822c-d53a8b33ceaa-kube-rbac-proxy-cm podName:b3afa3df-a0d8-4cd2-822c-d53a8b33ceaa nodeName:}" failed. No retries permitted until 2026-07-25 01:12:44.876467611 +0000 UTC m=+50.569562010 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/b3afa3df-a0d8-4cd2-822c-d53a8b33ceaa-kube-rbac-proxy-cm") pod "insights-runtime-extractor-hbxst" (UID: "b3afa3df-a0d8-4cd2-822c-d53a8b33ceaa") : configmap "kube-rbac-proxy" not found Jul 25 01:12:42.876497 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:12:42.876425 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/b3afa3df-a0d8-4cd2-822c-d53a8b33ceaa-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-hbxst\" (UID: \"b3afa3df-a0d8-4cd2-822c-d53a8b33ceaa\") " pod="openshift-insights/insights-runtime-extractor-hbxst" Jul 25 01:12:42.876497 ip-10-0-129-35 kubenswrapper[2567]: E0725 01:12:42.876497 2567 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 25 01:12:42.876647 ip-10-0-129-35 kubenswrapper[2567]: E0725 01:12:42.876532 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b3afa3df-a0d8-4cd2-822c-d53a8b33ceaa-insights-runtime-extractor-tls podName:b3afa3df-a0d8-4cd2-822c-d53a8b33ceaa nodeName:}" failed. No retries permitted until 2026-07-25 01:12:44.876521468 +0000 UTC m=+50.569615866 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/b3afa3df-a0d8-4cd2-822c-d53a8b33ceaa-insights-runtime-extractor-tls") pod "insights-runtime-extractor-hbxst" (UID: "b3afa3df-a0d8-4cd2-822c-d53a8b33ceaa") : secret "insights-runtime-extractor-tls" not found Jul 25 01:12:43.800263 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:12:43.800228 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-8cd2m_9ea66485-c377-4229-b4df-c91ec571cca5/dns-node-resolver/0.log" Jul 25 01:12:44.800091 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:12:44.800066 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-c42rd_4a3b7c62-05b6-4e7f-9c84-249de675af87/node-ca/0.log" Jul 25 01:12:44.892268 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:12:44.892239 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/b3afa3df-a0d8-4cd2-822c-d53a8b33ceaa-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-hbxst\" (UID: \"b3afa3df-a0d8-4cd2-822c-d53a8b33ceaa\") " pod="openshift-insights/insights-runtime-extractor-hbxst" Jul 25 01:12:44.892636 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:12:44.892334 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/b3afa3df-a0d8-4cd2-822c-d53a8b33ceaa-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-hbxst\" (UID: \"b3afa3df-a0d8-4cd2-822c-d53a8b33ceaa\") " pod="openshift-insights/insights-runtime-extractor-hbxst" Jul 25 01:12:44.892636 ip-10-0-129-35 kubenswrapper[2567]: E0725 01:12:44.892364 2567 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 25 01:12:44.892636 ip-10-0-129-35 kubenswrapper[2567]: E0725 01:12:44.892444 2567 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 25 01:12:44.892636 ip-10-0-129-35 kubenswrapper[2567]: E0725 01:12:44.892445 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/b3afa3df-a0d8-4cd2-822c-d53a8b33ceaa-kube-rbac-proxy-cm podName:b3afa3df-a0d8-4cd2-822c-d53a8b33ceaa nodeName:}" failed. No retries permitted until 2026-07-25 01:12:48.892428186 +0000 UTC m=+54.585522590 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/b3afa3df-a0d8-4cd2-822c-d53a8b33ceaa-kube-rbac-proxy-cm") pod "insights-runtime-extractor-hbxst" (UID: "b3afa3df-a0d8-4cd2-822c-d53a8b33ceaa") : configmap "kube-rbac-proxy" not found Jul 25 01:12:44.892636 ip-10-0-129-35 kubenswrapper[2567]: E0725 01:12:44.892492 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b3afa3df-a0d8-4cd2-822c-d53a8b33ceaa-insights-runtime-extractor-tls podName:b3afa3df-a0d8-4cd2-822c-d53a8b33ceaa nodeName:}" failed. No retries permitted until 2026-07-25 01:12:48.892480734 +0000 UTC m=+54.585575130 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/b3afa3df-a0d8-4cd2-822c-d53a8b33ceaa-insights-runtime-extractor-tls") pod "insights-runtime-extractor-hbxst" (UID: "b3afa3df-a0d8-4cd2-822c-d53a8b33ceaa") : secret "insights-runtime-extractor-tls" not found Jul 25 01:12:45.497882 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:12:45.497847 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/2a898496-0e3c-490b-94a6-0e05946b0313-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-hnxdh\" (UID: \"2a898496-0e3c-490b-94a6-0e05946b0313\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-hnxdh" Jul 25 01:12:45.498053 ip-10-0-129-35 kubenswrapper[2567]: E0725 01:12:45.497996 2567 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 25 01:12:45.498093 ip-10-0-129-35 kubenswrapper[2567]: E0725 01:12:45.498060 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2a898496-0e3c-490b-94a6-0e05946b0313-networking-console-plugin-cert podName:2a898496-0e3c-490b-94a6-0e05946b0313 nodeName:}" failed. No retries permitted until 2026-07-25 01:13:01.498045111 +0000 UTC m=+67.191139508 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/2a898496-0e3c-490b-94a6-0e05946b0313-networking-console-plugin-cert") pod "networking-console-plugin-74c9f884b7-hnxdh" (UID: "2a898496-0e3c-490b-94a6-0e05946b0313") : secret "networking-console-plugin-cert" not found Jul 25 01:12:45.598590 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:12:45.598561 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a8cb1021-bc16-4dfc-9252-3773f7aaea5b-metrics-certs\") pod \"router-default-54fd59887f-g5zgr\" (UID: \"a8cb1021-bc16-4dfc-9252-3773f7aaea5b\") " pod="openshift-ingress/router-default-54fd59887f-g5zgr" Jul 25 01:12:45.598726 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:12:45.598629 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/59f19017-9df8-47ee-820e-fd8e02c1178f-metrics-tls\") pod \"dns-default-29jjm\" (UID: \"59f19017-9df8-47ee-820e-fd8e02c1178f\") " pod="openshift-dns/dns-default-29jjm" Jul 25 01:12:45.598726 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:12:45.598654 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/eecc300f-3388-493d-a229-4ba749887922-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-f5tvk\" (UID: \"eecc300f-3388-493d-a229-4ba749887922\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-f5tvk" Jul 25 01:12:45.598726 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:12:45.598678 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9cb28390-ddda-4bf0-85e5-59c3702123bd-registry-tls\") pod \"image-registry-6b68768447-slrxh\" (UID: \"9cb28390-ddda-4bf0-85e5-59c3702123bd\") " pod="openshift-image-registry/image-registry-6b68768447-slrxh" Jul 25 01:12:45.598726 ip-10-0-129-35 kubenswrapper[2567]: E0725 01:12:45.598700 2567 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 25 01:12:45.598931 ip-10-0-129-35 kubenswrapper[2567]: E0725 01:12:45.598756 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a8cb1021-bc16-4dfc-9252-3773f7aaea5b-metrics-certs podName:a8cb1021-bc16-4dfc-9252-3773f7aaea5b nodeName:}" failed. No retries permitted until 2026-07-25 01:13:01.598739433 +0000 UTC m=+67.291833831 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a8cb1021-bc16-4dfc-9252-3773f7aaea5b-metrics-certs") pod "router-default-54fd59887f-g5zgr" (UID: "a8cb1021-bc16-4dfc-9252-3773f7aaea5b") : secret "router-metrics-certs-default" not found Jul 25 01:12:45.598931 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:12:45.598705 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a8cb1021-bc16-4dfc-9252-3773f7aaea5b-service-ca-bundle\") pod \"router-default-54fd59887f-g5zgr\" (UID: \"a8cb1021-bc16-4dfc-9252-3773f7aaea5b\") " pod="openshift-ingress/router-default-54fd59887f-g5zgr" Jul 25 01:12:45.598931 ip-10-0-129-35 kubenswrapper[2567]: E0725 01:12:45.598797 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/a8cb1021-bc16-4dfc-9252-3773f7aaea5b-service-ca-bundle podName:a8cb1021-bc16-4dfc-9252-3773f7aaea5b nodeName:}" failed. No retries permitted until 2026-07-25 01:13:01.598783454 +0000 UTC m=+67.291877865 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/a8cb1021-bc16-4dfc-9252-3773f7aaea5b-service-ca-bundle") pod "router-default-54fd59887f-g5zgr" (UID: "a8cb1021-bc16-4dfc-9252-3773f7aaea5b") : configmap references non-existent config key: service-ca.crt Jul 25 01:12:45.598931 ip-10-0-129-35 kubenswrapper[2567]: E0725 01:12:45.598797 2567 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 25 01:12:45.598931 ip-10-0-129-35 kubenswrapper[2567]: E0725 01:12:45.598811 2567 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 25 01:12:45.598931 ip-10-0-129-35 kubenswrapper[2567]: E0725 01:12:45.598814 2567 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 25 01:12:45.598931 ip-10-0-129-35 kubenswrapper[2567]: E0725 01:12:45.598835 2567 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6b68768447-slrxh: secret "image-registry-tls" not found Jul 25 01:12:45.598931 ip-10-0-129-35 kubenswrapper[2567]: E0725 01:12:45.598854 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/eecc300f-3388-493d-a229-4ba749887922-cluster-monitoring-operator-tls podName:eecc300f-3388-493d-a229-4ba749887922 nodeName:}" failed. No retries permitted until 2026-07-25 01:13:01.598839642 +0000 UTC m=+67.291934052 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/eecc300f-3388-493d-a229-4ba749887922-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-548b489cb8-f5tvk" (UID: "eecc300f-3388-493d-a229-4ba749887922") : secret "cluster-monitoring-operator-tls" not found Jul 25 01:12:45.598931 ip-10-0-129-35 kubenswrapper[2567]: E0725 01:12:45.598884 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9cb28390-ddda-4bf0-85e5-59c3702123bd-registry-tls podName:9cb28390-ddda-4bf0-85e5-59c3702123bd nodeName:}" failed. No retries permitted until 2026-07-25 01:13:01.598869441 +0000 UTC m=+67.291963843 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/9cb28390-ddda-4bf0-85e5-59c3702123bd-registry-tls") pod "image-registry-6b68768447-slrxh" (UID: "9cb28390-ddda-4bf0-85e5-59c3702123bd") : secret "image-registry-tls" not found Jul 25 01:12:45.598931 ip-10-0-129-35 kubenswrapper[2567]: E0725 01:12:45.598902 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/59f19017-9df8-47ee-820e-fd8e02c1178f-metrics-tls podName:59f19017-9df8-47ee-820e-fd8e02c1178f nodeName:}" failed. No retries permitted until 2026-07-25 01:13:01.598893936 +0000 UTC m=+67.291988332 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/59f19017-9df8-47ee-820e-fd8e02c1178f-metrics-tls") pod "dns-default-29jjm" (UID: "59f19017-9df8-47ee-820e-fd8e02c1178f") : secret "dns-default-metrics-tls" not found Jul 25 01:12:45.599248 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:12:45.598951 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/5aed6b57-4e4c-45f2-975c-8776d87fe328-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-bp82d\" (UID: \"5aed6b57-4e4c-45f2-975c-8776d87fe328\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-bp82d" Jul 25 01:12:45.599248 ip-10-0-129-35 kubenswrapper[2567]: E0725 01:12:45.599038 2567 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 25 01:12:45.599248 ip-10-0-129-35 kubenswrapper[2567]: E0725 01:12:45.599066 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5aed6b57-4e4c-45f2-975c-8776d87fe328-samples-operator-tls podName:5aed6b57-4e4c-45f2-975c-8776d87fe328 nodeName:}" failed. No retries permitted until 2026-07-25 01:13:01.599058448 +0000 UTC m=+67.292152844 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/5aed6b57-4e4c-45f2-975c-8776d87fe328-samples-operator-tls") pod "cluster-samples-operator-6748489656-bp82d" (UID: "5aed6b57-4e4c-45f2-975c-8776d87fe328") : secret "samples-operator-tls" not found Jul 25 01:12:45.599985 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:12:45.599955 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-6qrg6_76e646a1-4d05-4518-8d13-21d3fa3bbf7d/serve-healthcheck-canary/0.log" Jul 25 01:12:46.618931 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:12:46.618900 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-6f4d6fb6bc-27qc8_e1d86a8c-ea94-4770-8136-8448f268d6d1/kube-storage-version-migrator-operator/0.log" Jul 25 01:12:48.925667 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:12:48.925629 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/b3afa3df-a0d8-4cd2-822c-d53a8b33ceaa-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-hbxst\" (UID: \"b3afa3df-a0d8-4cd2-822c-d53a8b33ceaa\") " pod="openshift-insights/insights-runtime-extractor-hbxst" Jul 25 01:12:48.926135 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:12:48.925726 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/b3afa3df-a0d8-4cd2-822c-d53a8b33ceaa-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-hbxst\" (UID: \"b3afa3df-a0d8-4cd2-822c-d53a8b33ceaa\") " pod="openshift-insights/insights-runtime-extractor-hbxst" Jul 25 01:12:48.926135 ip-10-0-129-35 kubenswrapper[2567]: E0725 01:12:48.925774 2567 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 25 01:12:48.926135 ip-10-0-129-35 kubenswrapper[2567]: E0725 01:12:48.925836 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b3afa3df-a0d8-4cd2-822c-d53a8b33ceaa-insights-runtime-extractor-tls podName:b3afa3df-a0d8-4cd2-822c-d53a8b33ceaa nodeName:}" failed. No retries permitted until 2026-07-25 01:12:56.925821873 +0000 UTC m=+62.618916270 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/b3afa3df-a0d8-4cd2-822c-d53a8b33ceaa-insights-runtime-extractor-tls") pod "insights-runtime-extractor-hbxst" (UID: "b3afa3df-a0d8-4cd2-822c-d53a8b33ceaa") : secret "insights-runtime-extractor-tls" not found Jul 25 01:12:48.926280 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:12:48.926261 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/b3afa3df-a0d8-4cd2-822c-d53a8b33ceaa-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-hbxst\" (UID: \"b3afa3df-a0d8-4cd2-822c-d53a8b33ceaa\") " pod="openshift-insights/insights-runtime-extractor-hbxst" Jul 25 01:12:49.977288 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:12:49.977255 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-584dcb6b54-s5tbd" Jul 25 01:12:49.977685 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:12:49.977313 2567 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-584dcb6b54-s5tbd" Jul 25 01:12:49.977685 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:12:49.977663 2567 scope.go:117] "RemoveContainer" containerID="ae04baae1362c8431a835cd18e41be4b5ee53c02bb043d00ba9761f86f6378cf" Jul 25 01:12:49.977828 ip-10-0-129-35 kubenswrapper[2567]: E0725 01:12:49.977807 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-584dcb6b54-s5tbd_openshift-console-operator(a9cb9aa9-8f43-4b32-a7b7-4eb9afb05c90)\"" pod="openshift-console-operator/console-operator-584dcb6b54-s5tbd" podUID="a9cb9aa9-8f43-4b32-a7b7-4eb9afb05c90" Jul 25 01:12:55.058420 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:12:55.058395 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-8hgk8" Jul 25 01:12:56.996920 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:12:56.996879 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/b3afa3df-a0d8-4cd2-822c-d53a8b33ceaa-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-hbxst\" (UID: \"b3afa3df-a0d8-4cd2-822c-d53a8b33ceaa\") " pod="openshift-insights/insights-runtime-extractor-hbxst" Jul 25 01:12:56.999213 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:12:56.999195 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/b3afa3df-a0d8-4cd2-822c-d53a8b33ceaa-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-hbxst\" (UID: \"b3afa3df-a0d8-4cd2-822c-d53a8b33ceaa\") " pod="openshift-insights/insights-runtime-extractor-hbxst" Jul 25 01:12:57.115358 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:12:57.115329 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-mmjlg\"" Jul 25 01:12:57.123318 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:12:57.123297 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-hbxst" Jul 25 01:12:57.245105 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:12:57.244999 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-hbxst"] Jul 25 01:12:57.247546 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:12:57.247491 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb3afa3df_a0d8_4cd2_822c_d53a8b33ceaa.slice/crio-7844ddecdcd62fec5dae31d7c4cae1bc4d4388f2f66839e9e438924653103e14 WatchSource:0}: Error finding container 7844ddecdcd62fec5dae31d7c4cae1bc4d4388f2f66839e9e438924653103e14: Status 404 returned error can't find the container with id 7844ddecdcd62fec5dae31d7c4cae1bc4d4388f2f66839e9e438924653103e14 Jul 25 01:12:58.227624 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:12:58.227591 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-hbxst" event={"ID":"b3afa3df-a0d8-4cd2-822c-d53a8b33ceaa","Type":"ContainerStarted","Data":"7844ddecdcd62fec5dae31d7c4cae1bc4d4388f2f66839e9e438924653103e14"} Jul 25 01:12:59.421698 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:12:59.421660 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b8bf4790-0739-471e-9b16-1c2e448a8b6a-metrics-certs\") pod \"network-metrics-daemon-5nl9g\" (UID: \"b8bf4790-0739-471e-9b16-1c2e448a8b6a\") " pod="openshift-multus/network-metrics-daemon-5nl9g" Jul 25 01:12:59.424153 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:12:59.424134 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 25 01:12:59.434966 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:12:59.434944 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b8bf4790-0739-471e-9b16-1c2e448a8b6a-metrics-certs\") pod \"network-metrics-daemon-5nl9g\" (UID: \"b8bf4790-0739-471e-9b16-1c2e448a8b6a\") " pod="openshift-multus/network-metrics-daemon-5nl9g" Jul 25 01:12:59.499791 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:12:59.499768 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-2flvd\"" Jul 25 01:12:59.508646 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:12:59.508625 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5nl9g" Jul 25 01:12:59.522298 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:12:59.522272 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5ada1026-5182-4a3e-9937-68258c8f240d-original-pull-secret\") pod \"global-pull-secret-syncer-mktch\" (UID: \"5ada1026-5182-4a3e-9937-68258c8f240d\") " pod="kube-system/global-pull-secret-syncer-mktch" Jul 25 01:12:59.524595 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:12:59.524413 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 25 01:12:59.535634 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:12:59.535616 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5ada1026-5182-4a3e-9937-68258c8f240d-original-pull-secret\") pod \"global-pull-secret-syncer-mktch\" (UID: \"5ada1026-5182-4a3e-9937-68258c8f240d\") " pod="kube-system/global-pull-secret-syncer-mktch" Jul 25 01:12:59.623653 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:12:59.623610 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-884lb\" (UniqueName: \"kubernetes.io/projected/8748d129-9ec1-44d6-8a95-88e0da2df4b3-kube-api-access-884lb\") pod \"network-check-target-znlzb\" (UID: \"8748d129-9ec1-44d6-8a95-88e0da2df4b3\") " pod="openshift-network-diagnostics/network-check-target-znlzb" Jul 25 01:12:59.626595 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:12:59.626570 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-884lb\" (UniqueName: \"kubernetes.io/projected/8748d129-9ec1-44d6-8a95-88e0da2df4b3-kube-api-access-884lb\") pod \"network-check-target-znlzb\" (UID: \"8748d129-9ec1-44d6-8a95-88e0da2df4b3\") " pod="openshift-network-diagnostics/network-check-target-znlzb" Jul 25 01:12:59.791933 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:12:59.791900 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mktch" Jul 25 01:12:59.806505 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:12:59.806476 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-2rr8l\"" Jul 25 01:12:59.814618 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:12:59.814598 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-znlzb" Jul 25 01:13:01.541559 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:13:01.541515 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/2a898496-0e3c-490b-94a6-0e05946b0313-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-hnxdh\" (UID: \"2a898496-0e3c-490b-94a6-0e05946b0313\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-hnxdh" Jul 25 01:13:01.544181 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:13:01.544154 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/2a898496-0e3c-490b-94a6-0e05946b0313-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-hnxdh\" (UID: \"2a898496-0e3c-490b-94a6-0e05946b0313\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-hnxdh" Jul 25 01:13:01.642667 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:13:01.642631 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/5aed6b57-4e4c-45f2-975c-8776d87fe328-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-bp82d\" (UID: \"5aed6b57-4e4c-45f2-975c-8776d87fe328\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-bp82d" Jul 25 01:13:01.642846 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:13:01.642681 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a8cb1021-bc16-4dfc-9252-3773f7aaea5b-metrics-certs\") pod \"router-default-54fd59887f-g5zgr\" (UID: \"a8cb1021-bc16-4dfc-9252-3773f7aaea5b\") " pod="openshift-ingress/router-default-54fd59887f-g5zgr" Jul 25 01:13:01.642846 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:13:01.642728 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/59f19017-9df8-47ee-820e-fd8e02c1178f-metrics-tls\") pod \"dns-default-29jjm\" (UID: \"59f19017-9df8-47ee-820e-fd8e02c1178f\") " pod="openshift-dns/dns-default-29jjm" Jul 25 01:13:01.642846 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:13:01.642761 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/eecc300f-3388-493d-a229-4ba749887922-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-f5tvk\" (UID: \"eecc300f-3388-493d-a229-4ba749887922\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-f5tvk" Jul 25 01:13:01.642846 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:13:01.642794 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9cb28390-ddda-4bf0-85e5-59c3702123bd-registry-tls\") pod \"image-registry-6b68768447-slrxh\" (UID: \"9cb28390-ddda-4bf0-85e5-59c3702123bd\") " pod="openshift-image-registry/image-registry-6b68768447-slrxh" Jul 25 01:13:01.642846 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:13:01.642827 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a8cb1021-bc16-4dfc-9252-3773f7aaea5b-service-ca-bundle\") pod \"router-default-54fd59887f-g5zgr\" (UID: \"a8cb1021-bc16-4dfc-9252-3773f7aaea5b\") " pod="openshift-ingress/router-default-54fd59887f-g5zgr" Jul 25 01:13:01.643720 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:13:01.643689 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a8cb1021-bc16-4dfc-9252-3773f7aaea5b-service-ca-bundle\") pod \"router-default-54fd59887f-g5zgr\" (UID: \"a8cb1021-bc16-4dfc-9252-3773f7aaea5b\") " pod="openshift-ingress/router-default-54fd59887f-g5zgr" Jul 25 01:13:01.645411 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:13:01.645366 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/59f19017-9df8-47ee-820e-fd8e02c1178f-metrics-tls\") pod \"dns-default-29jjm\" (UID: \"59f19017-9df8-47ee-820e-fd8e02c1178f\") " pod="openshift-dns/dns-default-29jjm" Jul 25 01:13:01.645771 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:13:01.645735 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/5aed6b57-4e4c-45f2-975c-8776d87fe328-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-bp82d\" (UID: \"5aed6b57-4e4c-45f2-975c-8776d87fe328\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-bp82d" Jul 25 01:13:01.645771 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:13:01.645751 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a8cb1021-bc16-4dfc-9252-3773f7aaea5b-metrics-certs\") pod \"router-default-54fd59887f-g5zgr\" (UID: \"a8cb1021-bc16-4dfc-9252-3773f7aaea5b\") " pod="openshift-ingress/router-default-54fd59887f-g5zgr" Jul 25 01:13:01.645926 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:13:01.645908 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9cb28390-ddda-4bf0-85e5-59c3702123bd-registry-tls\") pod \"image-registry-6b68768447-slrxh\" (UID: \"9cb28390-ddda-4bf0-85e5-59c3702123bd\") " pod="openshift-image-registry/image-registry-6b68768447-slrxh" Jul 25 01:13:01.646124 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:13:01.646106 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/eecc300f-3388-493d-a229-4ba749887922-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-f5tvk\" (UID: \"eecc300f-3388-493d-a229-4ba749887922\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-f5tvk" Jul 25 01:13:01.717297 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:13:01.717266 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-g77zs\"" Jul 25 01:13:01.725196 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:13:01.725170 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6b68768447-slrxh" Jul 25 01:13:01.745894 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:13:01.745867 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-fxvm2\"" Jul 25 01:13:01.753872 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:13:01.753844 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-29jjm" Jul 25 01:13:01.759643 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:13:01.759625 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-ndhbz\"" Jul 25 01:13:01.767143 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:13:01.767126 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-bp82d" Jul 25 01:13:01.772632 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:13:01.772617 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-lr6d9\"" Jul 25 01:13:01.780927 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:13:01.780908 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-f5tvk" Jul 25 01:13:01.806271 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:13:01.806254 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-p7l2f\"" Jul 25 01:13:01.815080 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:13:01.815063 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-74c9f884b7-hnxdh" Jul 25 01:13:01.833652 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:13:01.833626 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-9g7r8\"" Jul 25 01:13:01.842422 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:13:01.842393 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-54fd59887f-g5zgr" Jul 25 01:13:02.315726 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:13:02.315291 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-mktch"] Jul 25 01:13:02.454487 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:13:02.454447 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5ada1026_5182_4a3e_9937_68258c8f240d.slice/crio-08d0b21bdc76d52c7c5d0e8192e7977f63aeea59f9f0a69327516d434d588257 WatchSource:0}: Error finding container 08d0b21bdc76d52c7c5d0e8192e7977f63aeea59f9f0a69327516d434d588257: Status 404 returned error can't find the container with id 08d0b21bdc76d52c7c5d0e8192e7977f63aeea59f9f0a69327516d434d588257 Jul 25 01:13:02.514158 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:13:02.514126 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-znlzb"] Jul 25 01:13:02.517501 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:13:02.517472 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8748d129_9ec1_44d6_8a95_88e0da2df4b3.slice/crio-328347d17e3fda9b22547dfd44ebcc480c0c0112e9e54f91d7d291cf116b56de WatchSource:0}: Error finding container 328347d17e3fda9b22547dfd44ebcc480c0c0112e9e54f91d7d291cf116b56de: Status 404 returned error can't find the container with id 328347d17e3fda9b22547dfd44ebcc480c0c0112e9e54f91d7d291cf116b56de Jul 25 01:13:02.585681 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:13:02.585652 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-29jjm"] Jul 25 01:13:02.588481 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:13:02.588453 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod59f19017_9df8_47ee_820e_fd8e02c1178f.slice/crio-7eb891d61e3cc9a8c3de32548bed676e4a712072997f9a5d88200b584d043a34 WatchSource:0}: Error finding container 7eb891d61e3cc9a8c3de32548bed676e4a712072997f9a5d88200b584d043a34: Status 404 returned error can't find the container with id 7eb891d61e3cc9a8c3de32548bed676e4a712072997f9a5d88200b584d043a34 Jul 25 01:13:02.590998 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:13:02.590949 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-5nl9g"] Jul 25 01:13:02.595364 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:13:02.595311 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-74c9f884b7-hnxdh"] Jul 25 01:13:02.597179 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:13:02.597160 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-54fd59887f-g5zgr"] Jul 25 01:13:02.603516 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:13:02.602477 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2a898496_0e3c_490b_94a6_0e05946b0313.slice/crio-b64eb766fae2cc41b06d8a51af72b855c5f637e2f5fe41b7684ea1deb3a5f9f2 WatchSource:0}: Error finding container b64eb766fae2cc41b06d8a51af72b855c5f637e2f5fe41b7684ea1deb3a5f9f2: Status 404 returned error can't find the container with id b64eb766fae2cc41b06d8a51af72b855c5f637e2f5fe41b7684ea1deb3a5f9f2 Jul 25 01:13:02.603516 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:13:02.602836 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda8cb1021_bc16_4dfc_9252_3773f7aaea5b.slice/crio-ab54fbae7d9466db360256534ed81bd061b9193274a4ee4bd91bc78fc85ffe06 WatchSource:0}: Error finding container ab54fbae7d9466db360256534ed81bd061b9193274a4ee4bd91bc78fc85ffe06: Status 404 returned error can't find the container with id ab54fbae7d9466db360256534ed81bd061b9193274a4ee4bd91bc78fc85ffe06 Jul 25 01:13:02.636794 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:13:02.636766 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-6748489656-bp82d"] Jul 25 01:13:02.643605 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:13:02.640570 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-548b489cb8-f5tvk"] Jul 25 01:13:02.643605 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:13:02.642096 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-6b68768447-slrxh"] Jul 25 01:13:02.645984 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:13:02.645925 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeecc300f_3388_493d_a229_4ba749887922.slice/crio-b8748ca40967fa0e9ca10f6f1b3f594c0e342115fc8c5f43b04eb290581d58bb WatchSource:0}: Error finding container b8748ca40967fa0e9ca10f6f1b3f594c0e342115fc8c5f43b04eb290581d58bb: Status 404 returned error can't find the container with id b8748ca40967fa0e9ca10f6f1b3f594c0e342115fc8c5f43b04eb290581d58bb Jul 25 01:13:02.646574 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:13:02.646552 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9cb28390_ddda_4bf0_85e5_59c3702123bd.slice/crio-f7ceae7c51583c3cdbf2e7a3aabf5ea385b21400660606b7e14e052e61c2b87b WatchSource:0}: Error finding container f7ceae7c51583c3cdbf2e7a3aabf5ea385b21400660606b7e14e052e61c2b87b: Status 404 returned error can't find the container with id f7ceae7c51583c3cdbf2e7a3aabf5ea385b21400660606b7e14e052e61c2b87b Jul 25 01:13:03.257462 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:13:03.257360 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-hbxst" event={"ID":"b3afa3df-a0d8-4cd2-822c-d53a8b33ceaa","Type":"ContainerStarted","Data":"3e018062a9ef4bbbac1ce68093bcb4a34ebcf31f97e781b360a772dcfa1a257d"} Jul 25 01:13:03.258979 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:13:03.258929 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-f5tvk" event={"ID":"eecc300f-3388-493d-a229-4ba749887922","Type":"ContainerStarted","Data":"b8748ca40967fa0e9ca10f6f1b3f594c0e342115fc8c5f43b04eb290581d58bb"} Jul 25 01:13:03.260872 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:13:03.260839 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-74c9f884b7-hnxdh" event={"ID":"2a898496-0e3c-490b-94a6-0e05946b0313","Type":"ContainerStarted","Data":"b64eb766fae2cc41b06d8a51af72b855c5f637e2f5fe41b7684ea1deb3a5f9f2"} Jul 25 01:13:03.262953 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:13:03.262926 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-54fd59887f-g5zgr" event={"ID":"a8cb1021-bc16-4dfc-9252-3773f7aaea5b","Type":"ContainerStarted","Data":"0f574accfb921f08858dffcd942c778a4438c44fc216373b6256e6d9ab08d277"} Jul 25 01:13:03.262953 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:13:03.262970 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-54fd59887f-g5zgr" event={"ID":"a8cb1021-bc16-4dfc-9252-3773f7aaea5b","Type":"ContainerStarted","Data":"ab54fbae7d9466db360256534ed81bd061b9193274a4ee4bd91bc78fc85ffe06"} Jul 25 01:13:03.264756 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:13:03.264731 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-bp82d" event={"ID":"5aed6b57-4e4c-45f2-975c-8776d87fe328","Type":"ContainerStarted","Data":"3961840d32a5ab53cd10358a5f3fc35c5db54566f4ca317d99a4b79bfe993aa6"} Jul 25 01:13:03.267621 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:13:03.267558 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-29jjm" event={"ID":"59f19017-9df8-47ee-820e-fd8e02c1178f","Type":"ContainerStarted","Data":"7eb891d61e3cc9a8c3de32548bed676e4a712072997f9a5d88200b584d043a34"} Jul 25 01:13:03.270061 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:13:03.269475 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6b68768447-slrxh" event={"ID":"9cb28390-ddda-4bf0-85e5-59c3702123bd","Type":"ContainerStarted","Data":"2e22195033aa6f979e713f2ca9120dcf0c2ce5ce27e5aaee34e24eab879518d1"} Jul 25 01:13:03.270061 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:13:03.269518 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6b68768447-slrxh" event={"ID":"9cb28390-ddda-4bf0-85e5-59c3702123bd","Type":"ContainerStarted","Data":"f7ceae7c51583c3cdbf2e7a3aabf5ea385b21400660606b7e14e052e61c2b87b"} Jul 25 01:13:03.270061 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:13:03.270014 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-6b68768447-slrxh" Jul 25 01:13:03.271616 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:13:03.271595 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-5nl9g" event={"ID":"b8bf4790-0739-471e-9b16-1c2e448a8b6a","Type":"ContainerStarted","Data":"e4f65d6072f956e0677b32c13659a8efaf374fae1161a01a1c46edbaa7b28e89"} Jul 25 01:13:03.274641 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:13:03.274615 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-znlzb" event={"ID":"8748d129-9ec1-44d6-8a95-88e0da2df4b3","Type":"ContainerStarted","Data":"e5ff6c90c99cf4e38039975b1f88cf3fc3f46f59dbf2b7b979b9a4488ac56511"} Jul 25 01:13:03.274745 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:13:03.274667 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-znlzb" event={"ID":"8748d129-9ec1-44d6-8a95-88e0da2df4b3","Type":"ContainerStarted","Data":"328347d17e3fda9b22547dfd44ebcc480c0c0112e9e54f91d7d291cf116b56de"} Jul 25 01:13:03.274806 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:13:03.274780 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-znlzb" Jul 25 01:13:03.275833 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:13:03.275807 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-mktch" event={"ID":"5ada1026-5182-4a3e-9937-68258c8f240d","Type":"ContainerStarted","Data":"08d0b21bdc76d52c7c5d0e8192e7977f63aeea59f9f0a69327516d434d588257"} Jul 25 01:13:03.282441 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:13:03.281285 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-54fd59887f-g5zgr" podStartSLOduration=49.281272913 podStartE2EDuration="49.281272913s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-25 01:12:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-25 01:13:03.280555997 +0000 UTC m=+68.973650821" watchObservedRunningTime="2026-07-25 01:13:03.281272913 +0000 UTC m=+68.974367332" Jul 25 01:13:03.295000 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:13:03.293609 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-znlzb" podStartSLOduration=67.293591698 podStartE2EDuration="1m7.293591698s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-25 01:11:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-25 01:13:03.293157973 +0000 UTC m=+68.986252456" watchObservedRunningTime="2026-07-25 01:13:03.293591698 +0000 UTC m=+68.986686118" Jul 25 01:13:03.310586 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:13:03.310245 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-6b68768447-slrxh" podStartSLOduration=67.31022993 podStartE2EDuration="1m7.31022993s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-25 01:11:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-25 01:13:03.309307906 +0000 UTC m=+69.002402327" watchObservedRunningTime="2026-07-25 01:13:03.31022993 +0000 UTC m=+69.003324341" Jul 25 01:13:03.843844 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:13:03.843764 2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-54fd59887f-g5zgr" Jul 25 01:13:03.847324 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:13:03.847118 2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-54fd59887f-g5zgr" Jul 25 01:13:04.284118 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:13:04.284066 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-54fd59887f-g5zgr" Jul 25 01:13:04.285482 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:13:04.285459 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-54fd59887f-g5zgr" Jul 25 01:13:04.781456 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:13:04.781352 2567 scope.go:117] "RemoveContainer" containerID="ae04baae1362c8431a835cd18e41be4b5ee53c02bb043d00ba9761f86f6378cf" Jul 25 01:13:12.320615 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:13:12.320586 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-s5tbd_a9cb9aa9-8f43-4b32-a7b7-4eb9afb05c90/console-operator/1.log" Jul 25 01:13:12.321111 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:13:12.320707 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-584dcb6b54-s5tbd" event={"ID":"a9cb9aa9-8f43-4b32-a7b7-4eb9afb05c90","Type":"ContainerStarted","Data":"1f8ba310542108a04b10f7bb6ab9015fc266e18ea51974d46cd3f776d8dd8b6f"} Jul 25 01:13:12.321173 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:13:12.321123 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-584dcb6b54-s5tbd" Jul 25 01:13:12.323403 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:13:12.323323 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-hbxst" event={"ID":"b3afa3df-a0d8-4cd2-822c-d53a8b33ceaa","Type":"ContainerStarted","Data":"8127611a6ca8c72d3a9491468a50248952002a65b27f5a273a15ff6956af9346"} Jul 25 01:13:12.325797 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:13:12.325771 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-f5tvk" event={"ID":"eecc300f-3388-493d-a229-4ba749887922","Type":"ContainerStarted","Data":"d90191941266d75f8ceec62fea6c43ca61e7432a1cd9b5350c394806e8421900"} Jul 25 01:13:12.327090 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:13:12.327073 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-584dcb6b54-s5tbd" Jul 25 01:13:12.327884 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:13:12.327863 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-74c9f884b7-hnxdh" event={"ID":"2a898496-0e3c-490b-94a6-0e05946b0313","Type":"ContainerStarted","Data":"616d0c3eec965b8917d03a5a614445d774ad773c0a7572704824742e5c337af7"} Jul 25 01:13:12.329835 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:13:12.329810 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-bp82d" event={"ID":"5aed6b57-4e4c-45f2-975c-8776d87fe328","Type":"ContainerStarted","Data":"d908d6960046b74caaa1776bc3bde60ec9ec35286917dbae78480352320b3b20"} Jul 25 01:13:12.329953 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:13:12.329855 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-bp82d" event={"ID":"5aed6b57-4e4c-45f2-975c-8776d87fe328","Type":"ContainerStarted","Data":"c2a812c7c271f2a21da4d95c54232de8a79313491a72fec1cea6a0ba2a9f64f7"} Jul 25 01:13:12.331770 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:13:12.331743 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-29jjm" event={"ID":"59f19017-9df8-47ee-820e-fd8e02c1178f","Type":"ContainerStarted","Data":"fcfabb3dfa2e6510d8f8eb63e2e04c4f4e5a9c042767a1b9b6bead1f9eb7eb60"} Jul 25 01:13:12.331886 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:13:12.331788 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-29jjm" event={"ID":"59f19017-9df8-47ee-820e-fd8e02c1178f","Type":"ContainerStarted","Data":"33f75bfff40d99f909af1264e7b4dc6e64566fe1bd2b9f1d1d2027f29025f593"} Jul 25 01:13:12.331886 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:13:12.331838 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-29jjm" Jul 25 01:13:12.333694 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:13:12.333651 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-5nl9g" event={"ID":"b8bf4790-0739-471e-9b16-1c2e448a8b6a","Type":"ContainerStarted","Data":"14f3c48db957c1f95fa4d77eb1ba2ec8d1ed8e66d6cce5d47740ec2fd58a02c3"} Jul 25 01:13:12.333844 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:13:12.333713 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-5nl9g" event={"ID":"b8bf4790-0739-471e-9b16-1c2e448a8b6a","Type":"ContainerStarted","Data":"bf37128f7e9bd09de6320359d49cc6fa42cca6d26d395c410b4990204357fac8"} Jul 25 01:13:12.335867 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:13:12.335846 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-7c97dc4555-zkdh8"] Jul 25 01:13:12.338101 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:13:12.338082 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-mktch" event={"ID":"5ada1026-5182-4a3e-9937-68258c8f240d","Type":"ContainerStarted","Data":"72b8f6cc1b8d5b419717eb161229a61dad44ccd5e2ef4f967632a39198e456e0"} Jul 25 01:13:12.338183 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:13:12.338167 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-7c97dc4555-zkdh8" Jul 25 01:13:12.341176 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:13:12.341054 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-584dcb6b54-s5tbd" podStartSLOduration=50.609224251 podStartE2EDuration="58.341042048s" totalImagesPullingTime="7.731817797s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-25 01:12:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-25 01:13:12.339857165 +0000 UTC m=+78.032951616" watchObservedRunningTime="2026-07-25 01:13:12.341042048 +0000 UTC m=+78.034136467" Jul 25 01:13:12.341703 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:13:12.341682 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-nmqcd\"" Jul 25 01:13:12.341931 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:13:12.341904 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jul 25 01:13:12.342080 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:13:12.342061 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jul 25 01:13:12.348017 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:13:12.347996 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-7c97dc4555-zkdh8"] Jul 25 01:13:12.374898 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:13:12.374849 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-74c9f884b7-hnxdh" podStartSLOduration=47.020660861 podStartE2EDuration="55.374828843s" totalImagesPullingTime="8.354167982s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-25 01:12:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-25 01:13:12.373494979 +0000 UTC m=+78.066589402" watchObservedRunningTime="2026-07-25 01:13:12.374828843 +0000 UTC m=+78.067923264" Jul 25 01:13:12.388815 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:13:12.388765 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-5nl9g" podStartSLOduration=68.402921969 podStartE2EDuration="1m17.388746921s" totalImagesPullingTime="8.985824952s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-25 01:11:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-25 01:13:12.388131259 +0000 UTC m=+78.081225680" watchObservedRunningTime="2026-07-25 01:13:12.388746921 +0000 UTC m=+78.081841342" Jul 25 01:13:12.411577 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:13:12.411534 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-29jjm" podStartSLOduration=34.502575607 podStartE2EDuration="43.411521052s" totalImagesPullingTime="8.908945445s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-25 01:12:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-25 01:13:12.411008493 +0000 UTC m=+78.104102932" watchObservedRunningTime="2026-07-25 01:13:12.411521052 +0000 UTC m=+78.104615489" Jul 25 01:13:12.426859 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:13:12.426822 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-mktch" podStartSLOduration=67.31282481 podStartE2EDuration="1m16.426809485s" totalImagesPullingTime="9.113984675s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-25 01:11:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-25 01:13:12.426085957 +0000 UTC m=+78.119180373" watchObservedRunningTime="2026-07-25 01:13:12.426809485 +0000 UTC m=+78.119903883" Jul 25 01:13:12.433130 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:13:12.433108 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9ztrn\" (UniqueName: \"kubernetes.io/projected/ada8fa7b-3483-47e1-b9da-2aa44ded12c6-kube-api-access-9ztrn\") pod \"downloads-7c97dc4555-zkdh8\" (UID: \"ada8fa7b-3483-47e1-b9da-2aa44ded12c6\") " pod="openshift-console/downloads-7c97dc4555-zkdh8" Jul 25 01:13:12.443289 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:13:12.443225 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-f5tvk" podStartSLOduration=49.504856027 podStartE2EDuration="58.443210356s" totalImagesPullingTime="8.938354329s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-25 01:12:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-25 01:13:12.441854001 +0000 UTC m=+78.134948424" watchObservedRunningTime="2026-07-25 01:13:12.443210356 +0000 UTC m=+78.136304777" Jul 25 01:13:12.481255 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:13:12.481206 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-bp82d" podStartSLOduration=49.611977905 podStartE2EDuration="58.481188458s" totalImagesPullingTime="8.869210553s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-25 01:12:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-25 01:13:12.480681403 +0000 UTC m=+78.173775828" watchObservedRunningTime="2026-07-25 01:13:12.481188458 +0000 UTC m=+78.174282878" Jul 25 01:13:12.533995 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:13:12.533960 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9ztrn\" (UniqueName: \"kubernetes.io/projected/ada8fa7b-3483-47e1-b9da-2aa44ded12c6-kube-api-access-9ztrn\") pod \"downloads-7c97dc4555-zkdh8\" (UID: \"ada8fa7b-3483-47e1-b9da-2aa44ded12c6\") " pod="openshift-console/downloads-7c97dc4555-zkdh8" Jul 25 01:13:12.542618 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:13:12.542595 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9ztrn\" (UniqueName: \"kubernetes.io/projected/ada8fa7b-3483-47e1-b9da-2aa44ded12c6-kube-api-access-9ztrn\") pod \"downloads-7c97dc4555-zkdh8\" (UID: \"ada8fa7b-3483-47e1-b9da-2aa44ded12c6\") " pod="openshift-console/downloads-7c97dc4555-zkdh8" Jul 25 01:13:12.650684 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:13:12.650618 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-7c97dc4555-zkdh8" Jul 25 01:13:12.794061 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:13:12.794031 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-7c97dc4555-zkdh8"] Jul 25 01:13:12.797759 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:13:12.797727 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podada8fa7b_3483_47e1_b9da_2aa44ded12c6.slice/crio-38a6ddcbe3e0368bffa9300fd01c074d0ca3d2a85532ff65ddb798eea4c79d5a WatchSource:0}: Error finding container 38a6ddcbe3e0368bffa9300fd01c074d0ca3d2a85532ff65ddb798eea4c79d5a: Status 404 returned error can't find the container with id 38a6ddcbe3e0368bffa9300fd01c074d0ca3d2a85532ff65ddb798eea4c79d5a Jul 25 01:13:13.352578 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:13:13.352543 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-7c97dc4555-zkdh8" event={"ID":"ada8fa7b-3483-47e1-b9da-2aa44ded12c6","Type":"ContainerStarted","Data":"38a6ddcbe3e0368bffa9300fd01c074d0ca3d2a85532ff65ddb798eea4c79d5a"} Jul 25 01:13:16.370362 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:13:16.370326 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-hbxst" event={"ID":"b3afa3df-a0d8-4cd2-822c-d53a8b33ceaa","Type":"ContainerStarted","Data":"86824065cd15dba4e6bcf311075e2750cb2e755f98ce757934068fd4edf34421"} Jul 25 01:13:16.387332 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:13:16.387281 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-hbxst" podStartSLOduration=16.995938515 podStartE2EDuration="35.387262705s" totalImagesPullingTime="18.39132419s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-25 01:12:41 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-25 01:13:16.386958273 +0000 UTC m=+82.080052695" watchObservedRunningTime="2026-07-25 01:13:16.387262705 +0000 UTC m=+82.080357128" Jul 25 01:13:22.356455 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:13:22.356418 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-29jjm" Jul 25 01:13:23.716878 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:13:23.716843 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-98zxc"] Jul 25 01:13:23.720294 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:13:23.720263 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-98zxc" Jul 25 01:13:23.722768 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:13:23.722746 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 25 01:13:23.722909 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:13:23.722770 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-z8cbs\"" Jul 25 01:13:23.723075 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:13:23.723060 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 25 01:13:23.723833 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:13:23.723643 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 25 01:13:23.723833 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:13:23.723733 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 25 01:13:23.827159 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:13:23.827122 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e6618ca2-864b-408a-9825-84057199ae05-sys\") pod \"node-exporter-98zxc\" (UID: \"e6618ca2-864b-408a-9825-84057199ae05\") " pod="openshift-monitoring/node-exporter-98zxc" Jul 25 01:13:23.827337 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:13:23.827174 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/e6618ca2-864b-408a-9825-84057199ae05-root\") pod \"node-exporter-98zxc\" (UID: \"e6618ca2-864b-408a-9825-84057199ae05\") " pod="openshift-monitoring/node-exporter-98zxc" Jul 25 01:13:23.827337 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:13:23.827250 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/e6618ca2-864b-408a-9825-84057199ae05-node-exporter-textfile\") pod \"node-exporter-98zxc\" (UID: \"e6618ca2-864b-408a-9825-84057199ae05\") " pod="openshift-monitoring/node-exporter-98zxc" Jul 25 01:13:23.827337 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:13:23.827298 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e6618ca2-864b-408a-9825-84057199ae05-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-98zxc\" (UID: \"e6618ca2-864b-408a-9825-84057199ae05\") " pod="openshift-monitoring/node-exporter-98zxc" Jul 25 01:13:23.827551 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:13:23.827432 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/e6618ca2-864b-408a-9825-84057199ae05-node-exporter-tls\") pod \"node-exporter-98zxc\" (UID: \"e6618ca2-864b-408a-9825-84057199ae05\") " pod="openshift-monitoring/node-exporter-98zxc" Jul 25 01:13:23.827551 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:13:23.827467 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/e6618ca2-864b-408a-9825-84057199ae05-node-exporter-wtmp\") pod \"node-exporter-98zxc\" (UID: \"e6618ca2-864b-408a-9825-84057199ae05\") " pod="openshift-monitoring/node-exporter-98zxc" Jul 25 01:13:23.827551 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:13:23.827501 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/e6618ca2-864b-408a-9825-84057199ae05-node-exporter-accelerators-collector-config\") pod \"node-exporter-98zxc\" (UID: \"e6618ca2-864b-408a-9825-84057199ae05\") " pod="openshift-monitoring/node-exporter-98zxc" Jul 25 01:13:23.827679 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:13:23.827577 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lzs4d\" (UniqueName: \"kubernetes.io/projected/e6618ca2-864b-408a-9825-84057199ae05-kube-api-access-lzs4d\") pod \"node-exporter-98zxc\" (UID: \"e6618ca2-864b-408a-9825-84057199ae05\") " pod="openshift-monitoring/node-exporter-98zxc" Jul 25 01:13:23.827679 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:13:23.827617 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e6618ca2-864b-408a-9825-84057199ae05-metrics-client-ca\") pod \"node-exporter-98zxc\" (UID: \"e6618ca2-864b-408a-9825-84057199ae05\") " pod="openshift-monitoring/node-exporter-98zxc" Jul 25 01:13:23.928793 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:13:23.928749 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e6618ca2-864b-408a-9825-84057199ae05-metrics-client-ca\") pod \"node-exporter-98zxc\" (UID: \"e6618ca2-864b-408a-9825-84057199ae05\") " pod="openshift-monitoring/node-exporter-98zxc" Jul 25 01:13:23.928793 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:13:23.928795 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e6618ca2-864b-408a-9825-84057199ae05-sys\") pod \"node-exporter-98zxc\" (UID: \"e6618ca2-864b-408a-9825-84057199ae05\") " pod="openshift-monitoring/node-exporter-98zxc" Jul 25 01:13:23.929022 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:13:23.928822 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/e6618ca2-864b-408a-9825-84057199ae05-root\") pod \"node-exporter-98zxc\" (UID: \"e6618ca2-864b-408a-9825-84057199ae05\") " pod="openshift-monitoring/node-exporter-98zxc" Jul 25 01:13:23.929022 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:13:23.928843 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/e6618ca2-864b-408a-9825-84057199ae05-node-exporter-textfile\") pod \"node-exporter-98zxc\" (UID: \"e6618ca2-864b-408a-9825-84057199ae05\") " pod="openshift-monitoring/node-exporter-98zxc" Jul 25 01:13:23.929022 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:13:23.928869 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e6618ca2-864b-408a-9825-84057199ae05-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-98zxc\" (UID: \"e6618ca2-864b-408a-9825-84057199ae05\") " pod="openshift-monitoring/node-exporter-98zxc" Jul 25 01:13:23.929022 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:13:23.928921 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/e6618ca2-864b-408a-9825-84057199ae05-node-exporter-tls\") pod \"node-exporter-98zxc\" (UID: \"e6618ca2-864b-408a-9825-84057199ae05\") " pod="openshift-monitoring/node-exporter-98zxc" Jul 25 01:13:23.929022 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:13:23.928943 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/e6618ca2-864b-408a-9825-84057199ae05-node-exporter-wtmp\") pod \"node-exporter-98zxc\" (UID: \"e6618ca2-864b-408a-9825-84057199ae05\") " pod="openshift-monitoring/node-exporter-98zxc" Jul 25 01:13:23.929022 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:13:23.928947 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/e6618ca2-864b-408a-9825-84057199ae05-root\") pod \"node-exporter-98zxc\" (UID: \"e6618ca2-864b-408a-9825-84057199ae05\") " pod="openshift-monitoring/node-exporter-98zxc" Jul 25 01:13:23.929022 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:13:23.928968 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/e6618ca2-864b-408a-9825-84057199ae05-node-exporter-accelerators-collector-config\") pod \"node-exporter-98zxc\" (UID: \"e6618ca2-864b-408a-9825-84057199ae05\") " pod="openshift-monitoring/node-exporter-98zxc" Jul 25 01:13:23.929022 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:13:23.929011 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e6618ca2-864b-408a-9825-84057199ae05-sys\") pod \"node-exporter-98zxc\" (UID: \"e6618ca2-864b-408a-9825-84057199ae05\") " pod="openshift-monitoring/node-exporter-98zxc" Jul 25 01:13:23.929022 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:13:23.929010 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lzs4d\" (UniqueName: \"kubernetes.io/projected/e6618ca2-864b-408a-9825-84057199ae05-kube-api-access-lzs4d\") pod \"node-exporter-98zxc\" (UID: \"e6618ca2-864b-408a-9825-84057199ae05\") " pod="openshift-monitoring/node-exporter-98zxc" Jul 25 01:13:23.929474 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:13:23.929262 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/e6618ca2-864b-408a-9825-84057199ae05-node-exporter-wtmp\") pod \"node-exporter-98zxc\" (UID: \"e6618ca2-864b-408a-9825-84057199ae05\") " pod="openshift-monitoring/node-exporter-98zxc" Jul 25 01:13:23.929474 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:13:23.929452 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e6618ca2-864b-408a-9825-84057199ae05-metrics-client-ca\") pod \"node-exporter-98zxc\" (UID: \"e6618ca2-864b-408a-9825-84057199ae05\") " pod="openshift-monitoring/node-exporter-98zxc" Jul 25 01:13:23.929582 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:13:23.929500 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/e6618ca2-864b-408a-9825-84057199ae05-node-exporter-textfile\") pod \"node-exporter-98zxc\" (UID: \"e6618ca2-864b-408a-9825-84057199ae05\") " pod="openshift-monitoring/node-exporter-98zxc" Jul 25 01:13:23.929725 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:13:23.929692 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/e6618ca2-864b-408a-9825-84057199ae05-node-exporter-accelerators-collector-config\") pod \"node-exporter-98zxc\" (UID: \"e6618ca2-864b-408a-9825-84057199ae05\") " pod="openshift-monitoring/node-exporter-98zxc" Jul 25 01:13:23.931905 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:13:23.931881 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/e6618ca2-864b-408a-9825-84057199ae05-node-exporter-tls\") pod \"node-exporter-98zxc\" (UID: \"e6618ca2-864b-408a-9825-84057199ae05\") " pod="openshift-monitoring/node-exporter-98zxc" Jul 25 01:13:23.932020 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:13:23.931945 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e6618ca2-864b-408a-9825-84057199ae05-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-98zxc\" (UID: \"e6618ca2-864b-408a-9825-84057199ae05\") " pod="openshift-monitoring/node-exporter-98zxc" Jul 25 01:13:23.937265 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:13:23.937097 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lzs4d\" (UniqueName: \"kubernetes.io/projected/e6618ca2-864b-408a-9825-84057199ae05-kube-api-access-lzs4d\") pod \"node-exporter-98zxc\" (UID: \"e6618ca2-864b-408a-9825-84057199ae05\") " pod="openshift-monitoring/node-exporter-98zxc" Jul 25 01:13:24.031113 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:13:24.031043 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-98zxc" Jul 25 01:13:24.790215 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:13:24.790184 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 25 01:13:24.796172 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:13:24.796149 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 25 01:13:24.799060 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:13:24.799041 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jul 25 01:13:24.800018 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:13:24.799998 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jul 25 01:13:24.800128 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:13:24.800003 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jul 25 01:13:24.800258 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:13:24.800240 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jul 25 01:13:24.800342 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:13:24.800281 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jul 25 01:13:24.800342 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:13:24.800301 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-j7n8v\"" Jul 25 01:13:24.800342 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:13:24.800281 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jul 25 01:13:24.800898 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:13:24.800744 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jul 25 01:13:24.800898 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:13:24.800766 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jul 25 01:13:24.800898 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:13:24.800745 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jul 25 01:13:24.809563 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:13:24.809543 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 25 01:13:24.936419 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:13:24.936364 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/951e1890-cb13-4760-9cd3-4bb5db7c8a04-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"951e1890-cb13-4760-9cd3-4bb5db7c8a04\") " pod="openshift-monitoring/alertmanager-main-0" Jul 25 01:13:24.936695 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:13:24.936675 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/951e1890-cb13-4760-9cd3-4bb5db7c8a04-web-config\") pod \"alertmanager-main-0\" (UID: \"951e1890-cb13-4760-9cd3-4bb5db7c8a04\") " pod="openshift-monitoring/alertmanager-main-0" Jul 25 01:13:24.936819 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:13:24.936797 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/951e1890-cb13-4760-9cd3-4bb5db7c8a04-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"951e1890-cb13-4760-9cd3-4bb5db7c8a04\") " pod="openshift-monitoring/alertmanager-main-0" Jul 25 01:13:24.936931 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:13:24.936843 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/951e1890-cb13-4760-9cd3-4bb5db7c8a04-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"951e1890-cb13-4760-9cd3-4bb5db7c8a04\") " pod="openshift-monitoring/alertmanager-main-0" Jul 25 01:13:24.936931 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:13:24.936871 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/951e1890-cb13-4760-9cd3-4bb5db7c8a04-tls-assets\") pod \"alertmanager-main-0\" (UID: \"951e1890-cb13-4760-9cd3-4bb5db7c8a04\") " pod="openshift-monitoring/alertmanager-main-0" Jul 25 01:13:24.936931 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:13:24.936894 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/951e1890-cb13-4760-9cd3-4bb5db7c8a04-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"951e1890-cb13-4760-9cd3-4bb5db7c8a04\") " pod="openshift-monitoring/alertmanager-main-0" Jul 25 01:13:24.936931 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:13:24.936917 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/951e1890-cb13-4760-9cd3-4bb5db7c8a04-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"951e1890-cb13-4760-9cd3-4bb5db7c8a04\") " pod="openshift-monitoring/alertmanager-main-0" Jul 25 01:13:24.937130 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:13:24.936946 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-smk5w\" (UniqueName: \"kubernetes.io/projected/951e1890-cb13-4760-9cd3-4bb5db7c8a04-kube-api-access-smk5w\") pod \"alertmanager-main-0\" (UID: \"951e1890-cb13-4760-9cd3-4bb5db7c8a04\") " pod="openshift-monitoring/alertmanager-main-0" Jul 25 01:13:24.937130 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:13:24.937025 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/951e1890-cb13-4760-9cd3-4bb5db7c8a04-config-volume\") pod \"alertmanager-main-0\" (UID: \"951e1890-cb13-4760-9cd3-4bb5db7c8a04\") " pod="openshift-monitoring/alertmanager-main-0" Jul 25 01:13:24.937130 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:13:24.937050 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/951e1890-cb13-4760-9cd3-4bb5db7c8a04-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"951e1890-cb13-4760-9cd3-4bb5db7c8a04\") " pod="openshift-monitoring/alertmanager-main-0" Jul 25 01:13:24.937130 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:13:24.937073 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/951e1890-cb13-4760-9cd3-4bb5db7c8a04-config-out\") pod \"alertmanager-main-0\" (UID: \"951e1890-cb13-4760-9cd3-4bb5db7c8a04\") " pod="openshift-monitoring/alertmanager-main-0" Jul 25 01:13:24.937130 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:13:24.937108 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/951e1890-cb13-4760-9cd3-4bb5db7c8a04-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"951e1890-cb13-4760-9cd3-4bb5db7c8a04\") " pod="openshift-monitoring/alertmanager-main-0" Jul 25 01:13:24.937327 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:13:24.937135 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/951e1890-cb13-4760-9cd3-4bb5db7c8a04-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"951e1890-cb13-4760-9cd3-4bb5db7c8a04\") " pod="openshift-monitoring/alertmanager-main-0" Jul 25 01:13:25.037819 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:13:25.037782 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/951e1890-cb13-4760-9cd3-4bb5db7c8a04-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"951e1890-cb13-4760-9cd3-4bb5db7c8a04\") " pod="openshift-monitoring/alertmanager-main-0" Jul 25 01:13:25.037977 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:13:25.037848 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/951e1890-cb13-4760-9cd3-4bb5db7c8a04-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"951e1890-cb13-4760-9cd3-4bb5db7c8a04\") " pod="openshift-monitoring/alertmanager-main-0" Jul 25 01:13:25.037977 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:13:25.037882 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/951e1890-cb13-4760-9cd3-4bb5db7c8a04-web-config\") pod \"alertmanager-main-0\" (UID: \"951e1890-cb13-4760-9cd3-4bb5db7c8a04\") " pod="openshift-monitoring/alertmanager-main-0" Jul 25 01:13:25.037977 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:13:25.037911 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/951e1890-cb13-4760-9cd3-4bb5db7c8a04-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"951e1890-cb13-4760-9cd3-4bb5db7c8a04\") " pod="openshift-monitoring/alertmanager-main-0" Jul 25 01:13:25.037977 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:13:25.037946 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/951e1890-cb13-4760-9cd3-4bb5db7c8a04-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"951e1890-cb13-4760-9cd3-4bb5db7c8a04\") " pod="openshift-monitoring/alertmanager-main-0" Jul 25 01:13:25.037977 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:13:25.037971 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/951e1890-cb13-4760-9cd3-4bb5db7c8a04-tls-assets\") pod \"alertmanager-main-0\" (UID: \"951e1890-cb13-4760-9cd3-4bb5db7c8a04\") " pod="openshift-monitoring/alertmanager-main-0" Jul 25 01:13:25.038171 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:13:25.037995 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/951e1890-cb13-4760-9cd3-4bb5db7c8a04-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"951e1890-cb13-4760-9cd3-4bb5db7c8a04\") " pod="openshift-monitoring/alertmanager-main-0" Jul 25 01:13:25.038171 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:13:25.038020 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/951e1890-cb13-4760-9cd3-4bb5db7c8a04-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"951e1890-cb13-4760-9cd3-4bb5db7c8a04\") " pod="openshift-monitoring/alertmanager-main-0" Jul 25 01:13:25.038171 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:13:25.038049 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-smk5w\" (UniqueName: \"kubernetes.io/projected/951e1890-cb13-4760-9cd3-4bb5db7c8a04-kube-api-access-smk5w\") pod \"alertmanager-main-0\" (UID: \"951e1890-cb13-4760-9cd3-4bb5db7c8a04\") " pod="openshift-monitoring/alertmanager-main-0" Jul 25 01:13:25.038171 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:13:25.038091 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/951e1890-cb13-4760-9cd3-4bb5db7c8a04-config-volume\") pod \"alertmanager-main-0\" (UID: \"951e1890-cb13-4760-9cd3-4bb5db7c8a04\") " pod="openshift-monitoring/alertmanager-main-0" Jul 25 01:13:25.038171 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:13:25.038116 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/951e1890-cb13-4760-9cd3-4bb5db7c8a04-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"951e1890-cb13-4760-9cd3-4bb5db7c8a04\") " pod="openshift-monitoring/alertmanager-main-0" Jul 25 01:13:25.038171 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:13:25.038139 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/951e1890-cb13-4760-9cd3-4bb5db7c8a04-config-out\") pod \"alertmanager-main-0\" (UID: \"951e1890-cb13-4760-9cd3-4bb5db7c8a04\") " pod="openshift-monitoring/alertmanager-main-0" Jul 25 01:13:25.038171 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:13:25.038161 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/951e1890-cb13-4760-9cd3-4bb5db7c8a04-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"951e1890-cb13-4760-9cd3-4bb5db7c8a04\") " pod="openshift-monitoring/alertmanager-main-0" Jul 25 01:13:25.038490 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:13:25.038175 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/951e1890-cb13-4760-9cd3-4bb5db7c8a04-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"951e1890-cb13-4760-9cd3-4bb5db7c8a04\") " pod="openshift-monitoring/alertmanager-main-0" Jul 25 01:13:25.039710 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:13:25.039673 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/951e1890-cb13-4760-9cd3-4bb5db7c8a04-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"951e1890-cb13-4760-9cd3-4bb5db7c8a04\") " pod="openshift-monitoring/alertmanager-main-0" Jul 25 01:13:25.041218 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:13:25.041158 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/951e1890-cb13-4760-9cd3-4bb5db7c8a04-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"951e1890-cb13-4760-9cd3-4bb5db7c8a04\") " pod="openshift-monitoring/alertmanager-main-0" Jul 25 01:13:25.041654 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:13:25.041630 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/951e1890-cb13-4760-9cd3-4bb5db7c8a04-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"951e1890-cb13-4760-9cd3-4bb5db7c8a04\") " pod="openshift-monitoring/alertmanager-main-0" Jul 25 01:13:25.043497 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:13:25.043032 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/951e1890-cb13-4760-9cd3-4bb5db7c8a04-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"951e1890-cb13-4760-9cd3-4bb5db7c8a04\") " pod="openshift-monitoring/alertmanager-main-0" Jul 25 01:13:25.043497 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:13:25.043455 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/951e1890-cb13-4760-9cd3-4bb5db7c8a04-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"951e1890-cb13-4760-9cd3-4bb5db7c8a04\") " pod="openshift-monitoring/alertmanager-main-0" Jul 25 01:13:25.044048 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:13:25.043864 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/951e1890-cb13-4760-9cd3-4bb5db7c8a04-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"951e1890-cb13-4760-9cd3-4bb5db7c8a04\") " pod="openshift-monitoring/alertmanager-main-0" Jul 25 01:13:25.044048 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:13:25.044005 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/951e1890-cb13-4760-9cd3-4bb5db7c8a04-config-out\") pod \"alertmanager-main-0\" (UID: \"951e1890-cb13-4760-9cd3-4bb5db7c8a04\") " pod="openshift-monitoring/alertmanager-main-0" Jul 25 01:13:25.044202 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:13:25.044058 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/951e1890-cb13-4760-9cd3-4bb5db7c8a04-tls-assets\") pod \"alertmanager-main-0\" (UID: \"951e1890-cb13-4760-9cd3-4bb5db7c8a04\") " pod="openshift-monitoring/alertmanager-main-0" Jul 25 01:13:25.044689 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:13:25.044648 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/951e1890-cb13-4760-9cd3-4bb5db7c8a04-config-volume\") pod \"alertmanager-main-0\" (UID: \"951e1890-cb13-4760-9cd3-4bb5db7c8a04\") " pod="openshift-monitoring/alertmanager-main-0" Jul 25 01:13:25.045496 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:13:25.045432 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/951e1890-cb13-4760-9cd3-4bb5db7c8a04-web-config\") pod \"alertmanager-main-0\" (UID: \"951e1890-cb13-4760-9cd3-4bb5db7c8a04\") " pod="openshift-monitoring/alertmanager-main-0" Jul 25 01:13:25.046221 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:13:25.046181 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/951e1890-cb13-4760-9cd3-4bb5db7c8a04-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"951e1890-cb13-4760-9cd3-4bb5db7c8a04\") " pod="openshift-monitoring/alertmanager-main-0" Jul 25 01:13:25.049190 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:13:25.049169 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-smk5w\" (UniqueName: \"kubernetes.io/projected/951e1890-cb13-4760-9cd3-4bb5db7c8a04-kube-api-access-smk5w\") pod \"alertmanager-main-0\" (UID: \"951e1890-cb13-4760-9cd3-4bb5db7c8a04\") " pod="openshift-monitoring/alertmanager-main-0" Jul 25 01:13:25.109668 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:13:25.109644 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 25 01:13:25.293542 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:13:25.292818 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-6b68768447-slrxh" Jul 25 01:13:25.988014 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:13:25.987979 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-649f89cdbf-n8b6q"] Jul 25 01:13:25.998907 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:13:25.998873 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-649f89cdbf-n8b6q" Jul 25 01:13:26.001614 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:13:26.001586 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-8bx8f\"" Jul 25 01:13:26.004472 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:13:26.004444 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jul 25 01:13:26.004691 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:13:26.004498 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jul 25 01:13:26.004756 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:13:26.004696 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jul 25 01:13:26.004756 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:13:26.004742 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jul 25 01:13:26.004922 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:13:26.004906 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jul 25 01:13:26.009653 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:13:26.008480 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-649f89cdbf-n8b6q"] Jul 25 01:13:26.010221 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:13:26.010201 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jul 25 01:13:26.147273 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:13:26.147237 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6a43a5b1-26d2-48ba-984a-47f8f4df8963-console-oauth-config\") pod \"console-649f89cdbf-n8b6q\" (UID: \"6a43a5b1-26d2-48ba-984a-47f8f4df8963\") " pod="openshift-console/console-649f89cdbf-n8b6q" Jul 25 01:13:26.147457 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:13:26.147299 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6a43a5b1-26d2-48ba-984a-47f8f4df8963-console-config\") pod \"console-649f89cdbf-n8b6q\" (UID: \"6a43a5b1-26d2-48ba-984a-47f8f4df8963\") " pod="openshift-console/console-649f89cdbf-n8b6q" Jul 25 01:13:26.147457 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:13:26.147322 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6a43a5b1-26d2-48ba-984a-47f8f4df8963-trusted-ca-bundle\") pod \"console-649f89cdbf-n8b6q\" (UID: \"6a43a5b1-26d2-48ba-984a-47f8f4df8963\") " pod="openshift-console/console-649f89cdbf-n8b6q" Jul 25 01:13:26.147457 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:13:26.147349 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6a43a5b1-26d2-48ba-984a-47f8f4df8963-service-ca\") pod \"console-649f89cdbf-n8b6q\" (UID: \"6a43a5b1-26d2-48ba-984a-47f8f4df8963\") " pod="openshift-console/console-649f89cdbf-n8b6q" Jul 25 01:13:26.147457 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:13:26.147438 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fd59r\" (UniqueName: \"kubernetes.io/projected/6a43a5b1-26d2-48ba-984a-47f8f4df8963-kube-api-access-fd59r\") pod \"console-649f89cdbf-n8b6q\" (UID: \"6a43a5b1-26d2-48ba-984a-47f8f4df8963\") " pod="openshift-console/console-649f89cdbf-n8b6q" Jul 25 01:13:26.147682 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:13:26.147501 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6a43a5b1-26d2-48ba-984a-47f8f4df8963-console-serving-cert\") pod \"console-649f89cdbf-n8b6q\" (UID: \"6a43a5b1-26d2-48ba-984a-47f8f4df8963\") " pod="openshift-console/console-649f89cdbf-n8b6q" Jul 25 01:13:26.147682 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:13:26.147536 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6a43a5b1-26d2-48ba-984a-47f8f4df8963-oauth-serving-cert\") pod \"console-649f89cdbf-n8b6q\" (UID: \"6a43a5b1-26d2-48ba-984a-47f8f4df8963\") " pod="openshift-console/console-649f89cdbf-n8b6q" Jul 25 01:13:26.248662 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:13:26.248571 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6a43a5b1-26d2-48ba-984a-47f8f4df8963-console-config\") pod \"console-649f89cdbf-n8b6q\" (UID: \"6a43a5b1-26d2-48ba-984a-47f8f4df8963\") " pod="openshift-console/console-649f89cdbf-n8b6q" Jul 25 01:13:26.248662 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:13:26.248624 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6a43a5b1-26d2-48ba-984a-47f8f4df8963-trusted-ca-bundle\") pod \"console-649f89cdbf-n8b6q\" (UID: \"6a43a5b1-26d2-48ba-984a-47f8f4df8963\") " pod="openshift-console/console-649f89cdbf-n8b6q" Jul 25 01:13:26.248894 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:13:26.248750 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6a43a5b1-26d2-48ba-984a-47f8f4df8963-service-ca\") pod \"console-649f89cdbf-n8b6q\" (UID: \"6a43a5b1-26d2-48ba-984a-47f8f4df8963\") " pod="openshift-console/console-649f89cdbf-n8b6q" Jul 25 01:13:26.248894 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:13:26.248810 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fd59r\" (UniqueName: \"kubernetes.io/projected/6a43a5b1-26d2-48ba-984a-47f8f4df8963-kube-api-access-fd59r\") pod \"console-649f89cdbf-n8b6q\" (UID: \"6a43a5b1-26d2-48ba-984a-47f8f4df8963\") " pod="openshift-console/console-649f89cdbf-n8b6q" Jul 25 01:13:26.248894 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:13:26.248876 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6a43a5b1-26d2-48ba-984a-47f8f4df8963-console-serving-cert\") pod \"console-649f89cdbf-n8b6q\" (UID: \"6a43a5b1-26d2-48ba-984a-47f8f4df8963\") " pod="openshift-console/console-649f89cdbf-n8b6q" Jul 25 01:13:26.249030 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:13:26.248917 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6a43a5b1-26d2-48ba-984a-47f8f4df8963-oauth-serving-cert\") pod \"console-649f89cdbf-n8b6q\" (UID: \"6a43a5b1-26d2-48ba-984a-47f8f4df8963\") " pod="openshift-console/console-649f89cdbf-n8b6q" Jul 25 01:13:26.249030 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:13:26.248968 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6a43a5b1-26d2-48ba-984a-47f8f4df8963-console-oauth-config\") pod \"console-649f89cdbf-n8b6q\" (UID: \"6a43a5b1-26d2-48ba-984a-47f8f4df8963\") " pod="openshift-console/console-649f89cdbf-n8b6q" Jul 25 01:13:26.249259 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:13:26.249241 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6a43a5b1-26d2-48ba-984a-47f8f4df8963-console-config\") pod \"console-649f89cdbf-n8b6q\" (UID: \"6a43a5b1-26d2-48ba-984a-47f8f4df8963\") " pod="openshift-console/console-649f89cdbf-n8b6q" Jul 25 01:13:26.249759 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:13:26.249717 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6a43a5b1-26d2-48ba-984a-47f8f4df8963-trusted-ca-bundle\") pod \"console-649f89cdbf-n8b6q\" (UID: \"6a43a5b1-26d2-48ba-984a-47f8f4df8963\") " pod="openshift-console/console-649f89cdbf-n8b6q" Jul 25 01:13:26.249935 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:13:26.249915 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6a43a5b1-26d2-48ba-984a-47f8f4df8963-service-ca\") pod \"console-649f89cdbf-n8b6q\" (UID: \"6a43a5b1-26d2-48ba-984a-47f8f4df8963\") " pod="openshift-console/console-649f89cdbf-n8b6q" Jul 25 01:13:26.250212 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:13:26.250185 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6a43a5b1-26d2-48ba-984a-47f8f4df8963-oauth-serving-cert\") pod \"console-649f89cdbf-n8b6q\" (UID: \"6a43a5b1-26d2-48ba-984a-47f8f4df8963\") " pod="openshift-console/console-649f89cdbf-n8b6q" Jul 25 01:13:26.251978 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:13:26.251955 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6a43a5b1-26d2-48ba-984a-47f8f4df8963-console-oauth-config\") pod \"console-649f89cdbf-n8b6q\" (UID: \"6a43a5b1-26d2-48ba-984a-47f8f4df8963\") " pod="openshift-console/console-649f89cdbf-n8b6q" Jul 25 01:13:26.252156 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:13:26.252139 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6a43a5b1-26d2-48ba-984a-47f8f4df8963-console-serving-cert\") pod \"console-649f89cdbf-n8b6q\" (UID: \"6a43a5b1-26d2-48ba-984a-47f8f4df8963\") " pod="openshift-console/console-649f89cdbf-n8b6q" Jul 25 01:13:26.259874 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:13:26.259851 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fd59r\" (UniqueName: \"kubernetes.io/projected/6a43a5b1-26d2-48ba-984a-47f8f4df8963-kube-api-access-fd59r\") pod \"console-649f89cdbf-n8b6q\" (UID: \"6a43a5b1-26d2-48ba-984a-47f8f4df8963\") " pod="openshift-console/console-649f89cdbf-n8b6q" Jul 25 01:13:26.313250 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:13:26.313213 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-649f89cdbf-n8b6q" Jul 25 01:13:26.877888 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:13:26.877853 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-96d97dbb4-6f8rw"] Jul 25 01:13:26.910902 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:13:26.910874 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-96d97dbb4-6f8rw"] Jul 25 01:13:26.911089 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:13:26.910996 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-96d97dbb4-6f8rw" Jul 25 01:13:26.914488 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:13:26.914459 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\"" Jul 25 01:13:26.914890 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:13:26.914630 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-84q0b8aq6fs0c\"" Jul 25 01:13:26.914890 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:13:26.914653 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\"" Jul 25 01:13:26.914890 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:13:26.914702 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\"" Jul 25 01:13:26.915522 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:13:26.915269 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\"" Jul 25 01:13:26.915522 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:13:26.915266 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-vg898\"" Jul 25 01:13:26.915522 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:13:26.915266 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\"" Jul 25 01:13:27.056106 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:13:27.056072 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/7c20369c-7b04-4440-a97f-a0d510443a66-secret-thanos-querier-tls\") pod \"thanos-querier-96d97dbb4-6f8rw\" (UID: \"7c20369c-7b04-4440-a97f-a0d510443a66\") " pod="openshift-monitoring/thanos-querier-96d97dbb4-6f8rw" Jul 25 01:13:27.056106 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:13:27.056113 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/7c20369c-7b04-4440-a97f-a0d510443a66-secret-grpc-tls\") pod \"thanos-querier-96d97dbb4-6f8rw\" (UID: \"7c20369c-7b04-4440-a97f-a0d510443a66\") " pod="openshift-monitoring/thanos-querier-96d97dbb4-6f8rw" Jul 25 01:13:27.056613 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:13:27.056138 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7c20369c-7b04-4440-a97f-a0d510443a66-metrics-client-ca\") pod \"thanos-querier-96d97dbb4-6f8rw\" (UID: \"7c20369c-7b04-4440-a97f-a0d510443a66\") " pod="openshift-monitoring/thanos-querier-96d97dbb4-6f8rw" Jul 25 01:13:27.056613 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:13:27.056262 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/7c20369c-7b04-4440-a97f-a0d510443a66-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-96d97dbb4-6f8rw\" (UID: \"7c20369c-7b04-4440-a97f-a0d510443a66\") " pod="openshift-monitoring/thanos-querier-96d97dbb4-6f8rw" Jul 25 01:13:27.056613 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:13:27.056346 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/7c20369c-7b04-4440-a97f-a0d510443a66-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-96d97dbb4-6f8rw\" (UID: \"7c20369c-7b04-4440-a97f-a0d510443a66\") " pod="openshift-monitoring/thanos-querier-96d97dbb4-6f8rw" Jul 25 01:13:27.056613 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:13:27.056410 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/7c20369c-7b04-4440-a97f-a0d510443a66-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-96d97dbb4-6f8rw\" (UID: \"7c20369c-7b04-4440-a97f-a0d510443a66\") " pod="openshift-monitoring/thanos-querier-96d97dbb4-6f8rw" Jul 25 01:13:27.056613 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:13:27.056461 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/7c20369c-7b04-4440-a97f-a0d510443a66-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-96d97dbb4-6f8rw\" (UID: \"7c20369c-7b04-4440-a97f-a0d510443a66\") " pod="openshift-monitoring/thanos-querier-96d97dbb4-6f8rw" Jul 25 01:13:27.056613 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:13:27.056487 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7qxcz\" (UniqueName: \"kubernetes.io/projected/7c20369c-7b04-4440-a97f-a0d510443a66-kube-api-access-7qxcz\") pod \"thanos-querier-96d97dbb4-6f8rw\" (UID: \"7c20369c-7b04-4440-a97f-a0d510443a66\") " pod="openshift-monitoring/thanos-querier-96d97dbb4-6f8rw" Jul 25 01:13:27.157860 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:13:27.157788 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/7c20369c-7b04-4440-a97f-a0d510443a66-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-96d97dbb4-6f8rw\" (UID: \"7c20369c-7b04-4440-a97f-a0d510443a66\") " pod="openshift-monitoring/thanos-querier-96d97dbb4-6f8rw" Jul 25 01:13:27.158020 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:13:27.157859 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/7c20369c-7b04-4440-a97f-a0d510443a66-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-96d97dbb4-6f8rw\" (UID: \"7c20369c-7b04-4440-a97f-a0d510443a66\") " pod="openshift-monitoring/thanos-querier-96d97dbb4-6f8rw" Jul 25 01:13:27.158020 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:13:27.157902 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/7c20369c-7b04-4440-a97f-a0d510443a66-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-96d97dbb4-6f8rw\" (UID: \"7c20369c-7b04-4440-a97f-a0d510443a66\") " pod="openshift-monitoring/thanos-querier-96d97dbb4-6f8rw" Jul 25 01:13:27.158020 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:13:27.157940 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/7c20369c-7b04-4440-a97f-a0d510443a66-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-96d97dbb4-6f8rw\" (UID: \"7c20369c-7b04-4440-a97f-a0d510443a66\") " pod="openshift-monitoring/thanos-querier-96d97dbb4-6f8rw" Jul 25 01:13:27.158020 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:13:27.157964 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7qxcz\" (UniqueName: \"kubernetes.io/projected/7c20369c-7b04-4440-a97f-a0d510443a66-kube-api-access-7qxcz\") pod \"thanos-querier-96d97dbb4-6f8rw\" (UID: \"7c20369c-7b04-4440-a97f-a0d510443a66\") " pod="openshift-monitoring/thanos-querier-96d97dbb4-6f8rw" Jul 25 01:13:27.158020 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:13:27.158001 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/7c20369c-7b04-4440-a97f-a0d510443a66-secret-thanos-querier-tls\") pod \"thanos-querier-96d97dbb4-6f8rw\" (UID: \"7c20369c-7b04-4440-a97f-a0d510443a66\") " pod="openshift-monitoring/thanos-querier-96d97dbb4-6f8rw" Jul 25 01:13:27.158268 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:13:27.158027 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/7c20369c-7b04-4440-a97f-a0d510443a66-secret-grpc-tls\") pod \"thanos-querier-96d97dbb4-6f8rw\" (UID: \"7c20369c-7b04-4440-a97f-a0d510443a66\") " pod="openshift-monitoring/thanos-querier-96d97dbb4-6f8rw" Jul 25 01:13:27.158268 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:13:27.158056 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7c20369c-7b04-4440-a97f-a0d510443a66-metrics-client-ca\") pod \"thanos-querier-96d97dbb4-6f8rw\" (UID: \"7c20369c-7b04-4440-a97f-a0d510443a66\") " pod="openshift-monitoring/thanos-querier-96d97dbb4-6f8rw" Jul 25 01:13:27.158908 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:13:27.158852 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7c20369c-7b04-4440-a97f-a0d510443a66-metrics-client-ca\") pod \"thanos-querier-96d97dbb4-6f8rw\" (UID: \"7c20369c-7b04-4440-a97f-a0d510443a66\") " pod="openshift-monitoring/thanos-querier-96d97dbb4-6f8rw" Jul 25 01:13:27.160810 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:13:27.160780 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/7c20369c-7b04-4440-a97f-a0d510443a66-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-96d97dbb4-6f8rw\" (UID: \"7c20369c-7b04-4440-a97f-a0d510443a66\") " pod="openshift-monitoring/thanos-querier-96d97dbb4-6f8rw" Jul 25 01:13:27.161464 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:13:27.161434 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/7c20369c-7b04-4440-a97f-a0d510443a66-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-96d97dbb4-6f8rw\" (UID: \"7c20369c-7b04-4440-a97f-a0d510443a66\") " pod="openshift-monitoring/thanos-querier-96d97dbb4-6f8rw" Jul 25 01:13:27.161802 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:13:27.161776 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/7c20369c-7b04-4440-a97f-a0d510443a66-secret-grpc-tls\") pod \"thanos-querier-96d97dbb4-6f8rw\" (UID: \"7c20369c-7b04-4440-a97f-a0d510443a66\") " pod="openshift-monitoring/thanos-querier-96d97dbb4-6f8rw" Jul 25 01:13:27.161923 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:13:27.161829 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/7c20369c-7b04-4440-a97f-a0d510443a66-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-96d97dbb4-6f8rw\" (UID: \"7c20369c-7b04-4440-a97f-a0d510443a66\") " pod="openshift-monitoring/thanos-querier-96d97dbb4-6f8rw" Jul 25 01:13:27.162019 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:13:27.161996 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/7c20369c-7b04-4440-a97f-a0d510443a66-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-96d97dbb4-6f8rw\" (UID: \"7c20369c-7b04-4440-a97f-a0d510443a66\") " pod="openshift-monitoring/thanos-querier-96d97dbb4-6f8rw" Jul 25 01:13:27.162601 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:13:27.162578 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/7c20369c-7b04-4440-a97f-a0d510443a66-secret-thanos-querier-tls\") pod \"thanos-querier-96d97dbb4-6f8rw\" (UID: \"7c20369c-7b04-4440-a97f-a0d510443a66\") " pod="openshift-monitoring/thanos-querier-96d97dbb4-6f8rw" Jul 25 01:13:27.168602 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:13:27.168574 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7qxcz\" (UniqueName: \"kubernetes.io/projected/7c20369c-7b04-4440-a97f-a0d510443a66-kube-api-access-7qxcz\") pod \"thanos-querier-96d97dbb4-6f8rw\" (UID: \"7c20369c-7b04-4440-a97f-a0d510443a66\") " pod="openshift-monitoring/thanos-querier-96d97dbb4-6f8rw" Jul 25 01:13:27.223409 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:13:27.223366 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-96d97dbb4-6f8rw" Jul 25 01:13:28.069922 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:13:28.069889 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-78b8677c94-n8q7h"] Jul 25 01:13:28.116905 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:13:28.116865 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-78b8677c94-n8q7h"] Jul 25 01:13:28.117072 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:13:28.116981 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-78b8677c94-n8q7h" Jul 25 01:13:28.120356 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:13:28.120332 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-pqlg8\"" Jul 25 01:13:28.120356 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:13:28.120350 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\"" Jul 25 01:13:28.120586 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:13:28.120343 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\"" Jul 25 01:13:28.120644 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:13:28.120621 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-cgb2lh48g0jo5\"" Jul 25 01:13:28.120729 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:13:28.120713 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\"" Jul 25 01:13:28.120823 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:13:28.120807 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jul 25 01:13:28.166040 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:13:28.166011 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1574c662-782a-499f-8bc4-455489f78954-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-78b8677c94-n8q7h\" (UID: \"1574c662-782a-499f-8bc4-455489f78954\") " pod="openshift-monitoring/metrics-server-78b8677c94-n8q7h" Jul 25 01:13:28.166180 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:13:28.166067 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/1574c662-782a-499f-8bc4-455489f78954-metrics-server-audit-profiles\") pod \"metrics-server-78b8677c94-n8q7h\" (UID: \"1574c662-782a-499f-8bc4-455489f78954\") " pod="openshift-monitoring/metrics-server-78b8677c94-n8q7h" Jul 25 01:13:28.166180 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:13:28.166087 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/1574c662-782a-499f-8bc4-455489f78954-client-ca-bundle\") pod \"metrics-server-78b8677c94-n8q7h\" (UID: \"1574c662-782a-499f-8bc4-455489f78954\") " pod="openshift-monitoring/metrics-server-78b8677c94-n8q7h" Jul 25 01:13:28.166269 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:13:28.166188 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9ht27\" (UniqueName: \"kubernetes.io/projected/1574c662-782a-499f-8bc4-455489f78954-kube-api-access-9ht27\") pod \"metrics-server-78b8677c94-n8q7h\" (UID: \"1574c662-782a-499f-8bc4-455489f78954\") " pod="openshift-monitoring/metrics-server-78b8677c94-n8q7h" Jul 25 01:13:28.166269 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:13:28.166228 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/1574c662-782a-499f-8bc4-455489f78954-audit-log\") pod \"metrics-server-78b8677c94-n8q7h\" (UID: \"1574c662-782a-499f-8bc4-455489f78954\") " pod="openshift-monitoring/metrics-server-78b8677c94-n8q7h" Jul 25 01:13:28.166269 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:13:28.166258 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/1574c662-782a-499f-8bc4-455489f78954-secret-metrics-server-tls\") pod \"metrics-server-78b8677c94-n8q7h\" (UID: \"1574c662-782a-499f-8bc4-455489f78954\") " pod="openshift-monitoring/metrics-server-78b8677c94-n8q7h" Jul 25 01:13:28.166421 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:13:28.166280 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/1574c662-782a-499f-8bc4-455489f78954-secret-metrics-server-client-certs\") pod \"metrics-server-78b8677c94-n8q7h\" (UID: \"1574c662-782a-499f-8bc4-455489f78954\") " pod="openshift-monitoring/metrics-server-78b8677c94-n8q7h" Jul 25 01:13:28.266819 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:13:28.266783 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1574c662-782a-499f-8bc4-455489f78954-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-78b8677c94-n8q7h\" (UID: \"1574c662-782a-499f-8bc4-455489f78954\") " pod="openshift-monitoring/metrics-server-78b8677c94-n8q7h" Jul 25 01:13:28.266989 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:13:28.266867 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/1574c662-782a-499f-8bc4-455489f78954-metrics-server-audit-profiles\") pod \"metrics-server-78b8677c94-n8q7h\" (UID: \"1574c662-782a-499f-8bc4-455489f78954\") " pod="openshift-monitoring/metrics-server-78b8677c94-n8q7h" Jul 25 01:13:28.266989 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:13:28.266894 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/1574c662-782a-499f-8bc4-455489f78954-client-ca-bundle\") pod \"metrics-server-78b8677c94-n8q7h\" (UID: \"1574c662-782a-499f-8bc4-455489f78954\") " pod="openshift-monitoring/metrics-server-78b8677c94-n8q7h" Jul 25 01:13:28.266989 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:13:28.266927 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9ht27\" (UniqueName: \"kubernetes.io/projected/1574c662-782a-499f-8bc4-455489f78954-kube-api-access-9ht27\") pod \"metrics-server-78b8677c94-n8q7h\" (UID: \"1574c662-782a-499f-8bc4-455489f78954\") " pod="openshift-monitoring/metrics-server-78b8677c94-n8q7h" Jul 25 01:13:28.266989 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:13:28.266972 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/1574c662-782a-499f-8bc4-455489f78954-audit-log\") pod \"metrics-server-78b8677c94-n8q7h\" (UID: \"1574c662-782a-499f-8bc4-455489f78954\") " pod="openshift-monitoring/metrics-server-78b8677c94-n8q7h" Jul 25 01:13:28.267206 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:13:28.267012 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/1574c662-782a-499f-8bc4-455489f78954-secret-metrics-server-tls\") pod \"metrics-server-78b8677c94-n8q7h\" (UID: \"1574c662-782a-499f-8bc4-455489f78954\") " pod="openshift-monitoring/metrics-server-78b8677c94-n8q7h" Jul 25 01:13:28.267206 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:13:28.267037 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/1574c662-782a-499f-8bc4-455489f78954-secret-metrics-server-client-certs\") pod \"metrics-server-78b8677c94-n8q7h\" (UID: \"1574c662-782a-499f-8bc4-455489f78954\") " pod="openshift-monitoring/metrics-server-78b8677c94-n8q7h" Jul 25 01:13:28.267556 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:13:28.267498 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/1574c662-782a-499f-8bc4-455489f78954-audit-log\") pod \"metrics-server-78b8677c94-n8q7h\" (UID: \"1574c662-782a-499f-8bc4-455489f78954\") " pod="openshift-monitoring/metrics-server-78b8677c94-n8q7h" Jul 25 01:13:28.267686 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:13:28.267622 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1574c662-782a-499f-8bc4-455489f78954-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-78b8677c94-n8q7h\" (UID: \"1574c662-782a-499f-8bc4-455489f78954\") " pod="openshift-monitoring/metrics-server-78b8677c94-n8q7h" Jul 25 01:13:28.268109 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:13:28.268073 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/1574c662-782a-499f-8bc4-455489f78954-metrics-server-audit-profiles\") pod \"metrics-server-78b8677c94-n8q7h\" (UID: \"1574c662-782a-499f-8bc4-455489f78954\") " pod="openshift-monitoring/metrics-server-78b8677c94-n8q7h" Jul 25 01:13:28.269881 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:13:28.269859 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/1574c662-782a-499f-8bc4-455489f78954-client-ca-bundle\") pod \"metrics-server-78b8677c94-n8q7h\" (UID: \"1574c662-782a-499f-8bc4-455489f78954\") " pod="openshift-monitoring/metrics-server-78b8677c94-n8q7h" Jul 25 01:13:28.270006 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:13:28.269987 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/1574c662-782a-499f-8bc4-455489f78954-secret-metrics-server-client-certs\") pod \"metrics-server-78b8677c94-n8q7h\" (UID: \"1574c662-782a-499f-8bc4-455489f78954\") " pod="openshift-monitoring/metrics-server-78b8677c94-n8q7h" Jul 25 01:13:28.271134 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:13:28.271110 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/1574c662-782a-499f-8bc4-455489f78954-secret-metrics-server-tls\") pod \"metrics-server-78b8677c94-n8q7h\" (UID: \"1574c662-782a-499f-8bc4-455489f78954\") " pod="openshift-monitoring/metrics-server-78b8677c94-n8q7h" Jul 25 01:13:28.274807 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:13:28.274788 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9ht27\" (UniqueName: \"kubernetes.io/projected/1574c662-782a-499f-8bc4-455489f78954-kube-api-access-9ht27\") pod \"metrics-server-78b8677c94-n8q7h\" (UID: \"1574c662-782a-499f-8bc4-455489f78954\") " pod="openshift-monitoring/metrics-server-78b8677c94-n8q7h" Jul 25 01:13:28.428736 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:13:28.428594 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-78b8677c94-n8q7h" Jul 25 01:13:29.510337 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:13:29.510296 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode6618ca2_864b_408a_9825_84057199ae05.slice/crio-1fbe477f910a2af212e4a19fa5a8e6c21668d11a67d32a13a16131f944676727 WatchSource:0}: Error finding container 1fbe477f910a2af212e4a19fa5a8e6c21668d11a67d32a13a16131f944676727: Status 404 returned error can't find the container with id 1fbe477f910a2af212e4a19fa5a8e6c21668d11a67d32a13a16131f944676727 Jul 25 01:13:29.656103 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:13:29.656068 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-96d97dbb4-6f8rw"] Jul 25 01:13:29.796174 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:13:29.796138 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7c20369c_7b04_4440_a97f_a0d510443a66.slice/crio-55484569e003a08191f898bd1d95cafdb02f1cf0969857b346e38e3b8835e694 WatchSource:0}: Error finding container 55484569e003a08191f898bd1d95cafdb02f1cf0969857b346e38e3b8835e694: Status 404 returned error can't find the container with id 55484569e003a08191f898bd1d95cafdb02f1cf0969857b346e38e3b8835e694 Jul 25 01:13:29.873727 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:13:29.873689 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-78b8677c94-n8q7h"] Jul 25 01:13:29.876578 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:13:29.876491 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-649f89cdbf-n8b6q"] Jul 25 01:13:29.876660 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:13:29.876640 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1574c662_782a_499f_8bc4_455489f78954.slice/crio-a5a2876f217d206ac0f37d5e503b5907477e7cb0443708ef2d09e3369cdff1ee WatchSource:0}: Error finding container a5a2876f217d206ac0f37d5e503b5907477e7cb0443708ef2d09e3369cdff1ee: Status 404 returned error can't find the container with id a5a2876f217d206ac0f37d5e503b5907477e7cb0443708ef2d09e3369cdff1ee Jul 25 01:13:29.878584 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:13:29.878528 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6a43a5b1_26d2_48ba_984a_47f8f4df8963.slice/crio-bd5c28af1e6ccd69e60647ee2c13ec8c2bb87a7f409405c032c47b0d9d2d629a WatchSource:0}: Error finding container bd5c28af1e6ccd69e60647ee2c13ec8c2bb87a7f409405c032c47b0d9d2d629a: Status 404 returned error can't find the container with id bd5c28af1e6ccd69e60647ee2c13ec8c2bb87a7f409405c032c47b0d9d2d629a Jul 25 01:13:29.886418 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:13:29.886360 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 25 01:13:29.888406 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:13:29.888359 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod951e1890_cb13_4760_9cd3_4bb5db7c8a04.slice/crio-4e5437f3bf9ec8beb96ab859e29cab972e21fe835a7e9c38bf7d9d235b3aed18 WatchSource:0}: Error finding container 4e5437f3bf9ec8beb96ab859e29cab972e21fe835a7e9c38bf7d9d235b3aed18: Status 404 returned error can't find the container with id 4e5437f3bf9ec8beb96ab859e29cab972e21fe835a7e9c38bf7d9d235b3aed18 Jul 25 01:13:30.440581 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:13:30.438262 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-7c97dc4555-zkdh8" event={"ID":"ada8fa7b-3483-47e1-b9da-2aa44ded12c6","Type":"ContainerStarted","Data":"d1238f596403ff762dc6232339cdae69b65b8c90897a7c8ab319e0796f74fcd1"} Jul 25 01:13:30.440581 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:13:30.439575 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-7c97dc4555-zkdh8" Jul 25 01:13:30.443647 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:13:30.443624 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-98zxc" event={"ID":"e6618ca2-864b-408a-9825-84057199ae05","Type":"ContainerStarted","Data":"1fbe477f910a2af212e4a19fa5a8e6c21668d11a67d32a13a16131f944676727"} Jul 25 01:13:30.444986 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:13:30.444955 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-78b8677c94-n8q7h" event={"ID":"1574c662-782a-499f-8bc4-455489f78954","Type":"ContainerStarted","Data":"a5a2876f217d206ac0f37d5e503b5907477e7cb0443708ef2d09e3369cdff1ee"} Jul 25 01:13:30.446316 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:13:30.446290 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"951e1890-cb13-4760-9cd3-4bb5db7c8a04","Type":"ContainerStarted","Data":"4e5437f3bf9ec8beb96ab859e29cab972e21fe835a7e9c38bf7d9d235b3aed18"} Jul 25 01:13:30.447640 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:13:30.447621 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-96d97dbb4-6f8rw" event={"ID":"7c20369c-7b04-4440-a97f-a0d510443a66","Type":"ContainerStarted","Data":"55484569e003a08191f898bd1d95cafdb02f1cf0969857b346e38e3b8835e694"} Jul 25 01:13:30.448953 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:13:30.448928 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-649f89cdbf-n8b6q" event={"ID":"6a43a5b1-26d2-48ba-984a-47f8f4df8963","Type":"ContainerStarted","Data":"bd5c28af1e6ccd69e60647ee2c13ec8c2bb87a7f409405c032c47b0d9d2d629a"} Jul 25 01:13:30.452125 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:13:30.452107 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-7c97dc4555-zkdh8" Jul 25 01:13:30.459569 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:13:30.459527 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-7c97dc4555-zkdh8" podStartSLOduration=1.391496229 podStartE2EDuration="18.459509633s" totalImagesPullingTime="17.068013404s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-25 01:13:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-25 01:13:30.457631659 +0000 UTC m=+96.150726079" watchObservedRunningTime="2026-07-25 01:13:30.459509633 +0000 UTC m=+96.152604057" Jul 25 01:13:31.465022 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:13:31.464941 2567 generic.go:356] "Generic (PLEG): container finished" podID="e6618ca2-864b-408a-9825-84057199ae05" containerID="2d15b71a9bccbe8d9072e0603234c93d411ebdc98a4f1aee76a341a85e3079c2" exitCode=0 Jul 25 01:13:31.466157 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:13:31.466126 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-98zxc" event={"ID":"e6618ca2-864b-408a-9825-84057199ae05","Type":"ContainerDied","Data":"2d15b71a9bccbe8d9072e0603234c93d411ebdc98a4f1aee76a341a85e3079c2"} Jul 25 01:13:31.778082 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:13:31.777203 2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-6b68768447-slrxh"] Jul 25 01:13:32.475985 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:13:32.475892 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-98zxc" event={"ID":"e6618ca2-864b-408a-9825-84057199ae05","Type":"ContainerStarted","Data":"b70ab78440f1061142073deeb558492278d2ebe4152f4a19c74bd00011e59454"} Jul 25 01:13:33.174487 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:13:33.174403 2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-649f89cdbf-n8b6q"] Jul 25 01:13:34.286061 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:13:34.286035 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-znlzb" Jul 25 01:13:36.498967 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:13:36.498695 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-649f89cdbf-n8b6q" event={"ID":"6a43a5b1-26d2-48ba-984a-47f8f4df8963","Type":"ContainerStarted","Data":"32cebb6ca2c2db9ec62a298792d40232d669fe34fd25af90f1a7bc40f74fb537"} Jul 25 01:13:36.501964 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:13:36.501936 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-98zxc" event={"ID":"e6618ca2-864b-408a-9825-84057199ae05","Type":"ContainerStarted","Data":"6adae8e878cf574d67452021a8b770449e9b6b77004a437c76ee46f8ff2179c1"} Jul 25 01:13:36.504200 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:13:36.504142 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-78b8677c94-n8q7h" event={"ID":"1574c662-782a-499f-8bc4-455489f78954","Type":"ContainerStarted","Data":"4f3543632af4f19dce01989b0858cfed7a0a836a0c8d071560afff4d83a585bc"} Jul 25 01:13:36.506059 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:13:36.506031 2567 generic.go:356] "Generic (PLEG): container finished" podID="951e1890-cb13-4760-9cd3-4bb5db7c8a04" containerID="5a692be849dfc42029adf349118ca18ba71d48c38c6eb188520507e6e4f178be" exitCode=0 Jul 25 01:13:36.506173 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:13:36.506121 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"951e1890-cb13-4760-9cd3-4bb5db7c8a04","Type":"ContainerDied","Data":"5a692be849dfc42029adf349118ca18ba71d48c38c6eb188520507e6e4f178be"} Jul 25 01:13:36.509160 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:13:36.509134 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-96d97dbb4-6f8rw" event={"ID":"7c20369c-7b04-4440-a97f-a0d510443a66","Type":"ContainerStarted","Data":"15efca3507c9107b0337e5e58cc6810a4defaf6035ef117e89d1d5b5194ffc22"} Jul 25 01:13:36.509265 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:13:36.509232 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-96d97dbb4-6f8rw" event={"ID":"7c20369c-7b04-4440-a97f-a0d510443a66","Type":"ContainerStarted","Data":"d791475b3a1e618d9fe98c1cf80100d7bc1930a7fe9162c86c38beec83a912d1"} Jul 25 01:13:36.509321 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:13:36.509278 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-96d97dbb4-6f8rw" event={"ID":"7c20369c-7b04-4440-a97f-a0d510443a66","Type":"ContainerStarted","Data":"16c61070ce6bf7eb892602b41ebe036bf70141c52200662f94f8ccd0ea18c4d8"} Jul 25 01:13:36.517070 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:13:36.516966 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-649f89cdbf-n8b6q" podStartSLOduration=5.297127696 podStartE2EDuration="11.51694877s" totalImagesPullingTime="6.219821074s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-25 01:13:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-25 01:13:36.515268915 +0000 UTC m=+102.208363336" watchObservedRunningTime="2026-07-25 01:13:36.51694877 +0000 UTC m=+102.210043190" Jul 25 01:13:36.531421 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:13:36.531329 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-98zxc" podStartSLOduration=12.140132064 podStartE2EDuration="13.531312749s" totalImagesPullingTime="1.247020933s" totalInitContainerRuntime="144.159752ms" isStatefulPod=true podCreationTimestamp="2026-07-25 01:13:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-25 01:13:36.530808202 +0000 UTC m=+102.223902623" watchObservedRunningTime="2026-07-25 01:13:36.531312749 +0000 UTC m=+102.224407170" Jul 25 01:13:36.572623 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:13:36.572565 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-78b8677c94-n8q7h" podStartSLOduration=2.695109327 podStartE2EDuration="8.572543881s" totalImagesPullingTime="5.877434554s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-25 01:13:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-25 01:13:36.571116899 +0000 UTC m=+102.264211323" watchObservedRunningTime="2026-07-25 01:13:36.572543881 +0000 UTC m=+102.265638369" Jul 25 01:13:39.529241 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:13:39.529201 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"951e1890-cb13-4760-9cd3-4bb5db7c8a04","Type":"ContainerStarted","Data":"5fa2fca64bf49ef24c1aea34308e9390fc92c08e6f5797b82b80f474c338e7bf"} Jul 25 01:13:39.529683 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:13:39.529277 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"951e1890-cb13-4760-9cd3-4bb5db7c8a04","Type":"ContainerStarted","Data":"4c74c4a2da4dc9a96b5eb3c2780001137113363a07bde26af7ae25ef52dd7f3d"} Jul 25 01:13:39.529683 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:13:39.529303 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"951e1890-cb13-4760-9cd3-4bb5db7c8a04","Type":"ContainerStarted","Data":"cbb189415ddf23d44dd9f39ba371d8ccb1578ce22c68cf67618492ef9fe76fba"} Jul 25 01:13:39.529683 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:13:39.529328 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"951e1890-cb13-4760-9cd3-4bb5db7c8a04","Type":"ContainerStarted","Data":"9c9310b5034c3d16cf00e17eaa4fcbede6f8680e6c38f350e6debda4809ef18f"} Jul 25 01:13:39.529683 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:13:39.529350 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"951e1890-cb13-4760-9cd3-4bb5db7c8a04","Type":"ContainerStarted","Data":"3ef2625b6c83b4b061a0f6f6c5110b95f20497ea0d8c344dbaa10ca6833ddb8d"} Jul 25 01:13:39.532088 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:13:39.532064 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-96d97dbb4-6f8rw" event={"ID":"7c20369c-7b04-4440-a97f-a0d510443a66","Type":"ContainerStarted","Data":"34db74fadacdcb097c0749df9dfcfb2b04ccd83f3a785533b26e9f6511a7cd33"} Jul 25 01:13:39.532190 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:13:39.532129 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-96d97dbb4-6f8rw" event={"ID":"7c20369c-7b04-4440-a97f-a0d510443a66","Type":"ContainerStarted","Data":"1e6e1e60d2b8a387c284bfe38ecfb1906d659a315d94fd8a0f960af4e3f6ad51"} Jul 25 01:13:39.532190 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:13:39.532184 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-96d97dbb4-6f8rw" event={"ID":"7c20369c-7b04-4440-a97f-a0d510443a66","Type":"ContainerStarted","Data":"e25ea2cdc0d8ef0e8cbb8e0aa5323206d0166128a7f962324d4252450d932dd9"} Jul 25 01:13:39.532257 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:13:39.532217 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-96d97dbb4-6f8rw" Jul 25 01:13:39.553148 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:13:39.553100 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-96d97dbb4-6f8rw" podStartSLOduration=5.545782363 podStartE2EDuration="13.553080257s" totalImagesPullingTime="8.007297894s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-25 01:13:26 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-25 01:13:39.552806485 +0000 UTC m=+105.245900902" watchObservedRunningTime="2026-07-25 01:13:39.553080257 +0000 UTC m=+105.246174693" Jul 25 01:13:40.540504 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:13:40.540470 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"951e1890-cb13-4760-9cd3-4bb5db7c8a04","Type":"ContainerStarted","Data":"de16dd695ab8d55d6cc69ac422f8192d8cd0493bbce800b57ffb04b0ffc98f37"} Jul 25 01:13:40.572129 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:13:40.572068 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=8.359500599 podStartE2EDuration="16.572049916s" totalImagesPullingTime="8.188889209s" totalInitContainerRuntime="23.660108ms" isStatefulPod=false podCreationTimestamp="2026-07-25 01:13:24 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-25 01:13:40.571176996 +0000 UTC m=+106.264271414" watchObservedRunningTime="2026-07-25 01:13:40.572049916 +0000 UTC m=+106.265144326" Jul 25 01:13:45.547134 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:13:45.547108 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-96d97dbb4-6f8rw" Jul 25 01:13:45.565263 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:13:45.565239 2567 generic.go:356] "Generic (PLEG): container finished" podID="e1d86a8c-ea94-4770-8136-8448f268d6d1" containerID="b904fc172b160b33504cdbdddc4779a3c9ef45fd60001d8c131d8962ad901e7f" exitCode=0 Jul 25 01:13:45.565419 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:13:45.565317 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-27qc8" event={"ID":"e1d86a8c-ea94-4770-8136-8448f268d6d1","Type":"ContainerDied","Data":"b904fc172b160b33504cdbdddc4779a3c9ef45fd60001d8c131d8962ad901e7f"} Jul 25 01:13:45.565644 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:13:45.565629 2567 scope.go:117] "RemoveContainer" containerID="b904fc172b160b33504cdbdddc4779a3c9ef45fd60001d8c131d8962ad901e7f" Jul 25 01:13:45.567004 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:13:45.566985 2567 generic.go:356] "Generic (PLEG): container finished" podID="e456d8b2-d6d4-4b00-bc45-e046481d15bb" containerID="a06734b8f62a582d4f7e3b1eafead312ef164a74abbc86d27755d95686935b08" exitCode=0 Jul 25 01:13:45.567083 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:13:45.567026 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5885fdb759-kq9tj" event={"ID":"e456d8b2-d6d4-4b00-bc45-e046481d15bb","Type":"ContainerDied","Data":"a06734b8f62a582d4f7e3b1eafead312ef164a74abbc86d27755d95686935b08"} Jul 25 01:13:45.567295 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:13:45.567283 2567 scope.go:117] "RemoveContainer" containerID="a06734b8f62a582d4f7e3b1eafead312ef164a74abbc86d27755d95686935b08" Jul 25 01:13:46.216799 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:13:46.216773 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-54fd59887f-g5zgr_a8cb1021-bc16-4dfc-9252-3773f7aaea5b/router/0.log" Jul 25 01:13:46.222910 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:13:46.222889 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-6qrg6_76e646a1-4d05-4518-8d13-21d3fa3bbf7d/serve-healthcheck-canary/0.log" Jul 25 01:13:46.314007 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:13:46.313970 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-649f89cdbf-n8b6q" Jul 25 01:13:46.573600 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:13:46.573565 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5885fdb759-kq9tj" event={"ID":"e456d8b2-d6d4-4b00-bc45-e046481d15bb","Type":"ContainerStarted","Data":"8cb94d3e1ababaa3b6d56816a257ffc51d829bcab2478bd92bbd6d9f9fe42a92"} Jul 25 01:13:46.575315 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:13:46.575290 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-27qc8" event={"ID":"e1d86a8c-ea94-4770-8136-8448f268d6d1","Type":"ContainerStarted","Data":"de0003ba112dca9a07999745f9cca24eae2933becba27383e2185c498df917b0"} Jul 25 01:13:48.429468 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:13:48.429434 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-78b8677c94-n8q7h" Jul 25 01:13:48.429840 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:13:48.429492 2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-78b8677c94-n8q7h" Jul 25 01:13:56.829510 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:13:56.829437 2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-6b68768447-slrxh" podUID="9cb28390-ddda-4bf0-85e5-59c3702123bd" containerName="registry" containerID="cri-o://2e22195033aa6f979e713f2ca9120dcf0c2ce5ce27e5aaee34e24eab879518d1" gracePeriod=30 Jul 25 01:13:57.118777 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:13:57.118753 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6b68768447-slrxh" Jul 25 01:13:57.235056 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:13:57.235027 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/9cb28390-ddda-4bf0-85e5-59c3702123bd-ca-trust-extracted\") pod \"9cb28390-ddda-4bf0-85e5-59c3702123bd\" (UID: \"9cb28390-ddda-4bf0-85e5-59c3702123bd\") " Jul 25 01:13:57.235056 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:13:57.235061 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/9cb28390-ddda-4bf0-85e5-59c3702123bd-image-registry-private-configuration\") pod \"9cb28390-ddda-4bf0-85e5-59c3702123bd\" (UID: \"9cb28390-ddda-4bf0-85e5-59c3702123bd\") " Jul 25 01:13:57.235300 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:13:57.235084 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/9cb28390-ddda-4bf0-85e5-59c3702123bd-registry-certificates\") pod \"9cb28390-ddda-4bf0-85e5-59c3702123bd\" (UID: \"9cb28390-ddda-4bf0-85e5-59c3702123bd\") " Jul 25 01:13:57.235300 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:13:57.235103 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/9cb28390-ddda-4bf0-85e5-59c3702123bd-bound-sa-token\") pod \"9cb28390-ddda-4bf0-85e5-59c3702123bd\" (UID: \"9cb28390-ddda-4bf0-85e5-59c3702123bd\") " Jul 25 01:13:57.235300 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:13:57.235127 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9cb28390-ddda-4bf0-85e5-59c3702123bd-registry-tls\") pod \"9cb28390-ddda-4bf0-85e5-59c3702123bd\" (UID: \"9cb28390-ddda-4bf0-85e5-59c3702123bd\") " Jul 25 01:13:57.235300 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:13:57.235172 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/9cb28390-ddda-4bf0-85e5-59c3702123bd-trusted-ca\") pod \"9cb28390-ddda-4bf0-85e5-59c3702123bd\" (UID: \"9cb28390-ddda-4bf0-85e5-59c3702123bd\") " Jul 25 01:13:57.235300 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:13:57.235206 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-g2nwb\" (UniqueName: \"kubernetes.io/projected/9cb28390-ddda-4bf0-85e5-59c3702123bd-kube-api-access-g2nwb\") pod \"9cb28390-ddda-4bf0-85e5-59c3702123bd\" (UID: \"9cb28390-ddda-4bf0-85e5-59c3702123bd\") " Jul 25 01:13:57.235300 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:13:57.235239 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/9cb28390-ddda-4bf0-85e5-59c3702123bd-installation-pull-secrets\") pod \"9cb28390-ddda-4bf0-85e5-59c3702123bd\" (UID: \"9cb28390-ddda-4bf0-85e5-59c3702123bd\") " Jul 25 01:13:57.235627 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:13:57.235466 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9cb28390-ddda-4bf0-85e5-59c3702123bd-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "9cb28390-ddda-4bf0-85e5-59c3702123bd" (UID: "9cb28390-ddda-4bf0-85e5-59c3702123bd"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 25 01:13:57.235627 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:13:57.235579 2567 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/9cb28390-ddda-4bf0-85e5-59c3702123bd-registry-certificates\") on node \"ip-10-0-129-35.ec2.internal\" DevicePath \"\"" Jul 25 01:13:57.235908 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:13:57.235873 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9cb28390-ddda-4bf0-85e5-59c3702123bd-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "9cb28390-ddda-4bf0-85e5-59c3702123bd" (UID: "9cb28390-ddda-4bf0-85e5-59c3702123bd"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 25 01:13:57.238234 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:13:57.238194 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9cb28390-ddda-4bf0-85e5-59c3702123bd-kube-api-access-g2nwb" (OuterVolumeSpecName: "kube-api-access-g2nwb") pod "9cb28390-ddda-4bf0-85e5-59c3702123bd" (UID: "9cb28390-ddda-4bf0-85e5-59c3702123bd"). InnerVolumeSpecName "kube-api-access-g2nwb". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 25 01:13:57.238444 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:13:57.238415 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9cb28390-ddda-4bf0-85e5-59c3702123bd-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "9cb28390-ddda-4bf0-85e5-59c3702123bd" (UID: "9cb28390-ddda-4bf0-85e5-59c3702123bd"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 25 01:13:57.238529 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:13:57.238464 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9cb28390-ddda-4bf0-85e5-59c3702123bd-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "9cb28390-ddda-4bf0-85e5-59c3702123bd" (UID: "9cb28390-ddda-4bf0-85e5-59c3702123bd"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 25 01:13:57.238529 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:13:57.238495 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9cb28390-ddda-4bf0-85e5-59c3702123bd-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "9cb28390-ddda-4bf0-85e5-59c3702123bd" (UID: "9cb28390-ddda-4bf0-85e5-59c3702123bd"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 25 01:13:57.238764 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:13:57.238744 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9cb28390-ddda-4bf0-85e5-59c3702123bd-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "9cb28390-ddda-4bf0-85e5-59c3702123bd" (UID: "9cb28390-ddda-4bf0-85e5-59c3702123bd"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 25 01:13:57.245582 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:13:57.245560 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9cb28390-ddda-4bf0-85e5-59c3702123bd-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "9cb28390-ddda-4bf0-85e5-59c3702123bd" (UID: "9cb28390-ddda-4bf0-85e5-59c3702123bd"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 25 01:13:57.336402 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:13:57.336311 2567 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/9cb28390-ddda-4bf0-85e5-59c3702123bd-ca-trust-extracted\") on node \"ip-10-0-129-35.ec2.internal\" DevicePath \"\"" Jul 25 01:13:57.336402 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:13:57.336344 2567 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/9cb28390-ddda-4bf0-85e5-59c3702123bd-image-registry-private-configuration\") on node \"ip-10-0-129-35.ec2.internal\" DevicePath \"\"" Jul 25 01:13:57.336402 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:13:57.336354 2567 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/9cb28390-ddda-4bf0-85e5-59c3702123bd-bound-sa-token\") on node \"ip-10-0-129-35.ec2.internal\" DevicePath \"\"" Jul 25 01:13:57.336402 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:13:57.336363 2567 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9cb28390-ddda-4bf0-85e5-59c3702123bd-registry-tls\") on node \"ip-10-0-129-35.ec2.internal\" DevicePath \"\"" Jul 25 01:13:57.336402 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:13:57.336371 2567 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/9cb28390-ddda-4bf0-85e5-59c3702123bd-trusted-ca\") on node \"ip-10-0-129-35.ec2.internal\" DevicePath \"\"" Jul 25 01:13:57.336402 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:13:57.336397 2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-g2nwb\" (UniqueName: \"kubernetes.io/projected/9cb28390-ddda-4bf0-85e5-59c3702123bd-kube-api-access-g2nwb\") on node \"ip-10-0-129-35.ec2.internal\" DevicePath \"\"" Jul 25 01:13:57.336709 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:13:57.336408 2567 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/9cb28390-ddda-4bf0-85e5-59c3702123bd-installation-pull-secrets\") on node \"ip-10-0-129-35.ec2.internal\" DevicePath \"\"" Jul 25 01:13:57.623280 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:13:57.623189 2567 generic.go:356] "Generic (PLEG): container finished" podID="9cb28390-ddda-4bf0-85e5-59c3702123bd" containerID="2e22195033aa6f979e713f2ca9120dcf0c2ce5ce27e5aaee34e24eab879518d1" exitCode=0 Jul 25 01:13:57.623280 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:13:57.623242 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6b68768447-slrxh" Jul 25 01:13:57.623280 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:13:57.623257 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6b68768447-slrxh" event={"ID":"9cb28390-ddda-4bf0-85e5-59c3702123bd","Type":"ContainerDied","Data":"2e22195033aa6f979e713f2ca9120dcf0c2ce5ce27e5aaee34e24eab879518d1"} Jul 25 01:13:57.623656 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:13:57.623310 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6b68768447-slrxh" event={"ID":"9cb28390-ddda-4bf0-85e5-59c3702123bd","Type":"ContainerDied","Data":"f7ceae7c51583c3cdbf2e7a3aabf5ea385b21400660606b7e14e052e61c2b87b"} Jul 25 01:13:57.623656 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:13:57.623332 2567 scope.go:117] "RemoveContainer" containerID="2e22195033aa6f979e713f2ca9120dcf0c2ce5ce27e5aaee34e24eab879518d1" Jul 25 01:13:57.633601 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:13:57.633586 2567 scope.go:117] "RemoveContainer" containerID="2e22195033aa6f979e713f2ca9120dcf0c2ce5ce27e5aaee34e24eab879518d1" Jul 25 01:13:57.633860 ip-10-0-129-35 kubenswrapper[2567]: E0725 01:13:57.633838 2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2e22195033aa6f979e713f2ca9120dcf0c2ce5ce27e5aaee34e24eab879518d1\": container with ID starting with 2e22195033aa6f979e713f2ca9120dcf0c2ce5ce27e5aaee34e24eab879518d1 not found: ID does not exist" containerID="2e22195033aa6f979e713f2ca9120dcf0c2ce5ce27e5aaee34e24eab879518d1" Jul 25 01:13:57.633950 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:13:57.633865 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2e22195033aa6f979e713f2ca9120dcf0c2ce5ce27e5aaee34e24eab879518d1"} err="failed to get container status \"2e22195033aa6f979e713f2ca9120dcf0c2ce5ce27e5aaee34e24eab879518d1\": rpc error: code = NotFound desc = could not find container \"2e22195033aa6f979e713f2ca9120dcf0c2ce5ce27e5aaee34e24eab879518d1\": container with ID starting with 2e22195033aa6f979e713f2ca9120dcf0c2ce5ce27e5aaee34e24eab879518d1 not found: ID does not exist" Jul 25 01:13:57.645219 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:13:57.645199 2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-6b68768447-slrxh"] Jul 25 01:13:57.648562 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:13:57.648511 2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-6b68768447-slrxh"] Jul 25 01:13:58.786153 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:13:58.786125 2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9cb28390-ddda-4bf0-85e5-59c3702123bd" path="/var/lib/kubelet/pods/9cb28390-ddda-4bf0-85e5-59c3702123bd/volumes" Jul 25 01:14:00.638804 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:14:00.638771 2567 generic.go:356] "Generic (PLEG): container finished" podID="9a0cf75d-3421-4485-afd7-e555f06ba176" containerID="d95c4100d32e47b290d04325914f0165129c3668f04f171923386eda02d36f05" exitCode=0 Jul 25 01:14:00.639177 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:14:00.638812 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-5j29m" event={"ID":"9a0cf75d-3421-4485-afd7-e555f06ba176","Type":"ContainerDied","Data":"d95c4100d32e47b290d04325914f0165129c3668f04f171923386eda02d36f05"} Jul 25 01:14:00.639177 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:14:00.639172 2567 scope.go:117] "RemoveContainer" containerID="d95c4100d32e47b290d04325914f0165129c3668f04f171923386eda02d36f05" Jul 25 01:14:01.523468 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:14:01.523429 2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-649f89cdbf-n8b6q" podUID="6a43a5b1-26d2-48ba-984a-47f8f4df8963" containerName="console" containerID="cri-o://32cebb6ca2c2db9ec62a298792d40232d669fe34fd25af90f1a7bc40f74fb537" gracePeriod=15 Jul 25 01:14:01.644694 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:14:01.644662 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-5j29m" event={"ID":"9a0cf75d-3421-4485-afd7-e555f06ba176","Type":"ContainerStarted","Data":"b8efcfa6742b4bd1bbcbeaab34bc65515e68e3b0ddd045a9739e85dcb7de3174"} Jul 25 01:14:01.646234 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:14:01.646214 2567 generic.go:356] "Generic (PLEG): container finished" podID="6a43a5b1-26d2-48ba-984a-47f8f4df8963" containerID="32cebb6ca2c2db9ec62a298792d40232d669fe34fd25af90f1a7bc40f74fb537" exitCode=0 Jul 25 01:14:01.646345 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:14:01.646287 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-649f89cdbf-n8b6q" event={"ID":"6a43a5b1-26d2-48ba-984a-47f8f4df8963","Type":"ContainerDied","Data":"32cebb6ca2c2db9ec62a298792d40232d669fe34fd25af90f1a7bc40f74fb537"} Jul 25 01:14:01.814722 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:14:01.814703 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-649f89cdbf-n8b6q" Jul 25 01:14:01.981455 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:14:01.981425 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6a43a5b1-26d2-48ba-984a-47f8f4df8963-console-oauth-config\") pod \"6a43a5b1-26d2-48ba-984a-47f8f4df8963\" (UID: \"6a43a5b1-26d2-48ba-984a-47f8f4df8963\") " Jul 25 01:14:01.981455 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:14:01.981456 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6a43a5b1-26d2-48ba-984a-47f8f4df8963-oauth-serving-cert\") pod \"6a43a5b1-26d2-48ba-984a-47f8f4df8963\" (UID: \"6a43a5b1-26d2-48ba-984a-47f8f4df8963\") " Jul 25 01:14:01.981678 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:14:01.981495 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fd59r\" (UniqueName: \"kubernetes.io/projected/6a43a5b1-26d2-48ba-984a-47f8f4df8963-kube-api-access-fd59r\") pod \"6a43a5b1-26d2-48ba-984a-47f8f4df8963\" (UID: \"6a43a5b1-26d2-48ba-984a-47f8f4df8963\") " Jul 25 01:14:01.981678 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:14:01.981512 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6a43a5b1-26d2-48ba-984a-47f8f4df8963-console-config\") pod \"6a43a5b1-26d2-48ba-984a-47f8f4df8963\" (UID: \"6a43a5b1-26d2-48ba-984a-47f8f4df8963\") " Jul 25 01:14:01.981678 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:14:01.981566 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6a43a5b1-26d2-48ba-984a-47f8f4df8963-trusted-ca-bundle\") pod \"6a43a5b1-26d2-48ba-984a-47f8f4df8963\" (UID: \"6a43a5b1-26d2-48ba-984a-47f8f4df8963\") " Jul 25 01:14:01.981678 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:14:01.981585 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6a43a5b1-26d2-48ba-984a-47f8f4df8963-console-serving-cert\") pod \"6a43a5b1-26d2-48ba-984a-47f8f4df8963\" (UID: \"6a43a5b1-26d2-48ba-984a-47f8f4df8963\") " Jul 25 01:14:01.981678 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:14:01.981618 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6a43a5b1-26d2-48ba-984a-47f8f4df8963-service-ca\") pod \"6a43a5b1-26d2-48ba-984a-47f8f4df8963\" (UID: \"6a43a5b1-26d2-48ba-984a-47f8f4df8963\") " Jul 25 01:14:01.981945 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:14:01.981918 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6a43a5b1-26d2-48ba-984a-47f8f4df8963-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "6a43a5b1-26d2-48ba-984a-47f8f4df8963" (UID: "6a43a5b1-26d2-48ba-984a-47f8f4df8963"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 25 01:14:01.982060 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:14:01.982033 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6a43a5b1-26d2-48ba-984a-47f8f4df8963-service-ca" (OuterVolumeSpecName: "service-ca") pod "6a43a5b1-26d2-48ba-984a-47f8f4df8963" (UID: "6a43a5b1-26d2-48ba-984a-47f8f4df8963"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 25 01:14:01.982124 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:14:01.982083 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6a43a5b1-26d2-48ba-984a-47f8f4df8963-console-config" (OuterVolumeSpecName: "console-config") pod "6a43a5b1-26d2-48ba-984a-47f8f4df8963" (UID: "6a43a5b1-26d2-48ba-984a-47f8f4df8963"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 25 01:14:01.982175 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:14:01.982157 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6a43a5b1-26d2-48ba-984a-47f8f4df8963-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "6a43a5b1-26d2-48ba-984a-47f8f4df8963" (UID: "6a43a5b1-26d2-48ba-984a-47f8f4df8963"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 25 01:14:01.983955 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:14:01.983922 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6a43a5b1-26d2-48ba-984a-47f8f4df8963-kube-api-access-fd59r" (OuterVolumeSpecName: "kube-api-access-fd59r") pod "6a43a5b1-26d2-48ba-984a-47f8f4df8963" (UID: "6a43a5b1-26d2-48ba-984a-47f8f4df8963"). InnerVolumeSpecName "kube-api-access-fd59r". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 25 01:14:01.983955 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:14:01.983935 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6a43a5b1-26d2-48ba-984a-47f8f4df8963-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "6a43a5b1-26d2-48ba-984a-47f8f4df8963" (UID: "6a43a5b1-26d2-48ba-984a-47f8f4df8963"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 25 01:14:01.984098 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:14:01.983977 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6a43a5b1-26d2-48ba-984a-47f8f4df8963-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "6a43a5b1-26d2-48ba-984a-47f8f4df8963" (UID: "6a43a5b1-26d2-48ba-984a-47f8f4df8963"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 25 01:14:02.082356 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:14:02.082328 2567 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6a43a5b1-26d2-48ba-984a-47f8f4df8963-console-oauth-config\") on node \"ip-10-0-129-35.ec2.internal\" DevicePath \"\"" Jul 25 01:14:02.082356 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:14:02.082353 2567 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6a43a5b1-26d2-48ba-984a-47f8f4df8963-oauth-serving-cert\") on node \"ip-10-0-129-35.ec2.internal\" DevicePath \"\"" Jul 25 01:14:02.082356 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:14:02.082362 2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fd59r\" (UniqueName: \"kubernetes.io/projected/6a43a5b1-26d2-48ba-984a-47f8f4df8963-kube-api-access-fd59r\") on node \"ip-10-0-129-35.ec2.internal\" DevicePath \"\"" Jul 25 01:14:02.082579 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:14:02.082371 2567 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6a43a5b1-26d2-48ba-984a-47f8f4df8963-console-config\") on node \"ip-10-0-129-35.ec2.internal\" DevicePath \"\"" Jul 25 01:14:02.082579 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:14:02.082402 2567 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6a43a5b1-26d2-48ba-984a-47f8f4df8963-trusted-ca-bundle\") on node \"ip-10-0-129-35.ec2.internal\" DevicePath \"\"" Jul 25 01:14:02.082579 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:14:02.082412 2567 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6a43a5b1-26d2-48ba-984a-47f8f4df8963-console-serving-cert\") on node \"ip-10-0-129-35.ec2.internal\" DevicePath \"\"" Jul 25 01:14:02.082579 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:14:02.082420 2567 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6a43a5b1-26d2-48ba-984a-47f8f4df8963-service-ca\") on node \"ip-10-0-129-35.ec2.internal\" DevicePath \"\"" Jul 25 01:14:02.651906 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:14:02.651875 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-649f89cdbf-n8b6q" event={"ID":"6a43a5b1-26d2-48ba-984a-47f8f4df8963","Type":"ContainerDied","Data":"bd5c28af1e6ccd69e60647ee2c13ec8c2bb87a7f409405c032c47b0d9d2d629a"} Jul 25 01:14:02.652397 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:14:02.651927 2567 scope.go:117] "RemoveContainer" containerID="32cebb6ca2c2db9ec62a298792d40232d669fe34fd25af90f1a7bc40f74fb537" Jul 25 01:14:02.652397 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:14:02.651971 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-649f89cdbf-n8b6q" Jul 25 01:14:02.671247 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:14:02.671225 2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-649f89cdbf-n8b6q"] Jul 25 01:14:02.675963 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:14:02.675945 2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-649f89cdbf-n8b6q"] Jul 25 01:14:02.785974 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:14:02.785947 2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6a43a5b1-26d2-48ba-984a-47f8f4df8963" path="/var/lib/kubelet/pods/6a43a5b1-26d2-48ba-984a-47f8f4df8963/volumes" Jul 25 01:14:08.434499 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:14:08.434463 2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-78b8677c94-n8q7h" Jul 25 01:14:08.438427 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:14:08.438404 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-78b8677c94-n8q7h" Jul 25 01:14:44.082273 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:14:44.082241 2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 25 01:14:44.082784 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:14:44.082533 2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="951e1890-cb13-4760-9cd3-4bb5db7c8a04" containerName="alertmanager" containerID="cri-o://3ef2625b6c83b4b061a0f6f6c5110b95f20497ea0d8c344dbaa10ca6833ddb8d" gracePeriod=120 Jul 25 01:14:44.082784 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:14:44.082606 2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="951e1890-cb13-4760-9cd3-4bb5db7c8a04" containerName="kube-rbac-proxy-metric" containerID="cri-o://5fa2fca64bf49ef24c1aea34308e9390fc92c08e6f5797b82b80f474c338e7bf" gracePeriod=120 Jul 25 01:14:44.082784 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:14:44.082623 2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="951e1890-cb13-4760-9cd3-4bb5db7c8a04" containerName="prom-label-proxy" containerID="cri-o://de16dd695ab8d55d6cc69ac422f8192d8cd0493bbce800b57ffb04b0ffc98f37" gracePeriod=120 Jul 25 01:14:44.082784 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:14:44.082673 2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="951e1890-cb13-4760-9cd3-4bb5db7c8a04" containerName="kube-rbac-proxy-web" containerID="cri-o://cbb189415ddf23d44dd9f39ba371d8ccb1578ce22c68cf67618492ef9fe76fba" gracePeriod=120 Jul 25 01:14:44.082784 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:14:44.082688 2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="951e1890-cb13-4760-9cd3-4bb5db7c8a04" containerName="kube-rbac-proxy" containerID="cri-o://4c74c4a2da4dc9a96b5eb3c2780001137113363a07bde26af7ae25ef52dd7f3d" gracePeriod=120 Jul 25 01:14:44.082784 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:14:44.082707 2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="951e1890-cb13-4760-9cd3-4bb5db7c8a04" containerName="config-reloader" containerID="cri-o://9c9310b5034c3d16cf00e17eaa4fcbede6f8680e6c38f350e6debda4809ef18f" gracePeriod=120 Jul 25 01:14:44.816887 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:14:44.816856 2567 generic.go:356] "Generic (PLEG): container finished" podID="951e1890-cb13-4760-9cd3-4bb5db7c8a04" containerID="de16dd695ab8d55d6cc69ac422f8192d8cd0493bbce800b57ffb04b0ffc98f37" exitCode=0 Jul 25 01:14:44.816887 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:14:44.816882 2567 generic.go:356] "Generic (PLEG): container finished" podID="951e1890-cb13-4760-9cd3-4bb5db7c8a04" containerID="5fa2fca64bf49ef24c1aea34308e9390fc92c08e6f5797b82b80f474c338e7bf" exitCode=0 Jul 25 01:14:44.816887 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:14:44.816888 2567 generic.go:356] "Generic (PLEG): container finished" podID="951e1890-cb13-4760-9cd3-4bb5db7c8a04" containerID="4c74c4a2da4dc9a96b5eb3c2780001137113363a07bde26af7ae25ef52dd7f3d" exitCode=0 Jul 25 01:14:44.816887 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:14:44.816894 2567 generic.go:356] "Generic (PLEG): container finished" podID="951e1890-cb13-4760-9cd3-4bb5db7c8a04" containerID="9c9310b5034c3d16cf00e17eaa4fcbede6f8680e6c38f350e6debda4809ef18f" exitCode=0 Jul 25 01:14:44.816887 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:14:44.816900 2567 generic.go:356] "Generic (PLEG): container finished" podID="951e1890-cb13-4760-9cd3-4bb5db7c8a04" containerID="3ef2625b6c83b4b061a0f6f6c5110b95f20497ea0d8c344dbaa10ca6833ddb8d" exitCode=0 Jul 25 01:14:44.817171 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:14:44.816930 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"951e1890-cb13-4760-9cd3-4bb5db7c8a04","Type":"ContainerDied","Data":"de16dd695ab8d55d6cc69ac422f8192d8cd0493bbce800b57ffb04b0ffc98f37"} Jul 25 01:14:44.817171 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:14:44.816989 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"951e1890-cb13-4760-9cd3-4bb5db7c8a04","Type":"ContainerDied","Data":"5fa2fca64bf49ef24c1aea34308e9390fc92c08e6f5797b82b80f474c338e7bf"} Jul 25 01:14:44.817171 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:14:44.817015 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"951e1890-cb13-4760-9cd3-4bb5db7c8a04","Type":"ContainerDied","Data":"4c74c4a2da4dc9a96b5eb3c2780001137113363a07bde26af7ae25ef52dd7f3d"} Jul 25 01:14:44.817171 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:14:44.817049 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"951e1890-cb13-4760-9cd3-4bb5db7c8a04","Type":"ContainerDied","Data":"9c9310b5034c3d16cf00e17eaa4fcbede6f8680e6c38f350e6debda4809ef18f"} Jul 25 01:14:44.817171 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:14:44.817073 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"951e1890-cb13-4760-9cd3-4bb5db7c8a04","Type":"ContainerDied","Data":"3ef2625b6c83b4b061a0f6f6c5110b95f20497ea0d8c344dbaa10ca6833ddb8d"} Jul 25 01:14:45.318907 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:14:45.318882 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 25 01:14:45.405343 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:14:45.405272 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/951e1890-cb13-4760-9cd3-4bb5db7c8a04-alertmanager-trusted-ca-bundle\") pod \"951e1890-cb13-4760-9cd3-4bb5db7c8a04\" (UID: \"951e1890-cb13-4760-9cd3-4bb5db7c8a04\") " Jul 25 01:14:45.405343 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:14:45.405307 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/951e1890-cb13-4760-9cd3-4bb5db7c8a04-secret-alertmanager-main-tls\") pod \"951e1890-cb13-4760-9cd3-4bb5db7c8a04\" (UID: \"951e1890-cb13-4760-9cd3-4bb5db7c8a04\") " Jul 25 01:14:45.405343 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:14:45.405329 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/951e1890-cb13-4760-9cd3-4bb5db7c8a04-secret-alertmanager-kube-rbac-proxy\") pod \"951e1890-cb13-4760-9cd3-4bb5db7c8a04\" (UID: \"951e1890-cb13-4760-9cd3-4bb5db7c8a04\") " Jul 25 01:14:45.405638 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:14:45.405351 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/951e1890-cb13-4760-9cd3-4bb5db7c8a04-web-config\") pod \"951e1890-cb13-4760-9cd3-4bb5db7c8a04\" (UID: \"951e1890-cb13-4760-9cd3-4bb5db7c8a04\") " Jul 25 01:14:45.405638 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:14:45.405370 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/951e1890-cb13-4760-9cd3-4bb5db7c8a04-secret-alertmanager-kube-rbac-proxy-web\") pod \"951e1890-cb13-4760-9cd3-4bb5db7c8a04\" (UID: \"951e1890-cb13-4760-9cd3-4bb5db7c8a04\") " Jul 25 01:14:45.405638 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:14:45.405419 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-smk5w\" (UniqueName: \"kubernetes.io/projected/951e1890-cb13-4760-9cd3-4bb5db7c8a04-kube-api-access-smk5w\") pod \"951e1890-cb13-4760-9cd3-4bb5db7c8a04\" (UID: \"951e1890-cb13-4760-9cd3-4bb5db7c8a04\") " Jul 25 01:14:45.405638 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:14:45.405435 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/951e1890-cb13-4760-9cd3-4bb5db7c8a04-metrics-client-ca\") pod \"951e1890-cb13-4760-9cd3-4bb5db7c8a04\" (UID: \"951e1890-cb13-4760-9cd3-4bb5db7c8a04\") " Jul 25 01:14:45.405638 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:14:45.405462 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/951e1890-cb13-4760-9cd3-4bb5db7c8a04-cluster-tls-config\") pod \"951e1890-cb13-4760-9cd3-4bb5db7c8a04\" (UID: \"951e1890-cb13-4760-9cd3-4bb5db7c8a04\") " Jul 25 01:14:45.405879 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:14:45.405778 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/951e1890-cb13-4760-9cd3-4bb5db7c8a04-alertmanager-main-db\") pod \"951e1890-cb13-4760-9cd3-4bb5db7c8a04\" (UID: \"951e1890-cb13-4760-9cd3-4bb5db7c8a04\") " Jul 25 01:14:45.405927 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:14:45.405917 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/951e1890-cb13-4760-9cd3-4bb5db7c8a04-tls-assets\") pod \"951e1890-cb13-4760-9cd3-4bb5db7c8a04\" (UID: \"951e1890-cb13-4760-9cd3-4bb5db7c8a04\") " Jul 25 01:14:45.405966 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:14:45.405950 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/951e1890-cb13-4760-9cd3-4bb5db7c8a04-config-volume\") pod \"951e1890-cb13-4760-9cd3-4bb5db7c8a04\" (UID: \"951e1890-cb13-4760-9cd3-4bb5db7c8a04\") " Jul 25 01:14:45.406003 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:14:45.405975 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/951e1890-cb13-4760-9cd3-4bb5db7c8a04-config-out\") pod \"951e1890-cb13-4760-9cd3-4bb5db7c8a04\" (UID: \"951e1890-cb13-4760-9cd3-4bb5db7c8a04\") " Jul 25 01:14:45.406042 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:14:45.406029 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/951e1890-cb13-4760-9cd3-4bb5db7c8a04-secret-alertmanager-kube-rbac-proxy-metric\") pod \"951e1890-cb13-4760-9cd3-4bb5db7c8a04\" (UID: \"951e1890-cb13-4760-9cd3-4bb5db7c8a04\") " Jul 25 01:14:45.406656 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:14:45.405776 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/951e1890-cb13-4760-9cd3-4bb5db7c8a04-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "951e1890-cb13-4760-9cd3-4bb5db7c8a04" (UID: "951e1890-cb13-4760-9cd3-4bb5db7c8a04"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 25 01:14:45.406656 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:14:45.406042 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/951e1890-cb13-4760-9cd3-4bb5db7c8a04-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "951e1890-cb13-4760-9cd3-4bb5db7c8a04" (UID: "951e1890-cb13-4760-9cd3-4bb5db7c8a04"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 25 01:14:45.406656 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:14:45.406367 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/951e1890-cb13-4760-9cd3-4bb5db7c8a04-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "951e1890-cb13-4760-9cd3-4bb5db7c8a04" (UID: "951e1890-cb13-4760-9cd3-4bb5db7c8a04"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 25 01:14:45.406656 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:14:45.406551 2567 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/951e1890-cb13-4760-9cd3-4bb5db7c8a04-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-129-35.ec2.internal\" DevicePath \"\"" Jul 25 01:14:45.406929 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:14:45.406632 2567 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/951e1890-cb13-4760-9cd3-4bb5db7c8a04-metrics-client-ca\") on node \"ip-10-0-129-35.ec2.internal\" DevicePath \"\"" Jul 25 01:14:45.406929 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:14:45.406680 2567 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/951e1890-cb13-4760-9cd3-4bb5db7c8a04-alertmanager-main-db\") on node \"ip-10-0-129-35.ec2.internal\" DevicePath \"\"" Jul 25 01:14:45.408451 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:14:45.408407 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/951e1890-cb13-4760-9cd3-4bb5db7c8a04-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "951e1890-cb13-4760-9cd3-4bb5db7c8a04" (UID: "951e1890-cb13-4760-9cd3-4bb5db7c8a04"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 25 01:14:45.409126 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:14:45.409102 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/951e1890-cb13-4760-9cd3-4bb5db7c8a04-config-volume" (OuterVolumeSpecName: "config-volume") pod "951e1890-cb13-4760-9cd3-4bb5db7c8a04" (UID: "951e1890-cb13-4760-9cd3-4bb5db7c8a04"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 25 01:14:45.409429 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:14:45.409367 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/951e1890-cb13-4760-9cd3-4bb5db7c8a04-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "951e1890-cb13-4760-9cd3-4bb5db7c8a04" (UID: "951e1890-cb13-4760-9cd3-4bb5db7c8a04"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 25 01:14:45.409617 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:14:45.409590 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/951e1890-cb13-4760-9cd3-4bb5db7c8a04-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "951e1890-cb13-4760-9cd3-4bb5db7c8a04" (UID: "951e1890-cb13-4760-9cd3-4bb5db7c8a04"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 25 01:14:45.409702 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:14:45.409628 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/951e1890-cb13-4760-9cd3-4bb5db7c8a04-config-out" (OuterVolumeSpecName: "config-out") pod "951e1890-cb13-4760-9cd3-4bb5db7c8a04" (UID: "951e1890-cb13-4760-9cd3-4bb5db7c8a04"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 25 01:14:45.409702 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:14:45.409653 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/951e1890-cb13-4760-9cd3-4bb5db7c8a04-kube-api-access-smk5w" (OuterVolumeSpecName: "kube-api-access-smk5w") pod "951e1890-cb13-4760-9cd3-4bb5db7c8a04" (UID: "951e1890-cb13-4760-9cd3-4bb5db7c8a04"). InnerVolumeSpecName "kube-api-access-smk5w". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 25 01:14:45.410230 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:14:45.410211 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/951e1890-cb13-4760-9cd3-4bb5db7c8a04-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "951e1890-cb13-4760-9cd3-4bb5db7c8a04" (UID: "951e1890-cb13-4760-9cd3-4bb5db7c8a04"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 25 01:14:45.410630 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:14:45.410614 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/951e1890-cb13-4760-9cd3-4bb5db7c8a04-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "951e1890-cb13-4760-9cd3-4bb5db7c8a04" (UID: "951e1890-cb13-4760-9cd3-4bb5db7c8a04"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 25 01:14:45.414099 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:14:45.413934 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/951e1890-cb13-4760-9cd3-4bb5db7c8a04-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "951e1890-cb13-4760-9cd3-4bb5db7c8a04" (UID: "951e1890-cb13-4760-9cd3-4bb5db7c8a04"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 25 01:14:45.421208 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:14:45.421183 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/951e1890-cb13-4760-9cd3-4bb5db7c8a04-web-config" (OuterVolumeSpecName: "web-config") pod "951e1890-cb13-4760-9cd3-4bb5db7c8a04" (UID: "951e1890-cb13-4760-9cd3-4bb5db7c8a04"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 25 01:14:45.507551 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:14:45.507529 2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-smk5w\" (UniqueName: \"kubernetes.io/projected/951e1890-cb13-4760-9cd3-4bb5db7c8a04-kube-api-access-smk5w\") on node \"ip-10-0-129-35.ec2.internal\" DevicePath \"\"" Jul 25 01:14:45.507551 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:14:45.507549 2567 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/951e1890-cb13-4760-9cd3-4bb5db7c8a04-cluster-tls-config\") on node \"ip-10-0-129-35.ec2.internal\" DevicePath \"\"" Jul 25 01:14:45.507673 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:14:45.507558 2567 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/951e1890-cb13-4760-9cd3-4bb5db7c8a04-tls-assets\") on node \"ip-10-0-129-35.ec2.internal\" DevicePath \"\"" Jul 25 01:14:45.507673 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:14:45.507567 2567 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/951e1890-cb13-4760-9cd3-4bb5db7c8a04-config-volume\") on node \"ip-10-0-129-35.ec2.internal\" DevicePath \"\"" Jul 25 01:14:45.507673 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:14:45.507575 2567 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/951e1890-cb13-4760-9cd3-4bb5db7c8a04-config-out\") on node \"ip-10-0-129-35.ec2.internal\" DevicePath \"\"" Jul 25 01:14:45.507673 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:14:45.507583 2567 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/951e1890-cb13-4760-9cd3-4bb5db7c8a04-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-129-35.ec2.internal\" DevicePath \"\"" Jul 25 01:14:45.507673 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:14:45.507592 2567 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/951e1890-cb13-4760-9cd3-4bb5db7c8a04-secret-alertmanager-main-tls\") on node \"ip-10-0-129-35.ec2.internal\" DevicePath \"\"" Jul 25 01:14:45.507673 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:14:45.507600 2567 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/951e1890-cb13-4760-9cd3-4bb5db7c8a04-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-129-35.ec2.internal\" DevicePath \"\"" Jul 25 01:14:45.507673 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:14:45.507610 2567 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/951e1890-cb13-4760-9cd3-4bb5db7c8a04-web-config\") on node \"ip-10-0-129-35.ec2.internal\" DevicePath \"\"" Jul 25 01:14:45.507673 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:14:45.507617 2567 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/951e1890-cb13-4760-9cd3-4bb5db7c8a04-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-129-35.ec2.internal\" DevicePath \"\"" Jul 25 01:14:45.824183 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:14:45.824147 2567 generic.go:356] "Generic (PLEG): container finished" podID="951e1890-cb13-4760-9cd3-4bb5db7c8a04" containerID="cbb189415ddf23d44dd9f39ba371d8ccb1578ce22c68cf67618492ef9fe76fba" exitCode=0 Jul 25 01:14:45.824338 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:14:45.824229 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 25 01:14:45.824338 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:14:45.824237 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"951e1890-cb13-4760-9cd3-4bb5db7c8a04","Type":"ContainerDied","Data":"cbb189415ddf23d44dd9f39ba371d8ccb1578ce22c68cf67618492ef9fe76fba"} Jul 25 01:14:45.824338 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:14:45.824303 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"951e1890-cb13-4760-9cd3-4bb5db7c8a04","Type":"ContainerDied","Data":"4e5437f3bf9ec8beb96ab859e29cab972e21fe835a7e9c38bf7d9d235b3aed18"} Jul 25 01:14:45.824532 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:14:45.824340 2567 scope.go:117] "RemoveContainer" containerID="de16dd695ab8d55d6cc69ac422f8192d8cd0493bbce800b57ffb04b0ffc98f37" Jul 25 01:14:45.832602 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:14:45.832585 2567 scope.go:117] "RemoveContainer" containerID="5fa2fca64bf49ef24c1aea34308e9390fc92c08e6f5797b82b80f474c338e7bf" Jul 25 01:14:45.839539 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:14:45.839527 2567 scope.go:117] "RemoveContainer" containerID="4c74c4a2da4dc9a96b5eb3c2780001137113363a07bde26af7ae25ef52dd7f3d" Jul 25 01:14:45.846674 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:14:45.846654 2567 scope.go:117] "RemoveContainer" containerID="cbb189415ddf23d44dd9f39ba371d8ccb1578ce22c68cf67618492ef9fe76fba" Jul 25 01:14:45.846755 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:14:45.846713 2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 25 01:14:45.850611 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:14:45.850593 2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 25 01:14:45.853799 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:14:45.853786 2567 scope.go:117] "RemoveContainer" containerID="9c9310b5034c3d16cf00e17eaa4fcbede6f8680e6c38f350e6debda4809ef18f" Jul 25 01:14:45.860644 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:14:45.860628 2567 scope.go:117] "RemoveContainer" containerID="3ef2625b6c83b4b061a0f6f6c5110b95f20497ea0d8c344dbaa10ca6833ddb8d" Jul 25 01:14:45.867765 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:14:45.867742 2567 scope.go:117] "RemoveContainer" containerID="5a692be849dfc42029adf349118ca18ba71d48c38c6eb188520507e6e4f178be" Jul 25 01:14:45.874529 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:14:45.874499 2567 scope.go:117] "RemoveContainer" containerID="de16dd695ab8d55d6cc69ac422f8192d8cd0493bbce800b57ffb04b0ffc98f37" Jul 25 01:14:45.875029 ip-10-0-129-35 kubenswrapper[2567]: E0725 01:14:45.874992 2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"de16dd695ab8d55d6cc69ac422f8192d8cd0493bbce800b57ffb04b0ffc98f37\": container with ID starting with de16dd695ab8d55d6cc69ac422f8192d8cd0493bbce800b57ffb04b0ffc98f37 not found: ID does not exist" containerID="de16dd695ab8d55d6cc69ac422f8192d8cd0493bbce800b57ffb04b0ffc98f37" Jul 25 01:14:45.875122 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:14:45.875039 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"de16dd695ab8d55d6cc69ac422f8192d8cd0493bbce800b57ffb04b0ffc98f37"} err="failed to get container status \"de16dd695ab8d55d6cc69ac422f8192d8cd0493bbce800b57ffb04b0ffc98f37\": rpc error: code = NotFound desc = could not find container \"de16dd695ab8d55d6cc69ac422f8192d8cd0493bbce800b57ffb04b0ffc98f37\": container with ID starting with de16dd695ab8d55d6cc69ac422f8192d8cd0493bbce800b57ffb04b0ffc98f37 not found: ID does not exist" Jul 25 01:14:45.875122 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:14:45.875064 2567 scope.go:117] "RemoveContainer" containerID="5fa2fca64bf49ef24c1aea34308e9390fc92c08e6f5797b82b80f474c338e7bf" Jul 25 01:14:45.875427 ip-10-0-129-35 kubenswrapper[2567]: E0725 01:14:45.875362 2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5fa2fca64bf49ef24c1aea34308e9390fc92c08e6f5797b82b80f474c338e7bf\": container with ID starting with 5fa2fca64bf49ef24c1aea34308e9390fc92c08e6f5797b82b80f474c338e7bf not found: ID does not exist" containerID="5fa2fca64bf49ef24c1aea34308e9390fc92c08e6f5797b82b80f474c338e7bf" Jul 25 01:14:45.875533 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:14:45.875451 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5fa2fca64bf49ef24c1aea34308e9390fc92c08e6f5797b82b80f474c338e7bf"} err="failed to get container status \"5fa2fca64bf49ef24c1aea34308e9390fc92c08e6f5797b82b80f474c338e7bf\": rpc error: code = NotFound desc = could not find container \"5fa2fca64bf49ef24c1aea34308e9390fc92c08e6f5797b82b80f474c338e7bf\": container with ID starting with 5fa2fca64bf49ef24c1aea34308e9390fc92c08e6f5797b82b80f474c338e7bf not found: ID does not exist" Jul 25 01:14:45.875533 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:14:45.875476 2567 scope.go:117] "RemoveContainer" containerID="4c74c4a2da4dc9a96b5eb3c2780001137113363a07bde26af7ae25ef52dd7f3d" Jul 25 01:14:45.875742 ip-10-0-129-35 kubenswrapper[2567]: E0725 01:14:45.875725 2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4c74c4a2da4dc9a96b5eb3c2780001137113363a07bde26af7ae25ef52dd7f3d\": container with ID starting with 4c74c4a2da4dc9a96b5eb3c2780001137113363a07bde26af7ae25ef52dd7f3d not found: ID does not exist" containerID="4c74c4a2da4dc9a96b5eb3c2780001137113363a07bde26af7ae25ef52dd7f3d" Jul 25 01:14:45.875785 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:14:45.875747 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4c74c4a2da4dc9a96b5eb3c2780001137113363a07bde26af7ae25ef52dd7f3d"} err="failed to get container status \"4c74c4a2da4dc9a96b5eb3c2780001137113363a07bde26af7ae25ef52dd7f3d\": rpc error: code = NotFound desc = could not find container \"4c74c4a2da4dc9a96b5eb3c2780001137113363a07bde26af7ae25ef52dd7f3d\": container with ID starting with 4c74c4a2da4dc9a96b5eb3c2780001137113363a07bde26af7ae25ef52dd7f3d not found: ID does not exist" Jul 25 01:14:45.875785 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:14:45.875763 2567 scope.go:117] "RemoveContainer" containerID="cbb189415ddf23d44dd9f39ba371d8ccb1578ce22c68cf67618492ef9fe76fba" Jul 25 01:14:45.875976 ip-10-0-129-35 kubenswrapper[2567]: E0725 01:14:45.875960 2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cbb189415ddf23d44dd9f39ba371d8ccb1578ce22c68cf67618492ef9fe76fba\": container with ID starting with cbb189415ddf23d44dd9f39ba371d8ccb1578ce22c68cf67618492ef9fe76fba not found: ID does not exist" containerID="cbb189415ddf23d44dd9f39ba371d8ccb1578ce22c68cf67618492ef9fe76fba" Jul 25 01:14:45.876010 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:14:45.875982 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cbb189415ddf23d44dd9f39ba371d8ccb1578ce22c68cf67618492ef9fe76fba"} err="failed to get container status \"cbb189415ddf23d44dd9f39ba371d8ccb1578ce22c68cf67618492ef9fe76fba\": rpc error: code = NotFound desc = could not find container \"cbb189415ddf23d44dd9f39ba371d8ccb1578ce22c68cf67618492ef9fe76fba\": container with ID starting with cbb189415ddf23d44dd9f39ba371d8ccb1578ce22c68cf67618492ef9fe76fba not found: ID does not exist" Jul 25 01:14:45.876010 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:14:45.875995 2567 scope.go:117] "RemoveContainer" containerID="9c9310b5034c3d16cf00e17eaa4fcbede6f8680e6c38f350e6debda4809ef18f" Jul 25 01:14:45.876253 ip-10-0-129-35 kubenswrapper[2567]: E0725 01:14:45.876236 2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9c9310b5034c3d16cf00e17eaa4fcbede6f8680e6c38f350e6debda4809ef18f\": container with ID starting with 9c9310b5034c3d16cf00e17eaa4fcbede6f8680e6c38f350e6debda4809ef18f not found: ID does not exist" containerID="9c9310b5034c3d16cf00e17eaa4fcbede6f8680e6c38f350e6debda4809ef18f" Jul 25 01:14:45.876308 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:14:45.876257 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9c9310b5034c3d16cf00e17eaa4fcbede6f8680e6c38f350e6debda4809ef18f"} err="failed to get container status \"9c9310b5034c3d16cf00e17eaa4fcbede6f8680e6c38f350e6debda4809ef18f\": rpc error: code = NotFound desc = could not find container \"9c9310b5034c3d16cf00e17eaa4fcbede6f8680e6c38f350e6debda4809ef18f\": container with ID starting with 9c9310b5034c3d16cf00e17eaa4fcbede6f8680e6c38f350e6debda4809ef18f not found: ID does not exist" Jul 25 01:14:45.876308 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:14:45.876271 2567 scope.go:117] "RemoveContainer" containerID="3ef2625b6c83b4b061a0f6f6c5110b95f20497ea0d8c344dbaa10ca6833ddb8d" Jul 25 01:14:45.876423 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:14:45.876400 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 25 01:14:45.876572 ip-10-0-129-35 kubenswrapper[2567]: E0725 01:14:45.876554 2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3ef2625b6c83b4b061a0f6f6c5110b95f20497ea0d8c344dbaa10ca6833ddb8d\": container with ID starting with 3ef2625b6c83b4b061a0f6f6c5110b95f20497ea0d8c344dbaa10ca6833ddb8d not found: ID does not exist" containerID="3ef2625b6c83b4b061a0f6f6c5110b95f20497ea0d8c344dbaa10ca6833ddb8d" Jul 25 01:14:45.876609 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:14:45.876576 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3ef2625b6c83b4b061a0f6f6c5110b95f20497ea0d8c344dbaa10ca6833ddb8d"} err="failed to get container status \"3ef2625b6c83b4b061a0f6f6c5110b95f20497ea0d8c344dbaa10ca6833ddb8d\": rpc error: code = NotFound desc = could not find container \"3ef2625b6c83b4b061a0f6f6c5110b95f20497ea0d8c344dbaa10ca6833ddb8d\": container with ID starting with 3ef2625b6c83b4b061a0f6f6c5110b95f20497ea0d8c344dbaa10ca6833ddb8d not found: ID does not exist" Jul 25 01:14:45.876609 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:14:45.876589 2567 scope.go:117] "RemoveContainer" containerID="5a692be849dfc42029adf349118ca18ba71d48c38c6eb188520507e6e4f178be" Jul 25 01:14:45.876760 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:14:45.876747 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="951e1890-cb13-4760-9cd3-4bb5db7c8a04" containerName="config-reloader" Jul 25 01:14:45.876805 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:14:45.876763 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="951e1890-cb13-4760-9cd3-4bb5db7c8a04" containerName="config-reloader" Jul 25 01:14:45.876805 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:14:45.876779 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="951e1890-cb13-4760-9cd3-4bb5db7c8a04" containerName="prom-label-proxy" Jul 25 01:14:45.876805 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:14:45.876785 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="951e1890-cb13-4760-9cd3-4bb5db7c8a04" containerName="prom-label-proxy" Jul 25 01:14:45.876805 ip-10-0-129-35 kubenswrapper[2567]: E0725 01:14:45.876778 2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5a692be849dfc42029adf349118ca18ba71d48c38c6eb188520507e6e4f178be\": container with ID starting with 5a692be849dfc42029adf349118ca18ba71d48c38c6eb188520507e6e4f178be not found: ID does not exist" containerID="5a692be849dfc42029adf349118ca18ba71d48c38c6eb188520507e6e4f178be" Jul 25 01:14:45.876805 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:14:45.876797 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="951e1890-cb13-4760-9cd3-4bb5db7c8a04" containerName="alertmanager" Jul 25 01:14:45.876805 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:14:45.876806 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="951e1890-cb13-4760-9cd3-4bb5db7c8a04" containerName="alertmanager" Jul 25 01:14:45.876964 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:14:45.876804 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5a692be849dfc42029adf349118ca18ba71d48c38c6eb188520507e6e4f178be"} err="failed to get container status \"5a692be849dfc42029adf349118ca18ba71d48c38c6eb188520507e6e4f178be\": rpc error: code = NotFound desc = could not find container \"5a692be849dfc42029adf349118ca18ba71d48c38c6eb188520507e6e4f178be\": container with ID starting with 5a692be849dfc42029adf349118ca18ba71d48c38c6eb188520507e6e4f178be not found: ID does not exist" Jul 25 01:14:45.876964 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:14:45.876812 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6a43a5b1-26d2-48ba-984a-47f8f4df8963" containerName="console" Jul 25 01:14:45.876964 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:14:45.876818 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="6a43a5b1-26d2-48ba-984a-47f8f4df8963" containerName="console" Jul 25 01:14:45.876964 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:14:45.876825 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9cb28390-ddda-4bf0-85e5-59c3702123bd" containerName="registry" Jul 25 01:14:45.876964 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:14:45.876830 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="9cb28390-ddda-4bf0-85e5-59c3702123bd" containerName="registry" Jul 25 01:14:45.876964 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:14:45.876839 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="951e1890-cb13-4760-9cd3-4bb5db7c8a04" containerName="init-config-reloader" Jul 25 01:14:45.876964 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:14:45.876844 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="951e1890-cb13-4760-9cd3-4bb5db7c8a04" containerName="init-config-reloader" Jul 25 01:14:45.876964 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:14:45.876849 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="951e1890-cb13-4760-9cd3-4bb5db7c8a04" containerName="kube-rbac-proxy" Jul 25 01:14:45.876964 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:14:45.876854 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="951e1890-cb13-4760-9cd3-4bb5db7c8a04" containerName="kube-rbac-proxy" Jul 25 01:14:45.876964 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:14:45.876866 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="951e1890-cb13-4760-9cd3-4bb5db7c8a04" containerName="kube-rbac-proxy-web" Jul 25 01:14:45.876964 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:14:45.876875 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="951e1890-cb13-4760-9cd3-4bb5db7c8a04" containerName="kube-rbac-proxy-web" Jul 25 01:14:45.876964 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:14:45.876886 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="951e1890-cb13-4760-9cd3-4bb5db7c8a04" containerName="kube-rbac-proxy-metric" Jul 25 01:14:45.876964 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:14:45.876891 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="951e1890-cb13-4760-9cd3-4bb5db7c8a04" containerName="kube-rbac-proxy-metric" Jul 25 01:14:45.876964 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:14:45.876941 2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="6a43a5b1-26d2-48ba-984a-47f8f4df8963" containerName="console" Jul 25 01:14:45.876964 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:14:45.876950 2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="951e1890-cb13-4760-9cd3-4bb5db7c8a04" containerName="alertmanager" Jul 25 01:14:45.876964 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:14:45.876958 2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="951e1890-cb13-4760-9cd3-4bb5db7c8a04" containerName="prom-label-proxy" Jul 25 01:14:45.876964 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:14:45.876964 2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="951e1890-cb13-4760-9cd3-4bb5db7c8a04" containerName="kube-rbac-proxy" Jul 25 01:14:45.876964 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:14:45.876970 2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="951e1890-cb13-4760-9cd3-4bb5db7c8a04" containerName="config-reloader" Jul 25 01:14:45.877494 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:14:45.876975 2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="9cb28390-ddda-4bf0-85e5-59c3702123bd" containerName="registry" Jul 25 01:14:45.877494 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:14:45.876980 2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="951e1890-cb13-4760-9cd3-4bb5db7c8a04" containerName="kube-rbac-proxy-web" Jul 25 01:14:45.877494 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:14:45.876986 2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="951e1890-cb13-4760-9cd3-4bb5db7c8a04" containerName="kube-rbac-proxy-metric" Jul 25 01:14:45.880881 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:14:45.880867 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 25 01:14:45.883288 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:14:45.883271 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jul 25 01:14:45.883288 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:14:45.883284 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jul 25 01:14:45.883449 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:14:45.883296 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jul 25 01:14:45.883449 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:14:45.883309 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jul 25 01:14:45.883449 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:14:45.883352 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jul 25 01:14:45.883678 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:14:45.883661 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jul 25 01:14:45.883719 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:14:45.883675 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jul 25 01:14:45.883719 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:14:45.883697 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-j7n8v\"" Jul 25 01:14:45.883806 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:14:45.883680 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jul 25 01:14:45.889945 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:14:45.889925 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jul 25 01:14:45.893798 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:14:45.893777 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 25 01:14:45.910114 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:14:45.910095 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/a45440d0-9aaf-45c7-9460-e77558cd671b-config-out\") pod \"alertmanager-main-0\" (UID: \"a45440d0-9aaf-45c7-9460-e77558cd671b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 25 01:14:45.910192 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:14:45.910120 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/a45440d0-9aaf-45c7-9460-e77558cd671b-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"a45440d0-9aaf-45c7-9460-e77558cd671b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 25 01:14:45.910192 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:14:45.910136 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a45440d0-9aaf-45c7-9460-e77558cd671b-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"a45440d0-9aaf-45c7-9460-e77558cd671b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 25 01:14:45.910192 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:14:45.910159 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a45440d0-9aaf-45c7-9460-e77558cd671b-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"a45440d0-9aaf-45c7-9460-e77558cd671b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 25 01:14:45.910288 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:14:45.910227 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a45440d0-9aaf-45c7-9460-e77558cd671b-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"a45440d0-9aaf-45c7-9460-e77558cd671b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 25 01:14:45.910288 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:14:45.910263 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/a45440d0-9aaf-45c7-9460-e77558cd671b-web-config\") pod \"alertmanager-main-0\" (UID: \"a45440d0-9aaf-45c7-9460-e77558cd671b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 25 01:14:45.910350 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:14:45.910312 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/a45440d0-9aaf-45c7-9460-e77558cd671b-tls-assets\") pod \"alertmanager-main-0\" (UID: \"a45440d0-9aaf-45c7-9460-e77558cd671b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 25 01:14:45.910350 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:14:45.910343 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/a45440d0-9aaf-45c7-9460-e77558cd671b-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"a45440d0-9aaf-45c7-9460-e77558cd671b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 25 01:14:45.910431 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:14:45.910362 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kqhlb\" (UniqueName: \"kubernetes.io/projected/a45440d0-9aaf-45c7-9460-e77558cd671b-kube-api-access-kqhlb\") pod \"alertmanager-main-0\" (UID: \"a45440d0-9aaf-45c7-9460-e77558cd671b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 25 01:14:45.910431 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:14:45.910391 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/a45440d0-9aaf-45c7-9460-e77558cd671b-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"a45440d0-9aaf-45c7-9460-e77558cd671b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 25 01:14:45.910431 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:14:45.910419 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/a45440d0-9aaf-45c7-9460-e77558cd671b-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"a45440d0-9aaf-45c7-9460-e77558cd671b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 25 01:14:45.910514 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:14:45.910461 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/a45440d0-9aaf-45c7-9460-e77558cd671b-config-volume\") pod \"alertmanager-main-0\" (UID: \"a45440d0-9aaf-45c7-9460-e77558cd671b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 25 01:14:45.910514 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:14:45.910480 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a45440d0-9aaf-45c7-9460-e77558cd671b-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"a45440d0-9aaf-45c7-9460-e77558cd671b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 25 01:14:46.010767 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:14:46.010743 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a45440d0-9aaf-45c7-9460-e77558cd671b-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"a45440d0-9aaf-45c7-9460-e77558cd671b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 25 01:14:46.010864 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:14:46.010777 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a45440d0-9aaf-45c7-9460-e77558cd671b-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"a45440d0-9aaf-45c7-9460-e77558cd671b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 25 01:14:46.010864 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:14:46.010797 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/a45440d0-9aaf-45c7-9460-e77558cd671b-web-config\") pod \"alertmanager-main-0\" (UID: \"a45440d0-9aaf-45c7-9460-e77558cd671b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 25 01:14:46.010864 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:14:46.010839 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/a45440d0-9aaf-45c7-9460-e77558cd671b-tls-assets\") pod \"alertmanager-main-0\" (UID: \"a45440d0-9aaf-45c7-9460-e77558cd671b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 25 01:14:46.010864 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:14:46.010862 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/a45440d0-9aaf-45c7-9460-e77558cd671b-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"a45440d0-9aaf-45c7-9460-e77558cd671b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 25 01:14:46.011107 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:14:46.010877 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kqhlb\" (UniqueName: \"kubernetes.io/projected/a45440d0-9aaf-45c7-9460-e77558cd671b-kube-api-access-kqhlb\") pod \"alertmanager-main-0\" (UID: \"a45440d0-9aaf-45c7-9460-e77558cd671b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 25 01:14:46.011107 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:14:46.010894 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/a45440d0-9aaf-45c7-9460-e77558cd671b-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"a45440d0-9aaf-45c7-9460-e77558cd671b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 25 01:14:46.011107 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:14:46.010922 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/a45440d0-9aaf-45c7-9460-e77558cd671b-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"a45440d0-9aaf-45c7-9460-e77558cd671b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 25 01:14:46.011107 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:14:46.011056 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/a45440d0-9aaf-45c7-9460-e77558cd671b-config-volume\") pod \"alertmanager-main-0\" (UID: \"a45440d0-9aaf-45c7-9460-e77558cd671b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 25 01:14:46.011107 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:14:46.011094 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a45440d0-9aaf-45c7-9460-e77558cd671b-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"a45440d0-9aaf-45c7-9460-e77558cd671b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 25 01:14:46.011370 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:14:46.011132 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/a45440d0-9aaf-45c7-9460-e77558cd671b-config-out\") pod \"alertmanager-main-0\" (UID: \"a45440d0-9aaf-45c7-9460-e77558cd671b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 25 01:14:46.011370 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:14:46.011161 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/a45440d0-9aaf-45c7-9460-e77558cd671b-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"a45440d0-9aaf-45c7-9460-e77558cd671b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 25 01:14:46.011370 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:14:46.011187 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a45440d0-9aaf-45c7-9460-e77558cd671b-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"a45440d0-9aaf-45c7-9460-e77558cd671b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 25 01:14:46.011370 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:14:46.011337 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/a45440d0-9aaf-45c7-9460-e77558cd671b-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"a45440d0-9aaf-45c7-9460-e77558cd671b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 25 01:14:46.012599 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:14:46.012249 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a45440d0-9aaf-45c7-9460-e77558cd671b-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"a45440d0-9aaf-45c7-9460-e77558cd671b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 25 01:14:46.012599 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:14:46.012249 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a45440d0-9aaf-45c7-9460-e77558cd671b-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"a45440d0-9aaf-45c7-9460-e77558cd671b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 25 01:14:46.014074 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:14:46.014048 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a45440d0-9aaf-45c7-9460-e77558cd671b-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"a45440d0-9aaf-45c7-9460-e77558cd671b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 25 01:14:46.014188 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:14:46.014167 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/a45440d0-9aaf-45c7-9460-e77558cd671b-tls-assets\") pod \"alertmanager-main-0\" (UID: \"a45440d0-9aaf-45c7-9460-e77558cd671b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 25 01:14:46.014423 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:14:46.014370 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/a45440d0-9aaf-45c7-9460-e77558cd671b-config-out\") pod \"alertmanager-main-0\" (UID: \"a45440d0-9aaf-45c7-9460-e77558cd671b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 25 01:14:46.014905 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:14:46.014886 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/a45440d0-9aaf-45c7-9460-e77558cd671b-web-config\") pod \"alertmanager-main-0\" (UID: \"a45440d0-9aaf-45c7-9460-e77558cd671b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 25 01:14:46.014998 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:14:46.014951 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/a45440d0-9aaf-45c7-9460-e77558cd671b-config-volume\") pod \"alertmanager-main-0\" (UID: \"a45440d0-9aaf-45c7-9460-e77558cd671b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 25 01:14:46.015051 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:14:46.015030 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/a45440d0-9aaf-45c7-9460-e77558cd671b-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"a45440d0-9aaf-45c7-9460-e77558cd671b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 25 01:14:46.015090 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:14:46.015069 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a45440d0-9aaf-45c7-9460-e77558cd671b-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"a45440d0-9aaf-45c7-9460-e77558cd671b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 25 01:14:46.015732 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:14:46.015713 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/a45440d0-9aaf-45c7-9460-e77558cd671b-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"a45440d0-9aaf-45c7-9460-e77558cd671b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 25 01:14:46.016159 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:14:46.016135 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/a45440d0-9aaf-45c7-9460-e77558cd671b-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"a45440d0-9aaf-45c7-9460-e77558cd671b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 25 01:14:46.018242 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:14:46.018224 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kqhlb\" (UniqueName: \"kubernetes.io/projected/a45440d0-9aaf-45c7-9460-e77558cd671b-kube-api-access-kqhlb\") pod \"alertmanager-main-0\" (UID: \"a45440d0-9aaf-45c7-9460-e77558cd671b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 25 01:14:46.191067 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:14:46.191038 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 25 01:14:46.330965 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:14:46.330943 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 25 01:14:46.333294 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:14:46.333268 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda45440d0_9aaf_45c7_9460_e77558cd671b.slice/crio-632935573a5af4b66f6a0c35f8a3adeb9e76d5f87e6925ede86cf152ba2b8293 WatchSource:0}: Error finding container 632935573a5af4b66f6a0c35f8a3adeb9e76d5f87e6925ede86cf152ba2b8293: Status 404 returned error can't find the container with id 632935573a5af4b66f6a0c35f8a3adeb9e76d5f87e6925ede86cf152ba2b8293 Jul 25 01:14:46.785852 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:14:46.785822 2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="951e1890-cb13-4760-9cd3-4bb5db7c8a04" path="/var/lib/kubelet/pods/951e1890-cb13-4760-9cd3-4bb5db7c8a04/volumes" Jul 25 01:14:46.829802 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:14:46.829777 2567 generic.go:356] "Generic (PLEG): container finished" podID="a45440d0-9aaf-45c7-9460-e77558cd671b" containerID="af4f3ade0a2582115855131cde2757a7411d3c8a92b245aea2196823cb9014ac" exitCode=0 Jul 25 01:14:46.829926 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:14:46.829867 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"a45440d0-9aaf-45c7-9460-e77558cd671b","Type":"ContainerDied","Data":"af4f3ade0a2582115855131cde2757a7411d3c8a92b245aea2196823cb9014ac"} Jul 25 01:14:46.829987 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:14:46.829933 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"a45440d0-9aaf-45c7-9460-e77558cd671b","Type":"ContainerStarted","Data":"632935573a5af4b66f6a0c35f8a3adeb9e76d5f87e6925ede86cf152ba2b8293"} Jul 25 01:14:47.837348 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:14:47.837305 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"a45440d0-9aaf-45c7-9460-e77558cd671b","Type":"ContainerStarted","Data":"25a7d04d830ade6d92ae88739e3438e49b3f39a0b9452069b5c72f2bf59751bc"} Jul 25 01:14:47.837745 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:14:47.837395 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"a45440d0-9aaf-45c7-9460-e77558cd671b","Type":"ContainerStarted","Data":"daa7d1eba63e9ce85800e3fbe851c217a3549c26c449f2edca44801a7f842911"} Jul 25 01:14:47.837745 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:14:47.837429 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"a45440d0-9aaf-45c7-9460-e77558cd671b","Type":"ContainerStarted","Data":"05182e05bff5f057852ffe4ccd58753a7413c42fa1c35af7ffe362e7a95bc205"} Jul 25 01:14:47.837745 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:14:47.837454 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"a45440d0-9aaf-45c7-9460-e77558cd671b","Type":"ContainerStarted","Data":"3e84d8af86dce3cf33679fdb1a8a4a91c50778895e49e09aca24365c0e4349a5"} Jul 25 01:14:47.837745 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:14:47.837478 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"a45440d0-9aaf-45c7-9460-e77558cd671b","Type":"ContainerStarted","Data":"8c666ebe39bace2c2602d592d2ad32f4d31d69da92c345cd0100cbd89caa0ec0"} Jul 25 01:14:47.837745 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:14:47.837499 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"a45440d0-9aaf-45c7-9460-e77558cd671b","Type":"ContainerStarted","Data":"102982f662db6ad9cb8190bb281dc2f4f302fb656df1b708bcf713e705942d26"} Jul 25 01:14:47.862573 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:14:47.862534 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.847554596 podStartE2EDuration="2.862516653s" totalImagesPullingTime="0s" totalInitContainerRuntime="14.962057ms" isStatefulPod=false podCreationTimestamp="2026-07-25 01:14:45 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-25 01:14:47.860607504 +0000 UTC m=+173.553701949" watchObservedRunningTime="2026-07-25 01:14:47.862516653 +0000 UTC m=+173.555611071" Jul 25 01:14:48.113806 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:14:48.113729 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-b5b6f7fcb-srjg4"] Jul 25 01:14:48.117030 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:14:48.117007 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-b5b6f7fcb-srjg4" Jul 25 01:14:48.119233 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:14:48.119214 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\"" Jul 25 01:14:48.119501 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:14:48.119476 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\"" Jul 25 01:14:48.119501 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:14:48.119483 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\"" Jul 25 01:14:48.119671 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:14:48.119500 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\"" Jul 25 01:14:48.119671 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:14:48.119483 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-nmr8p\"" Jul 25 01:14:48.119671 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:14:48.119503 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\"" Jul 25 01:14:48.125793 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:14:48.125774 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\"" Jul 25 01:14:48.130340 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:14:48.130320 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-b5b6f7fcb-srjg4"] Jul 25 01:14:48.231194 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:14:48.231167 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f396f8e1-7b9c-43c9-9229-201466b8b34f-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-b5b6f7fcb-srjg4\" (UID: \"f396f8e1-7b9c-43c9-9229-201466b8b34f\") " pod="openshift-monitoring/telemeter-client-b5b6f7fcb-srjg4" Jul 25 01:14:48.231320 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:14:48.231202 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qwljd\" (UniqueName: \"kubernetes.io/projected/f396f8e1-7b9c-43c9-9229-201466b8b34f-kube-api-access-qwljd\") pod \"telemeter-client-b5b6f7fcb-srjg4\" (UID: \"f396f8e1-7b9c-43c9-9229-201466b8b34f\") " pod="openshift-monitoring/telemeter-client-b5b6f7fcb-srjg4" Jul 25 01:14:48.231320 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:14:48.231244 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f396f8e1-7b9c-43c9-9229-201466b8b34f-telemeter-trusted-ca-bundle\") pod \"telemeter-client-b5b6f7fcb-srjg4\" (UID: \"f396f8e1-7b9c-43c9-9229-201466b8b34f\") " pod="openshift-monitoring/telemeter-client-b5b6f7fcb-srjg4" Jul 25 01:14:48.231320 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:14:48.231281 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/f396f8e1-7b9c-43c9-9229-201466b8b34f-federate-client-tls\") pod \"telemeter-client-b5b6f7fcb-srjg4\" (UID: \"f396f8e1-7b9c-43c9-9229-201466b8b34f\") " pod="openshift-monitoring/telemeter-client-b5b6f7fcb-srjg4" Jul 25 01:14:48.231320 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:14:48.231310 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/f396f8e1-7b9c-43c9-9229-201466b8b34f-telemeter-client-tls\") pod \"telemeter-client-b5b6f7fcb-srjg4\" (UID: \"f396f8e1-7b9c-43c9-9229-201466b8b34f\") " pod="openshift-monitoring/telemeter-client-b5b6f7fcb-srjg4" Jul 25 01:14:48.231500 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:14:48.231357 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f396f8e1-7b9c-43c9-9229-201466b8b34f-serving-certs-ca-bundle\") pod \"telemeter-client-b5b6f7fcb-srjg4\" (UID: \"f396f8e1-7b9c-43c9-9229-201466b8b34f\") " pod="openshift-monitoring/telemeter-client-b5b6f7fcb-srjg4" Jul 25 01:14:48.231500 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:14:48.231439 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/f396f8e1-7b9c-43c9-9229-201466b8b34f-secret-telemeter-client\") pod \"telemeter-client-b5b6f7fcb-srjg4\" (UID: \"f396f8e1-7b9c-43c9-9229-201466b8b34f\") " pod="openshift-monitoring/telemeter-client-b5b6f7fcb-srjg4" Jul 25 01:14:48.231500 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:14:48.231463 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f396f8e1-7b9c-43c9-9229-201466b8b34f-metrics-client-ca\") pod \"telemeter-client-b5b6f7fcb-srjg4\" (UID: \"f396f8e1-7b9c-43c9-9229-201466b8b34f\") " pod="openshift-monitoring/telemeter-client-b5b6f7fcb-srjg4" Jul 25 01:14:48.332086 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:14:48.332059 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f396f8e1-7b9c-43c9-9229-201466b8b34f-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-b5b6f7fcb-srjg4\" (UID: \"f396f8e1-7b9c-43c9-9229-201466b8b34f\") " pod="openshift-monitoring/telemeter-client-b5b6f7fcb-srjg4" Jul 25 01:14:48.332209 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:14:48.332092 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qwljd\" (UniqueName: \"kubernetes.io/projected/f396f8e1-7b9c-43c9-9229-201466b8b34f-kube-api-access-qwljd\") pod \"telemeter-client-b5b6f7fcb-srjg4\" (UID: \"f396f8e1-7b9c-43c9-9229-201466b8b34f\") " pod="openshift-monitoring/telemeter-client-b5b6f7fcb-srjg4" Jul 25 01:14:48.332209 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:14:48.332129 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f396f8e1-7b9c-43c9-9229-201466b8b34f-telemeter-trusted-ca-bundle\") pod \"telemeter-client-b5b6f7fcb-srjg4\" (UID: \"f396f8e1-7b9c-43c9-9229-201466b8b34f\") " pod="openshift-monitoring/telemeter-client-b5b6f7fcb-srjg4" Jul 25 01:14:48.332209 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:14:48.332166 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/f396f8e1-7b9c-43c9-9229-201466b8b34f-federate-client-tls\") pod \"telemeter-client-b5b6f7fcb-srjg4\" (UID: \"f396f8e1-7b9c-43c9-9229-201466b8b34f\") " pod="openshift-monitoring/telemeter-client-b5b6f7fcb-srjg4" Jul 25 01:14:48.332209 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:14:48.332204 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/f396f8e1-7b9c-43c9-9229-201466b8b34f-telemeter-client-tls\") pod \"telemeter-client-b5b6f7fcb-srjg4\" (UID: \"f396f8e1-7b9c-43c9-9229-201466b8b34f\") " pod="openshift-monitoring/telemeter-client-b5b6f7fcb-srjg4" Jul 25 01:14:48.332452 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:14:48.332234 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f396f8e1-7b9c-43c9-9229-201466b8b34f-serving-certs-ca-bundle\") pod \"telemeter-client-b5b6f7fcb-srjg4\" (UID: \"f396f8e1-7b9c-43c9-9229-201466b8b34f\") " pod="openshift-monitoring/telemeter-client-b5b6f7fcb-srjg4" Jul 25 01:14:48.332452 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:14:48.332271 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/f396f8e1-7b9c-43c9-9229-201466b8b34f-secret-telemeter-client\") pod \"telemeter-client-b5b6f7fcb-srjg4\" (UID: \"f396f8e1-7b9c-43c9-9229-201466b8b34f\") " pod="openshift-monitoring/telemeter-client-b5b6f7fcb-srjg4" Jul 25 01:14:48.332452 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:14:48.332301 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f396f8e1-7b9c-43c9-9229-201466b8b34f-metrics-client-ca\") pod \"telemeter-client-b5b6f7fcb-srjg4\" (UID: \"f396f8e1-7b9c-43c9-9229-201466b8b34f\") " pod="openshift-monitoring/telemeter-client-b5b6f7fcb-srjg4" Jul 25 01:14:48.333020 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:14:48.332994 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f396f8e1-7b9c-43c9-9229-201466b8b34f-serving-certs-ca-bundle\") pod \"telemeter-client-b5b6f7fcb-srjg4\" (UID: \"f396f8e1-7b9c-43c9-9229-201466b8b34f\") " pod="openshift-monitoring/telemeter-client-b5b6f7fcb-srjg4" Jul 25 01:14:48.333261 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:14:48.333241 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f396f8e1-7b9c-43c9-9229-201466b8b34f-metrics-client-ca\") pod \"telemeter-client-b5b6f7fcb-srjg4\" (UID: \"f396f8e1-7b9c-43c9-9229-201466b8b34f\") " pod="openshift-monitoring/telemeter-client-b5b6f7fcb-srjg4" Jul 25 01:14:48.333440 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:14:48.333418 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f396f8e1-7b9c-43c9-9229-201466b8b34f-telemeter-trusted-ca-bundle\") pod \"telemeter-client-b5b6f7fcb-srjg4\" (UID: \"f396f8e1-7b9c-43c9-9229-201466b8b34f\") " pod="openshift-monitoring/telemeter-client-b5b6f7fcb-srjg4" Jul 25 01:14:48.334855 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:14:48.334835 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/f396f8e1-7b9c-43c9-9229-201466b8b34f-secret-telemeter-client\") pod \"telemeter-client-b5b6f7fcb-srjg4\" (UID: \"f396f8e1-7b9c-43c9-9229-201466b8b34f\") " pod="openshift-monitoring/telemeter-client-b5b6f7fcb-srjg4" Jul 25 01:14:48.334931 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:14:48.334893 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/f396f8e1-7b9c-43c9-9229-201466b8b34f-telemeter-client-tls\") pod \"telemeter-client-b5b6f7fcb-srjg4\" (UID: \"f396f8e1-7b9c-43c9-9229-201466b8b34f\") " pod="openshift-monitoring/telemeter-client-b5b6f7fcb-srjg4" Jul 25 01:14:48.335236 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:14:48.335218 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/f396f8e1-7b9c-43c9-9229-201466b8b34f-federate-client-tls\") pod \"telemeter-client-b5b6f7fcb-srjg4\" (UID: \"f396f8e1-7b9c-43c9-9229-201466b8b34f\") " pod="openshift-monitoring/telemeter-client-b5b6f7fcb-srjg4" Jul 25 01:14:48.335299 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:14:48.335225 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f396f8e1-7b9c-43c9-9229-201466b8b34f-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-b5b6f7fcb-srjg4\" (UID: \"f396f8e1-7b9c-43c9-9229-201466b8b34f\") " pod="openshift-monitoring/telemeter-client-b5b6f7fcb-srjg4" Jul 25 01:14:48.339399 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:14:48.339364 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qwljd\" (UniqueName: \"kubernetes.io/projected/f396f8e1-7b9c-43c9-9229-201466b8b34f-kube-api-access-qwljd\") pod \"telemeter-client-b5b6f7fcb-srjg4\" (UID: \"f396f8e1-7b9c-43c9-9229-201466b8b34f\") " pod="openshift-monitoring/telemeter-client-b5b6f7fcb-srjg4" Jul 25 01:14:48.427740 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:14:48.427687 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-b5b6f7fcb-srjg4" Jul 25 01:14:48.573226 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:14:48.573205 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-b5b6f7fcb-srjg4"] Jul 25 01:14:48.575208 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:14:48.575176 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf396f8e1_7b9c_43c9_9229_201466b8b34f.slice/crio-84c29c5e25966e38e0d9060a7f7cfbeca578aa07d07154706d80dfa2350aa7f1 WatchSource:0}: Error finding container 84c29c5e25966e38e0d9060a7f7cfbeca578aa07d07154706d80dfa2350aa7f1: Status 404 returned error can't find the container with id 84c29c5e25966e38e0d9060a7f7cfbeca578aa07d07154706d80dfa2350aa7f1 Jul 25 01:14:48.848076 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:14:48.848043 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-b5b6f7fcb-srjg4" event={"ID":"f396f8e1-7b9c-43c9-9229-201466b8b34f","Type":"ContainerStarted","Data":"84c29c5e25966e38e0d9060a7f7cfbeca578aa07d07154706d80dfa2350aa7f1"} Jul 25 01:14:50.860675 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:14:50.860640 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-b5b6f7fcb-srjg4" event={"ID":"f396f8e1-7b9c-43c9-9229-201466b8b34f","Type":"ContainerStarted","Data":"2efab46486153232ba2d3ed5cd39346704a9f8c6843baa76a02d836fafcad4c5"} Jul 25 01:14:50.861098 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:14:50.860691 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-b5b6f7fcb-srjg4" event={"ID":"f396f8e1-7b9c-43c9-9229-201466b8b34f","Type":"ContainerStarted","Data":"98f7c1fdda4ce910865ffc9dd34c6a689755c17ca8ea7b72569315c994209fca"} Jul 25 01:14:50.861098 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:14:50.860709 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-b5b6f7fcb-srjg4" event={"ID":"f396f8e1-7b9c-43c9-9229-201466b8b34f","Type":"ContainerStarted","Data":"68b1ed7124ed4f95191c30d34278dbb7dfeb839792078fe1abdb722908a2407b"} Jul 25 01:14:50.884013 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:14:50.883968 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-b5b6f7fcb-srjg4" podStartSLOduration=1.114911061 podStartE2EDuration="2.883950253s" totalImagesPullingTime="1.769039192s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-25 01:14:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-25 01:14:50.882103245 +0000 UTC m=+176.575197661" watchObservedRunningTime="2026-07-25 01:14:50.883950253 +0000 UTC m=+176.577044671" Jul 25 01:16:54.666606 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:16:54.666580 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-s5tbd_a9cb9aa9-8f43-4b32-a7b7-4eb9afb05c90/console-operator/1.log" Jul 25 01:16:54.669914 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:16:54.669891 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-s5tbd_a9cb9aa9-8f43-4b32-a7b7-4eb9afb05c90/console-operator/1.log" Jul 25 01:16:54.676695 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:16:54.676679 2567 kubelet.go:1648] "Image garbage collection succeeded" Jul 25 01:17:39.375422 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:17:39.375388 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-54tnh"] Jul 25 01:17:39.378648 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:17:39.378631 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-54tnh" Jul 25 01:17:39.381535 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:17:39.381511 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\"" Jul 25 01:17:39.381900 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:17:39.381881 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-lxfdr\"" Jul 25 01:17:39.382117 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:17:39.382102 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\"" Jul 25 01:17:39.390777 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:17:39.390754 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4b2bcf55-db39-4d69-999a-9da9df2396ee-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-54tnh\" (UID: \"4b2bcf55-db39-4d69-999a-9da9df2396ee\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-54tnh" Jul 25 01:17:39.390865 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:17:39.390799 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4chxr\" (UniqueName: \"kubernetes.io/projected/4b2bcf55-db39-4d69-999a-9da9df2396ee-kube-api-access-4chxr\") pod \"cert-manager-operator-controller-manager-55c444bf86-54tnh\" (UID: \"4b2bcf55-db39-4d69-999a-9da9df2396ee\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-54tnh" Jul 25 01:17:39.393840 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:17:39.393819 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-54tnh"] Jul 25 01:17:39.491523 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:17:39.491501 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4b2bcf55-db39-4d69-999a-9da9df2396ee-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-54tnh\" (UID: \"4b2bcf55-db39-4d69-999a-9da9df2396ee\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-54tnh" Jul 25 01:17:39.491642 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:17:39.491543 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4chxr\" (UniqueName: \"kubernetes.io/projected/4b2bcf55-db39-4d69-999a-9da9df2396ee-kube-api-access-4chxr\") pod \"cert-manager-operator-controller-manager-55c444bf86-54tnh\" (UID: \"4b2bcf55-db39-4d69-999a-9da9df2396ee\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-54tnh" Jul 25 01:17:39.491880 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:17:39.491863 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4b2bcf55-db39-4d69-999a-9da9df2396ee-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-54tnh\" (UID: \"4b2bcf55-db39-4d69-999a-9da9df2396ee\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-54tnh" Jul 25 01:17:39.499200 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:17:39.499183 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4chxr\" (UniqueName: \"kubernetes.io/projected/4b2bcf55-db39-4d69-999a-9da9df2396ee-kube-api-access-4chxr\") pod \"cert-manager-operator-controller-manager-55c444bf86-54tnh\" (UID: \"4b2bcf55-db39-4d69-999a-9da9df2396ee\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-54tnh" Jul 25 01:17:39.688586 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:17:39.688502 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-54tnh" Jul 25 01:17:39.830957 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:17:39.830929 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-54tnh"] Jul 25 01:17:39.834483 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:17:39.834462 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4b2bcf55_db39_4d69_999a_9da9df2396ee.slice/crio-11076db952ba2183155d1f5a99aa148444fd91b9e2caf5de5816ae0801f3056f WatchSource:0}: Error finding container 11076db952ba2183155d1f5a99aa148444fd91b9e2caf5de5816ae0801f3056f: Status 404 returned error can't find the container with id 11076db952ba2183155d1f5a99aa148444fd91b9e2caf5de5816ae0801f3056f Jul 25 01:17:39.837663 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:17:39.837645 2567 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 25 01:17:40.550622 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:17:40.550596 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-54tnh" event={"ID":"4b2bcf55-db39-4d69-999a-9da9df2396ee","Type":"ContainerStarted","Data":"11076db952ba2183155d1f5a99aa148444fd91b9e2caf5de5816ae0801f3056f"} Jul 25 01:17:42.561117 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:17:42.561086 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-54tnh" event={"ID":"4b2bcf55-db39-4d69-999a-9da9df2396ee","Type":"ContainerStarted","Data":"9c5557051e8f7bd82c84aba9d4b6fcd246557d7e2837b3c354513c70c646c9a0"} Jul 25 01:17:42.582457 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:17:42.582412 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-54tnh" podStartSLOduration=1.065871713 podStartE2EDuration="3.582397941s" totalImagesPullingTime="2.516526228s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-25 01:17:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-25 01:17:42.581139737 +0000 UTC m=+348.274234156" watchObservedRunningTime="2026-07-25 01:17:42.582397941 +0000 UTC m=+348.275492360" Jul 25 01:17:47.619608 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:17:47.619529 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-b9zqt"] Jul 25 01:17:47.622845 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:17:47.622830 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-b9zqt" Jul 25 01:17:47.625251 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:17:47.625227 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Jul 25 01:17:47.625251 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:17:47.625245 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-t85xl\"" Jul 25 01:17:47.625962 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:17:47.625949 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Jul 25 01:17:47.629983 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:17:47.629961 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-b9zqt"] Jul 25 01:17:47.658363 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:17:47.658337 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-74mvm\" (UniqueName: \"kubernetes.io/projected/578bb39b-950d-4796-ab1d-484e025792b1-kube-api-access-74mvm\") pod \"cert-manager-cainjector-559cdd8c87-b9zqt\" (UID: \"578bb39b-950d-4796-ab1d-484e025792b1\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-b9zqt" Jul 25 01:17:47.658474 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:17:47.658365 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/578bb39b-950d-4796-ab1d-484e025792b1-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-b9zqt\" (UID: \"578bb39b-950d-4796-ab1d-484e025792b1\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-b9zqt" Jul 25 01:17:47.759695 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:17:47.759673 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-74mvm\" (UniqueName: \"kubernetes.io/projected/578bb39b-950d-4796-ab1d-484e025792b1-kube-api-access-74mvm\") pod \"cert-manager-cainjector-559cdd8c87-b9zqt\" (UID: \"578bb39b-950d-4796-ab1d-484e025792b1\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-b9zqt" Jul 25 01:17:47.759777 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:17:47.759699 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/578bb39b-950d-4796-ab1d-484e025792b1-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-b9zqt\" (UID: \"578bb39b-950d-4796-ab1d-484e025792b1\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-b9zqt" Jul 25 01:17:47.767277 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:17:47.767261 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/578bb39b-950d-4796-ab1d-484e025792b1-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-b9zqt\" (UID: \"578bb39b-950d-4796-ab1d-484e025792b1\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-b9zqt" Jul 25 01:17:47.767551 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:17:47.767529 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-74mvm\" (UniqueName: \"kubernetes.io/projected/578bb39b-950d-4796-ab1d-484e025792b1-kube-api-access-74mvm\") pod \"cert-manager-cainjector-559cdd8c87-b9zqt\" (UID: \"578bb39b-950d-4796-ab1d-484e025792b1\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-b9zqt" Jul 25 01:17:47.939972 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:17:47.939903 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-b9zqt" Jul 25 01:17:48.068779 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:17:48.068756 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-b9zqt"] Jul 25 01:17:48.071210 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:17:48.071178 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod578bb39b_950d_4796_ab1d_484e025792b1.slice/crio-1c18f41a6b9ea1c6936ef46ef331c40fe9febeb5f3599fe2732755ee459b2a09 WatchSource:0}: Error finding container 1c18f41a6b9ea1c6936ef46ef331c40fe9febeb5f3599fe2732755ee459b2a09: Status 404 returned error can't find the container with id 1c18f41a6b9ea1c6936ef46ef331c40fe9febeb5f3599fe2732755ee459b2a09 Jul 25 01:17:48.594196 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:17:48.594165 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-b9zqt" event={"ID":"578bb39b-950d-4796-ab1d-484e025792b1","Type":"ContainerStarted","Data":"1c18f41a6b9ea1c6936ef46ef331c40fe9febeb5f3599fe2732755ee459b2a09"} Jul 25 01:17:51.612180 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:17:51.612143 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-b9zqt" event={"ID":"578bb39b-950d-4796-ab1d-484e025792b1","Type":"ContainerStarted","Data":"e233e1204f8dbe3539cfb4d9ca1f6bcdf809022842bf5e6bef4f4a0786b71cf2"} Jul 25 01:17:51.630855 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:17:51.630810 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-559cdd8c87-b9zqt" podStartSLOduration=1.6355068369999999 podStartE2EDuration="4.630796077s" totalImagesPullingTime="2.99528924s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-25 01:17:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-25 01:17:51.628831501 +0000 UTC m=+357.321925916" watchObservedRunningTime="2026-07-25 01:17:51.630796077 +0000 UTC m=+357.323890496" Jul 25 01:17:55.779554 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:17:55.779522 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-55b4d954d5-6nlw4"] Jul 25 01:17:55.782915 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:17:55.782895 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-6nlw4" Jul 25 01:17:55.785220 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:17:55.785201 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-dktkp\"" Jul 25 01:17:55.794567 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:17:55.794546 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-6nlw4"] Jul 25 01:17:55.828606 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:17:55.828584 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6br7d\" (UniqueName: \"kubernetes.io/projected/0ff8ef8c-8a4e-4dbd-abe4-45343d78797e-kube-api-access-6br7d\") pod \"cert-manager-55b4d954d5-6nlw4\" (UID: \"0ff8ef8c-8a4e-4dbd-abe4-45343d78797e\") " pod="cert-manager/cert-manager-55b4d954d5-6nlw4" Jul 25 01:17:55.828729 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:17:55.828622 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/0ff8ef8c-8a4e-4dbd-abe4-45343d78797e-bound-sa-token\") pod \"cert-manager-55b4d954d5-6nlw4\" (UID: \"0ff8ef8c-8a4e-4dbd-abe4-45343d78797e\") " pod="cert-manager/cert-manager-55b4d954d5-6nlw4" Jul 25 01:17:55.929964 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:17:55.929936 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6br7d\" (UniqueName: \"kubernetes.io/projected/0ff8ef8c-8a4e-4dbd-abe4-45343d78797e-kube-api-access-6br7d\") pod \"cert-manager-55b4d954d5-6nlw4\" (UID: \"0ff8ef8c-8a4e-4dbd-abe4-45343d78797e\") " pod="cert-manager/cert-manager-55b4d954d5-6nlw4" Jul 25 01:17:55.930083 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:17:55.929984 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/0ff8ef8c-8a4e-4dbd-abe4-45343d78797e-bound-sa-token\") pod \"cert-manager-55b4d954d5-6nlw4\" (UID: \"0ff8ef8c-8a4e-4dbd-abe4-45343d78797e\") " pod="cert-manager/cert-manager-55b4d954d5-6nlw4" Jul 25 01:17:55.937633 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:17:55.937611 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/0ff8ef8c-8a4e-4dbd-abe4-45343d78797e-bound-sa-token\") pod \"cert-manager-55b4d954d5-6nlw4\" (UID: \"0ff8ef8c-8a4e-4dbd-abe4-45343d78797e\") " pod="cert-manager/cert-manager-55b4d954d5-6nlw4" Jul 25 01:17:55.937821 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:17:55.937804 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6br7d\" (UniqueName: \"kubernetes.io/projected/0ff8ef8c-8a4e-4dbd-abe4-45343d78797e-kube-api-access-6br7d\") pod \"cert-manager-55b4d954d5-6nlw4\" (UID: \"0ff8ef8c-8a4e-4dbd-abe4-45343d78797e\") " pod="cert-manager/cert-manager-55b4d954d5-6nlw4" Jul 25 01:17:56.091480 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:17:56.091444 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-6nlw4" Jul 25 01:17:56.240500 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:17:56.240467 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-6nlw4"] Jul 25 01:17:56.242997 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:17:56.242972 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod0ff8ef8c_8a4e_4dbd_abe4_45343d78797e.slice/crio-f84bb0aff6832ad6b0632ca393970a6892693b4c2cbb1b5b9333d98d4ea129ab WatchSource:0}: Error finding container f84bb0aff6832ad6b0632ca393970a6892693b4c2cbb1b5b9333d98d4ea129ab: Status 404 returned error can't find the container with id f84bb0aff6832ad6b0632ca393970a6892693b4c2cbb1b5b9333d98d4ea129ab Jul 25 01:17:56.635133 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:17:56.635101 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-6nlw4" event={"ID":"0ff8ef8c-8a4e-4dbd-abe4-45343d78797e","Type":"ContainerStarted","Data":"a74f20a994fee0733a7437a0f2213a500477068875c17a4ce841697d8f62ba34"} Jul 25 01:17:56.635334 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:17:56.635142 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-6nlw4" event={"ID":"0ff8ef8c-8a4e-4dbd-abe4-45343d78797e","Type":"ContainerStarted","Data":"f84bb0aff6832ad6b0632ca393970a6892693b4c2cbb1b5b9333d98d4ea129ab"} Jul 25 01:18:16.774843 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:18:16.774790 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-55b4d954d5-6nlw4" podStartSLOduration=21.774773175 podStartE2EDuration="21.774773175s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-25 01:17:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-25 01:17:56.649192772 +0000 UTC m=+362.342287190" watchObservedRunningTime="2026-07-25 01:18:16.774773175 +0000 UTC m=+382.467867594" Jul 25 01:18:16.775346 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:18:16.775006 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-6b87879b5d-n88g9"] Jul 25 01:18:16.778144 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:18:16.778130 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-6b87879b5d-n88g9" Jul 25 01:18:16.781444 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:18:16.781421 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Jul 25 01:18:16.781719 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:18:16.781705 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jul 25 01:18:16.782752 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:18:16.782733 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jul 25 01:18:16.782894 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:18:16.782735 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Jul 25 01:18:16.782894 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:18:16.782737 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Jul 25 01:18:16.782894 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:18:16.782737 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-cdnkn\"" Jul 25 01:18:16.789285 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:18:16.789265 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-6b87879b5d-n88g9"] Jul 25 01:18:16.911895 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:18:16.911864 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/47aa68ac-93b3-4783-8d45-45e747144e70-manager-config\") pod \"lws-controller-manager-6b87879b5d-n88g9\" (UID: \"47aa68ac-93b3-4783-8d45-45e747144e70\") " pod="openshift-lws-operator/lws-controller-manager-6b87879b5d-n88g9" Jul 25 01:18:16.911895 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:18:16.911894 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/47aa68ac-93b3-4783-8d45-45e747144e70-metrics-cert\") pod \"lws-controller-manager-6b87879b5d-n88g9\" (UID: \"47aa68ac-93b3-4783-8d45-45e747144e70\") " pod="openshift-lws-operator/lws-controller-manager-6b87879b5d-n88g9" Jul 25 01:18:16.912076 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:18:16.911989 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wr5p6\" (UniqueName: \"kubernetes.io/projected/47aa68ac-93b3-4783-8d45-45e747144e70-kube-api-access-wr5p6\") pod \"lws-controller-manager-6b87879b5d-n88g9\" (UID: \"47aa68ac-93b3-4783-8d45-45e747144e70\") " pod="openshift-lws-operator/lws-controller-manager-6b87879b5d-n88g9" Jul 25 01:18:16.912076 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:18:16.912034 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/47aa68ac-93b3-4783-8d45-45e747144e70-cert\") pod \"lws-controller-manager-6b87879b5d-n88g9\" (UID: \"47aa68ac-93b3-4783-8d45-45e747144e70\") " pod="openshift-lws-operator/lws-controller-manager-6b87879b5d-n88g9" Jul 25 01:18:17.012368 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:18:17.012341 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/47aa68ac-93b3-4783-8d45-45e747144e70-metrics-cert\") pod \"lws-controller-manager-6b87879b5d-n88g9\" (UID: \"47aa68ac-93b3-4783-8d45-45e747144e70\") " pod="openshift-lws-operator/lws-controller-manager-6b87879b5d-n88g9" Jul 25 01:18:17.012528 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:18:17.012450 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wr5p6\" (UniqueName: \"kubernetes.io/projected/47aa68ac-93b3-4783-8d45-45e747144e70-kube-api-access-wr5p6\") pod \"lws-controller-manager-6b87879b5d-n88g9\" (UID: \"47aa68ac-93b3-4783-8d45-45e747144e70\") " pod="openshift-lws-operator/lws-controller-manager-6b87879b5d-n88g9" Jul 25 01:18:17.012528 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:18:17.012492 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/47aa68ac-93b3-4783-8d45-45e747144e70-cert\") pod \"lws-controller-manager-6b87879b5d-n88g9\" (UID: \"47aa68ac-93b3-4783-8d45-45e747144e70\") " pod="openshift-lws-operator/lws-controller-manager-6b87879b5d-n88g9" Jul 25 01:18:17.012628 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:18:17.012540 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/47aa68ac-93b3-4783-8d45-45e747144e70-manager-config\") pod \"lws-controller-manager-6b87879b5d-n88g9\" (UID: \"47aa68ac-93b3-4783-8d45-45e747144e70\") " pod="openshift-lws-operator/lws-controller-manager-6b87879b5d-n88g9" Jul 25 01:18:17.013134 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:18:17.013114 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/47aa68ac-93b3-4783-8d45-45e747144e70-manager-config\") pod \"lws-controller-manager-6b87879b5d-n88g9\" (UID: \"47aa68ac-93b3-4783-8d45-45e747144e70\") " pod="openshift-lws-operator/lws-controller-manager-6b87879b5d-n88g9" Jul 25 01:18:17.014952 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:18:17.014933 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/47aa68ac-93b3-4783-8d45-45e747144e70-metrics-cert\") pod \"lws-controller-manager-6b87879b5d-n88g9\" (UID: \"47aa68ac-93b3-4783-8d45-45e747144e70\") " pod="openshift-lws-operator/lws-controller-manager-6b87879b5d-n88g9" Jul 25 01:18:17.015044 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:18:17.014965 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/47aa68ac-93b3-4783-8d45-45e747144e70-cert\") pod \"lws-controller-manager-6b87879b5d-n88g9\" (UID: \"47aa68ac-93b3-4783-8d45-45e747144e70\") " pod="openshift-lws-operator/lws-controller-manager-6b87879b5d-n88g9" Jul 25 01:18:17.027078 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:18:17.027028 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wr5p6\" (UniqueName: \"kubernetes.io/projected/47aa68ac-93b3-4783-8d45-45e747144e70-kube-api-access-wr5p6\") pod \"lws-controller-manager-6b87879b5d-n88g9\" (UID: \"47aa68ac-93b3-4783-8d45-45e747144e70\") " pod="openshift-lws-operator/lws-controller-manager-6b87879b5d-n88g9" Jul 25 01:18:17.089130 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:18:17.089106 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-6b87879b5d-n88g9" Jul 25 01:18:17.238465 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:18:17.238442 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-6b87879b5d-n88g9"] Jul 25 01:18:17.240710 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:18:17.240687 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod47aa68ac_93b3_4783_8d45_45e747144e70.slice/crio-f45ba5e923d55bca72d55e18f4a58814d7bcd7c95c68285a78a1291d23bb5508 WatchSource:0}: Error finding container f45ba5e923d55bca72d55e18f4a58814d7bcd7c95c68285a78a1291d23bb5508: Status 404 returned error can't find the container with id f45ba5e923d55bca72d55e18f4a58814d7bcd7c95c68285a78a1291d23bb5508 Jul 25 01:18:17.405444 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:18:17.405413 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7587ff6c45-nch6b"] Jul 25 01:18:17.408654 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:18:17.408633 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-7587ff6c45-nch6b" Jul 25 01:18:17.417484 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:18:17.417464 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jul 25 01:18:17.417599 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:18:17.417484 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-ndvlx\"" Jul 25 01:18:17.417762 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:18:17.417746 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jul 25 01:18:17.418216 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:18:17.418201 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jul 25 01:18:17.418545 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:18:17.418529 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jul 25 01:18:17.433717 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:18:17.433698 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7587ff6c45-nch6b"] Jul 25 01:18:17.517108 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:18:17.517084 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/920dd835-79d2-4e0c-b48b-a44df8036f19-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7587ff6c45-nch6b\" (UID: \"920dd835-79d2-4e0c-b48b-a44df8036f19\") " pod="opendatahub/opendatahub-operator-controller-manager-7587ff6c45-nch6b" Jul 25 01:18:17.517244 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:18:17.517119 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/920dd835-79d2-4e0c-b48b-a44df8036f19-webhook-cert\") pod \"opendatahub-operator-controller-manager-7587ff6c45-nch6b\" (UID: \"920dd835-79d2-4e0c-b48b-a44df8036f19\") " pod="opendatahub/opendatahub-operator-controller-manager-7587ff6c45-nch6b" Jul 25 01:18:17.517244 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:18:17.517140 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/920dd835-79d2-4e0c-b48b-a44df8036f19-manifests\") pod \"opendatahub-operator-controller-manager-7587ff6c45-nch6b\" (UID: \"920dd835-79d2-4e0c-b48b-a44df8036f19\") " pod="opendatahub/opendatahub-operator-controller-manager-7587ff6c45-nch6b" Jul 25 01:18:17.517244 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:18:17.517161 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/920dd835-79d2-4e0c-b48b-a44df8036f19-tmp\") pod \"opendatahub-operator-controller-manager-7587ff6c45-nch6b\" (UID: \"920dd835-79d2-4e0c-b48b-a44df8036f19\") " pod="opendatahub/opendatahub-operator-controller-manager-7587ff6c45-nch6b" Jul 25 01:18:17.517414 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:18:17.517243 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5bbjk\" (UniqueName: \"kubernetes.io/projected/920dd835-79d2-4e0c-b48b-a44df8036f19-kube-api-access-5bbjk\") pod \"opendatahub-operator-controller-manager-7587ff6c45-nch6b\" (UID: \"920dd835-79d2-4e0c-b48b-a44df8036f19\") " pod="opendatahub/opendatahub-operator-controller-manager-7587ff6c45-nch6b" Jul 25 01:18:17.617961 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:18:17.617929 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/920dd835-79d2-4e0c-b48b-a44df8036f19-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7587ff6c45-nch6b\" (UID: \"920dd835-79d2-4e0c-b48b-a44df8036f19\") " pod="opendatahub/opendatahub-operator-controller-manager-7587ff6c45-nch6b" Jul 25 01:18:17.618074 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:18:17.617986 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/920dd835-79d2-4e0c-b48b-a44df8036f19-webhook-cert\") pod \"opendatahub-operator-controller-manager-7587ff6c45-nch6b\" (UID: \"920dd835-79d2-4e0c-b48b-a44df8036f19\") " pod="opendatahub/opendatahub-operator-controller-manager-7587ff6c45-nch6b" Jul 25 01:18:17.618074 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:18:17.618012 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/920dd835-79d2-4e0c-b48b-a44df8036f19-manifests\") pod \"opendatahub-operator-controller-manager-7587ff6c45-nch6b\" (UID: \"920dd835-79d2-4e0c-b48b-a44df8036f19\") " pod="opendatahub/opendatahub-operator-controller-manager-7587ff6c45-nch6b" Jul 25 01:18:17.618074 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:18:17.618038 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/920dd835-79d2-4e0c-b48b-a44df8036f19-tmp\") pod \"opendatahub-operator-controller-manager-7587ff6c45-nch6b\" (UID: \"920dd835-79d2-4e0c-b48b-a44df8036f19\") " pod="opendatahub/opendatahub-operator-controller-manager-7587ff6c45-nch6b" Jul 25 01:18:17.618239 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:18:17.618071 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5bbjk\" (UniqueName: \"kubernetes.io/projected/920dd835-79d2-4e0c-b48b-a44df8036f19-kube-api-access-5bbjk\") pod \"opendatahub-operator-controller-manager-7587ff6c45-nch6b\" (UID: \"920dd835-79d2-4e0c-b48b-a44df8036f19\") " pod="opendatahub/opendatahub-operator-controller-manager-7587ff6c45-nch6b" Jul 25 01:18:17.618510 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:18:17.618492 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/920dd835-79d2-4e0c-b48b-a44df8036f19-manifests\") pod \"opendatahub-operator-controller-manager-7587ff6c45-nch6b\" (UID: \"920dd835-79d2-4e0c-b48b-a44df8036f19\") " pod="opendatahub/opendatahub-operator-controller-manager-7587ff6c45-nch6b" Jul 25 01:18:17.620473 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:18:17.620453 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/920dd835-79d2-4e0c-b48b-a44df8036f19-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7587ff6c45-nch6b\" (UID: \"920dd835-79d2-4e0c-b48b-a44df8036f19\") " pod="opendatahub/opendatahub-operator-controller-manager-7587ff6c45-nch6b" Jul 25 01:18:17.620882 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:18:17.620865 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/920dd835-79d2-4e0c-b48b-a44df8036f19-tmp\") pod \"opendatahub-operator-controller-manager-7587ff6c45-nch6b\" (UID: \"920dd835-79d2-4e0c-b48b-a44df8036f19\") " pod="opendatahub/opendatahub-operator-controller-manager-7587ff6c45-nch6b" Jul 25 01:18:17.621057 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:18:17.621043 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/920dd835-79d2-4e0c-b48b-a44df8036f19-webhook-cert\") pod \"opendatahub-operator-controller-manager-7587ff6c45-nch6b\" (UID: \"920dd835-79d2-4e0c-b48b-a44df8036f19\") " pod="opendatahub/opendatahub-operator-controller-manager-7587ff6c45-nch6b" Jul 25 01:18:17.629602 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:18:17.629585 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5bbjk\" (UniqueName: \"kubernetes.io/projected/920dd835-79d2-4e0c-b48b-a44df8036f19-kube-api-access-5bbjk\") pod \"opendatahub-operator-controller-manager-7587ff6c45-nch6b\" (UID: \"920dd835-79d2-4e0c-b48b-a44df8036f19\") " pod="opendatahub/opendatahub-operator-controller-manager-7587ff6c45-nch6b" Jul 25 01:18:17.719293 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:18:17.719240 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-7587ff6c45-nch6b" Jul 25 01:18:17.729670 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:18:17.729646 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-6b87879b5d-n88g9" event={"ID":"47aa68ac-93b3-4783-8d45-45e747144e70","Type":"ContainerStarted","Data":"f45ba5e923d55bca72d55e18f4a58814d7bcd7c95c68285a78a1291d23bb5508"} Jul 25 01:18:17.858090 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:18:17.858066 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7587ff6c45-nch6b"] Jul 25 01:18:17.860703 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:18:17.860679 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod920dd835_79d2_4e0c_b48b_a44df8036f19.slice/crio-6ca826b00eb238c5a2c03caf13a3a331cab0d5ef531850f8982300d1536854b8 WatchSource:0}: Error finding container 6ca826b00eb238c5a2c03caf13a3a331cab0d5ef531850f8982300d1536854b8: Status 404 returned error can't find the container with id 6ca826b00eb238c5a2c03caf13a3a331cab0d5ef531850f8982300d1536854b8 Jul 25 01:18:18.739040 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:18:18.738987 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7587ff6c45-nch6b" event={"ID":"920dd835-79d2-4e0c-b48b-a44df8036f19","Type":"ContainerStarted","Data":"6ca826b00eb238c5a2c03caf13a3a331cab0d5ef531850f8982300d1536854b8"} Jul 25 01:18:21.754413 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:18:21.754169 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-6b87879b5d-n88g9" event={"ID":"47aa68ac-93b3-4783-8d45-45e747144e70","Type":"ContainerStarted","Data":"35a9828c9b29b33c35f77c1a9787801846bb9300558acf27423dbbb71222e93d"} Jul 25 01:18:21.754413 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:18:21.754249 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-6b87879b5d-n88g9" Jul 25 01:18:21.755926 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:18:21.755904 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7587ff6c45-nch6b" event={"ID":"920dd835-79d2-4e0c-b48b-a44df8036f19","Type":"ContainerStarted","Data":"0a20f805290d89794f5ea27ecf6ef28200616a1a46ed28fb8626cc46b950522b"} Jul 25 01:18:21.774708 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:18:21.774662 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-6b87879b5d-n88g9" podStartSLOduration=1.347233058 podStartE2EDuration="5.774649323s" totalImagesPullingTime="4.427416265s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-25 01:18:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-25 01:18:21.772916754 +0000 UTC m=+387.466011175" watchObservedRunningTime="2026-07-25 01:18:21.774649323 +0000 UTC m=+387.467743743" Jul 25 01:18:23.768636 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:18:23.768607 2567 generic.go:356] "Generic (PLEG): container finished" podID="920dd835-79d2-4e0c-b48b-a44df8036f19" containerID="0a20f805290d89794f5ea27ecf6ef28200616a1a46ed28fb8626cc46b950522b" exitCode=0 Jul 25 01:18:23.769036 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:18:23.768674 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7587ff6c45-nch6b" event={"ID":"920dd835-79d2-4e0c-b48b-a44df8036f19","Type":"ContainerDied","Data":"0a20f805290d89794f5ea27ecf6ef28200616a1a46ed28fb8626cc46b950522b"} Jul 25 01:18:24.775718 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:18:24.775685 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7587ff6c45-nch6b" event={"ID":"920dd835-79d2-4e0c-b48b-a44df8036f19","Type":"ContainerStarted","Data":"324037c8671a16df5adb111b4d7816099e94a19b307858249841b9a536a62ab1"} Jul 25 01:18:24.776123 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:18:24.775899 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-7587ff6c45-nch6b" Jul 25 01:18:24.823877 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:18:24.823838 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-7587ff6c45-nch6b" podStartSLOduration=2.481278432 podStartE2EDuration="7.823823797s" totalImagesPullingTime="4.274895963s" totalInitContainerRuntime="1.067649402s" isStatefulPod=false podCreationTimestamp="2026-07-25 01:18:17 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-25 01:18:24.823675418 +0000 UTC m=+390.516769837" watchObservedRunningTime="2026-07-25 01:18:24.823823797 +0000 UTC m=+390.516918216" Jul 25 01:18:32.763434 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:18:32.763404 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-6b87879b5d-n88g9" Jul 25 01:18:35.781699 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:18:35.781670 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-7587ff6c45-nch6b" Jul 25 01:18:46.172237 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:18:46.172200 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-zfw2x"] Jul 25 01:18:46.174539 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:18:46.174524 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-zfw2x" Jul 25 01:18:46.176835 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:18:46.176810 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\"" Jul 25 01:18:46.177052 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:18:46.177033 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\"" Jul 25 01:18:46.177176 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:18:46.177067 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\"" Jul 25 01:18:46.177426 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:18:46.177407 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-jb7sl\"" Jul 25 01:18:46.177495 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:18:46.177409 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jul 25 01:18:46.189324 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:18:46.189303 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-zfw2x"] Jul 25 01:18:46.252542 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:18:46.252511 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/1599c83e-0513-4447-9e7c-db9494241eb3-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-zfw2x\" (UID: \"1599c83e-0513-4447-9e7c-db9494241eb3\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-zfw2x" Jul 25 01:18:46.252689 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:18:46.252544 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/1599c83e-0513-4447-9e7c-db9494241eb3-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-zfw2x\" (UID: \"1599c83e-0513-4447-9e7c-db9494241eb3\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-zfw2x" Jul 25 01:18:46.252689 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:18:46.252597 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kg5vk\" (UniqueName: \"kubernetes.io/projected/1599c83e-0513-4447-9e7c-db9494241eb3-kube-api-access-kg5vk\") pod \"istiod-openshift-gateway-5677ccb49b-zfw2x\" (UID: \"1599c83e-0513-4447-9e7c-db9494241eb3\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-zfw2x" Jul 25 01:18:46.252689 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:18:46.252619 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/1599c83e-0513-4447-9e7c-db9494241eb3-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-zfw2x\" (UID: \"1599c83e-0513-4447-9e7c-db9494241eb3\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-zfw2x" Jul 25 01:18:46.252689 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:18:46.252644 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/1599c83e-0513-4447-9e7c-db9494241eb3-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-zfw2x\" (UID: \"1599c83e-0513-4447-9e7c-db9494241eb3\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-zfw2x" Jul 25 01:18:46.252823 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:18:46.252694 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/1599c83e-0513-4447-9e7c-db9494241eb3-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-zfw2x\" (UID: \"1599c83e-0513-4447-9e7c-db9494241eb3\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-zfw2x" Jul 25 01:18:46.252823 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:18:46.252720 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1599c83e-0513-4447-9e7c-db9494241eb3-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-zfw2x\" (UID: \"1599c83e-0513-4447-9e7c-db9494241eb3\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-zfw2x" Jul 25 01:18:46.353786 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:18:46.353751 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/1599c83e-0513-4447-9e7c-db9494241eb3-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-zfw2x\" (UID: \"1599c83e-0513-4447-9e7c-db9494241eb3\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-zfw2x" Jul 25 01:18:46.353786 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:18:46.353783 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/1599c83e-0513-4447-9e7c-db9494241eb3-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-zfw2x\" (UID: \"1599c83e-0513-4447-9e7c-db9494241eb3\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-zfw2x" Jul 25 01:18:46.354015 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:18:46.353825 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kg5vk\" (UniqueName: \"kubernetes.io/projected/1599c83e-0513-4447-9e7c-db9494241eb3-kube-api-access-kg5vk\") pod \"istiod-openshift-gateway-5677ccb49b-zfw2x\" (UID: \"1599c83e-0513-4447-9e7c-db9494241eb3\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-zfw2x" Jul 25 01:18:46.354015 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:18:46.353856 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/1599c83e-0513-4447-9e7c-db9494241eb3-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-zfw2x\" (UID: \"1599c83e-0513-4447-9e7c-db9494241eb3\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-zfw2x" Jul 25 01:18:46.354015 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:18:46.353881 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/1599c83e-0513-4447-9e7c-db9494241eb3-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-zfw2x\" (UID: \"1599c83e-0513-4447-9e7c-db9494241eb3\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-zfw2x" Jul 25 01:18:46.354015 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:18:46.353939 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/1599c83e-0513-4447-9e7c-db9494241eb3-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-zfw2x\" (UID: \"1599c83e-0513-4447-9e7c-db9494241eb3\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-zfw2x" Jul 25 01:18:46.354015 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:18:46.353968 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1599c83e-0513-4447-9e7c-db9494241eb3-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-zfw2x\" (UID: \"1599c83e-0513-4447-9e7c-db9494241eb3\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-zfw2x" Jul 25 01:18:46.354596 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:18:46.354515 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/1599c83e-0513-4447-9e7c-db9494241eb3-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-zfw2x\" (UID: \"1599c83e-0513-4447-9e7c-db9494241eb3\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-zfw2x" Jul 25 01:18:46.356742 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:18:46.356719 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/1599c83e-0513-4447-9e7c-db9494241eb3-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-zfw2x\" (UID: \"1599c83e-0513-4447-9e7c-db9494241eb3\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-zfw2x" Jul 25 01:18:46.356889 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:18:46.356743 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/1599c83e-0513-4447-9e7c-db9494241eb3-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-zfw2x\" (UID: \"1599c83e-0513-4447-9e7c-db9494241eb3\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-zfw2x" Jul 25 01:18:46.356959 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:18:46.356908 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/1599c83e-0513-4447-9e7c-db9494241eb3-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-zfw2x\" (UID: \"1599c83e-0513-4447-9e7c-db9494241eb3\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-zfw2x" Jul 25 01:18:46.357021 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:18:46.357002 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/1599c83e-0513-4447-9e7c-db9494241eb3-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-zfw2x\" (UID: \"1599c83e-0513-4447-9e7c-db9494241eb3\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-zfw2x" Jul 25 01:18:46.366330 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:18:46.365809 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kg5vk\" (UniqueName: \"kubernetes.io/projected/1599c83e-0513-4447-9e7c-db9494241eb3-kube-api-access-kg5vk\") pod \"istiod-openshift-gateway-5677ccb49b-zfw2x\" (UID: \"1599c83e-0513-4447-9e7c-db9494241eb3\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-zfw2x" Jul 25 01:18:46.367138 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:18:46.367109 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1599c83e-0513-4447-9e7c-db9494241eb3-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-zfw2x\" (UID: \"1599c83e-0513-4447-9e7c-db9494241eb3\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-zfw2x" Jul 25 01:18:46.484581 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:18:46.484495 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-zfw2x" Jul 25 01:18:46.641947 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:18:46.641916 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-zfw2x"] Jul 25 01:18:46.874039 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:18:46.874002 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-zfw2x" event={"ID":"1599c83e-0513-4447-9e7c-db9494241eb3","Type":"ContainerStarted","Data":"f4343fa5201a41aab98aba7ec327fcfb76107cf15b8047a9f3fa9316baa8a9e9"} Jul 25 01:18:49.811561 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:18:49.811513 2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 25 01:18:49.811799 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:18:49.811591 2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 25 01:18:49.890650 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:18:49.890612 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-zfw2x" event={"ID":"1599c83e-0513-4447-9e7c-db9494241eb3","Type":"ContainerStarted","Data":"7b4e29f4f570ccd1019826f53d5db7b8d1cccb8563b1b4fbabd8ae7ec131eded"} Jul 25 01:18:49.890809 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:18:49.890695 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-zfw2x" Jul 25 01:18:49.918059 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:18:49.917257 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-zfw2x" podStartSLOduration=0.750946644 podStartE2EDuration="3.917238893s" totalImagesPullingTime="3.166292249s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-25 01:18:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-25 01:18:49.915965698 +0000 UTC m=+415.609060116" watchObservedRunningTime="2026-07-25 01:18:49.917238893 +0000 UTC m=+415.610333313" Jul 25 01:18:50.896732 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:18:50.896688 2567 patch_prober.go:28] interesting pod/istiod-openshift-gateway-5677ccb49b-zfw2x container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Jul 25 01:18:50.897070 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:18:50.896750 2567 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-zfw2x" podUID="1599c83e-0513-4447-9e7c-db9494241eb3" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 25 01:18:53.895881 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:18:53.895851 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-zfw2x" Jul 25 01:19:51.638712 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:19:51.638671 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-6459ff8c8b-qfbjr"] Jul 25 01:19:51.642015 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:19:51.641994 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6459ff8c8b-qfbjr" Jul 25 01:19:51.644294 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:19:51.644272 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jul 25 01:19:51.644468 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:19:51.644274 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jul 25 01:19:51.645080 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:19:51.645060 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jul 25 01:19:51.645182 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:19:51.645126 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jul 25 01:19:51.645182 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:19:51.645145 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jul 25 01:19:51.646233 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:19:51.646212 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-8bx8f\"" Jul 25 01:19:51.649463 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:19:51.649441 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jul 25 01:19:51.652110 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:19:51.652082 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6459ff8c8b-qfbjr"] Jul 25 01:19:51.680506 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:19:51.680483 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7e8d9bf9-81a6-49f6-8e5b-2973c99284c5-service-ca\") pod \"console-6459ff8c8b-qfbjr\" (UID: \"7e8d9bf9-81a6-49f6-8e5b-2973c99284c5\") " pod="openshift-console/console-6459ff8c8b-qfbjr" Jul 25 01:19:51.680596 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:19:51.680509 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7e8d9bf9-81a6-49f6-8e5b-2973c99284c5-console-oauth-config\") pod \"console-6459ff8c8b-qfbjr\" (UID: \"7e8d9bf9-81a6-49f6-8e5b-2973c99284c5\") " pod="openshift-console/console-6459ff8c8b-qfbjr" Jul 25 01:19:51.680596 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:19:51.680527 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7e8d9bf9-81a6-49f6-8e5b-2973c99284c5-trusted-ca-bundle\") pod \"console-6459ff8c8b-qfbjr\" (UID: \"7e8d9bf9-81a6-49f6-8e5b-2973c99284c5\") " pod="openshift-console/console-6459ff8c8b-qfbjr" Jul 25 01:19:51.680596 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:19:51.680545 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7e8d9bf9-81a6-49f6-8e5b-2973c99284c5-oauth-serving-cert\") pod \"console-6459ff8c8b-qfbjr\" (UID: \"7e8d9bf9-81a6-49f6-8e5b-2973c99284c5\") " pod="openshift-console/console-6459ff8c8b-qfbjr" Jul 25 01:19:51.680596 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:19:51.680560 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qvk2m\" (UniqueName: \"kubernetes.io/projected/7e8d9bf9-81a6-49f6-8e5b-2973c99284c5-kube-api-access-qvk2m\") pod \"console-6459ff8c8b-qfbjr\" (UID: \"7e8d9bf9-81a6-49f6-8e5b-2973c99284c5\") " pod="openshift-console/console-6459ff8c8b-qfbjr" Jul 25 01:19:51.680727 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:19:51.680615 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7e8d9bf9-81a6-49f6-8e5b-2973c99284c5-console-serving-cert\") pod \"console-6459ff8c8b-qfbjr\" (UID: \"7e8d9bf9-81a6-49f6-8e5b-2973c99284c5\") " pod="openshift-console/console-6459ff8c8b-qfbjr" Jul 25 01:19:51.680727 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:19:51.680673 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7e8d9bf9-81a6-49f6-8e5b-2973c99284c5-console-config\") pod \"console-6459ff8c8b-qfbjr\" (UID: \"7e8d9bf9-81a6-49f6-8e5b-2973c99284c5\") " pod="openshift-console/console-6459ff8c8b-qfbjr" Jul 25 01:19:51.781192 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:19:51.781159 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7e8d9bf9-81a6-49f6-8e5b-2973c99284c5-console-config\") pod \"console-6459ff8c8b-qfbjr\" (UID: \"7e8d9bf9-81a6-49f6-8e5b-2973c99284c5\") " pod="openshift-console/console-6459ff8c8b-qfbjr" Jul 25 01:19:51.781293 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:19:51.781246 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7e8d9bf9-81a6-49f6-8e5b-2973c99284c5-service-ca\") pod \"console-6459ff8c8b-qfbjr\" (UID: \"7e8d9bf9-81a6-49f6-8e5b-2973c99284c5\") " pod="openshift-console/console-6459ff8c8b-qfbjr" Jul 25 01:19:51.781293 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:19:51.781274 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7e8d9bf9-81a6-49f6-8e5b-2973c99284c5-console-oauth-config\") pod \"console-6459ff8c8b-qfbjr\" (UID: \"7e8d9bf9-81a6-49f6-8e5b-2973c99284c5\") " pod="openshift-console/console-6459ff8c8b-qfbjr" Jul 25 01:19:51.781448 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:19:51.781298 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7e8d9bf9-81a6-49f6-8e5b-2973c99284c5-trusted-ca-bundle\") pod \"console-6459ff8c8b-qfbjr\" (UID: \"7e8d9bf9-81a6-49f6-8e5b-2973c99284c5\") " pod="openshift-console/console-6459ff8c8b-qfbjr" Jul 25 01:19:51.781448 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:19:51.781323 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7e8d9bf9-81a6-49f6-8e5b-2973c99284c5-oauth-serving-cert\") pod \"console-6459ff8c8b-qfbjr\" (UID: \"7e8d9bf9-81a6-49f6-8e5b-2973c99284c5\") " pod="openshift-console/console-6459ff8c8b-qfbjr" Jul 25 01:19:51.781448 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:19:51.781345 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qvk2m\" (UniqueName: \"kubernetes.io/projected/7e8d9bf9-81a6-49f6-8e5b-2973c99284c5-kube-api-access-qvk2m\") pod \"console-6459ff8c8b-qfbjr\" (UID: \"7e8d9bf9-81a6-49f6-8e5b-2973c99284c5\") " pod="openshift-console/console-6459ff8c8b-qfbjr" Jul 25 01:19:51.781448 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:19:51.781431 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7e8d9bf9-81a6-49f6-8e5b-2973c99284c5-console-serving-cert\") pod \"console-6459ff8c8b-qfbjr\" (UID: \"7e8d9bf9-81a6-49f6-8e5b-2973c99284c5\") " pod="openshift-console/console-6459ff8c8b-qfbjr" Jul 25 01:19:51.781962 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:19:51.781936 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7e8d9bf9-81a6-49f6-8e5b-2973c99284c5-console-config\") pod \"console-6459ff8c8b-qfbjr\" (UID: \"7e8d9bf9-81a6-49f6-8e5b-2973c99284c5\") " pod="openshift-console/console-6459ff8c8b-qfbjr" Jul 25 01:19:51.782237 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:19:51.782027 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7e8d9bf9-81a6-49f6-8e5b-2973c99284c5-service-ca\") pod \"console-6459ff8c8b-qfbjr\" (UID: \"7e8d9bf9-81a6-49f6-8e5b-2973c99284c5\") " pod="openshift-console/console-6459ff8c8b-qfbjr" Jul 25 01:19:51.782237 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:19:51.782053 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7e8d9bf9-81a6-49f6-8e5b-2973c99284c5-oauth-serving-cert\") pod \"console-6459ff8c8b-qfbjr\" (UID: \"7e8d9bf9-81a6-49f6-8e5b-2973c99284c5\") " pod="openshift-console/console-6459ff8c8b-qfbjr" Jul 25 01:19:51.782237 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:19:51.782206 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7e8d9bf9-81a6-49f6-8e5b-2973c99284c5-trusted-ca-bundle\") pod \"console-6459ff8c8b-qfbjr\" (UID: \"7e8d9bf9-81a6-49f6-8e5b-2973c99284c5\") " pod="openshift-console/console-6459ff8c8b-qfbjr" Jul 25 01:19:51.783764 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:19:51.783746 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7e8d9bf9-81a6-49f6-8e5b-2973c99284c5-console-oauth-config\") pod \"console-6459ff8c8b-qfbjr\" (UID: \"7e8d9bf9-81a6-49f6-8e5b-2973c99284c5\") " pod="openshift-console/console-6459ff8c8b-qfbjr" Jul 25 01:19:51.783935 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:19:51.783919 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7e8d9bf9-81a6-49f6-8e5b-2973c99284c5-console-serving-cert\") pod \"console-6459ff8c8b-qfbjr\" (UID: \"7e8d9bf9-81a6-49f6-8e5b-2973c99284c5\") " pod="openshift-console/console-6459ff8c8b-qfbjr" Jul 25 01:19:51.789076 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:19:51.789061 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qvk2m\" (UniqueName: \"kubernetes.io/projected/7e8d9bf9-81a6-49f6-8e5b-2973c99284c5-kube-api-access-qvk2m\") pod \"console-6459ff8c8b-qfbjr\" (UID: \"7e8d9bf9-81a6-49f6-8e5b-2973c99284c5\") " pod="openshift-console/console-6459ff8c8b-qfbjr" Jul 25 01:19:51.953051 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:19:51.952979 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6459ff8c8b-qfbjr" Jul 25 01:19:52.101526 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:19:52.101504 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6459ff8c8b-qfbjr"] Jul 25 01:19:52.104191 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:19:52.104166 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7e8d9bf9_81a6_49f6_8e5b_2973c99284c5.slice/crio-0f85d286e52e82d34e1b2974383a9a1e155798ce2848c8710bea0cf04b25bd77 WatchSource:0}: Error finding container 0f85d286e52e82d34e1b2974383a9a1e155798ce2848c8710bea0cf04b25bd77: Status 404 returned error can't find the container with id 0f85d286e52e82d34e1b2974383a9a1e155798ce2848c8710bea0cf04b25bd77 Jul 25 01:19:52.177577 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:19:52.177543 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6459ff8c8b-qfbjr" event={"ID":"7e8d9bf9-81a6-49f6-8e5b-2973c99284c5","Type":"ContainerStarted","Data":"8380fac1a88451f0772132ba077f6767ee15bd7896e50df70ebc6ec12d09fafb"} Jul 25 01:19:52.177688 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:19:52.177608 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6459ff8c8b-qfbjr" event={"ID":"7e8d9bf9-81a6-49f6-8e5b-2973c99284c5","Type":"ContainerStarted","Data":"0f85d286e52e82d34e1b2974383a9a1e155798ce2848c8710bea0cf04b25bd77"} Jul 25 01:19:52.197473 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:19:52.197425 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-6459ff8c8b-qfbjr" podStartSLOduration=1.197410535 podStartE2EDuration="1.197410535s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-25 01:19:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-25 01:19:52.195515117 +0000 UTC m=+477.888609535" watchObservedRunningTime="2026-07-25 01:19:52.197410535 +0000 UTC m=+477.890504954" Jul 25 01:20:01.953492 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:20:01.953457 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6459ff8c8b-qfbjr" Jul 25 01:20:01.953883 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:20:01.953504 2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-6459ff8c8b-qfbjr" Jul 25 01:20:01.958528 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:20:01.958507 2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-6459ff8c8b-qfbjr" Jul 25 01:20:02.229770 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:20:02.229692 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-6459ff8c8b-qfbjr" Jul 25 01:21:22.571794 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:21:22.571716 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mlpq2"] Jul 25 01:21:22.574967 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:21:22.574951 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-mlpq2" Jul 25 01:21:22.577387 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:21:22.577356 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jul 25 01:21:22.577498 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:21:22.577398 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-zjr6l\"" Jul 25 01:21:22.578086 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:21:22.578071 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" Jul 25 01:21:22.578128 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:21:22.578116 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jul 25 01:21:22.583318 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:21:22.583299 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mlpq2"] Jul 25 01:21:22.616785 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:21:22.616749 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mlpq2"] Jul 25 01:21:22.715695 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:21:22.715662 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zrdtg\" (UniqueName: \"kubernetes.io/projected/c3034cb0-fae0-409e-9ec4-d8b206e9c8af-kube-api-access-zrdtg\") pod \"limitador-limitador-54d6d988d5-mlpq2\" (UID: \"c3034cb0-fae0-409e-9ec4-d8b206e9c8af\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-mlpq2" Jul 25 01:21:22.715882 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:21:22.715732 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/c3034cb0-fae0-409e-9ec4-d8b206e9c8af-config-file\") pod \"limitador-limitador-54d6d988d5-mlpq2\" (UID: \"c3034cb0-fae0-409e-9ec4-d8b206e9c8af\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-mlpq2" Jul 25 01:21:22.816542 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:21:22.816508 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/c3034cb0-fae0-409e-9ec4-d8b206e9c8af-config-file\") pod \"limitador-limitador-54d6d988d5-mlpq2\" (UID: \"c3034cb0-fae0-409e-9ec4-d8b206e9c8af\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-mlpq2" Jul 25 01:21:22.816701 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:21:22.816620 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zrdtg\" (UniqueName: \"kubernetes.io/projected/c3034cb0-fae0-409e-9ec4-d8b206e9c8af-kube-api-access-zrdtg\") pod \"limitador-limitador-54d6d988d5-mlpq2\" (UID: \"c3034cb0-fae0-409e-9ec4-d8b206e9c8af\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-mlpq2" Jul 25 01:21:22.817246 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:21:22.817227 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/c3034cb0-fae0-409e-9ec4-d8b206e9c8af-config-file\") pod \"limitador-limitador-54d6d988d5-mlpq2\" (UID: \"c3034cb0-fae0-409e-9ec4-d8b206e9c8af\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-mlpq2" Jul 25 01:21:22.824678 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:21:22.824614 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zrdtg\" (UniqueName: \"kubernetes.io/projected/c3034cb0-fae0-409e-9ec4-d8b206e9c8af-kube-api-access-zrdtg\") pod \"limitador-limitador-54d6d988d5-mlpq2\" (UID: \"c3034cb0-fae0-409e-9ec4-d8b206e9c8af\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-mlpq2" Jul 25 01:21:22.886591 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:21:22.886565 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-mlpq2" Jul 25 01:21:23.017846 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:21:23.017825 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mlpq2"] Jul 25 01:21:23.019853 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:21:23.019823 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc3034cb0_fae0_409e_9ec4_d8b206e9c8af.slice/crio-15aafdbef7b99409a5ad26ce324746398e95f9d4bc63a13dcb76bd6cc382a90d WatchSource:0}: Error finding container 15aafdbef7b99409a5ad26ce324746398e95f9d4bc63a13dcb76bd6cc382a90d: Status 404 returned error can't find the container with id 15aafdbef7b99409a5ad26ce324746398e95f9d4bc63a13dcb76bd6cc382a90d Jul 25 01:21:23.610422 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:21:23.610331 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-mlpq2" event={"ID":"c3034cb0-fae0-409e-9ec4-d8b206e9c8af","Type":"ContainerStarted","Data":"15aafdbef7b99409a5ad26ce324746398e95f9d4bc63a13dcb76bd6cc382a90d"} Jul 25 01:21:25.620924 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:21:25.620889 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-mlpq2" event={"ID":"c3034cb0-fae0-409e-9ec4-d8b206e9c8af","Type":"ContainerStarted","Data":"3d67e3713e9ce7cca7831f67b5753563436cd433553ed30de5219ef7a62fa290"} Jul 25 01:21:25.621282 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:21:25.620950 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-mlpq2" Jul 25 01:21:25.653986 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:21:25.653896 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-54d6d988d5-mlpq2" podStartSLOduration=1.275163596 podStartE2EDuration="3.653882287s" totalImagesPullingTime="2.378718691s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-25 01:21:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-25 01:21:25.652652735 +0000 UTC m=+571.345747156" watchObservedRunningTime="2026-07-25 01:21:25.653882287 +0000 UTC m=+571.346976705" Jul 25 01:21:36.626516 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:21:36.626488 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-mlpq2" Jul 25 01:21:54.698174 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:21:54.698142 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-s5tbd_a9cb9aa9-8f43-4b32-a7b7-4eb9afb05c90/console-operator/1.log" Jul 25 01:21:54.698174 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:21:54.698161 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-s5tbd_a9cb9aa9-8f43-4b32-a7b7-4eb9afb05c90/console-operator/1.log" Jul 25 01:22:39.006432 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:22:39.006395 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mlpq2"] Jul 25 01:22:54.709165 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:22:54.709128 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mlpq2"] Jul 25 01:23:07.090224 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:23:07.090193 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mlpq2"] Jul 25 01:23:13.691698 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:23:13.691662 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-mxg2f"] Jul 25 01:23:13.694658 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:23:13.694641 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-mxg2f" Jul 25 01:23:13.696977 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:23:13.696959 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jul 25 01:23:13.698110 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:23:13.698095 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jul 25 01:23:13.698188 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:23:13.698172 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-ls94p\"" Jul 25 01:23:13.698241 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:23:13.698198 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\"" Jul 25 01:23:13.707532 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:23:13.707510 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-mxg2f"] Jul 25 01:23:13.782336 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:23:13.782308 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7670bdad-de73-45d6-b243-ff7d1a869ad6-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-mxg2f\" (UID: \"7670bdad-de73-45d6-b243-ff7d1a869ad6\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-mxg2f" Jul 25 01:23:13.782517 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:23:13.782389 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7670bdad-de73-45d6-b243-ff7d1a869ad6-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-mxg2f\" (UID: \"7670bdad-de73-45d6-b243-ff7d1a869ad6\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-mxg2f" Jul 25 01:23:13.782517 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:23:13.782496 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7670bdad-de73-45d6-b243-ff7d1a869ad6-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-mxg2f\" (UID: \"7670bdad-de73-45d6-b243-ff7d1a869ad6\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-mxg2f" Jul 25 01:23:13.782602 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:23:13.782520 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7670bdad-de73-45d6-b243-ff7d1a869ad6-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-mxg2f\" (UID: \"7670bdad-de73-45d6-b243-ff7d1a869ad6\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-mxg2f" Jul 25 01:23:13.782602 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:23:13.782548 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-24zp6\" (UniqueName: \"kubernetes.io/projected/7670bdad-de73-45d6-b243-ff7d1a869ad6-kube-api-access-24zp6\") pod \"e2e-trlp-test-simulated-kserve-598466548d-mxg2f\" (UID: \"7670bdad-de73-45d6-b243-ff7d1a869ad6\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-mxg2f" Jul 25 01:23:13.782696 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:23:13.782636 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7670bdad-de73-45d6-b243-ff7d1a869ad6-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-mxg2f\" (UID: \"7670bdad-de73-45d6-b243-ff7d1a869ad6\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-mxg2f" Jul 25 01:23:13.883249 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:23:13.883214 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7670bdad-de73-45d6-b243-ff7d1a869ad6-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-mxg2f\" (UID: \"7670bdad-de73-45d6-b243-ff7d1a869ad6\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-mxg2f" Jul 25 01:23:13.883249 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:23:13.883246 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7670bdad-de73-45d6-b243-ff7d1a869ad6-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-mxg2f\" (UID: \"7670bdad-de73-45d6-b243-ff7d1a869ad6\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-mxg2f" Jul 25 01:23:13.883526 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:23:13.883265 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-24zp6\" (UniqueName: \"kubernetes.io/projected/7670bdad-de73-45d6-b243-ff7d1a869ad6-kube-api-access-24zp6\") pod \"e2e-trlp-test-simulated-kserve-598466548d-mxg2f\" (UID: \"7670bdad-de73-45d6-b243-ff7d1a869ad6\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-mxg2f" Jul 25 01:23:13.883526 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:23:13.883288 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7670bdad-de73-45d6-b243-ff7d1a869ad6-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-mxg2f\" (UID: \"7670bdad-de73-45d6-b243-ff7d1a869ad6\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-mxg2f" Jul 25 01:23:13.883526 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:23:13.883320 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7670bdad-de73-45d6-b243-ff7d1a869ad6-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-mxg2f\" (UID: \"7670bdad-de73-45d6-b243-ff7d1a869ad6\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-mxg2f" Jul 25 01:23:13.883526 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:23:13.883355 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7670bdad-de73-45d6-b243-ff7d1a869ad6-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-mxg2f\" (UID: \"7670bdad-de73-45d6-b243-ff7d1a869ad6\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-mxg2f" Jul 25 01:23:13.883699 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:23:13.883645 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7670bdad-de73-45d6-b243-ff7d1a869ad6-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-mxg2f\" (UID: \"7670bdad-de73-45d6-b243-ff7d1a869ad6\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-mxg2f" Jul 25 01:23:13.883731 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:23:13.883699 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7670bdad-de73-45d6-b243-ff7d1a869ad6-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-mxg2f\" (UID: \"7670bdad-de73-45d6-b243-ff7d1a869ad6\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-mxg2f" Jul 25 01:23:13.883731 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:23:13.883716 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7670bdad-de73-45d6-b243-ff7d1a869ad6-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-mxg2f\" (UID: \"7670bdad-de73-45d6-b243-ff7d1a869ad6\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-mxg2f" Jul 25 01:23:13.885804 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:23:13.885779 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7670bdad-de73-45d6-b243-ff7d1a869ad6-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-mxg2f\" (UID: \"7670bdad-de73-45d6-b243-ff7d1a869ad6\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-mxg2f" Jul 25 01:23:13.886059 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:23:13.886041 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7670bdad-de73-45d6-b243-ff7d1a869ad6-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-mxg2f\" (UID: \"7670bdad-de73-45d6-b243-ff7d1a869ad6\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-mxg2f" Jul 25 01:23:13.890848 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:23:13.890828 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-24zp6\" (UniqueName: \"kubernetes.io/projected/7670bdad-de73-45d6-b243-ff7d1a869ad6-kube-api-access-24zp6\") pod \"e2e-trlp-test-simulated-kserve-598466548d-mxg2f\" (UID: \"7670bdad-de73-45d6-b243-ff7d1a869ad6\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-mxg2f" Jul 25 01:23:14.005171 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:23:14.005068 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-mxg2f" Jul 25 01:23:14.137729 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:23:14.137704 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-mxg2f"] Jul 25 01:23:14.139730 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:23:14.139707 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7670bdad_de73_45d6_b243_ff7d1a869ad6.slice/crio-53e08fd835254b7ffba1e2bc3f17c7f1dfe9bf020577aacc02d5f3dfc878a4f3 WatchSource:0}: Error finding container 53e08fd835254b7ffba1e2bc3f17c7f1dfe9bf020577aacc02d5f3dfc878a4f3: Status 404 returned error can't find the container with id 53e08fd835254b7ffba1e2bc3f17c7f1dfe9bf020577aacc02d5f3dfc878a4f3 Jul 25 01:23:14.141282 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:23:14.141262 2567 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 25 01:23:15.138274 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:23:15.138247 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-mxg2f" event={"ID":"7670bdad-de73-45d6-b243-ff7d1a869ad6","Type":"ContainerStarted","Data":"6ab4a935f4a79de7cf72943ca8561bfe11a2d1227c718ba83ed6925d5e643475"} Jul 25 01:23:15.138640 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:23:15.138294 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-mxg2f" event={"ID":"7670bdad-de73-45d6-b243-ff7d1a869ad6","Type":"ContainerStarted","Data":"53e08fd835254b7ffba1e2bc3f17c7f1dfe9bf020577aacc02d5f3dfc878a4f3"} Jul 25 01:23:15.159225 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:23:15.159174 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-mxg2f" podStartSLOduration=1.229068433 podStartE2EDuration="2.159157546s" totalImagesPullingTime="930.089113ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-25 01:23:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-25 01:23:15.158487394 +0000 UTC m=+680.851581814" watchObservedRunningTime="2026-07-25 01:23:15.159157546 +0000 UTC m=+680.852251965" Jul 25 01:23:15.186728 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:23:15.186697 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mlpq2"] Jul 25 01:23:22.298838 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:23:22.298801 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mlpq2"] Jul 25 01:23:24.005923 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:23:24.005879 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-mxg2f" Jul 25 01:23:24.006324 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:23:24.006141 2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-mxg2f" Jul 25 01:23:24.019030 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:23:24.019001 2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-mxg2f" Jul 25 01:23:24.192958 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:23:24.192933 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-mxg2f" Jul 25 01:23:33.704394 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:23:33.704354 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mlpq2"] Jul 25 01:23:45.391209 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:23:45.391136 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-57fc66f697-bqrvt"] Jul 25 01:23:45.395739 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:23:45.395720 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-bqrvt" Jul 25 01:23:45.398356 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:23:45.398338 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"premium-simulated-simulated-premium-kserve-self-signed-certs\"" Jul 25 01:23:45.403861 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:23:45.403841 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-57fc66f697-bqrvt"] Jul 25 01:23:45.567183 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:23:45.567148 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9b8f9103-6f7c-4281-b6cd-dddb4a01c2b4-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-bqrvt\" (UID: \"9b8f9103-6f7c-4281-b6cd-dddb4a01c2b4\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-bqrvt" Jul 25 01:23:45.567334 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:23:45.567203 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9b8f9103-6f7c-4281-b6cd-dddb4a01c2b4-home\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-bqrvt\" (UID: \"9b8f9103-6f7c-4281-b6cd-dddb4a01c2b4\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-bqrvt" Jul 25 01:23:45.567334 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:23:45.567275 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7fdhr\" (UniqueName: \"kubernetes.io/projected/9b8f9103-6f7c-4281-b6cd-dddb4a01c2b4-kube-api-access-7fdhr\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-bqrvt\" (UID: \"9b8f9103-6f7c-4281-b6cd-dddb4a01c2b4\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-bqrvt" Jul 25 01:23:45.567334 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:23:45.567325 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9b8f9103-6f7c-4281-b6cd-dddb4a01c2b4-dshm\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-bqrvt\" (UID: \"9b8f9103-6f7c-4281-b6cd-dddb4a01c2b4\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-bqrvt" Jul 25 01:23:45.567515 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:23:45.567403 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9b8f9103-6f7c-4281-b6cd-dddb4a01c2b4-model-cache\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-bqrvt\" (UID: \"9b8f9103-6f7c-4281-b6cd-dddb4a01c2b4\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-bqrvt" Jul 25 01:23:45.567515 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:23:45.567467 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9b8f9103-6f7c-4281-b6cd-dddb4a01c2b4-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-bqrvt\" (UID: \"9b8f9103-6f7c-4281-b6cd-dddb4a01c2b4\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-bqrvt" Jul 25 01:23:45.668863 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:23:45.668796 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7fdhr\" (UniqueName: \"kubernetes.io/projected/9b8f9103-6f7c-4281-b6cd-dddb4a01c2b4-kube-api-access-7fdhr\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-bqrvt\" (UID: \"9b8f9103-6f7c-4281-b6cd-dddb4a01c2b4\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-bqrvt" Jul 25 01:23:45.668863 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:23:45.668842 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9b8f9103-6f7c-4281-b6cd-dddb4a01c2b4-dshm\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-bqrvt\" (UID: \"9b8f9103-6f7c-4281-b6cd-dddb4a01c2b4\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-bqrvt" Jul 25 01:23:45.669062 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:23:45.668868 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9b8f9103-6f7c-4281-b6cd-dddb4a01c2b4-model-cache\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-bqrvt\" (UID: \"9b8f9103-6f7c-4281-b6cd-dddb4a01c2b4\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-bqrvt" Jul 25 01:23:45.669062 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:23:45.668900 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9b8f9103-6f7c-4281-b6cd-dddb4a01c2b4-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-bqrvt\" (UID: \"9b8f9103-6f7c-4281-b6cd-dddb4a01c2b4\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-bqrvt" Jul 25 01:23:45.669062 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:23:45.668920 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9b8f9103-6f7c-4281-b6cd-dddb4a01c2b4-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-bqrvt\" (UID: \"9b8f9103-6f7c-4281-b6cd-dddb4a01c2b4\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-bqrvt" Jul 25 01:23:45.669062 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:23:45.668949 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9b8f9103-6f7c-4281-b6cd-dddb4a01c2b4-home\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-bqrvt\" (UID: \"9b8f9103-6f7c-4281-b6cd-dddb4a01c2b4\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-bqrvt" Jul 25 01:23:45.669328 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:23:45.669305 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9b8f9103-6f7c-4281-b6cd-dddb4a01c2b4-home\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-bqrvt\" (UID: \"9b8f9103-6f7c-4281-b6cd-dddb4a01c2b4\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-bqrvt" Jul 25 01:23:45.669413 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:23:45.669336 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9b8f9103-6f7c-4281-b6cd-dddb4a01c2b4-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-bqrvt\" (UID: \"9b8f9103-6f7c-4281-b6cd-dddb4a01c2b4\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-bqrvt" Jul 25 01:23:45.669413 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:23:45.669307 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9b8f9103-6f7c-4281-b6cd-dddb4a01c2b4-model-cache\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-bqrvt\" (UID: \"9b8f9103-6f7c-4281-b6cd-dddb4a01c2b4\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-bqrvt" Jul 25 01:23:45.671216 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:23:45.671195 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9b8f9103-6f7c-4281-b6cd-dddb4a01c2b4-dshm\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-bqrvt\" (UID: \"9b8f9103-6f7c-4281-b6cd-dddb4a01c2b4\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-bqrvt" Jul 25 01:23:45.671406 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:23:45.671369 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9b8f9103-6f7c-4281-b6cd-dddb4a01c2b4-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-bqrvt\" (UID: \"9b8f9103-6f7c-4281-b6cd-dddb4a01c2b4\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-bqrvt" Jul 25 01:23:45.676525 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:23:45.676507 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7fdhr\" (UniqueName: \"kubernetes.io/projected/9b8f9103-6f7c-4281-b6cd-dddb4a01c2b4-kube-api-access-7fdhr\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-bqrvt\" (UID: \"9b8f9103-6f7c-4281-b6cd-dddb4a01c2b4\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-bqrvt" Jul 25 01:23:45.706068 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:23:45.706050 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-bqrvt" Jul 25 01:23:45.842633 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:23:45.842609 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-57fc66f697-bqrvt"] Jul 25 01:23:45.845274 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:23:45.845247 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod9b8f9103_6f7c_4281_b6cd_dddb4a01c2b4.slice/crio-d1e348604accb87c243ebfa50142aff777ff3e8abf46f65f65258d255213fb74 WatchSource:0}: Error finding container d1e348604accb87c243ebfa50142aff777ff3e8abf46f65f65258d255213fb74: Status 404 returned error can't find the container with id d1e348604accb87c243ebfa50142aff777ff3e8abf46f65f65258d255213fb74 Jul 25 01:23:46.287737 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:23:46.287707 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-bqrvt" event={"ID":"9b8f9103-6f7c-4281-b6cd-dddb4a01c2b4","Type":"ContainerStarted","Data":"2f627475d421afd6beff68644a928f054f79ebb84f9ec886cfaf07dd9912cc80"} Jul 25 01:23:46.287892 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:23:46.287747 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-bqrvt" event={"ID":"9b8f9103-6f7c-4281-b6cd-dddb4a01c2b4","Type":"ContainerStarted","Data":"d1e348604accb87c243ebfa50142aff777ff3e8abf46f65f65258d255213fb74"} Jul 25 01:23:46.305285 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:23:46.305240 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-bqrvt" podStartSLOduration=1.124764405 podStartE2EDuration="1.305224957s" totalImagesPullingTime="180.460552ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-25 01:23:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-25 01:23:46.304210381 +0000 UTC m=+711.997304800" watchObservedRunningTime="2026-07-25 01:23:46.305224957 +0000 UTC m=+711.998319377" Jul 25 01:23:47.790032 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:23:47.789998 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mlpq2"] Jul 25 01:23:55.707126 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:23:55.707088 2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-bqrvt" Jul 25 01:23:55.707126 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:23:55.707130 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-bqrvt" Jul 25 01:23:55.719630 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:23:55.719607 2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-bqrvt" Jul 25 01:23:56.346826 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:23:56.346800 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-bqrvt" Jul 25 01:25:25.097144 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:25:25.097053 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mlpq2"] Jul 25 01:25:35.188538 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:25:35.188497 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mlpq2"] Jul 25 01:25:45.308396 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:25:45.308348 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mlpq2"] Jul 25 01:26:54.728406 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:26:54.728312 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-s5tbd_a9cb9aa9-8f43-4b32-a7b7-4eb9afb05c90/console-operator/1.log" Jul 25 01:26:54.729472 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:26:54.729454 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-s5tbd_a9cb9aa9-8f43-4b32-a7b7-4eb9afb05c90/console-operator/1.log" Jul 25 01:27:27.595485 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:27:27.595455 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mlpq2"] Jul 25 01:28:13.097913 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:28:13.097870 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mlpq2"] Jul 25 01:28:20.899461 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:28:20.899366 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mlpq2"] Jul 25 01:28:31.995056 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:28:31.995025 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mlpq2"] Jul 25 01:28:39.995049 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:28:39.995022 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mlpq2"] Jul 25 01:28:50.894967 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:28:50.894937 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mlpq2"] Jul 25 01:28:59.799827 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:28:59.799791 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mlpq2"] Jul 25 01:29:11.801948 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:29:11.801918 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mlpq2"] Jul 25 01:29:19.491836 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:29:19.491807 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mlpq2"] Jul 25 01:29:27.892677 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:29:27.892641 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mlpq2"] Jul 25 01:29:35.395708 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:29:35.395675 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mlpq2"] Jul 25 01:29:47.599086 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:29:47.599012 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mlpq2"] Jul 25 01:29:56.789113 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:29:56.789084 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mlpq2"] Jul 25 01:30:19.698678 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:30:19.698643 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mlpq2"] Jul 25 01:30:31.089912 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:30:31.089882 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mlpq2"] Jul 25 01:30:40.498801 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:30:40.498762 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mlpq2"] Jul 25 01:30:56.297472 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:30:56.297437 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mlpq2"] Jul 25 01:31:06.098829 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:31:06.098796 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mlpq2"] Jul 25 01:31:15.394175 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:31:15.394096 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mlpq2"] Jul 25 01:31:23.991090 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:31:23.991055 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mlpq2"] Jul 25 01:31:33.895319 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:31:33.895283 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mlpq2"] Jul 25 01:31:43.994662 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:31:43.994629 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mlpq2"] Jul 25 01:31:52.092297 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:31:52.092269 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mlpq2"] Jul 25 01:31:54.758091 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:31:54.758063 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-s5tbd_a9cb9aa9-8f43-4b32-a7b7-4eb9afb05c90/console-operator/1.log" Jul 25 01:31:54.759841 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:31:54.759819 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-s5tbd_a9cb9aa9-8f43-4b32-a7b7-4eb9afb05c90/console-operator/1.log" Jul 25 01:34:44.401434 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:34:44.401396 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mlpq2"] Jul 25 01:34:56.091666 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:34:56.091636 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mlpq2"] Jul 25 01:35:06.888260 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:35:06.888226 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mlpq2"] Jul 25 01:35:18.687592 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:35:18.687556 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mlpq2"] Jul 25 01:35:27.587363 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:35:27.587324 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mlpq2"] Jul 25 01:35:38.098219 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:35:38.098183 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mlpq2"] Jul 25 01:35:49.894956 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:35:49.894880 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mlpq2"] Jul 25 01:35:58.497801 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:35:58.497765 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mlpq2"] Jul 25 01:36:09.388877 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:36:09.388835 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mlpq2"] Jul 25 01:36:30.794890 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:36:30.794862 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mlpq2"] Jul 25 01:36:39.704983 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:36:39.704949 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mlpq2"] Jul 25 01:36:54.789669 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:36:54.789645 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-s5tbd_a9cb9aa9-8f43-4b32-a7b7-4eb9afb05c90/console-operator/1.log" Jul 25 01:36:54.791914 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:36:54.791895 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-s5tbd_a9cb9aa9-8f43-4b32-a7b7-4eb9afb05c90/console-operator/1.log" Jul 25 01:37:03.387144 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:37:03.387114 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mlpq2"] Jul 25 01:37:16.593519 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:37:16.593437 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mlpq2"] Jul 25 01:37:40.787213 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:37:40.787174 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mlpq2"] Jul 25 01:37:53.187559 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:37:53.187519 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mlpq2"] Jul 25 01:37:59.402719 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:37:59.402677 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mlpq2"] Jul 25 01:38:08.592542 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:38:08.592506 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mlpq2"] Jul 25 01:38:16.688104 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:38:16.688073 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mlpq2"] Jul 25 01:38:26.088074 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:38:26.088043 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mlpq2"] Jul 25 01:38:35.191275 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:38:35.191243 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mlpq2"] Jul 25 01:38:45.385042 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:38:45.384949 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mlpq2"] Jul 25 01:38:54.195987 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:38:54.195948 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mlpq2"] Jul 25 01:39:04.795031 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:39:04.795001 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mlpq2"] Jul 25 01:39:17.692939 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:39:17.692905 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mlpq2"] Jul 25 01:39:26.792229 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:39:26.792187 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mlpq2"] Jul 25 01:39:35.497232 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:39:35.497194 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mlpq2"] Jul 25 01:39:46.990223 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:39:46.990194 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mlpq2"] Jul 25 01:39:56.490800 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:39:56.490768 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mlpq2"] Jul 25 01:40:03.191072 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:40:03.191040 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mlpq2"] Jul 25 01:40:18.294339 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:40:18.294255 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mlpq2"] Jul 25 01:40:30.787321 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:40:30.787287 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mlpq2"] Jul 25 01:40:41.591584 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:40:41.591551 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mlpq2"] Jul 25 01:40:50.395904 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:40:50.395868 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mlpq2"] Jul 25 01:41:03.696462 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:41:03.696428 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mlpq2"] Jul 25 01:41:14.892695 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:41:14.892657 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mlpq2"] Jul 25 01:41:31.498849 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:41:31.498816 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mlpq2"] Jul 25 01:41:54.823530 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:41:54.823500 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-s5tbd_a9cb9aa9-8f43-4b32-a7b7-4eb9afb05c90/console-operator/1.log" Jul 25 01:41:54.826640 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:41:54.826615 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-s5tbd_a9cb9aa9-8f43-4b32-a7b7-4eb9afb05c90/console-operator/1.log" Jul 25 01:42:03.590342 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:42:03.590302 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mlpq2"] Jul 25 01:42:15.996469 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:42:15.996431 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mlpq2"] Jul 25 01:42:50.798615 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:42:50.798587 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mlpq2"] Jul 25 01:43:01.794600 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:43:01.794564 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mlpq2"] Jul 25 01:43:34.788522 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:43:34.788490 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mlpq2"] Jul 25 01:43:44.393732 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:43:44.393698 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mlpq2"] Jul 25 01:44:05.598616 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:44:05.598583 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-906a2829-mq2bn"] Jul 25 01:44:05.602070 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:44:05.602054 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-906a2829-mq2bn" Jul 25 01:44:05.604178 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:44:05.604160 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-88hjh\"" Jul 25 01:44:05.604261 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:44:05.604161 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\"" Jul 25 01:44:05.609876 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:44:05.609855 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-906a2829-mq2bn"] Jul 25 01:44:05.672009 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:44:05.671977 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/9ea29f9d-3393-4abc-b074-1f9509172f2b-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-906a2829-mq2bn\" (UID: \"9ea29f9d-3393-4abc-b074-1f9509172f2b\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-906a2829-mq2bn" Jul 25 01:44:05.772451 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:44:05.772416 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/9ea29f9d-3393-4abc-b074-1f9509172f2b-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-906a2829-mq2bn\" (UID: \"9ea29f9d-3393-4abc-b074-1f9509172f2b\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-906a2829-mq2bn" Jul 25 01:44:05.772976 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:44:05.772959 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/9ea29f9d-3393-4abc-b074-1f9509172f2b-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-906a2829-mq2bn\" (UID: \"9ea29f9d-3393-4abc-b074-1f9509172f2b\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-906a2829-mq2bn" Jul 25 01:44:05.913002 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:44:05.912920 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-906a2829-mq2bn" Jul 25 01:44:06.049037 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:44:06.049014 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-906a2829-mq2bn"] Jul 25 01:44:06.051669 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:44:06.051642 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9ea29f9d_3393_4abc_b074_1f9509172f2b.slice/crio-1c5f37f4d6e6c434a1fd75adeda4dc7cd21af552a814f41294596c8df1772280 WatchSource:0}: Error finding container 1c5f37f4d6e6c434a1fd75adeda4dc7cd21af552a814f41294596c8df1772280: Status 404 returned error can't find the container with id 1c5f37f4d6e6c434a1fd75adeda4dc7cd21af552a814f41294596c8df1772280 Jul 25 01:44:06.053567 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:44:06.053553 2567 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 25 01:44:06.162951 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:44:06.162921 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-906a2829-mq2bn" event={"ID":"9ea29f9d-3393-4abc-b074-1f9509172f2b","Type":"ContainerStarted","Data":"1c5f37f4d6e6c434a1fd75adeda4dc7cd21af552a814f41294596c8df1772280"} Jul 25 01:44:10.186041 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:44:10.186005 2567 generic.go:356] "Generic (PLEG): container finished" podID="9ea29f9d-3393-4abc-b074-1f9509172f2b" containerID="cfc98ae9a22d91c50a373c6931409a9ea77fc220f7325e522cef4058844517b5" exitCode=0 Jul 25 01:44:10.186467 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:44:10.186059 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-906a2829-mq2bn" event={"ID":"9ea29f9d-3393-4abc-b074-1f9509172f2b","Type":"ContainerDied","Data":"cfc98ae9a22d91c50a373c6931409a9ea77fc220f7325e522cef4058844517b5"} Jul 25 01:44:11.323840 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:44:11.323814 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-906a2829-mq2bn" Jul 25 01:44:11.423223 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:44:11.423195 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/9ea29f9d-3393-4abc-b074-1f9509172f2b-maas-api-service-ca\") pod \"9ea29f9d-3393-4abc-b074-1f9509172f2b\" (UID: \"9ea29f9d-3393-4abc-b074-1f9509172f2b\") " Jul 25 01:44:11.423560 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:44:11.423538 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9ea29f9d-3393-4abc-b074-1f9509172f2b-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "9ea29f9d-3393-4abc-b074-1f9509172f2b" (UID: "9ea29f9d-3393-4abc-b074-1f9509172f2b"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 25 01:44:11.524309 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:44:11.524236 2567 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/9ea29f9d-3393-4abc-b074-1f9509172f2b-maas-api-service-ca\") on node \"ip-10-0-129-35.ec2.internal\" DevicePath \"\"" Jul 25 01:44:12.196445 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:44:12.196416 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-906a2829-mq2bn" Jul 25 01:44:12.196608 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:44:12.196417 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-906a2829-mq2bn" event={"ID":"9ea29f9d-3393-4abc-b074-1f9509172f2b","Type":"ContainerDied","Data":"1c5f37f4d6e6c434a1fd75adeda4dc7cd21af552a814f41294596c8df1772280"} Jul 25 01:44:12.196608 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:44:12.196532 2567 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="1c5f37f4d6e6c434a1fd75adeda4dc7cd21af552a814f41294596c8df1772280" Jul 25 01:44:19.193236 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:44:19.193207 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mlpq2"] Jul 25 01:44:20.671750 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:44:20.671716 2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-906a2829-mq2bn"] Jul 25 01:44:20.676551 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:44:20.676527 2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-906a2829-mq2bn"] Jul 25 01:44:20.787327 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:44:20.787294 2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9ea29f9d-3393-4abc-b074-1f9509172f2b" path="/var/lib/kubelet/pods/9ea29f9d-3393-4abc-b074-1f9509172f2b/volumes" Jul 25 01:45:46.098249 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:45:46.098205 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mlpq2"] Jul 25 01:45:58.294490 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:45:58.294455 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mlpq2"] Jul 25 01:46:08.894571 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:46:08.894536 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mlpq2"] Jul 25 01:46:18.095670 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:46:18.095584 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mlpq2"] Jul 25 01:46:24.942340 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:46:24.942298 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-6d92f36d-gf9j8"] Jul 25 01:46:24.942929 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:46:24.942849 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9ea29f9d-3393-4abc-b074-1f9509172f2b" containerName="revoke-keys" Jul 25 01:46:24.942929 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:46:24.942868 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="9ea29f9d-3393-4abc-b074-1f9509172f2b" containerName="revoke-keys" Jul 25 01:46:24.943053 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:46:24.942996 2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="9ea29f9d-3393-4abc-b074-1f9509172f2b" containerName="revoke-keys" Jul 25 01:46:24.945085 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:46:24.945064 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-6d92f36d-gf9j8" Jul 25 01:46:24.948278 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:46:24.948260 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-88hjh\"" Jul 25 01:46:24.948591 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:46:24.948578 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\"" Jul 25 01:46:24.954888 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:46:24.954862 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-6d92f36d-gf9j8"] Jul 25 01:46:25.073194 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:46:25.073169 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/9fff4b9d-5107-4caf-8fb1-fd5aca4f1b04-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-6d92f36d-gf9j8\" (UID: \"9fff4b9d-5107-4caf-8fb1-fd5aca4f1b04\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-6d92f36d-gf9j8" Jul 25 01:46:25.174083 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:46:25.174055 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/9fff4b9d-5107-4caf-8fb1-fd5aca4f1b04-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-6d92f36d-gf9j8\" (UID: \"9fff4b9d-5107-4caf-8fb1-fd5aca4f1b04\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-6d92f36d-gf9j8" Jul 25 01:46:25.174721 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:46:25.174695 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/9fff4b9d-5107-4caf-8fb1-fd5aca4f1b04-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-6d92f36d-gf9j8\" (UID: \"9fff4b9d-5107-4caf-8fb1-fd5aca4f1b04\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-6d92f36d-gf9j8" Jul 25 01:46:25.256293 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:46:25.256236 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-6d92f36d-gf9j8" Jul 25 01:46:25.389733 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:46:25.389709 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-6d92f36d-gf9j8"] Jul 25 01:46:25.391631 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:46:25.391600 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9fff4b9d_5107_4caf_8fb1_fd5aca4f1b04.slice/crio-735553e7076b2939d1463ccaef4a07861c6e15f6a3c367311eb430efd7e79f9d WatchSource:0}: Error finding container 735553e7076b2939d1463ccaef4a07861c6e15f6a3c367311eb430efd7e79f9d: Status 404 returned error can't find the container with id 735553e7076b2939d1463ccaef4a07861c6e15f6a3c367311eb430efd7e79f9d Jul 25 01:46:25.846531 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:46:25.846495 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-6d92f36d-gf9j8" event={"ID":"9fff4b9d-5107-4caf-8fb1-fd5aca4f1b04","Type":"ContainerStarted","Data":"323ab842d85808aa81030a982cd426f5d71c219fc53bfb686ac5be3ba3ec11c5"} Jul 25 01:46:25.846690 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:46:25.846547 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-6d92f36d-gf9j8" event={"ID":"9fff4b9d-5107-4caf-8fb1-fd5aca4f1b04","Type":"ContainerStarted","Data":"735553e7076b2939d1463ccaef4a07861c6e15f6a3c367311eb430efd7e79f9d"} Jul 25 01:46:25.861478 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:46:25.861428 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-6d92f36d-gf9j8" podStartSLOduration=1.861412845 podStartE2EDuration="1.861412845s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-25 01:46:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-25 01:46:25.85968768 +0000 UTC m=+2071.552782099" watchObservedRunningTime="2026-07-25 01:46:25.861412845 +0000 UTC m=+2071.554507263" Jul 25 01:46:26.852614 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:46:26.852583 2567 generic.go:356] "Generic (PLEG): container finished" podID="9fff4b9d-5107-4caf-8fb1-fd5aca4f1b04" containerID="323ab842d85808aa81030a982cd426f5d71c219fc53bfb686ac5be3ba3ec11c5" exitCode=0 Jul 25 01:46:26.852984 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:46:26.852665 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-6d92f36d-gf9j8" event={"ID":"9fff4b9d-5107-4caf-8fb1-fd5aca4f1b04","Type":"ContainerDied","Data":"323ab842d85808aa81030a982cd426f5d71c219fc53bfb686ac5be3ba3ec11c5"} Jul 25 01:46:27.989457 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:46:27.989436 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-6d92f36d-gf9j8" Jul 25 01:46:27.996897 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:46:27.996877 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/9fff4b9d-5107-4caf-8fb1-fd5aca4f1b04-maas-api-service-ca\") pod \"9fff4b9d-5107-4caf-8fb1-fd5aca4f1b04\" (UID: \"9fff4b9d-5107-4caf-8fb1-fd5aca4f1b04\") " Jul 25 01:46:27.997180 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:46:27.997161 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9fff4b9d-5107-4caf-8fb1-fd5aca4f1b04-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "9fff4b9d-5107-4caf-8fb1-fd5aca4f1b04" (UID: "9fff4b9d-5107-4caf-8fb1-fd5aca4f1b04"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 25 01:46:28.098207 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:46:28.098178 2567 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/9fff4b9d-5107-4caf-8fb1-fd5aca4f1b04-maas-api-service-ca\") on node \"ip-10-0-129-35.ec2.internal\" DevicePath \"\"" Jul 25 01:46:28.863727 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:46:28.863705 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-6d92f36d-gf9j8" Jul 25 01:46:28.863727 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:46:28.863719 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-6d92f36d-gf9j8" event={"ID":"9fff4b9d-5107-4caf-8fb1-fd5aca4f1b04","Type":"ContainerDied","Data":"735553e7076b2939d1463ccaef4a07861c6e15f6a3c367311eb430efd7e79f9d"} Jul 25 01:46:28.863907 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:46:28.863756 2567 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="735553e7076b2939d1463ccaef4a07861c6e15f6a3c367311eb430efd7e79f9d" Jul 25 01:46:37.694128 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:46:37.694093 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mlpq2"] Jul 25 01:46:40.033835 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:46:40.033794 2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-6d92f36d-gf9j8"] Jul 25 01:46:40.036225 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:46:40.036205 2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-6d92f36d-gf9j8"] Jul 25 01:46:40.786948 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:46:40.786909 2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9fff4b9d-5107-4caf-8fb1-fd5aca4f1b04" path="/var/lib/kubelet/pods/9fff4b9d-5107-4caf-8fb1-fd5aca4f1b04/volumes" Jul 25 01:46:54.854719 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:46:54.854693 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-s5tbd_a9cb9aa9-8f43-4b32-a7b7-4eb9afb05c90/console-operator/1.log" Jul 25 01:46:54.857733 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:46:54.857704 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-s5tbd_a9cb9aa9-8f43-4b32-a7b7-4eb9afb05c90/console-operator/1.log" Jul 25 01:47:16.693533 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:47:16.693499 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mlpq2"] Jul 25 01:47:25.103996 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:47:25.103959 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mlpq2"] Jul 25 01:47:54.400606 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:47:54.400531 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mlpq2"] Jul 25 01:47:58.999405 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:47:58.999363 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-5e11b867-2ljs8"] Jul 25 01:47:58.999770 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:47:58.999724 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9fff4b9d-5107-4caf-8fb1-fd5aca4f1b04" containerName="revoke-keys" Jul 25 01:47:58.999770 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:47:58.999736 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="9fff4b9d-5107-4caf-8fb1-fd5aca4f1b04" containerName="revoke-keys" Jul 25 01:47:58.999844 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:47:58.999811 2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="9fff4b9d-5107-4caf-8fb1-fd5aca4f1b04" containerName="revoke-keys" Jul 25 01:47:59.002854 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:47:59.002840 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-5e11b867-2ljs8" Jul 25 01:47:59.005355 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:47:59.005332 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-88hjh\"" Jul 25 01:47:59.005503 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:47:59.005371 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\"" Jul 25 01:47:59.009595 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:47:59.009549 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-5e11b867-2ljs8"] Jul 25 01:47:59.073670 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:47:59.073651 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/412e4a00-ea54-496d-ae23-8426d9f7af97-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-5e11b867-2ljs8\" (UID: \"412e4a00-ea54-496d-ae23-8426d9f7af97\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-5e11b867-2ljs8" Jul 25 01:47:59.174713 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:47:59.174690 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/412e4a00-ea54-496d-ae23-8426d9f7af97-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-5e11b867-2ljs8\" (UID: \"412e4a00-ea54-496d-ae23-8426d9f7af97\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-5e11b867-2ljs8" Jul 25 01:47:59.175240 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:47:59.175222 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/412e4a00-ea54-496d-ae23-8426d9f7af97-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-5e11b867-2ljs8\" (UID: \"412e4a00-ea54-496d-ae23-8426d9f7af97\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-5e11b867-2ljs8" Jul 25 01:47:59.315785 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:47:59.315764 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-5e11b867-2ljs8" Jul 25 01:47:59.445949 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:47:59.445926 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-5e11b867-2ljs8"] Jul 25 01:47:59.448131 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:47:59.448106 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod412e4a00_ea54_496d_ae23_8426d9f7af97.slice/crio-00edc2ac43a2d3c268eb124387a49ca0865556c4959b9bf4e2d843520fd6b5df WatchSource:0}: Error finding container 00edc2ac43a2d3c268eb124387a49ca0865556c4959b9bf4e2d843520fd6b5df: Status 404 returned error can't find the container with id 00edc2ac43a2d3c268eb124387a49ca0865556c4959b9bf4e2d843520fd6b5df Jul 25 01:48:00.314308 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:48:00.314275 2567 generic.go:356] "Generic (PLEG): container finished" podID="412e4a00-ea54-496d-ae23-8426d9f7af97" containerID="72347c927da0dffaf0a01477d5e1187ebeacd4a3c1b38efabbb5ab470bca0858" exitCode=0 Jul 25 01:48:00.314689 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:48:00.314336 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-5e11b867-2ljs8" event={"ID":"412e4a00-ea54-496d-ae23-8426d9f7af97","Type":"ContainerDied","Data":"72347c927da0dffaf0a01477d5e1187ebeacd4a3c1b38efabbb5ab470bca0858"} Jul 25 01:48:00.314689 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:48:00.314423 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-5e11b867-2ljs8" event={"ID":"412e4a00-ea54-496d-ae23-8426d9f7af97","Type":"ContainerStarted","Data":"00edc2ac43a2d3c268eb124387a49ca0865556c4959b9bf4e2d843520fd6b5df"} Jul 25 01:48:01.454973 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:48:01.454951 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-5e11b867-2ljs8" Jul 25 01:48:01.594975 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:48:01.594913 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/412e4a00-ea54-496d-ae23-8426d9f7af97-maas-api-service-ca\") pod \"412e4a00-ea54-496d-ae23-8426d9f7af97\" (UID: \"412e4a00-ea54-496d-ae23-8426d9f7af97\") " Jul 25 01:48:01.595224 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:48:01.595203 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/412e4a00-ea54-496d-ae23-8426d9f7af97-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "412e4a00-ea54-496d-ae23-8426d9f7af97" (UID: "412e4a00-ea54-496d-ae23-8426d9f7af97"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 25 01:48:01.696065 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:48:01.696030 2567 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/412e4a00-ea54-496d-ae23-8426d9f7af97-maas-api-service-ca\") on node \"ip-10-0-129-35.ec2.internal\" DevicePath \"\"" Jul 25 01:48:02.325572 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:48:02.325549 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-5e11b867-2ljs8" Jul 25 01:48:02.325738 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:48:02.325580 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-5e11b867-2ljs8" event={"ID":"412e4a00-ea54-496d-ae23-8426d9f7af97","Type":"ContainerDied","Data":"00edc2ac43a2d3c268eb124387a49ca0865556c4959b9bf4e2d843520fd6b5df"} Jul 25 01:48:02.325738 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:48:02.325622 2567 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="00edc2ac43a2d3c268eb124387a49ca0865556c4959b9bf4e2d843520fd6b5df" Jul 25 01:48:13.000940 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:48:13.000905 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mlpq2"] Jul 25 01:48:19.080177 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:48:19.080147 2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-5e11b867-2ljs8"] Jul 25 01:48:19.084350 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:48:19.084328 2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-5e11b867-2ljs8"] Jul 25 01:48:20.793606 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:48:20.793574 2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="412e4a00-ea54-496d-ae23-8426d9f7af97" path="/var/lib/kubelet/pods/412e4a00-ea54-496d-ae23-8426d9f7af97/volumes" Jul 25 01:48:23.801339 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:48:23.801303 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mlpq2"] Jul 25 01:49:19.903820 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:49:19.903740 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mlpq2"] Jul 25 01:49:29.399604 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:49:29.399564 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mlpq2"] Jul 25 01:50:21.007193 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:50:21.007162 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mlpq2"] Jul 25 01:50:33.904441 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:50:33.904409 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mlpq2"] Jul 25 01:50:42.796481 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:50:42.796444 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mlpq2"] Jul 25 01:50:54.919985 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:50:54.919918 2567 scope.go:117] "RemoveContainer" containerID="cfc98ae9a22d91c50a373c6931409a9ea77fc220f7325e522cef4058844517b5" Jul 25 01:50:56.794371 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:50:56.794334 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mlpq2"] Jul 25 01:51:24.492217 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:51:24.492183 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mlpq2"] Jul 25 01:51:54.885032 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:51:54.885005 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-s5tbd_a9cb9aa9-8f43-4b32-a7b7-4eb9afb05c90/console-operator/1.log" Jul 25 01:51:54.889118 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:51:54.889099 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-s5tbd_a9cb9aa9-8f43-4b32-a7b7-4eb9afb05c90/console-operator/1.log" Jul 25 01:52:04.175419 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:52:04.175363 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-df5e5d-k84zq"] Jul 25 01:52:04.175878 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:52:04.175769 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="412e4a00-ea54-496d-ae23-8426d9f7af97" containerName="revoke-keys" Jul 25 01:52:04.175878 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:52:04.175781 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="412e4a00-ea54-496d-ae23-8426d9f7af97" containerName="revoke-keys" Jul 25 01:52:04.175878 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:52:04.175860 2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="412e4a00-ea54-496d-ae23-8426d9f7af97" containerName="revoke-keys" Jul 25 01:52:04.178968 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:52:04.178953 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-df5e5d-k84zq" Jul 25 01:52:04.180943 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:52:04.180923 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-88hjh\"" Jul 25 01:52:04.181113 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:52:04.181099 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\"" Jul 25 01:52:04.185481 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:52:04.185458 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-df5e5d-k84zq"] Jul 25 01:52:04.277012 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:52:04.276976 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/27d954a2-42eb-44a7-bd11-61fb7e4a1e5c-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-df5e5d-k84zq\" (UID: \"27d954a2-42eb-44a7-bd11-61fb7e4a1e5c\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-df5e5d-k84zq" Jul 25 01:52:04.377499 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:52:04.377464 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/27d954a2-42eb-44a7-bd11-61fb7e4a1e5c-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-df5e5d-k84zq\" (UID: \"27d954a2-42eb-44a7-bd11-61fb7e4a1e5c\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-df5e5d-k84zq" Jul 25 01:52:04.378141 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:52:04.378123 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/27d954a2-42eb-44a7-bd11-61fb7e4a1e5c-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-df5e5d-k84zq\" (UID: \"27d954a2-42eb-44a7-bd11-61fb7e4a1e5c\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-df5e5d-k84zq" Jul 25 01:52:04.492602 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:52:04.492515 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-df5e5d-k84zq" Jul 25 01:52:04.630740 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:52:04.630715 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-df5e5d-k84zq"] Jul 25 01:52:04.632668 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:52:04.632637 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod27d954a2_42eb_44a7_bd11_61fb7e4a1e5c.slice/crio-4d3a810b6c70d875368a7db554f8b8480c07924c9b9450fd957dd18e70cc88c4 WatchSource:0}: Error finding container 4d3a810b6c70d875368a7db554f8b8480c07924c9b9450fd957dd18e70cc88c4: Status 404 returned error can't find the container with id 4d3a810b6c70d875368a7db554f8b8480c07924c9b9450fd957dd18e70cc88c4 Jul 25 01:52:05.536111 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:52:05.536076 2567 generic.go:356] "Generic (PLEG): container finished" podID="27d954a2-42eb-44a7-bd11-61fb7e4a1e5c" containerID="89a0beec591f4e33c329177a0715b0c2b2a374a98672c96942279b5bba8dd1fd" exitCode=0 Jul 25 01:52:05.536561 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:52:05.536172 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-df5e5d-k84zq" event={"ID":"27d954a2-42eb-44a7-bd11-61fb7e4a1e5c","Type":"ContainerDied","Data":"89a0beec591f4e33c329177a0715b0c2b2a374a98672c96942279b5bba8dd1fd"} Jul 25 01:52:05.536561 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:52:05.536272 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-df5e5d-k84zq" event={"ID":"27d954a2-42eb-44a7-bd11-61fb7e4a1e5c","Type":"ContainerStarted","Data":"4d3a810b6c70d875368a7db554f8b8480c07924c9b9450fd957dd18e70cc88c4"} Jul 25 01:52:06.679713 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:52:06.679687 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-df5e5d-k84zq" Jul 25 01:52:06.811055 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:52:06.810975 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/27d954a2-42eb-44a7-bd11-61fb7e4a1e5c-maas-api-service-ca\") pod \"27d954a2-42eb-44a7-bd11-61fb7e4a1e5c\" (UID: \"27d954a2-42eb-44a7-bd11-61fb7e4a1e5c\") " Jul 25 01:52:06.811368 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:52:06.811342 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/27d954a2-42eb-44a7-bd11-61fb7e4a1e5c-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "27d954a2-42eb-44a7-bd11-61fb7e4a1e5c" (UID: "27d954a2-42eb-44a7-bd11-61fb7e4a1e5c"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 25 01:52:06.911713 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:52:06.911675 2567 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/27d954a2-42eb-44a7-bd11-61fb7e4a1e5c-maas-api-service-ca\") on node \"ip-10-0-129-35.ec2.internal\" DevicePath \"\"" Jul 25 01:52:07.547130 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:52:07.547097 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-df5e5d-k84zq" Jul 25 01:52:07.547130 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:52:07.547115 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-df5e5d-k84zq" event={"ID":"27d954a2-42eb-44a7-bd11-61fb7e4a1e5c","Type":"ContainerDied","Data":"4d3a810b6c70d875368a7db554f8b8480c07924c9b9450fd957dd18e70cc88c4"} Jul 25 01:52:07.547346 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:52:07.547156 2567 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="4d3a810b6c70d875368a7db554f8b8480c07924c9b9450fd957dd18e70cc88c4" Jul 25 01:52:08.293975 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:52:08.293939 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mlpq2"] Jul 25 01:52:19.257806 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:52:19.257721 2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-df5e5d-k84zq"] Jul 25 01:52:19.259539 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:52:19.259520 2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-df5e5d-k84zq"] Jul 25 01:52:20.786071 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:52:20.786026 2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="27d954a2-42eb-44a7-bd11-61fb7e4a1e5c" path="/var/lib/kubelet/pods/27d954a2-42eb-44a7-bd11-61fb7e4a1e5c/volumes" Jul 25 01:52:23.494978 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:52:23.494942 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mlpq2"] Jul 25 01:52:26.100075 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:52:26.100045 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-320e6c-9mjhg"] Jul 25 01:52:26.100512 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:52:26.100443 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="27d954a2-42eb-44a7-bd11-61fb7e4a1e5c" containerName="revoke-keys" Jul 25 01:52:26.100512 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:52:26.100456 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="27d954a2-42eb-44a7-bd11-61fb7e4a1e5c" containerName="revoke-keys" Jul 25 01:52:26.100592 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:52:26.100524 2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="27d954a2-42eb-44a7-bd11-61fb7e4a1e5c" containerName="revoke-keys" Jul 25 01:52:26.104738 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:52:26.104723 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-320e6c-9mjhg" Jul 25 01:52:26.106982 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:52:26.106959 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-88hjh\"" Jul 25 01:52:26.107111 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:52:26.106964 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\"" Jul 25 01:52:26.113653 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:52:26.111110 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-320e6c-9mjhg"] Jul 25 01:52:26.201488 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:52:26.201455 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/bcfd74ef-866a-40dc-97da-180ce7176145-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-320e6c-9mjhg\" (UID: \"bcfd74ef-866a-40dc-97da-180ce7176145\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-320e6c-9mjhg" Jul 25 01:52:26.302444 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:52:26.302414 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/bcfd74ef-866a-40dc-97da-180ce7176145-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-320e6c-9mjhg\" (UID: \"bcfd74ef-866a-40dc-97da-180ce7176145\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-320e6c-9mjhg" Jul 25 01:52:26.303032 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:52:26.303008 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/bcfd74ef-866a-40dc-97da-180ce7176145-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-320e6c-9mjhg\" (UID: \"bcfd74ef-866a-40dc-97da-180ce7176145\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-320e6c-9mjhg" Jul 25 01:52:26.420027 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:52:26.419956 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-320e6c-9mjhg" Jul 25 01:52:26.549325 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:52:26.549302 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-320e6c-9mjhg"] Jul 25 01:52:26.550959 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:52:26.550933 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbcfd74ef_866a_40dc_97da_180ce7176145.slice/crio-87f9e6e57c90151fe7ad66e9af7b2943d690d70dbf2d6528f5f96cedc1d90401 WatchSource:0}: Error finding container 87f9e6e57c90151fe7ad66e9af7b2943d690d70dbf2d6528f5f96cedc1d90401: Status 404 returned error can't find the container with id 87f9e6e57c90151fe7ad66e9af7b2943d690d70dbf2d6528f5f96cedc1d90401 Jul 25 01:52:26.641429 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:52:26.641393 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-320e6c-9mjhg" event={"ID":"bcfd74ef-866a-40dc-97da-180ce7176145","Type":"ContainerStarted","Data":"87f9e6e57c90151fe7ad66e9af7b2943d690d70dbf2d6528f5f96cedc1d90401"} Jul 25 01:52:27.647725 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:52:27.647690 2567 generic.go:356] "Generic (PLEG): container finished" podID="bcfd74ef-866a-40dc-97da-180ce7176145" containerID="736dfe5f57131885b578850b460fe0d567ce7fd07ac9604d9ff70ffba00a284a" exitCode=0 Jul 25 01:52:27.648110 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:52:27.647775 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-320e6c-9mjhg" event={"ID":"bcfd74ef-866a-40dc-97da-180ce7176145","Type":"ContainerDied","Data":"736dfe5f57131885b578850b460fe0d567ce7fd07ac9604d9ff70ffba00a284a"} Jul 25 01:52:28.789835 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:52:28.789812 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-320e6c-9mjhg" Jul 25 01:52:28.822119 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:52:28.822094 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/bcfd74ef-866a-40dc-97da-180ce7176145-maas-api-service-ca\") pod \"bcfd74ef-866a-40dc-97da-180ce7176145\" (UID: \"bcfd74ef-866a-40dc-97da-180ce7176145\") " Jul 25 01:52:28.822448 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:52:28.822424 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bcfd74ef-866a-40dc-97da-180ce7176145-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "bcfd74ef-866a-40dc-97da-180ce7176145" (UID: "bcfd74ef-866a-40dc-97da-180ce7176145"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 25 01:52:28.923165 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:52:28.923094 2567 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/bcfd74ef-866a-40dc-97da-180ce7176145-maas-api-service-ca\") on node \"ip-10-0-129-35.ec2.internal\" DevicePath \"\"" Jul 25 01:52:29.658458 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:52:29.658431 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-320e6c-9mjhg" Jul 25 01:52:29.658627 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:52:29.658421 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-320e6c-9mjhg" event={"ID":"bcfd74ef-866a-40dc-97da-180ce7176145","Type":"ContainerDied","Data":"87f9e6e57c90151fe7ad66e9af7b2943d690d70dbf2d6528f5f96cedc1d90401"} Jul 25 01:52:29.658627 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:52:29.658550 2567 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="87f9e6e57c90151fe7ad66e9af7b2943d690d70dbf2d6528f5f96cedc1d90401" Jul 25 01:52:40.093395 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:52:40.093344 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mlpq2"] Jul 25 01:52:41.169426 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:52:41.169368 2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-320e6c-9mjhg"] Jul 25 01:52:41.171514 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:52:41.171496 2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-320e6c-9mjhg"] Jul 25 01:52:42.786131 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:52:42.786095 2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bcfd74ef-866a-40dc-97da-180ce7176145" path="/var/lib/kubelet/pods/bcfd74ef-866a-40dc-97da-180ce7176145/volumes" Jul 25 01:52:54.947011 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:52:54.946978 2567 scope.go:117] "RemoveContainer" containerID="323ab842d85808aa81030a982cd426f5d71c219fc53bfb686ac5be3ba3ec11c5" Jul 25 01:52:59.900387 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:52:59.900340 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mlpq2"] Jul 25 01:53:00.222051 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:53:00.221963 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-393e3a-55c94757f6-pwkch"] Jul 25 01:53:00.222392 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:53:00.222364 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bcfd74ef-866a-40dc-97da-180ce7176145" containerName="revoke-keys" Jul 25 01:53:00.222392 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:53:00.222392 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="bcfd74ef-866a-40dc-97da-180ce7176145" containerName="revoke-keys" Jul 25 01:53:00.222513 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:53:00.222479 2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="bcfd74ef-866a-40dc-97da-180ce7176145" containerName="revoke-keys" Jul 25 01:53:00.225713 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:53:00.225694 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-b-393e3a-55c94757f6-pwkch" Jul 25 01:53:00.228176 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:53:00.228154 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-api-b-393e3a\"" Jul 25 01:53:00.233873 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:53:00.233850 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-393e3a-55c94757f6-pwkch"] Jul 25 01:53:00.397888 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:53:00.397850 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3c70f05d-f878-4f29-9be0-d9043e51ba04-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-b-393e3a-55c94757f6-pwkch\" (UID: \"3c70f05d-f878-4f29-9be0-d9043e51ba04\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-393e3a-55c94757f6-pwkch" Jul 25 01:53:00.397888 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:53:00.397888 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bbzgp\" (UniqueName: \"kubernetes.io/projected/3c70f05d-f878-4f29-9be0-d9043e51ba04-kube-api-access-bbzgp\") pod \"payload-pre-processing-e2e-api-b-393e3a-55c94757f6-pwkch\" (UID: \"3c70f05d-f878-4f29-9be0-d9043e51ba04\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-393e3a-55c94757f6-pwkch" Jul 25 01:53:00.498767 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:53:00.498686 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3c70f05d-f878-4f29-9be0-d9043e51ba04-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-b-393e3a-55c94757f6-pwkch\" (UID: \"3c70f05d-f878-4f29-9be0-d9043e51ba04\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-393e3a-55c94757f6-pwkch" Jul 25 01:53:00.498767 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:53:00.498716 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bbzgp\" (UniqueName: \"kubernetes.io/projected/3c70f05d-f878-4f29-9be0-d9043e51ba04-kube-api-access-bbzgp\") pod \"payload-pre-processing-e2e-api-b-393e3a-55c94757f6-pwkch\" (UID: \"3c70f05d-f878-4f29-9be0-d9043e51ba04\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-393e3a-55c94757f6-pwkch" Jul 25 01:53:00.499463 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:53:00.499439 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3c70f05d-f878-4f29-9be0-d9043e51ba04-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-b-393e3a-55c94757f6-pwkch\" (UID: \"3c70f05d-f878-4f29-9be0-d9043e51ba04\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-393e3a-55c94757f6-pwkch" Jul 25 01:53:00.505934 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:53:00.505910 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bbzgp\" (UniqueName: \"kubernetes.io/projected/3c70f05d-f878-4f29-9be0-d9043e51ba04-kube-api-access-bbzgp\") pod \"payload-pre-processing-e2e-api-b-393e3a-55c94757f6-pwkch\" (UID: \"3c70f05d-f878-4f29-9be0-d9043e51ba04\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-393e3a-55c94757f6-pwkch" Jul 25 01:53:00.536933 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:53:00.536907 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-b-393e3a-55c94757f6-pwkch" Jul 25 01:53:00.679910 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:53:00.679873 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-393e3a-55c94757f6-pwkch"] Jul 25 01:53:00.682925 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:53:00.682889 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3c70f05d_f878_4f29_9be0_d9043e51ba04.slice/crio-52c8a90d95108202107283c99805f03c29290ef3f4fa7d271fb322e8115fe887 WatchSource:0}: Error finding container 52c8a90d95108202107283c99805f03c29290ef3f4fa7d271fb322e8115fe887: Status 404 returned error can't find the container with id 52c8a90d95108202107283c99805f03c29290ef3f4fa7d271fb322e8115fe887 Jul 25 01:53:00.685158 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:53:00.685142 2567 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 25 01:53:00.819475 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:53:00.819438 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-b-393e3a-55c94757f6-pwkch" event={"ID":"3c70f05d-f878-4f29-9be0-d9043e51ba04","Type":"ContainerStarted","Data":"52c8a90d95108202107283c99805f03c29290ef3f4fa7d271fb322e8115fe887"} Jul 25 01:53:02.833725 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:53:02.833690 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-b-393e3a-55c94757f6-pwkch" event={"ID":"3c70f05d-f878-4f29-9be0-d9043e51ba04","Type":"ContainerStarted","Data":"1ea685d7a0174fbeedab1cbfcbef9d723b2af4631dc78d661753b5961a41267d"} Jul 25 01:53:02.834115 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:53:02.833831 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-api-b-393e3a-55c94757f6-pwkch" Jul 25 01:53:13.842561 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:53:13.842528 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-api-b-393e3a-55c94757f6-pwkch" Jul 25 01:53:13.858412 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:53:13.858347 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-api-b-393e3a-55c94757f6-pwkch" podStartSLOduration=12.200271712 podStartE2EDuration="13.858327003s" totalImagesPullingTime="1.658055291s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-25 01:53:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-25 01:53:02.847048931 +0000 UTC m=+2468.540143363" watchObservedRunningTime="2026-07-25 01:53:13.858327003 +0000 UTC m=+2479.551421421" Jul 25 01:53:16.705969 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:53:16.705938 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mlpq2"] Jul 25 01:53:32.192068 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:53:32.191985 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mlpq2"] Jul 25 01:53:54.729621 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:53:54.729539 2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-393e3a-55c94757f6-pwkch"] Jul 25 01:53:54.730122 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:53:54.729856 2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-api-b-393e3a-55c94757f6-pwkch" podUID="3c70f05d-f878-4f29-9be0-d9043e51ba04" containerName="payload-pre-processing" containerID="cri-o://1ea685d7a0174fbeedab1cbfcbef9d723b2af4631dc78d661753b5961a41267d" gracePeriod=30 Jul 25 01:53:54.991154 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:53:54.991096 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-b-393e3a-55c94757f6-pwkch" Jul 25 01:53:54.991561 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:53:54.991543 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bbzgp\" (UniqueName: \"kubernetes.io/projected/3c70f05d-f878-4f29-9be0-d9043e51ba04-kube-api-access-bbzgp\") pod \"3c70f05d-f878-4f29-9be0-d9043e51ba04\" (UID: \"3c70f05d-f878-4f29-9be0-d9043e51ba04\") " Jul 25 01:53:54.993865 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:53:54.993842 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3c70f05d-f878-4f29-9be0-d9043e51ba04-kube-api-access-bbzgp" (OuterVolumeSpecName: "kube-api-access-bbzgp") pod "3c70f05d-f878-4f29-9be0-d9043e51ba04" (UID: "3c70f05d-f878-4f29-9be0-d9043e51ba04"). InnerVolumeSpecName "kube-api-access-bbzgp". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 25 01:53:55.092290 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:53:55.092263 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3c70f05d-f878-4f29-9be0-d9043e51ba04-plugins-config-volume\") pod \"3c70f05d-f878-4f29-9be0-d9043e51ba04\" (UID: \"3c70f05d-f878-4f29-9be0-d9043e51ba04\") " Jul 25 01:53:55.092457 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:53:55.092445 2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bbzgp\" (UniqueName: \"kubernetes.io/projected/3c70f05d-f878-4f29-9be0-d9043e51ba04-kube-api-access-bbzgp\") on node \"ip-10-0-129-35.ec2.internal\" DevicePath \"\"" Jul 25 01:53:55.092658 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:53:55.092639 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3c70f05d-f878-4f29-9be0-d9043e51ba04-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "3c70f05d-f878-4f29-9be0-d9043e51ba04" (UID: "3c70f05d-f878-4f29-9be0-d9043e51ba04"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 25 01:53:55.104339 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:53:55.104311 2567 generic.go:356] "Generic (PLEG): container finished" podID="3c70f05d-f878-4f29-9be0-d9043e51ba04" containerID="1ea685d7a0174fbeedab1cbfcbef9d723b2af4631dc78d661753b5961a41267d" exitCode=0 Jul 25 01:53:55.104458 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:53:55.104352 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-b-393e3a-55c94757f6-pwkch" Jul 25 01:53:55.104458 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:53:55.104417 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-b-393e3a-55c94757f6-pwkch" event={"ID":"3c70f05d-f878-4f29-9be0-d9043e51ba04","Type":"ContainerDied","Data":"1ea685d7a0174fbeedab1cbfcbef9d723b2af4631dc78d661753b5961a41267d"} Jul 25 01:53:55.104530 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:53:55.104468 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-b-393e3a-55c94757f6-pwkch" event={"ID":"3c70f05d-f878-4f29-9be0-d9043e51ba04","Type":"ContainerDied","Data":"52c8a90d95108202107283c99805f03c29290ef3f4fa7d271fb322e8115fe887"} Jul 25 01:53:55.104530 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:53:55.104491 2567 scope.go:117] "RemoveContainer" containerID="1ea685d7a0174fbeedab1cbfcbef9d723b2af4631dc78d661753b5961a41267d" Jul 25 01:53:55.113238 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:53:55.113223 2567 scope.go:117] "RemoveContainer" containerID="1ea685d7a0174fbeedab1cbfcbef9d723b2af4631dc78d661753b5961a41267d" Jul 25 01:53:55.113520 ip-10-0-129-35 kubenswrapper[2567]: E0725 01:53:55.113502 2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1ea685d7a0174fbeedab1cbfcbef9d723b2af4631dc78d661753b5961a41267d\": container with ID starting with 1ea685d7a0174fbeedab1cbfcbef9d723b2af4631dc78d661753b5961a41267d not found: ID does not exist" containerID="1ea685d7a0174fbeedab1cbfcbef9d723b2af4631dc78d661753b5961a41267d" Jul 25 01:53:55.113580 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:53:55.113528 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1ea685d7a0174fbeedab1cbfcbef9d723b2af4631dc78d661753b5961a41267d"} err="failed to get container status \"1ea685d7a0174fbeedab1cbfcbef9d723b2af4631dc78d661753b5961a41267d\": rpc error: code = NotFound desc = could not find container \"1ea685d7a0174fbeedab1cbfcbef9d723b2af4631dc78d661753b5961a41267d\": container with ID starting with 1ea685d7a0174fbeedab1cbfcbef9d723b2af4631dc78d661753b5961a41267d not found: ID does not exist" Jul 25 01:53:55.124565 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:53:55.124547 2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-393e3a-55c94757f6-pwkch"] Jul 25 01:53:55.128956 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:53:55.128935 2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-393e3a-55c94757f6-pwkch"] Jul 25 01:53:55.192937 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:53:55.192913 2567 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3c70f05d-f878-4f29-9be0-d9043e51ba04-plugins-config-volume\") on node \"ip-10-0-129-35.ec2.internal\" DevicePath \"\"" Jul 25 01:53:56.786308 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:53:56.786276 2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3c70f05d-f878-4f29-9be0-d9043e51ba04" path="/var/lib/kubelet/pods/3c70f05d-f878-4f29-9be0-d9043e51ba04/volumes" Jul 25 01:53:59.306930 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:53:59.306897 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mlpq2"] Jul 25 01:54:10.394467 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:54:10.394432 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-299af2-65d57c848d-p9sbk"] Jul 25 01:54:10.394868 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:54:10.394817 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3c70f05d-f878-4f29-9be0-d9043e51ba04" containerName="payload-pre-processing" Jul 25 01:54:10.394868 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:54:10.394829 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="3c70f05d-f878-4f29-9be0-d9043e51ba04" containerName="payload-pre-processing" Jul 25 01:54:10.395134 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:54:10.394900 2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="3c70f05d-f878-4f29-9be0-d9043e51ba04" containerName="payload-pre-processing" Jul 25 01:54:10.397339 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:54:10.397322 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-299af2-65d57c848d-p9sbk" Jul 25 01:54:10.399976 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:54:10.399949 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-shared-a-299af2\"" Jul 25 01:54:10.400087 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:54:10.400057 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-shared-a-299af2-dockercfg-w55t8\"" Jul 25 01:54:10.409552 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:54:10.409529 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-299af2-65d57c848d-p9sbk"] Jul 25 01:54:10.434279 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:54:10.434250 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-299af2-865774ff5d-x572k"] Jul 25 01:54:10.436643 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:54:10.436627 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-299af2-865774ff5d-x572k" Jul 25 01:54:10.444872 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:54:10.444849 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-299af2-865774ff5d-x572k"] Jul 25 01:54:10.525236 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:54:10.525204 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-624qt\" (UniqueName: \"kubernetes.io/projected/8003b15e-d043-4334-a7a0-a3cd53bd28d9-kube-api-access-624qt\") pod \"payload-pre-processing-e2e-shared-a-299af2-65d57c848d-p9sbk\" (UID: \"8003b15e-d043-4334-a7a0-a3cd53bd28d9\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-299af2-65d57c848d-p9sbk" Jul 25 01:54:10.525422 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:54:10.525250 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8003b15e-d043-4334-a7a0-a3cd53bd28d9-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-299af2-65d57c848d-p9sbk\" (UID: \"8003b15e-d043-4334-a7a0-a3cd53bd28d9\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-299af2-65d57c848d-p9sbk" Jul 25 01:54:10.525422 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:54:10.525283 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t64rk\" (UniqueName: \"kubernetes.io/projected/1495beb6-a0be-4300-af70-c4d924859c4b-kube-api-access-t64rk\") pod \"payload-processing-e2e-shared-a-299af2-865774ff5d-x572k\" (UID: \"1495beb6-a0be-4300-af70-c4d924859c4b\") " pod="openshift-ingress/payload-processing-e2e-shared-a-299af2-865774ff5d-x572k" Jul 25 01:54:10.525422 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:54:10.525317 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1495beb6-a0be-4300-af70-c4d924859c4b-plugins-config-volume\") pod \"payload-processing-e2e-shared-a-299af2-865774ff5d-x572k\" (UID: \"1495beb6-a0be-4300-af70-c4d924859c4b\") " pod="openshift-ingress/payload-processing-e2e-shared-a-299af2-865774ff5d-x572k" Jul 25 01:54:10.626253 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:54:10.626222 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1495beb6-a0be-4300-af70-c4d924859c4b-plugins-config-volume\") pod \"payload-processing-e2e-shared-a-299af2-865774ff5d-x572k\" (UID: \"1495beb6-a0be-4300-af70-c4d924859c4b\") " pod="openshift-ingress/payload-processing-e2e-shared-a-299af2-865774ff5d-x572k" Jul 25 01:54:10.626456 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:54:10.626330 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-624qt\" (UniqueName: \"kubernetes.io/projected/8003b15e-d043-4334-a7a0-a3cd53bd28d9-kube-api-access-624qt\") pod \"payload-pre-processing-e2e-shared-a-299af2-65d57c848d-p9sbk\" (UID: \"8003b15e-d043-4334-a7a0-a3cd53bd28d9\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-299af2-65d57c848d-p9sbk" Jul 25 01:54:10.626456 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:54:10.626366 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8003b15e-d043-4334-a7a0-a3cd53bd28d9-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-299af2-65d57c848d-p9sbk\" (UID: \"8003b15e-d043-4334-a7a0-a3cd53bd28d9\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-299af2-65d57c848d-p9sbk" Jul 25 01:54:10.626456 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:54:10.626414 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t64rk\" (UniqueName: \"kubernetes.io/projected/1495beb6-a0be-4300-af70-c4d924859c4b-kube-api-access-t64rk\") pod \"payload-processing-e2e-shared-a-299af2-865774ff5d-x572k\" (UID: \"1495beb6-a0be-4300-af70-c4d924859c4b\") " pod="openshift-ingress/payload-processing-e2e-shared-a-299af2-865774ff5d-x572k" Jul 25 01:54:10.627031 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:54:10.627012 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8003b15e-d043-4334-a7a0-a3cd53bd28d9-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-299af2-65d57c848d-p9sbk\" (UID: \"8003b15e-d043-4334-a7a0-a3cd53bd28d9\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-299af2-65d57c848d-p9sbk" Jul 25 01:54:10.627100 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:54:10.627012 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1495beb6-a0be-4300-af70-c4d924859c4b-plugins-config-volume\") pod \"payload-processing-e2e-shared-a-299af2-865774ff5d-x572k\" (UID: \"1495beb6-a0be-4300-af70-c4d924859c4b\") " pod="openshift-ingress/payload-processing-e2e-shared-a-299af2-865774ff5d-x572k" Jul 25 01:54:10.633797 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:54:10.633774 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-624qt\" (UniqueName: \"kubernetes.io/projected/8003b15e-d043-4334-a7a0-a3cd53bd28d9-kube-api-access-624qt\") pod \"payload-pre-processing-e2e-shared-a-299af2-65d57c848d-p9sbk\" (UID: \"8003b15e-d043-4334-a7a0-a3cd53bd28d9\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-299af2-65d57c848d-p9sbk" Jul 25 01:54:10.633948 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:54:10.633927 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t64rk\" (UniqueName: \"kubernetes.io/projected/1495beb6-a0be-4300-af70-c4d924859c4b-kube-api-access-t64rk\") pod \"payload-processing-e2e-shared-a-299af2-865774ff5d-x572k\" (UID: \"1495beb6-a0be-4300-af70-c4d924859c4b\") " pod="openshift-ingress/payload-processing-e2e-shared-a-299af2-865774ff5d-x572k" Jul 25 01:54:10.707779 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:54:10.707680 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-299af2-65d57c848d-p9sbk" Jul 25 01:54:10.748323 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:54:10.748286 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-299af2-865774ff5d-x572k" Jul 25 01:54:10.853159 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:54:10.853122 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-299af2-65d57c848d-p9sbk"] Jul 25 01:54:10.855738 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:54:10.855674 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8003b15e_d043_4334_a7a0_a3cd53bd28d9.slice/crio-e23c0d056f694d7c0d1812e271572ea21ae71e8a65b672cc0d65855cf92e441c WatchSource:0}: Error finding container e23c0d056f694d7c0d1812e271572ea21ae71e8a65b672cc0d65855cf92e441c: Status 404 returned error can't find the container with id e23c0d056f694d7c0d1812e271572ea21ae71e8a65b672cc0d65855cf92e441c Jul 25 01:54:10.906460 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:54:10.906362 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-299af2-865774ff5d-x572k"] Jul 25 01:54:10.908599 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:54:10.908573 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1495beb6_a0be_4300_af70_c4d924859c4b.slice/crio-5c7aaadbd907220c9227de8b1d54e8a5778a38179f0f5d5cff02575fa5435d40 WatchSource:0}: Error finding container 5c7aaadbd907220c9227de8b1d54e8a5778a38179f0f5d5cff02575fa5435d40: Status 404 returned error can't find the container with id 5c7aaadbd907220c9227de8b1d54e8a5778a38179f0f5d5cff02575fa5435d40 Jul 25 01:54:11.188621 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:54:11.188582 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-299af2-865774ff5d-x572k" event={"ID":"1495beb6-a0be-4300-af70-c4d924859c4b","Type":"ContainerStarted","Data":"59401f86b67da9cb4349c96fe2c7c07721bdc05205e73798f8986a9c5149b5be"} Jul 25 01:54:11.188827 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:54:11.188638 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-299af2-865774ff5d-x572k" event={"ID":"1495beb6-a0be-4300-af70-c4d924859c4b","Type":"ContainerStarted","Data":"5c7aaadbd907220c9227de8b1d54e8a5778a38179f0f5d5cff02575fa5435d40"} Jul 25 01:54:11.188827 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:54:11.188757 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-shared-a-299af2-865774ff5d-x572k" Jul 25 01:54:11.190072 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:54:11.190049 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-299af2-65d57c848d-p9sbk" event={"ID":"8003b15e-d043-4334-a7a0-a3cd53bd28d9","Type":"ContainerStarted","Data":"49abc71b327dcf678845acba57094e055907fe86676227dba0e76ae9ebee5197"} Jul 25 01:54:11.190178 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:54:11.190089 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-299af2-65d57c848d-p9sbk" event={"ID":"8003b15e-d043-4334-a7a0-a3cd53bd28d9","Type":"ContainerStarted","Data":"e23c0d056f694d7c0d1812e271572ea21ae71e8a65b672cc0d65855cf92e441c"} Jul 25 01:54:11.190178 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:54:11.190168 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-299af2-65d57c848d-p9sbk" Jul 25 01:54:11.205343 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:54:11.205295 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-shared-a-299af2-865774ff5d-x572k" podStartSLOduration=1.205282221 podStartE2EDuration="1.205282221s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-25 01:54:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-25 01:54:11.202541053 +0000 UTC m=+2536.895635469" watchObservedRunningTime="2026-07-25 01:54:11.205282221 +0000 UTC m=+2536.898376630" Jul 25 01:54:11.216555 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:54:11.216514 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-299af2-65d57c848d-p9sbk" podStartSLOduration=1.216497913 podStartE2EDuration="1.216497913s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-25 01:54:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-25 01:54:11.216175941 +0000 UTC m=+2536.909270351" watchObservedRunningTime="2026-07-25 01:54:11.216497913 +0000 UTC m=+2536.909592318" Jul 25 01:54:18.194422 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:54:18.194364 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mlpq2"] Jul 25 01:54:18.842989 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:54:18.842957 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-ab0ae6-5dbc87c56-hmkr7"] Jul 25 01:54:18.845970 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:54:18.845955 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-ab0ae6-5dbc87c56-hmkr7" Jul 25 01:54:18.848236 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:54:18.848214 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-shared-b-ab0ae6-dockercfg-qw5zc\"" Jul 25 01:54:18.848368 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:54:18.848238 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-shared-b-ab0ae6\"" Jul 25 01:54:18.855988 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:54:18.855966 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-ab0ae6-5dbc87c56-hmkr7"] Jul 25 01:54:18.901059 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:54:18.901026 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dt2t7\" (UniqueName: \"kubernetes.io/projected/25d4dc23-5491-47bc-a2d7-21f6fb9144da-kube-api-access-dt2t7\") pod \"payload-pre-processing-e2e-shared-b-ab0ae6-5dbc87c56-hmkr7\" (UID: \"25d4dc23-5491-47bc-a2d7-21f6fb9144da\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-ab0ae6-5dbc87c56-hmkr7" Jul 25 01:54:18.901211 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:54:18.901153 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/25d4dc23-5491-47bc-a2d7-21f6fb9144da-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-b-ab0ae6-5dbc87c56-hmkr7\" (UID: \"25d4dc23-5491-47bc-a2d7-21f6fb9144da\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-ab0ae6-5dbc87c56-hmkr7" Jul 25 01:54:19.002235 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:54:19.002195 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/25d4dc23-5491-47bc-a2d7-21f6fb9144da-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-b-ab0ae6-5dbc87c56-hmkr7\" (UID: \"25d4dc23-5491-47bc-a2d7-21f6fb9144da\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-ab0ae6-5dbc87c56-hmkr7" Jul 25 01:54:19.002429 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:54:19.002345 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dt2t7\" (UniqueName: \"kubernetes.io/projected/25d4dc23-5491-47bc-a2d7-21f6fb9144da-kube-api-access-dt2t7\") pod \"payload-pre-processing-e2e-shared-b-ab0ae6-5dbc87c56-hmkr7\" (UID: \"25d4dc23-5491-47bc-a2d7-21f6fb9144da\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-ab0ae6-5dbc87c56-hmkr7" Jul 25 01:54:19.002887 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:54:19.002869 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/25d4dc23-5491-47bc-a2d7-21f6fb9144da-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-b-ab0ae6-5dbc87c56-hmkr7\" (UID: \"25d4dc23-5491-47bc-a2d7-21f6fb9144da\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-ab0ae6-5dbc87c56-hmkr7" Jul 25 01:54:19.012746 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:54:19.012719 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dt2t7\" (UniqueName: \"kubernetes.io/projected/25d4dc23-5491-47bc-a2d7-21f6fb9144da-kube-api-access-dt2t7\") pod \"payload-pre-processing-e2e-shared-b-ab0ae6-5dbc87c56-hmkr7\" (UID: \"25d4dc23-5491-47bc-a2d7-21f6fb9144da\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-ab0ae6-5dbc87c56-hmkr7" Jul 25 01:54:19.157099 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:54:19.157026 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-ab0ae6-5dbc87c56-hmkr7" Jul 25 01:54:19.291868 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:54:19.291838 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-ab0ae6-5dbc87c56-hmkr7"] Jul 25 01:54:19.293709 ip-10-0-129-35 kubenswrapper[2567]: W0725 01:54:19.293685 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod25d4dc23_5491_47bc_a2d7_21f6fb9144da.slice/crio-b286a2f5ebf4943c90fcf086c20f3fa6d1373441e40322212d04736ea63c6926 WatchSource:0}: Error finding container b286a2f5ebf4943c90fcf086c20f3fa6d1373441e40322212d04736ea63c6926: Status 404 returned error can't find the container with id b286a2f5ebf4943c90fcf086c20f3fa6d1373441e40322212d04736ea63c6926 Jul 25 01:54:20.246725 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:54:20.246688 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-ab0ae6-5dbc87c56-hmkr7" event={"ID":"25d4dc23-5491-47bc-a2d7-21f6fb9144da","Type":"ContainerStarted","Data":"08c07c06a1f555ffc30beec85c15f2f0f09de99f78ecce682e113668632f9d7b"} Jul 25 01:54:20.246933 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:54:20.246738 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-ab0ae6-5dbc87c56-hmkr7" event={"ID":"25d4dc23-5491-47bc-a2d7-21f6fb9144da","Type":"ContainerStarted","Data":"b286a2f5ebf4943c90fcf086c20f3fa6d1373441e40322212d04736ea63c6926"} Jul 25 01:54:20.246933 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:54:20.246767 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-ab0ae6-5dbc87c56-hmkr7" Jul 25 01:54:20.266026 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:54:20.265974 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-ab0ae6-5dbc87c56-hmkr7" podStartSLOduration=2.265957434 podStartE2EDuration="2.265957434s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-25 01:54:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-25 01:54:20.263519127 +0000 UTC m=+2545.956613546" watchObservedRunningTime="2026-07-25 01:54:20.265957434 +0000 UTC m=+2545.959051853" Jul 25 01:54:22.203560 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:54:22.203530 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-shared-a-299af2-865774ff5d-x572k" Jul 25 01:54:22.203981 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:54:22.203813 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-299af2-65d57c848d-p9sbk" Jul 25 01:54:30.694185 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:54:30.694152 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mlpq2"] Jul 25 01:54:31.254260 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:54:31.254234 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-ab0ae6-5dbc87c56-hmkr7" Jul 25 01:54:40.497937 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:54:40.497908 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mlpq2"] Jul 25 01:54:54.976018 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:54:54.975987 2567 scope.go:117] "RemoveContainer" containerID="72347c927da0dffaf0a01477d5e1187ebeacd4a3c1b38efabbb5ab470bca0858" Jul 25 01:55:03.109644 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:55:03.109611 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mlpq2"] Jul 25 01:55:39.001819 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:55:39.001777 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mlpq2"] Jul 25 01:56:05.399777 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:56:05.399740 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mlpq2"] Jul 25 01:56:21.687490 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:56:21.687456 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mlpq2"] Jul 25 01:56:41.687690 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:56:41.687650 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mlpq2"] Jul 25 01:56:54.917359 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:56:54.917271 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-s5tbd_a9cb9aa9-8f43-4b32-a7b7-4eb9afb05c90/console-operator/1.log" Jul 25 01:56:54.921106 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:56:54.921087 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-s5tbd_a9cb9aa9-8f43-4b32-a7b7-4eb9afb05c90/console-operator/1.log" Jul 25 01:57:00.794019 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:57:00.793990 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mlpq2"] Jul 25 01:57:22.790510 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:57:22.790482 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mlpq2"] Jul 25 01:57:41.188394 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:57:41.188342 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mlpq2"] Jul 25 01:58:02.691498 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:58:02.691459 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mlpq2"] Jul 25 01:58:20.994957 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:58:20.994884 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mlpq2"] Jul 25 01:58:43.494280 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:58:43.494244 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mlpq2"] Jul 25 01:58:55.022527 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:58:55.022498 2567 scope.go:117] "RemoveContainer" containerID="89a0beec591f4e33c329177a0715b0c2b2a374a98672c96942279b5bba8dd1fd" Jul 25 01:58:55.031074 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:58:55.031055 2567 scope.go:117] "RemoveContainer" containerID="736dfe5f57131885b578850b460fe0d567ce7fd07ac9604d9ff70ffba00a284a" Jul 25 01:59:01.690743 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:59:01.690711 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mlpq2"] Jul 25 01:59:28.794147 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:59:28.794113 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mlpq2"] Jul 25 01:59:44.987513 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:59:44.987438 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mlpq2"] Jul 25 01:59:59.896196 ip-10-0-129-35 kubenswrapper[2567]: I0725 01:59:59.896167 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mlpq2"] Jul 25 02:00:00.130445 ip-10-0-129-35 kubenswrapper[2567]: I0725 02:00:00.130411 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-ab0ae6-29749080-2l59k"] Jul 25 02:00:00.134047 ip-10-0-129-35 kubenswrapper[2567]: I0725 02:00:00.134030 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-ab0ae6-29749080-2l59k" Jul 25 02:00:00.136037 ip-10-0-129-35 kubenswrapper[2567]: I0725 02:00:00.136011 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-88hjh\"" Jul 25 02:00:00.143927 ip-10-0-129-35 kubenswrapper[2567]: I0725 02:00:00.143898 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-ab0ae6-29749080-2l59k"] Jul 25 02:00:00.146720 ip-10-0-129-35 kubenswrapper[2567]: I0725 02:00:00.146659 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-ab0ae6-29749080-2l59k" Jul 25 02:00:00.287886 ip-10-0-129-35 kubenswrapper[2567]: I0725 02:00:00.287806 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-ab0ae6-29749080-2l59k"] Jul 25 02:00:00.291679 ip-10-0-129-35 kubenswrapper[2567]: W0725 02:00:00.291650 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podafe2c1d1_cd02_47dd_88b0_ba155e79452f.slice/crio-e00939d65e97d5013cfb66c62416a3559c878abae4ac0ad430a61ad7c75328c1 WatchSource:0}: Error finding container e00939d65e97d5013cfb66c62416a3559c878abae4ac0ad430a61ad7c75328c1: Status 404 returned error can't find the container with id e00939d65e97d5013cfb66c62416a3559c878abae4ac0ad430a61ad7c75328c1 Jul 25 02:00:00.970178 ip-10-0-129-35 kubenswrapper[2567]: I0725 02:00:00.970087 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-ab0ae6-29749080-2l59k" event={"ID":"afe2c1d1-cd02-47dd-88b0-ba155e79452f","Type":"ContainerStarted","Data":"85a03c8812041b0b0b1c551940345ec78b09e6ae565d9237cb0f7aaa33853f27"} Jul 25 02:00:00.970178 ip-10-0-129-35 kubenswrapper[2567]: I0725 02:00:00.970148 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-ab0ae6-29749080-2l59k" event={"ID":"afe2c1d1-cd02-47dd-88b0-ba155e79452f","Type":"ContainerStarted","Data":"e00939d65e97d5013cfb66c62416a3559c878abae4ac0ad430a61ad7c75328c1"} Jul 25 02:00:00.983834 ip-10-0-129-35 kubenswrapper[2567]: I0725 02:00:00.983787 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-ab0ae6-29749080-2l59k" podStartSLOduration=0.983771388 podStartE2EDuration="983.771388ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-25 02:00:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-25 02:00:00.982486364 +0000 UTC m=+2886.675580783" watchObservedRunningTime="2026-07-25 02:00:00.983771388 +0000 UTC m=+2886.676865806" Jul 25 02:00:01.977595 ip-10-0-129-35 kubenswrapper[2567]: I0725 02:00:01.977563 2567 generic.go:356] "Generic (PLEG): container finished" podID="afe2c1d1-cd02-47dd-88b0-ba155e79452f" containerID="85a03c8812041b0b0b1c551940345ec78b09e6ae565d9237cb0f7aaa33853f27" exitCode=0 Jul 25 02:00:01.978048 ip-10-0-129-35 kubenswrapper[2567]: I0725 02:00:01.977644 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-ab0ae6-29749080-2l59k" event={"ID":"afe2c1d1-cd02-47dd-88b0-ba155e79452f","Type":"ContainerDied","Data":"85a03c8812041b0b0b1c551940345ec78b09e6ae565d9237cb0f7aaa33853f27"} Jul 25 02:00:03.120905 ip-10-0-129-35 kubenswrapper[2567]: I0725 02:00:03.120882 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-ab0ae6-29749080-2l59k" Jul 25 02:00:03.988815 ip-10-0-129-35 kubenswrapper[2567]: I0725 02:00:03.988782 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-ab0ae6-29749080-2l59k" Jul 25 02:00:03.988815 ip-10-0-129-35 kubenswrapper[2567]: I0725 02:00:03.988810 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-ab0ae6-29749080-2l59k" event={"ID":"afe2c1d1-cd02-47dd-88b0-ba155e79452f","Type":"ContainerDied","Data":"e00939d65e97d5013cfb66c62416a3559c878abae4ac0ad430a61ad7c75328c1"} Jul 25 02:00:03.989037 ip-10-0-129-35 kubenswrapper[2567]: I0725 02:00:03.988859 2567 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e00939d65e97d5013cfb66c62416a3559c878abae4ac0ad430a61ad7c75328c1" Jul 25 02:00:32.493820 ip-10-0-129-35 kubenswrapper[2567]: I0725 02:00:32.493783 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mlpq2"] Jul 25 02:01:13.289218 ip-10-0-129-35 kubenswrapper[2567]: I0725 02:01:13.289183 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mlpq2"] Jul 25 02:01:31.395651 ip-10-0-129-35 kubenswrapper[2567]: I0725 02:01:31.395617 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mlpq2"] Jul 25 02:01:52.090131 ip-10-0-129-35 kubenswrapper[2567]: I0725 02:01:52.090090 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mlpq2"] Jul 25 02:01:54.951184 ip-10-0-129-35 kubenswrapper[2567]: I0725 02:01:54.951158 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-s5tbd_a9cb9aa9-8f43-4b32-a7b7-4eb9afb05c90/console-operator/1.log" Jul 25 02:01:54.956776 ip-10-0-129-35 kubenswrapper[2567]: I0725 02:01:54.956752 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-s5tbd_a9cb9aa9-8f43-4b32-a7b7-4eb9afb05c90/console-operator/1.log" Jul 25 02:02:08.890860 ip-10-0-129-35 kubenswrapper[2567]: I0725 02:02:08.890827 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mlpq2"] Jul 25 02:02:26.688980 ip-10-0-129-35 kubenswrapper[2567]: I0725 02:02:26.688951 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mlpq2"] Jul 25 02:03:13.994756 ip-10-0-129-35 kubenswrapper[2567]: I0725 02:03:13.994722 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mlpq2"] Jul 25 02:03:53.483753 ip-10-0-129-35 kubenswrapper[2567]: I0725 02:03:53.483723 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mlpq2"] Jul 25 02:04:07.390023 ip-10-0-129-35 kubenswrapper[2567]: I0725 02:04:07.389989 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mlpq2"] Jul 25 02:04:22.189797 ip-10-0-129-35 kubenswrapper[2567]: I0725 02:04:22.189715 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mlpq2"] Jul 25 02:04:36.889533 ip-10-0-129-35 kubenswrapper[2567]: I0725 02:04:36.889489 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mlpq2"] Jul 25 02:04:39.736797 ip-10-0-129-35 kubenswrapper[2567]: I0725 02:04:39.736763 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-n9bfw"] Jul 25 02:04:39.737200 ip-10-0-129-35 kubenswrapper[2567]: I0725 02:04:39.737190 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="afe2c1d1-cd02-47dd-88b0-ba155e79452f" containerName="cleanup" Jul 25 02:04:39.737257 ip-10-0-129-35 kubenswrapper[2567]: I0725 02:04:39.737201 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="afe2c1d1-cd02-47dd-88b0-ba155e79452f" containerName="cleanup" Jul 25 02:04:39.737295 ip-10-0-129-35 kubenswrapper[2567]: I0725 02:04:39.737290 2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="afe2c1d1-cd02-47dd-88b0-ba155e79452f" containerName="cleanup" Jul 25 02:04:39.740538 ip-10-0-129-35 kubenswrapper[2567]: I0725 02:04:39.740522 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-n9bfw" Jul 25 02:04:39.742565 ip-10-0-129-35 kubenswrapper[2567]: I0725 02:04:39.742544 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-catalog-dockercfg-6dtmp\"" Jul 25 02:04:39.748105 ip-10-0-129-35 kubenswrapper[2567]: I0725 02:04:39.748085 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-n9bfw"] Jul 25 02:04:39.873696 ip-10-0-129-35 kubenswrapper[2567]: I0725 02:04:39.873669 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xqflx\" (UniqueName: \"kubernetes.io/projected/ba244f49-0a21-42f3-9a38-0802cdfc4490-kube-api-access-xqflx\") pod \"kuadrant-operator-catalog-n9bfw\" (UID: \"ba244f49-0a21-42f3-9a38-0802cdfc4490\") " pod="kuadrant-system/kuadrant-operator-catalog-n9bfw" Jul 25 02:04:39.974616 ip-10-0-129-35 kubenswrapper[2567]: I0725 02:04:39.974581 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xqflx\" (UniqueName: \"kubernetes.io/projected/ba244f49-0a21-42f3-9a38-0802cdfc4490-kube-api-access-xqflx\") pod \"kuadrant-operator-catalog-n9bfw\" (UID: \"ba244f49-0a21-42f3-9a38-0802cdfc4490\") " pod="kuadrant-system/kuadrant-operator-catalog-n9bfw" Jul 25 02:04:39.982204 ip-10-0-129-35 kubenswrapper[2567]: I0725 02:04:39.982181 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xqflx\" (UniqueName: \"kubernetes.io/projected/ba244f49-0a21-42f3-9a38-0802cdfc4490-kube-api-access-xqflx\") pod \"kuadrant-operator-catalog-n9bfw\" (UID: \"ba244f49-0a21-42f3-9a38-0802cdfc4490\") " pod="kuadrant-system/kuadrant-operator-catalog-n9bfw" Jul 25 02:04:40.050189 ip-10-0-129-35 kubenswrapper[2567]: I0725 02:04:40.050166 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-n9bfw" Jul 25 02:04:40.192262 ip-10-0-129-35 kubenswrapper[2567]: I0725 02:04:40.192237 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-n9bfw"] Jul 25 02:04:40.194465 ip-10-0-129-35 kubenswrapper[2567]: W0725 02:04:40.194439 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podba244f49_0a21_42f3_9a38_0802cdfc4490.slice/crio-93474be3251812a0a18bb2494caf50b494ecbe78d721be74d31c497f4b07363e WatchSource:0}: Error finding container 93474be3251812a0a18bb2494caf50b494ecbe78d721be74d31c497f4b07363e: Status 404 returned error can't find the container with id 93474be3251812a0a18bb2494caf50b494ecbe78d721be74d31c497f4b07363e Jul 25 02:04:40.195779 ip-10-0-129-35 kubenswrapper[2567]: I0725 02:04:40.195761 2567 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 25 02:04:40.370525 ip-10-0-129-35 kubenswrapper[2567]: I0725 02:04:40.370447 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-n9bfw" event={"ID":"ba244f49-0a21-42f3-9a38-0802cdfc4490","Type":"ContainerStarted","Data":"93474be3251812a0a18bb2494caf50b494ecbe78d721be74d31c497f4b07363e"} Jul 25 02:04:42.385537 ip-10-0-129-35 kubenswrapper[2567]: I0725 02:04:42.385507 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-n9bfw" event={"ID":"ba244f49-0a21-42f3-9a38-0802cdfc4490","Type":"ContainerStarted","Data":"4cb55b486663f1a7713c7736634dd0988e3142f8aa4283db263f335d0ab7ecf1"} Jul 25 02:04:42.399107 ip-10-0-129-35 kubenswrapper[2567]: I0725 02:04:42.399062 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-n9bfw" podStartSLOduration=1.2863265130000001 podStartE2EDuration="3.399046246s" totalImagesPullingTime="2.112719733s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-25 02:04:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-25 02:04:42.397886265 +0000 UTC m=+3168.090980684" watchObservedRunningTime="2026-07-25 02:04:42.399046246 +0000 UTC m=+3168.092140665" Jul 25 02:04:50.050889 ip-10-0-129-35 kubenswrapper[2567]: I0725 02:04:50.050863 2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kuadrant-system/kuadrant-operator-catalog-n9bfw" Jul 25 02:04:50.051439 ip-10-0-129-35 kubenswrapper[2567]: I0725 02:04:50.050916 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-catalog-n9bfw" Jul 25 02:04:50.074237 ip-10-0-129-35 kubenswrapper[2567]: I0725 02:04:50.074209 2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kuadrant-system/kuadrant-operator-catalog-n9bfw" Jul 25 02:04:50.450401 ip-10-0-129-35 kubenswrapper[2567]: I0725 02:04:50.450317 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-catalog-n9bfw" Jul 25 02:04:50.487549 ip-10-0-129-35 kubenswrapper[2567]: I0725 02:04:50.487515 2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-n9bfw"] Jul 25 02:04:50.921655 ip-10-0-129-35 kubenswrapper[2567]: I0725 02:04:50.921621 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-e22c40-6fcb96ddb4-lrn6x"] Jul 25 02:04:50.926430 ip-10-0-129-35 kubenswrapper[2567]: I0725 02:04:50.926409 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-e22c40-6fcb96ddb4-lrn6x" Jul 25 02:04:50.928606 ip-10-0-129-35 kubenswrapper[2567]: I0725 02:04:50.928585 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ipp-a-e22c40\"" Jul 25 02:04:50.934912 ip-10-0-129-35 kubenswrapper[2567]: I0725 02:04:50.934893 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-e22c40-6fcb96ddb4-lrn6x"] Jul 25 02:04:50.974472 ip-10-0-129-35 kubenswrapper[2567]: I0725 02:04:50.974440 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-e22c40-546577f5b6-46s62"] Jul 25 02:04:50.978256 ip-10-0-129-35 kubenswrapper[2567]: I0725 02:04:50.978223 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-a-e22c40-546577f5b6-46s62" Jul 25 02:04:50.980583 ip-10-0-129-35 kubenswrapper[2567]: I0725 02:04:50.980567 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ipp-a-e22c40-dockercfg-hcdkr\"" Jul 25 02:04:50.989700 ip-10-0-129-35 kubenswrapper[2567]: I0725 02:04:50.989672 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-e22c40-546577f5b6-46s62"] Jul 25 02:04:51.079545 ip-10-0-129-35 kubenswrapper[2567]: I0725 02:04:51.079513 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qqwln\" (UniqueName: \"kubernetes.io/projected/82ad8f9d-317a-421c-bd32-4e59d194db0b-kube-api-access-qqwln\") pod \"payload-processing-e2e-ipp-a-e22c40-546577f5b6-46s62\" (UID: \"82ad8f9d-317a-421c-bd32-4e59d194db0b\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-e22c40-546577f5b6-46s62" Jul 25 02:04:51.079933 ip-10-0-129-35 kubenswrapper[2567]: I0725 02:04:51.079683 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/82ad8f9d-317a-421c-bd32-4e59d194db0b-plugins-config-volume\") pod \"payload-processing-e2e-ipp-a-e22c40-546577f5b6-46s62\" (UID: \"82ad8f9d-317a-421c-bd32-4e59d194db0b\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-e22c40-546577f5b6-46s62" Jul 25 02:04:51.079933 ip-10-0-129-35 kubenswrapper[2567]: I0725 02:04:51.079713 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tmn9p\" (UniqueName: \"kubernetes.io/projected/05da5617-9ff9-497c-b28a-2281be693b86-kube-api-access-tmn9p\") pod \"payload-pre-processing-e2e-ipp-a-e22c40-6fcb96ddb4-lrn6x\" (UID: \"05da5617-9ff9-497c-b28a-2281be693b86\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-e22c40-6fcb96ddb4-lrn6x" Jul 25 02:04:51.079933 ip-10-0-129-35 kubenswrapper[2567]: I0725 02:04:51.079746 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/05da5617-9ff9-497c-b28a-2281be693b86-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-a-e22c40-6fcb96ddb4-lrn6x\" (UID: \"05da5617-9ff9-497c-b28a-2281be693b86\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-e22c40-6fcb96ddb4-lrn6x" Jul 25 02:04:51.180606 ip-10-0-129-35 kubenswrapper[2567]: I0725 02:04:51.180530 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/05da5617-9ff9-497c-b28a-2281be693b86-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-a-e22c40-6fcb96ddb4-lrn6x\" (UID: \"05da5617-9ff9-497c-b28a-2281be693b86\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-e22c40-6fcb96ddb4-lrn6x" Jul 25 02:04:51.180606 ip-10-0-129-35 kubenswrapper[2567]: I0725 02:04:51.180585 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qqwln\" (UniqueName: \"kubernetes.io/projected/82ad8f9d-317a-421c-bd32-4e59d194db0b-kube-api-access-qqwln\") pod \"payload-processing-e2e-ipp-a-e22c40-546577f5b6-46s62\" (UID: \"82ad8f9d-317a-421c-bd32-4e59d194db0b\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-e22c40-546577f5b6-46s62" Jul 25 02:04:51.180811 ip-10-0-129-35 kubenswrapper[2567]: I0725 02:04:51.180641 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/82ad8f9d-317a-421c-bd32-4e59d194db0b-plugins-config-volume\") pod \"payload-processing-e2e-ipp-a-e22c40-546577f5b6-46s62\" (UID: \"82ad8f9d-317a-421c-bd32-4e59d194db0b\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-e22c40-546577f5b6-46s62" Jul 25 02:04:51.180811 ip-10-0-129-35 kubenswrapper[2567]: I0725 02:04:51.180659 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tmn9p\" (UniqueName: \"kubernetes.io/projected/05da5617-9ff9-497c-b28a-2281be693b86-kube-api-access-tmn9p\") pod \"payload-pre-processing-e2e-ipp-a-e22c40-6fcb96ddb4-lrn6x\" (UID: \"05da5617-9ff9-497c-b28a-2281be693b86\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-e22c40-6fcb96ddb4-lrn6x" Jul 25 02:04:51.181324 ip-10-0-129-35 kubenswrapper[2567]: I0725 02:04:51.181299 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/05da5617-9ff9-497c-b28a-2281be693b86-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-a-e22c40-6fcb96ddb4-lrn6x\" (UID: \"05da5617-9ff9-497c-b28a-2281be693b86\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-e22c40-6fcb96ddb4-lrn6x" Jul 25 02:04:51.181445 ip-10-0-129-35 kubenswrapper[2567]: I0725 02:04:51.181345 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/82ad8f9d-317a-421c-bd32-4e59d194db0b-plugins-config-volume\") pod \"payload-processing-e2e-ipp-a-e22c40-546577f5b6-46s62\" (UID: \"82ad8f9d-317a-421c-bd32-4e59d194db0b\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-e22c40-546577f5b6-46s62" Jul 25 02:04:51.187898 ip-10-0-129-35 kubenswrapper[2567]: I0725 02:04:51.187875 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tmn9p\" (UniqueName: \"kubernetes.io/projected/05da5617-9ff9-497c-b28a-2281be693b86-kube-api-access-tmn9p\") pod \"payload-pre-processing-e2e-ipp-a-e22c40-6fcb96ddb4-lrn6x\" (UID: \"05da5617-9ff9-497c-b28a-2281be693b86\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-e22c40-6fcb96ddb4-lrn6x" Jul 25 02:04:51.188007 ip-10-0-129-35 kubenswrapper[2567]: I0725 02:04:51.187988 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qqwln\" (UniqueName: \"kubernetes.io/projected/82ad8f9d-317a-421c-bd32-4e59d194db0b-kube-api-access-qqwln\") pod \"payload-processing-e2e-ipp-a-e22c40-546577f5b6-46s62\" (UID: \"82ad8f9d-317a-421c-bd32-4e59d194db0b\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-e22c40-546577f5b6-46s62" Jul 25 02:04:51.237593 ip-10-0-129-35 kubenswrapper[2567]: I0725 02:04:51.237565 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-e22c40-6fcb96ddb4-lrn6x" Jul 25 02:04:51.289426 ip-10-0-129-35 kubenswrapper[2567]: I0725 02:04:51.289398 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-a-e22c40-546577f5b6-46s62" Jul 25 02:04:51.378001 ip-10-0-129-35 kubenswrapper[2567]: I0725 02:04:51.377976 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-e22c40-6fcb96ddb4-lrn6x"] Jul 25 02:04:51.380923 ip-10-0-129-35 kubenswrapper[2567]: W0725 02:04:51.380894 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod05da5617_9ff9_497c_b28a_2281be693b86.slice/crio-f31b8c3410d8b850df5e51069c08356f4d72d9504ec05047bd5b03f232a86a17 WatchSource:0}: Error finding container f31b8c3410d8b850df5e51069c08356f4d72d9504ec05047bd5b03f232a86a17: Status 404 returned error can't find the container with id f31b8c3410d8b850df5e51069c08356f4d72d9504ec05047bd5b03f232a86a17 Jul 25 02:04:51.435606 ip-10-0-129-35 kubenswrapper[2567]: I0725 02:04:51.435537 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-e22c40-6fcb96ddb4-lrn6x" event={"ID":"05da5617-9ff9-497c-b28a-2281be693b86","Type":"ContainerStarted","Data":"f31b8c3410d8b850df5e51069c08356f4d72d9504ec05047bd5b03f232a86a17"} Jul 25 02:04:51.646119 ip-10-0-129-35 kubenswrapper[2567]: I0725 02:04:51.646094 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-e22c40-546577f5b6-46s62"] Jul 25 02:04:51.647602 ip-10-0-129-35 kubenswrapper[2567]: W0725 02:04:51.647577 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod82ad8f9d_317a_421c_bd32_4e59d194db0b.slice/crio-17c9163902f341e651d8657870927bf2dd07531f19f04eca015eaa14618a6386 WatchSource:0}: Error finding container 17c9163902f341e651d8657870927bf2dd07531f19f04eca015eaa14618a6386: Status 404 returned error can't find the container with id 17c9163902f341e651d8657870927bf2dd07531f19f04eca015eaa14618a6386 Jul 25 02:04:52.443952 ip-10-0-129-35 kubenswrapper[2567]: I0725 02:04:52.443920 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-a-e22c40-546577f5b6-46s62" event={"ID":"82ad8f9d-317a-421c-bd32-4e59d194db0b","Type":"ContainerStarted","Data":"3e3e6482691bbd48a0276948acdd663caf8a7dbbb68ee03e2055d227026c6f12"} Jul 25 02:04:52.444444 ip-10-0-129-35 kubenswrapper[2567]: I0725 02:04:52.443970 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-a-e22c40-546577f5b6-46s62" event={"ID":"82ad8f9d-317a-421c-bd32-4e59d194db0b","Type":"ContainerStarted","Data":"17c9163902f341e651d8657870927bf2dd07531f19f04eca015eaa14618a6386"} Jul 25 02:04:52.444444 ip-10-0-129-35 kubenswrapper[2567]: I0725 02:04:52.444009 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ipp-a-e22c40-546577f5b6-46s62" Jul 25 02:04:52.445564 ip-10-0-129-35 kubenswrapper[2567]: I0725 02:04:52.445534 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-e22c40-6fcb96ddb4-lrn6x" event={"ID":"05da5617-9ff9-497c-b28a-2281be693b86","Type":"ContainerStarted","Data":"b9df518b01a89ca6fc9abdccc1034d305ba2d6c703e0cdd5fe726c2229b5d675"} Jul 25 02:04:52.445697 ip-10-0-129-35 kubenswrapper[2567]: I0725 02:04:52.445589 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-e22c40-6fcb96ddb4-lrn6x" Jul 25 02:04:52.445697 ip-10-0-129-35 kubenswrapper[2567]: I0725 02:04:52.445597 2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-catalog-n9bfw" podUID="ba244f49-0a21-42f3-9a38-0802cdfc4490" containerName="registry-server" containerID="cri-o://4cb55b486663f1a7713c7736634dd0988e3142f8aa4283db263f335d0ab7ecf1" gracePeriod=2 Jul 25 02:04:52.457523 ip-10-0-129-35 kubenswrapper[2567]: I0725 02:04:52.457469 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ipp-a-e22c40-546577f5b6-46s62" podStartSLOduration=2.457455445 podStartE2EDuration="2.457455445s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-25 02:04:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-25 02:04:52.457263525 +0000 UTC m=+3178.150357943" watchObservedRunningTime="2026-07-25 02:04:52.457455445 +0000 UTC m=+3178.150549846" Jul 25 02:04:52.486170 ip-10-0-129-35 kubenswrapper[2567]: I0725 02:04:52.486124 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-e22c40-6fcb96ddb4-lrn6x" podStartSLOduration=2.486111616 podStartE2EDuration="2.486111616s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-25 02:04:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-25 02:04:52.484893142 +0000 UTC m=+3178.177987562" watchObservedRunningTime="2026-07-25 02:04:52.486111616 +0000 UTC m=+3178.179206032" Jul 25 02:04:52.704707 ip-10-0-129-35 kubenswrapper[2567]: I0725 02:04:52.704649 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-n9bfw" Jul 25 02:04:52.795735 ip-10-0-129-35 kubenswrapper[2567]: I0725 02:04:52.795712 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xqflx\" (UniqueName: \"kubernetes.io/projected/ba244f49-0a21-42f3-9a38-0802cdfc4490-kube-api-access-xqflx\") pod \"ba244f49-0a21-42f3-9a38-0802cdfc4490\" (UID: \"ba244f49-0a21-42f3-9a38-0802cdfc4490\") " Jul 25 02:04:52.797991 ip-10-0-129-35 kubenswrapper[2567]: I0725 02:04:52.797957 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ba244f49-0a21-42f3-9a38-0802cdfc4490-kube-api-access-xqflx" (OuterVolumeSpecName: "kube-api-access-xqflx") pod "ba244f49-0a21-42f3-9a38-0802cdfc4490" (UID: "ba244f49-0a21-42f3-9a38-0802cdfc4490"). InnerVolumeSpecName "kube-api-access-xqflx". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 25 02:04:52.897237 ip-10-0-129-35 kubenswrapper[2567]: I0725 02:04:52.897211 2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xqflx\" (UniqueName: \"kubernetes.io/projected/ba244f49-0a21-42f3-9a38-0802cdfc4490-kube-api-access-xqflx\") on node \"ip-10-0-129-35.ec2.internal\" DevicePath \"\"" Jul 25 02:04:53.452002 ip-10-0-129-35 kubenswrapper[2567]: I0725 02:04:53.451968 2567 generic.go:356] "Generic (PLEG): container finished" podID="ba244f49-0a21-42f3-9a38-0802cdfc4490" containerID="4cb55b486663f1a7713c7736634dd0988e3142f8aa4283db263f335d0ab7ecf1" exitCode=0 Jul 25 02:04:53.452502 ip-10-0-129-35 kubenswrapper[2567]: I0725 02:04:53.452015 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-n9bfw" Jul 25 02:04:53.452502 ip-10-0-129-35 kubenswrapper[2567]: I0725 02:04:53.452035 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-n9bfw" event={"ID":"ba244f49-0a21-42f3-9a38-0802cdfc4490","Type":"ContainerDied","Data":"4cb55b486663f1a7713c7736634dd0988e3142f8aa4283db263f335d0ab7ecf1"} Jul 25 02:04:53.452502 ip-10-0-129-35 kubenswrapper[2567]: I0725 02:04:53.452080 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-n9bfw" event={"ID":"ba244f49-0a21-42f3-9a38-0802cdfc4490","Type":"ContainerDied","Data":"93474be3251812a0a18bb2494caf50b494ecbe78d721be74d31c497f4b07363e"} Jul 25 02:04:53.452502 ip-10-0-129-35 kubenswrapper[2567]: I0725 02:04:53.452103 2567 scope.go:117] "RemoveContainer" containerID="4cb55b486663f1a7713c7736634dd0988e3142f8aa4283db263f335d0ab7ecf1" Jul 25 02:04:53.462917 ip-10-0-129-35 kubenswrapper[2567]: I0725 02:04:53.462900 2567 scope.go:117] "RemoveContainer" containerID="4cb55b486663f1a7713c7736634dd0988e3142f8aa4283db263f335d0ab7ecf1" Jul 25 02:04:53.463234 ip-10-0-129-35 kubenswrapper[2567]: E0725 02:04:53.463180 2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4cb55b486663f1a7713c7736634dd0988e3142f8aa4283db263f335d0ab7ecf1\": container with ID starting with 4cb55b486663f1a7713c7736634dd0988e3142f8aa4283db263f335d0ab7ecf1 not found: ID does not exist" containerID="4cb55b486663f1a7713c7736634dd0988e3142f8aa4283db263f335d0ab7ecf1" Jul 25 02:04:53.463281 ip-10-0-129-35 kubenswrapper[2567]: I0725 02:04:53.463246 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4cb55b486663f1a7713c7736634dd0988e3142f8aa4283db263f335d0ab7ecf1"} err="failed to get container status \"4cb55b486663f1a7713c7736634dd0988e3142f8aa4283db263f335d0ab7ecf1\": rpc error: code = NotFound desc = could not find container \"4cb55b486663f1a7713c7736634dd0988e3142f8aa4283db263f335d0ab7ecf1\": container with ID starting with 4cb55b486663f1a7713c7736634dd0988e3142f8aa4283db263f335d0ab7ecf1 not found: ID does not exist" Jul 25 02:04:53.472489 ip-10-0-129-35 kubenswrapper[2567]: I0725 02:04:53.472467 2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-n9bfw"] Jul 25 02:04:53.476483 ip-10-0-129-35 kubenswrapper[2567]: I0725 02:04:53.476462 2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-n9bfw"] Jul 25 02:04:54.787230 ip-10-0-129-35 kubenswrapper[2567]: I0725 02:04:54.787199 2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ba244f49-0a21-42f3-9a38-0802cdfc4490" path="/var/lib/kubelet/pods/ba244f49-0a21-42f3-9a38-0802cdfc4490/volumes" Jul 25 02:04:58.989475 ip-10-0-129-35 kubenswrapper[2567]: I0725 02:04:58.989436 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mlpq2"] Jul 25 02:05:03.454276 ip-10-0-129-35 kubenswrapper[2567]: I0725 02:05:03.454245 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ipp-a-e22c40-546577f5b6-46s62" Jul 25 02:05:03.454773 ip-10-0-129-35 kubenswrapper[2567]: I0725 02:05:03.454327 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-e22c40-6fcb96ddb4-lrn6x" Jul 25 02:05:09.992667 ip-10-0-129-35 kubenswrapper[2567]: I0725 02:05:09.992636 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-d66e66-fc5bc655b-q24j8"] Jul 25 02:05:09.993302 ip-10-0-129-35 kubenswrapper[2567]: I0725 02:05:09.993284 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ba244f49-0a21-42f3-9a38-0802cdfc4490" containerName="registry-server" Jul 25 02:05:09.993355 ip-10-0-129-35 kubenswrapper[2567]: I0725 02:05:09.993306 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="ba244f49-0a21-42f3-9a38-0802cdfc4490" containerName="registry-server" Jul 25 02:05:09.993437 ip-10-0-129-35 kubenswrapper[2567]: I0725 02:05:09.993425 2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="ba244f49-0a21-42f3-9a38-0802cdfc4490" containerName="registry-server" Jul 25 02:05:09.997141 ip-10-0-129-35 kubenswrapper[2567]: I0725 02:05:09.997122 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-d66e66-fc5bc655b-q24j8" Jul 25 02:05:10.001274 ip-10-0-129-35 kubenswrapper[2567]: I0725 02:05:10.001253 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ipp-b-d66e66-dockercfg-5vkfp\"" Jul 25 02:05:10.001616 ip-10-0-129-35 kubenswrapper[2567]: I0725 02:05:10.001601 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ipp-b-d66e66\"" Jul 25 02:05:10.009290 ip-10-0-129-35 kubenswrapper[2567]: I0725 02:05:10.009269 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-d66e66-fc5bc655b-q24j8"] Jul 25 02:05:10.023613 ip-10-0-129-35 kubenswrapper[2567]: I0725 02:05:10.023590 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-d66e66-6688874d6b-sqj8t"] Jul 25 02:05:10.027234 ip-10-0-129-35 kubenswrapper[2567]: I0725 02:05:10.027218 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-b-d66e66-6688874d6b-sqj8t" Jul 25 02:05:10.037498 ip-10-0-129-35 kubenswrapper[2567]: I0725 02:05:10.037480 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-d66e66-6688874d6b-sqj8t"] Jul 25 02:05:10.058507 ip-10-0-129-35 kubenswrapper[2567]: I0725 02:05:10.058475 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8f444b70-c52e-42fe-a6b5-e98d324ad48d-plugins-config-volume\") pod \"payload-processing-e2e-ipp-b-d66e66-6688874d6b-sqj8t\" (UID: \"8f444b70-c52e-42fe-a6b5-e98d324ad48d\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-d66e66-6688874d6b-sqj8t" Jul 25 02:05:10.058663 ip-10-0-129-35 kubenswrapper[2567]: I0725 02:05:10.058522 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ttq4g\" (UniqueName: \"kubernetes.io/projected/8f444b70-c52e-42fe-a6b5-e98d324ad48d-kube-api-access-ttq4g\") pod \"payload-processing-e2e-ipp-b-d66e66-6688874d6b-sqj8t\" (UID: \"8f444b70-c52e-42fe-a6b5-e98d324ad48d\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-d66e66-6688874d6b-sqj8t" Jul 25 02:05:10.058663 ip-10-0-129-35 kubenswrapper[2567]: I0725 02:05:10.058590 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xmp75\" (UniqueName: \"kubernetes.io/projected/990d6e7f-18b2-42db-a5cf-f86356afad56-kube-api-access-xmp75\") pod \"payload-pre-processing-e2e-ipp-b-d66e66-fc5bc655b-q24j8\" (UID: \"990d6e7f-18b2-42db-a5cf-f86356afad56\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-d66e66-fc5bc655b-q24j8" Jul 25 02:05:10.058793 ip-10-0-129-35 kubenswrapper[2567]: I0725 02:05:10.058657 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/990d6e7f-18b2-42db-a5cf-f86356afad56-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-b-d66e66-fc5bc655b-q24j8\" (UID: \"990d6e7f-18b2-42db-a5cf-f86356afad56\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-d66e66-fc5bc655b-q24j8" Jul 25 02:05:10.159253 ip-10-0-129-35 kubenswrapper[2567]: I0725 02:05:10.159218 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xmp75\" (UniqueName: \"kubernetes.io/projected/990d6e7f-18b2-42db-a5cf-f86356afad56-kube-api-access-xmp75\") pod \"payload-pre-processing-e2e-ipp-b-d66e66-fc5bc655b-q24j8\" (UID: \"990d6e7f-18b2-42db-a5cf-f86356afad56\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-d66e66-fc5bc655b-q24j8" Jul 25 02:05:10.159473 ip-10-0-129-35 kubenswrapper[2567]: I0725 02:05:10.159262 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/990d6e7f-18b2-42db-a5cf-f86356afad56-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-b-d66e66-fc5bc655b-q24j8\" (UID: \"990d6e7f-18b2-42db-a5cf-f86356afad56\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-d66e66-fc5bc655b-q24j8" Jul 25 02:05:10.159473 ip-10-0-129-35 kubenswrapper[2567]: I0725 02:05:10.159353 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8f444b70-c52e-42fe-a6b5-e98d324ad48d-plugins-config-volume\") pod \"payload-processing-e2e-ipp-b-d66e66-6688874d6b-sqj8t\" (UID: \"8f444b70-c52e-42fe-a6b5-e98d324ad48d\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-d66e66-6688874d6b-sqj8t" Jul 25 02:05:10.159473 ip-10-0-129-35 kubenswrapper[2567]: I0725 02:05:10.159421 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ttq4g\" (UniqueName: \"kubernetes.io/projected/8f444b70-c52e-42fe-a6b5-e98d324ad48d-kube-api-access-ttq4g\") pod \"payload-processing-e2e-ipp-b-d66e66-6688874d6b-sqj8t\" (UID: \"8f444b70-c52e-42fe-a6b5-e98d324ad48d\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-d66e66-6688874d6b-sqj8t" Jul 25 02:05:10.160093 ip-10-0-129-35 kubenswrapper[2567]: I0725 02:05:10.160072 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8f444b70-c52e-42fe-a6b5-e98d324ad48d-plugins-config-volume\") pod \"payload-processing-e2e-ipp-b-d66e66-6688874d6b-sqj8t\" (UID: \"8f444b70-c52e-42fe-a6b5-e98d324ad48d\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-d66e66-6688874d6b-sqj8t" Jul 25 02:05:10.160141 ip-10-0-129-35 kubenswrapper[2567]: I0725 02:05:10.160090 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/990d6e7f-18b2-42db-a5cf-f86356afad56-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-b-d66e66-fc5bc655b-q24j8\" (UID: \"990d6e7f-18b2-42db-a5cf-f86356afad56\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-d66e66-fc5bc655b-q24j8" Jul 25 02:05:10.166777 ip-10-0-129-35 kubenswrapper[2567]: I0725 02:05:10.166749 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ttq4g\" (UniqueName: \"kubernetes.io/projected/8f444b70-c52e-42fe-a6b5-e98d324ad48d-kube-api-access-ttq4g\") pod \"payload-processing-e2e-ipp-b-d66e66-6688874d6b-sqj8t\" (UID: \"8f444b70-c52e-42fe-a6b5-e98d324ad48d\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-d66e66-6688874d6b-sqj8t" Jul 25 02:05:10.167138 ip-10-0-129-35 kubenswrapper[2567]: I0725 02:05:10.167122 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xmp75\" (UniqueName: \"kubernetes.io/projected/990d6e7f-18b2-42db-a5cf-f86356afad56-kube-api-access-xmp75\") pod \"payload-pre-processing-e2e-ipp-b-d66e66-fc5bc655b-q24j8\" (UID: \"990d6e7f-18b2-42db-a5cf-f86356afad56\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-d66e66-fc5bc655b-q24j8" Jul 25 02:05:10.308746 ip-10-0-129-35 kubenswrapper[2567]: I0725 02:05:10.308713 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-d66e66-fc5bc655b-q24j8" Jul 25 02:05:10.340137 ip-10-0-129-35 kubenswrapper[2567]: I0725 02:05:10.340112 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-b-d66e66-6688874d6b-sqj8t" Jul 25 02:05:10.464935 ip-10-0-129-35 kubenswrapper[2567]: I0725 02:05:10.464894 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-d66e66-fc5bc655b-q24j8"] Jul 25 02:05:10.466877 ip-10-0-129-35 kubenswrapper[2567]: W0725 02:05:10.466844 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod990d6e7f_18b2_42db_a5cf_f86356afad56.slice/crio-58db2053cf4c44d77fe11b39e777dd431135b3a213dc4db56178b3b8d133c452 WatchSource:0}: Error finding container 58db2053cf4c44d77fe11b39e777dd431135b3a213dc4db56178b3b8d133c452: Status 404 returned error can't find the container with id 58db2053cf4c44d77fe11b39e777dd431135b3a213dc4db56178b3b8d133c452 Jul 25 02:05:10.496071 ip-10-0-129-35 kubenswrapper[2567]: I0725 02:05:10.496045 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-d66e66-6688874d6b-sqj8t"] Jul 25 02:05:10.505319 ip-10-0-129-35 kubenswrapper[2567]: W0725 02:05:10.505290 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8f444b70_c52e_42fe_a6b5_e98d324ad48d.slice/crio-8093ead1e1e15c8b9208aeccc6d99cb4ad03dc865045708417b83d3b9c071520 WatchSource:0}: Error finding container 8093ead1e1e15c8b9208aeccc6d99cb4ad03dc865045708417b83d3b9c071520: Status 404 returned error can't find the container with id 8093ead1e1e15c8b9208aeccc6d99cb4ad03dc865045708417b83d3b9c071520 Jul 25 02:05:10.546344 ip-10-0-129-35 kubenswrapper[2567]: I0725 02:05:10.546317 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-b-d66e66-6688874d6b-sqj8t" event={"ID":"8f444b70-c52e-42fe-a6b5-e98d324ad48d","Type":"ContainerStarted","Data":"8093ead1e1e15c8b9208aeccc6d99cb4ad03dc865045708417b83d3b9c071520"} Jul 25 02:05:10.547921 ip-10-0-129-35 kubenswrapper[2567]: I0725 02:05:10.547901 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-d66e66-fc5bc655b-q24j8" event={"ID":"990d6e7f-18b2-42db-a5cf-f86356afad56","Type":"ContainerStarted","Data":"7d2fbf26d56a2ccb7c492f44c172969603884cd7605450592c739c7c1936b852"} Jul 25 02:05:10.548028 ip-10-0-129-35 kubenswrapper[2567]: I0725 02:05:10.547944 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-d66e66-fc5bc655b-q24j8" event={"ID":"990d6e7f-18b2-42db-a5cf-f86356afad56","Type":"ContainerStarted","Data":"58db2053cf4c44d77fe11b39e777dd431135b3a213dc4db56178b3b8d133c452"} Jul 25 02:05:10.548101 ip-10-0-129-35 kubenswrapper[2567]: I0725 02:05:10.548034 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-d66e66-fc5bc655b-q24j8" Jul 25 02:05:10.562448 ip-10-0-129-35 kubenswrapper[2567]: I0725 02:05:10.562354 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-d66e66-fc5bc655b-q24j8" podStartSLOduration=1.562339257 podStartE2EDuration="1.562339257s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-25 02:05:09 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-25 02:05:10.56117865 +0000 UTC m=+3196.254273062" watchObservedRunningTime="2026-07-25 02:05:10.562339257 +0000 UTC m=+3196.255433675" Jul 25 02:05:11.554900 ip-10-0-129-35 kubenswrapper[2567]: I0725 02:05:11.554868 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-b-d66e66-6688874d6b-sqj8t" event={"ID":"8f444b70-c52e-42fe-a6b5-e98d324ad48d","Type":"ContainerStarted","Data":"84c42dd58be3b0537fe047cb6105d59218b036e19a3a0fc2f9f79adc95162385"} Jul 25 02:05:11.555325 ip-10-0-129-35 kubenswrapper[2567]: I0725 02:05:11.554944 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ipp-b-d66e66-6688874d6b-sqj8t" Jul 25 02:05:11.570943 ip-10-0-129-35 kubenswrapper[2567]: I0725 02:05:11.570900 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ipp-b-d66e66-6688874d6b-sqj8t" podStartSLOduration=1.570884811 podStartE2EDuration="1.570884811s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-25 02:05:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-25 02:05:11.56982861 +0000 UTC m=+3197.262923029" watchObservedRunningTime="2026-07-25 02:05:11.570884811 +0000 UTC m=+3197.263979227" Jul 25 02:05:17.585587 ip-10-0-129-35 kubenswrapper[2567]: I0725 02:05:17.585546 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mlpq2"] Jul 25 02:05:21.556786 ip-10-0-129-35 kubenswrapper[2567]: I0725 02:05:21.556758 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-d66e66-fc5bc655b-q24j8" Jul 25 02:05:22.562671 ip-10-0-129-35 kubenswrapper[2567]: I0725 02:05:22.562643 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ipp-b-d66e66-6688874d6b-sqj8t" Jul 25 02:05:31.273366 ip-10-0-129-35 kubenswrapper[2567]: I0725 02:05:31.273339 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-e2e-ipp-b-d66e66-6688874d6b-sqj8t_8f444b70-c52e-42fe-a6b5-e98d324ad48d/payload-processing/0.log" Jul 25 02:05:38.386918 ip-10-0-129-35 kubenswrapper[2567]: I0725 02:05:38.386884 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mlpq2"] Jul 25 02:06:16.688505 ip-10-0-129-35 kubenswrapper[2567]: I0725 02:06:16.688468 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mlpq2"] Jul 25 02:06:28.537652 ip-10-0-129-35 kubenswrapper[2567]: I0725 02:06:28.537619 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-e2e-ipp-a-e22c40-546577f5b6-46s62_82ad8f9d-317a-421c-bd32-4e59d194db0b/payload-processing/0.log" Jul 25 02:06:28.805731 ip-10-0-129-35 kubenswrapper[2567]: I0725 02:06:28.805645 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-e2e-ipp-b-d66e66-6688874d6b-sqj8t_8f444b70-c52e-42fe-a6b5-e98d324ad48d/payload-processing/0.log" Jul 25 02:06:33.564079 ip-10-0-129-35 kubenswrapper[2567]: I0725 02:06:33.564043 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-a585ca-7d466b4bbd-w87gh"] Jul 25 02:06:33.568102 ip-10-0-129-35 kubenswrapper[2567]: I0725 02:06:33.568086 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-a585ca-7d466b4bbd-w87gh" Jul 25 02:06:33.570510 ip-10-0-129-35 kubenswrapper[2567]: I0725 02:06:33.570482 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ipp-cleanup-a585ca\"" Jul 25 02:06:33.570632 ip-10-0-129-35 kubenswrapper[2567]: I0725 02:06:33.570515 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ipp-cleanup-a585ca-dockercfg-thgzh\"" Jul 25 02:06:33.579146 ip-10-0-129-35 kubenswrapper[2567]: I0725 02:06:33.579127 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-a585ca-7d466b4bbd-w87gh"] Jul 25 02:06:33.600684 ip-10-0-129-35 kubenswrapper[2567]: I0725 02:06:33.600662 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-a585ca-8b466745d-252vt"] Jul 25 02:06:33.604190 ip-10-0-129-35 kubenswrapper[2567]: I0725 02:06:33.604175 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-a585ca-8b466745d-252vt" Jul 25 02:06:33.614202 ip-10-0-129-35 kubenswrapper[2567]: I0725 02:06:33.614186 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-a585ca-8b466745d-252vt"] Jul 25 02:06:33.705587 ip-10-0-129-35 kubenswrapper[2567]: I0725 02:06:33.705557 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/bd537d3f-6fd4-4a89-9cd8-35279fc6db1a-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-cleanup-a585ca-7d466b4bbd-w87gh\" (UID: \"bd537d3f-6fd4-4a89-9cd8-35279fc6db1a\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-a585ca-7d466b4bbd-w87gh" Jul 25 02:06:33.705737 ip-10-0-129-35 kubenswrapper[2567]: I0725 02:06:33.705589 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/eecb3c1c-cc3c-4a1d-a792-0edcde7c1873-plugins-config-volume\") pod \"payload-processing-e2e-ipp-cleanup-a585ca-8b466745d-252vt\" (UID: \"eecb3c1c-cc3c-4a1d-a792-0edcde7c1873\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-a585ca-8b466745d-252vt" Jul 25 02:06:33.705737 ip-10-0-129-35 kubenswrapper[2567]: I0725 02:06:33.705690 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9s7w9\" (UniqueName: \"kubernetes.io/projected/eecb3c1c-cc3c-4a1d-a792-0edcde7c1873-kube-api-access-9s7w9\") pod \"payload-processing-e2e-ipp-cleanup-a585ca-8b466745d-252vt\" (UID: \"eecb3c1c-cc3c-4a1d-a792-0edcde7c1873\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-a585ca-8b466745d-252vt" Jul 25 02:06:33.705737 ip-10-0-129-35 kubenswrapper[2567]: I0725 02:06:33.705723 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-brv6m\" (UniqueName: \"kubernetes.io/projected/bd537d3f-6fd4-4a89-9cd8-35279fc6db1a-kube-api-access-brv6m\") pod \"payload-pre-processing-e2e-ipp-cleanup-a585ca-7d466b4bbd-w87gh\" (UID: \"bd537d3f-6fd4-4a89-9cd8-35279fc6db1a\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-a585ca-7d466b4bbd-w87gh" Jul 25 02:06:33.806367 ip-10-0-129-35 kubenswrapper[2567]: I0725 02:06:33.806340 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/bd537d3f-6fd4-4a89-9cd8-35279fc6db1a-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-cleanup-a585ca-7d466b4bbd-w87gh\" (UID: \"bd537d3f-6fd4-4a89-9cd8-35279fc6db1a\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-a585ca-7d466b4bbd-w87gh" Jul 25 02:06:33.806538 ip-10-0-129-35 kubenswrapper[2567]: I0725 02:06:33.806371 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/eecb3c1c-cc3c-4a1d-a792-0edcde7c1873-plugins-config-volume\") pod \"payload-processing-e2e-ipp-cleanup-a585ca-8b466745d-252vt\" (UID: \"eecb3c1c-cc3c-4a1d-a792-0edcde7c1873\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-a585ca-8b466745d-252vt" Jul 25 02:06:33.806538 ip-10-0-129-35 kubenswrapper[2567]: I0725 02:06:33.806437 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9s7w9\" (UniqueName: \"kubernetes.io/projected/eecb3c1c-cc3c-4a1d-a792-0edcde7c1873-kube-api-access-9s7w9\") pod \"payload-processing-e2e-ipp-cleanup-a585ca-8b466745d-252vt\" (UID: \"eecb3c1c-cc3c-4a1d-a792-0edcde7c1873\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-a585ca-8b466745d-252vt" Jul 25 02:06:33.806538 ip-10-0-129-35 kubenswrapper[2567]: I0725 02:06:33.806457 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-brv6m\" (UniqueName: \"kubernetes.io/projected/bd537d3f-6fd4-4a89-9cd8-35279fc6db1a-kube-api-access-brv6m\") pod \"payload-pre-processing-e2e-ipp-cleanup-a585ca-7d466b4bbd-w87gh\" (UID: \"bd537d3f-6fd4-4a89-9cd8-35279fc6db1a\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-a585ca-7d466b4bbd-w87gh" Jul 25 02:06:33.807016 ip-10-0-129-35 kubenswrapper[2567]: I0725 02:06:33.806998 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/bd537d3f-6fd4-4a89-9cd8-35279fc6db1a-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-cleanup-a585ca-7d466b4bbd-w87gh\" (UID: \"bd537d3f-6fd4-4a89-9cd8-35279fc6db1a\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-a585ca-7d466b4bbd-w87gh" Jul 25 02:06:33.807120 ip-10-0-129-35 kubenswrapper[2567]: I0725 02:06:33.807103 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/eecb3c1c-cc3c-4a1d-a792-0edcde7c1873-plugins-config-volume\") pod \"payload-processing-e2e-ipp-cleanup-a585ca-8b466745d-252vt\" (UID: \"eecb3c1c-cc3c-4a1d-a792-0edcde7c1873\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-a585ca-8b466745d-252vt" Jul 25 02:06:33.814422 ip-10-0-129-35 kubenswrapper[2567]: I0725 02:06:33.814341 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9s7w9\" (UniqueName: \"kubernetes.io/projected/eecb3c1c-cc3c-4a1d-a792-0edcde7c1873-kube-api-access-9s7w9\") pod \"payload-processing-e2e-ipp-cleanup-a585ca-8b466745d-252vt\" (UID: \"eecb3c1c-cc3c-4a1d-a792-0edcde7c1873\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-a585ca-8b466745d-252vt" Jul 25 02:06:33.814539 ip-10-0-129-35 kubenswrapper[2567]: I0725 02:06:33.814516 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-brv6m\" (UniqueName: \"kubernetes.io/projected/bd537d3f-6fd4-4a89-9cd8-35279fc6db1a-kube-api-access-brv6m\") pod \"payload-pre-processing-e2e-ipp-cleanup-a585ca-7d466b4bbd-w87gh\" (UID: \"bd537d3f-6fd4-4a89-9cd8-35279fc6db1a\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-a585ca-7d466b4bbd-w87gh" Jul 25 02:06:33.878719 ip-10-0-129-35 kubenswrapper[2567]: I0725 02:06:33.878697 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-a585ca-7d466b4bbd-w87gh" Jul 25 02:06:33.914319 ip-10-0-129-35 kubenswrapper[2567]: I0725 02:06:33.914295 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-a585ca-8b466745d-252vt" Jul 25 02:06:34.037126 ip-10-0-129-35 kubenswrapper[2567]: I0725 02:06:34.037089 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-a585ca-7d466b4bbd-w87gh"] Jul 25 02:06:34.038214 ip-10-0-129-35 kubenswrapper[2567]: W0725 02:06:34.038169 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbd537d3f_6fd4_4a89_9cd8_35279fc6db1a.slice/crio-99f0dcb91e48a9db9d60a5679f0ee54e46c223d20482a4d22e03f68605df37d9 WatchSource:0}: Error finding container 99f0dcb91e48a9db9d60a5679f0ee54e46c223d20482a4d22e03f68605df37d9: Status 404 returned error can't find the container with id 99f0dcb91e48a9db9d60a5679f0ee54e46c223d20482a4d22e03f68605df37d9 Jul 25 02:06:34.072098 ip-10-0-129-35 kubenswrapper[2567]: I0725 02:06:34.071977 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-a585ca-8b466745d-252vt"] Jul 25 02:06:34.994680 ip-10-0-129-35 kubenswrapper[2567]: I0725 02:06:34.994642 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-a585ca-7d466b4bbd-w87gh" event={"ID":"bd537d3f-6fd4-4a89-9cd8-35279fc6db1a","Type":"ContainerStarted","Data":"1b925edffd18221dde8e66244ce4c3f490e6011a39cf86186df9b9b3f78e380a"} Jul 25 02:06:34.995089 ip-10-0-129-35 kubenswrapper[2567]: I0725 02:06:34.994704 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-a585ca-7d466b4bbd-w87gh" event={"ID":"bd537d3f-6fd4-4a89-9cd8-35279fc6db1a","Type":"ContainerStarted","Data":"99f0dcb91e48a9db9d60a5679f0ee54e46c223d20482a4d22e03f68605df37d9"} Jul 25 02:06:34.995089 ip-10-0-129-35 kubenswrapper[2567]: I0725 02:06:34.994732 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-a585ca-7d466b4bbd-w87gh" Jul 25 02:06:34.996204 ip-10-0-129-35 kubenswrapper[2567]: I0725 02:06:34.996158 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-a585ca-8b466745d-252vt" event={"ID":"eecb3c1c-cc3c-4a1d-a792-0edcde7c1873","Type":"ContainerStarted","Data":"bdfec61eab281adae4472f5968c8a46c30742b71a247c561b985bddbe47e4204"} Jul 25 02:06:34.996317 ip-10-0-129-35 kubenswrapper[2567]: I0725 02:06:34.996229 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-a585ca-8b466745d-252vt" event={"ID":"eecb3c1c-cc3c-4a1d-a792-0edcde7c1873","Type":"ContainerStarted","Data":"496308ca80246f39e0eace52ad7af1651147054a8f1327ae75dda9536c9ec322"} Jul 25 02:06:34.996317 ip-10-0-129-35 kubenswrapper[2567]: I0725 02:06:34.996259 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-a585ca-8b466745d-252vt" Jul 25 02:06:35.009828 ip-10-0-129-35 kubenswrapper[2567]: I0725 02:06:35.009790 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-a585ca-7d466b4bbd-w87gh" podStartSLOduration=2.009775134 podStartE2EDuration="2.009775134s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-25 02:06:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-25 02:06:35.008613137 +0000 UTC m=+3280.701707557" watchObservedRunningTime="2026-07-25 02:06:35.009775134 +0000 UTC m=+3280.702869605" Jul 25 02:06:35.023810 ip-10-0-129-35 kubenswrapper[2567]: I0725 02:06:35.023768 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-a585ca-8b466745d-252vt" podStartSLOduration=2.023754404 podStartE2EDuration="2.023754404s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-25 02:06:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-25 02:06:35.021719704 +0000 UTC m=+3280.714814128" watchObservedRunningTime="2026-07-25 02:06:35.023754404 +0000 UTC m=+3280.716848823" Jul 25 02:06:46.003399 ip-10-0-129-35 kubenswrapper[2567]: I0725 02:06:46.003346 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-a585ca-7d466b4bbd-w87gh" Jul 25 02:06:46.003765 ip-10-0-129-35 kubenswrapper[2567]: I0725 02:06:46.003457 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-a585ca-8b466745d-252vt" Jul 25 02:06:46.391907 ip-10-0-129-35 kubenswrapper[2567]: I0725 02:06:46.391874 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mlpq2"] Jul 25 02:06:48.067365 ip-10-0-129-35 kubenswrapper[2567]: I0725 02:06:48.067324 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-a585ca-ngfpr"] Jul 25 02:06:48.074467 ip-10-0-129-35 kubenswrapper[2567]: I0725 02:06:48.074441 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-a585ca-ngfpr"] Jul 25 02:06:48.074629 ip-10-0-129-35 kubenswrapper[2567]: I0725 02:06:48.074547 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-a585ca-ngfpr" Jul 25 02:06:48.076761 ip-10-0-129-35 kubenswrapper[2567]: I0725 02:06:48.076741 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\"" Jul 25 02:06:48.076878 ip-10-0-129-35 kubenswrapper[2567]: I0725 02:06:48.076740 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-88hjh\"" Jul 25 02:06:48.134184 ip-10-0-129-35 kubenswrapper[2567]: I0725 02:06:48.134157 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0d10e383-6dce-482b-9ad0-48241de47ace-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-cleanup-a585ca-ngfpr\" (UID: \"0d10e383-6dce-482b-9ad0-48241de47ace\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-a585ca-ngfpr" Jul 25 02:06:48.235158 ip-10-0-129-35 kubenswrapper[2567]: I0725 02:06:48.235137 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0d10e383-6dce-482b-9ad0-48241de47ace-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-cleanup-a585ca-ngfpr\" (UID: \"0d10e383-6dce-482b-9ad0-48241de47ace\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-a585ca-ngfpr" Jul 25 02:06:48.235728 ip-10-0-129-35 kubenswrapper[2567]: I0725 02:06:48.235710 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0d10e383-6dce-482b-9ad0-48241de47ace-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-cleanup-a585ca-ngfpr\" (UID: \"0d10e383-6dce-482b-9ad0-48241de47ace\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-a585ca-ngfpr" Jul 25 02:06:48.389391 ip-10-0-129-35 kubenswrapper[2567]: I0725 02:06:48.389315 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-a585ca-ngfpr" Jul 25 02:06:48.520655 ip-10-0-129-35 kubenswrapper[2567]: I0725 02:06:48.520632 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-a585ca-ngfpr"] Jul 25 02:06:48.523552 ip-10-0-129-35 kubenswrapper[2567]: W0725 02:06:48.523518 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0d10e383_6dce_482b_9ad0_48241de47ace.slice/crio-f16dabadbfa1c4bc183bf11eecf3ec924a41724aaac830dbc1a63fb24b2173f8 WatchSource:0}: Error finding container f16dabadbfa1c4bc183bf11eecf3ec924a41724aaac830dbc1a63fb24b2173f8: Status 404 returned error can't find the container with id f16dabadbfa1c4bc183bf11eecf3ec924a41724aaac830dbc1a63fb24b2173f8 Jul 25 02:06:49.072189 ip-10-0-129-35 kubenswrapper[2567]: I0725 02:06:49.072147 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-a585ca-ngfpr" event={"ID":"0d10e383-6dce-482b-9ad0-48241de47ace","Type":"ContainerStarted","Data":"46c9783329ce4f073a8a317ad6429b784e28e6574d92e77a232b3704e6b68761"} Jul 25 02:06:49.072587 ip-10-0-129-35 kubenswrapper[2567]: I0725 02:06:49.072215 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-a585ca-ngfpr" event={"ID":"0d10e383-6dce-482b-9ad0-48241de47ace","Type":"ContainerStarted","Data":"f16dabadbfa1c4bc183bf11eecf3ec924a41724aaac830dbc1a63fb24b2173f8"} Jul 25 02:06:49.086417 ip-10-0-129-35 kubenswrapper[2567]: I0725 02:06:49.086352 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-a585ca-ngfpr" podStartSLOduration=1.0863373570000001 podStartE2EDuration="1.086337357s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-25 02:06:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-25 02:06:49.085104619 +0000 UTC m=+3294.778199038" watchObservedRunningTime="2026-07-25 02:06:49.086337357 +0000 UTC m=+3294.779431775" Jul 25 02:06:50.079479 ip-10-0-129-35 kubenswrapper[2567]: I0725 02:06:50.079443 2567 generic.go:356] "Generic (PLEG): container finished" podID="0d10e383-6dce-482b-9ad0-48241de47ace" containerID="46c9783329ce4f073a8a317ad6429b784e28e6574d92e77a232b3704e6b68761" exitCode=0 Jul 25 02:06:50.079855 ip-10-0-129-35 kubenswrapper[2567]: I0725 02:06:50.079494 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-a585ca-ngfpr" event={"ID":"0d10e383-6dce-482b-9ad0-48241de47ace","Type":"ContainerDied","Data":"46c9783329ce4f073a8a317ad6429b784e28e6574d92e77a232b3704e6b68761"} Jul 25 02:06:51.223923 ip-10-0-129-35 kubenswrapper[2567]: I0725 02:06:51.223900 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-a585ca-ngfpr" Jul 25 02:06:51.265229 ip-10-0-129-35 kubenswrapper[2567]: I0725 02:06:51.265188 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0d10e383-6dce-482b-9ad0-48241de47ace-maas-api-service-ca\") pod \"0d10e383-6dce-482b-9ad0-48241de47ace\" (UID: \"0d10e383-6dce-482b-9ad0-48241de47ace\") " Jul 25 02:06:51.265590 ip-10-0-129-35 kubenswrapper[2567]: I0725 02:06:51.265565 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0d10e383-6dce-482b-9ad0-48241de47ace-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "0d10e383-6dce-482b-9ad0-48241de47ace" (UID: "0d10e383-6dce-482b-9ad0-48241de47ace"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 25 02:06:51.366841 ip-10-0-129-35 kubenswrapper[2567]: I0725 02:06:51.366769 2567 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0d10e383-6dce-482b-9ad0-48241de47ace-maas-api-service-ca\") on node \"ip-10-0-129-35.ec2.internal\" DevicePath \"\"" Jul 25 02:06:52.091253 ip-10-0-129-35 kubenswrapper[2567]: I0725 02:06:52.091219 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-a585ca-ngfpr" Jul 25 02:06:52.091481 ip-10-0-129-35 kubenswrapper[2567]: I0725 02:06:52.091268 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-a585ca-ngfpr" event={"ID":"0d10e383-6dce-482b-9ad0-48241de47ace","Type":"ContainerDied","Data":"f16dabadbfa1c4bc183bf11eecf3ec924a41724aaac830dbc1a63fb24b2173f8"} Jul 25 02:06:52.091481 ip-10-0-129-35 kubenswrapper[2567]: I0725 02:06:52.091310 2567 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="f16dabadbfa1c4bc183bf11eecf3ec924a41724aaac830dbc1a63fb24b2173f8" Jul 25 02:06:54.986660 ip-10-0-129-35 kubenswrapper[2567]: I0725 02:06:54.986631 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-s5tbd_a9cb9aa9-8f43-4b32-a7b7-4eb9afb05c90/console-operator/1.log" Jul 25 02:06:54.991765 ip-10-0-129-35 kubenswrapper[2567]: I0725 02:06:54.991742 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-s5tbd_a9cb9aa9-8f43-4b32-a7b7-4eb9afb05c90/console-operator/1.log" Jul 25 02:06:58.672344 ip-10-0-129-35 kubenswrapper[2567]: I0725 02:06:58.672303 2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-a585ca-8b466745d-252vt"] Jul 25 02:06:58.672809 ip-10-0-129-35 kubenswrapper[2567]: I0725 02:06:58.672611 2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-a585ca-8b466745d-252vt" podUID="eecb3c1c-cc3c-4a1d-a792-0edcde7c1873" containerName="payload-processing" containerID="cri-o://bdfec61eab281adae4472f5968c8a46c30742b71a247c561b985bddbe47e4204" gracePeriod=30 Jul 25 02:06:58.679879 ip-10-0-129-35 kubenswrapper[2567]: I0725 02:06:58.679851 2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-a585ca-7d466b4bbd-w87gh"] Jul 25 02:06:58.680085 ip-10-0-129-35 kubenswrapper[2567]: I0725 02:06:58.680063 2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-a585ca-7d466b4bbd-w87gh" podUID="bd537d3f-6fd4-4a89-9cd8-35279fc6db1a" containerName="payload-pre-processing" containerID="cri-o://1b925edffd18221dde8e66244ce4c3f490e6011a39cf86186df9b9b3f78e380a" gracePeriod=30 Jul 25 02:06:58.965330 ip-10-0-129-35 kubenswrapper[2567]: I0725 02:06:58.965307 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-a585ca-8b466745d-252vt" Jul 25 02:06:58.969000 ip-10-0-129-35 kubenswrapper[2567]: I0725 02:06:58.968971 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-a585ca-7d466b4bbd-w87gh" Jul 25 02:06:59.034454 ip-10-0-129-35 kubenswrapper[2567]: I0725 02:06:59.034427 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9s7w9\" (UniqueName: \"kubernetes.io/projected/eecb3c1c-cc3c-4a1d-a792-0edcde7c1873-kube-api-access-9s7w9\") pod \"eecb3c1c-cc3c-4a1d-a792-0edcde7c1873\" (UID: \"eecb3c1c-cc3c-4a1d-a792-0edcde7c1873\") " Jul 25 02:06:59.034619 ip-10-0-129-35 kubenswrapper[2567]: I0725 02:06:59.034494 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/eecb3c1c-cc3c-4a1d-a792-0edcde7c1873-plugins-config-volume\") pod \"eecb3c1c-cc3c-4a1d-a792-0edcde7c1873\" (UID: \"eecb3c1c-cc3c-4a1d-a792-0edcde7c1873\") " Jul 25 02:06:59.034619 ip-10-0-129-35 kubenswrapper[2567]: I0725 02:06:59.034527 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/bd537d3f-6fd4-4a89-9cd8-35279fc6db1a-plugins-config-volume\") pod \"bd537d3f-6fd4-4a89-9cd8-35279fc6db1a\" (UID: \"bd537d3f-6fd4-4a89-9cd8-35279fc6db1a\") " Jul 25 02:06:59.034619 ip-10-0-129-35 kubenswrapper[2567]: I0725 02:06:59.034575 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-brv6m\" (UniqueName: \"kubernetes.io/projected/bd537d3f-6fd4-4a89-9cd8-35279fc6db1a-kube-api-access-brv6m\") pod \"bd537d3f-6fd4-4a89-9cd8-35279fc6db1a\" (UID: \"bd537d3f-6fd4-4a89-9cd8-35279fc6db1a\") " Jul 25 02:06:59.034932 ip-10-0-129-35 kubenswrapper[2567]: I0725 02:06:59.034905 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bd537d3f-6fd4-4a89-9cd8-35279fc6db1a-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "bd537d3f-6fd4-4a89-9cd8-35279fc6db1a" (UID: "bd537d3f-6fd4-4a89-9cd8-35279fc6db1a"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 25 02:06:59.034932 ip-10-0-129-35 kubenswrapper[2567]: I0725 02:06:59.034913 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/eecb3c1c-cc3c-4a1d-a792-0edcde7c1873-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "eecb3c1c-cc3c-4a1d-a792-0edcde7c1873" (UID: "eecb3c1c-cc3c-4a1d-a792-0edcde7c1873"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 25 02:06:59.036771 ip-10-0-129-35 kubenswrapper[2567]: I0725 02:06:59.036746 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/eecb3c1c-cc3c-4a1d-a792-0edcde7c1873-kube-api-access-9s7w9" (OuterVolumeSpecName: "kube-api-access-9s7w9") pod "eecb3c1c-cc3c-4a1d-a792-0edcde7c1873" (UID: "eecb3c1c-cc3c-4a1d-a792-0edcde7c1873"). InnerVolumeSpecName "kube-api-access-9s7w9". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 25 02:06:59.036854 ip-10-0-129-35 kubenswrapper[2567]: I0725 02:06:59.036824 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bd537d3f-6fd4-4a89-9cd8-35279fc6db1a-kube-api-access-brv6m" (OuterVolumeSpecName: "kube-api-access-brv6m") pod "bd537d3f-6fd4-4a89-9cd8-35279fc6db1a" (UID: "bd537d3f-6fd4-4a89-9cd8-35279fc6db1a"). InnerVolumeSpecName "kube-api-access-brv6m". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 25 02:06:59.136032 ip-10-0-129-35 kubenswrapper[2567]: I0725 02:06:59.136002 2567 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/eecb3c1c-cc3c-4a1d-a792-0edcde7c1873-plugins-config-volume\") on node \"ip-10-0-129-35.ec2.internal\" DevicePath \"\"" Jul 25 02:06:59.136032 ip-10-0-129-35 kubenswrapper[2567]: I0725 02:06:59.136031 2567 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/bd537d3f-6fd4-4a89-9cd8-35279fc6db1a-plugins-config-volume\") on node \"ip-10-0-129-35.ec2.internal\" DevicePath \"\"" Jul 25 02:06:59.136210 ip-10-0-129-35 kubenswrapper[2567]: I0725 02:06:59.136045 2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-brv6m\" (UniqueName: \"kubernetes.io/projected/bd537d3f-6fd4-4a89-9cd8-35279fc6db1a-kube-api-access-brv6m\") on node \"ip-10-0-129-35.ec2.internal\" DevicePath \"\"" Jul 25 02:06:59.136210 ip-10-0-129-35 kubenswrapper[2567]: I0725 02:06:59.136054 2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9s7w9\" (UniqueName: \"kubernetes.io/projected/eecb3c1c-cc3c-4a1d-a792-0edcde7c1873-kube-api-access-9s7w9\") on node \"ip-10-0-129-35.ec2.internal\" DevicePath \"\"" Jul 25 02:06:59.137092 ip-10-0-129-35 kubenswrapper[2567]: I0725 02:06:59.137070 2567 generic.go:356] "Generic (PLEG): container finished" podID="eecb3c1c-cc3c-4a1d-a792-0edcde7c1873" containerID="bdfec61eab281adae4472f5968c8a46c30742b71a247c561b985bddbe47e4204" exitCode=0 Jul 25 02:06:59.137174 ip-10-0-129-35 kubenswrapper[2567]: I0725 02:06:59.137110 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-a585ca-8b466745d-252vt" Jul 25 02:06:59.137174 ip-10-0-129-35 kubenswrapper[2567]: I0725 02:06:59.137144 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-a585ca-8b466745d-252vt" event={"ID":"eecb3c1c-cc3c-4a1d-a792-0edcde7c1873","Type":"ContainerDied","Data":"bdfec61eab281adae4472f5968c8a46c30742b71a247c561b985bddbe47e4204"} Jul 25 02:06:59.137274 ip-10-0-129-35 kubenswrapper[2567]: I0725 02:06:59.137192 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-a585ca-8b466745d-252vt" event={"ID":"eecb3c1c-cc3c-4a1d-a792-0edcde7c1873","Type":"ContainerDied","Data":"496308ca80246f39e0eace52ad7af1651147054a8f1327ae75dda9536c9ec322"} Jul 25 02:06:59.137274 ip-10-0-129-35 kubenswrapper[2567]: I0725 02:06:59.137224 2567 scope.go:117] "RemoveContainer" containerID="bdfec61eab281adae4472f5968c8a46c30742b71a247c561b985bddbe47e4204" Jul 25 02:06:59.138446 ip-10-0-129-35 kubenswrapper[2567]: I0725 02:06:59.138424 2567 generic.go:356] "Generic (PLEG): container finished" podID="bd537d3f-6fd4-4a89-9cd8-35279fc6db1a" containerID="1b925edffd18221dde8e66244ce4c3f490e6011a39cf86186df9b9b3f78e380a" exitCode=0 Jul 25 02:06:59.138522 ip-10-0-129-35 kubenswrapper[2567]: I0725 02:06:59.138458 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-a585ca-7d466b4bbd-w87gh" Jul 25 02:06:59.138572 ip-10-0-129-35 kubenswrapper[2567]: I0725 02:06:59.138450 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-a585ca-7d466b4bbd-w87gh" event={"ID":"bd537d3f-6fd4-4a89-9cd8-35279fc6db1a","Type":"ContainerDied","Data":"1b925edffd18221dde8e66244ce4c3f490e6011a39cf86186df9b9b3f78e380a"} Jul 25 02:06:59.138611 ip-10-0-129-35 kubenswrapper[2567]: I0725 02:06:59.138581 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-a585ca-7d466b4bbd-w87gh" event={"ID":"bd537d3f-6fd4-4a89-9cd8-35279fc6db1a","Type":"ContainerDied","Data":"99f0dcb91e48a9db9d60a5679f0ee54e46c223d20482a4d22e03f68605df37d9"} Jul 25 02:06:59.147948 ip-10-0-129-35 kubenswrapper[2567]: I0725 02:06:59.147934 2567 scope.go:117] "RemoveContainer" containerID="bdfec61eab281adae4472f5968c8a46c30742b71a247c561b985bddbe47e4204" Jul 25 02:06:59.148254 ip-10-0-129-35 kubenswrapper[2567]: E0725 02:06:59.148229 2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bdfec61eab281adae4472f5968c8a46c30742b71a247c561b985bddbe47e4204\": container with ID starting with bdfec61eab281adae4472f5968c8a46c30742b71a247c561b985bddbe47e4204 not found: ID does not exist" containerID="bdfec61eab281adae4472f5968c8a46c30742b71a247c561b985bddbe47e4204" Jul 25 02:06:59.148329 ip-10-0-129-35 kubenswrapper[2567]: I0725 02:06:59.148265 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bdfec61eab281adae4472f5968c8a46c30742b71a247c561b985bddbe47e4204"} err="failed to get container status \"bdfec61eab281adae4472f5968c8a46c30742b71a247c561b985bddbe47e4204\": rpc error: code = NotFound desc = could not find container \"bdfec61eab281adae4472f5968c8a46c30742b71a247c561b985bddbe47e4204\": container with ID starting with bdfec61eab281adae4472f5968c8a46c30742b71a247c561b985bddbe47e4204 not found: ID does not exist" Jul 25 02:06:59.148329 ip-10-0-129-35 kubenswrapper[2567]: I0725 02:06:59.148287 2567 scope.go:117] "RemoveContainer" containerID="1b925edffd18221dde8e66244ce4c3f490e6011a39cf86186df9b9b3f78e380a" Jul 25 02:06:59.157006 ip-10-0-129-35 kubenswrapper[2567]: I0725 02:06:59.156989 2567 scope.go:117] "RemoveContainer" containerID="1b925edffd18221dde8e66244ce4c3f490e6011a39cf86186df9b9b3f78e380a" Jul 25 02:06:59.157242 ip-10-0-129-35 kubenswrapper[2567]: E0725 02:06:59.157226 2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1b925edffd18221dde8e66244ce4c3f490e6011a39cf86186df9b9b3f78e380a\": container with ID starting with 1b925edffd18221dde8e66244ce4c3f490e6011a39cf86186df9b9b3f78e380a not found: ID does not exist" containerID="1b925edffd18221dde8e66244ce4c3f490e6011a39cf86186df9b9b3f78e380a" Jul 25 02:06:59.157306 ip-10-0-129-35 kubenswrapper[2567]: I0725 02:06:59.157248 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1b925edffd18221dde8e66244ce4c3f490e6011a39cf86186df9b9b3f78e380a"} err="failed to get container status \"1b925edffd18221dde8e66244ce4c3f490e6011a39cf86186df9b9b3f78e380a\": rpc error: code = NotFound desc = could not find container \"1b925edffd18221dde8e66244ce4c3f490e6011a39cf86186df9b9b3f78e380a\": container with ID starting with 1b925edffd18221dde8e66244ce4c3f490e6011a39cf86186df9b9b3f78e380a not found: ID does not exist" Jul 25 02:06:59.158720 ip-10-0-129-35 kubenswrapper[2567]: I0725 02:06:59.158698 2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-a585ca-8b466745d-252vt"] Jul 25 02:06:59.161822 ip-10-0-129-35 kubenswrapper[2567]: I0725 02:06:59.161801 2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-a585ca-8b466745d-252vt"] Jul 25 02:06:59.175489 ip-10-0-129-35 kubenswrapper[2567]: I0725 02:06:59.175467 2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-a585ca-7d466b4bbd-w87gh"] Jul 25 02:06:59.179304 ip-10-0-129-35 kubenswrapper[2567]: I0725 02:06:59.179283 2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-a585ca-7d466b4bbd-w87gh"] Jul 25 02:07:00.787650 ip-10-0-129-35 kubenswrapper[2567]: I0725 02:07:00.787620 2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bd537d3f-6fd4-4a89-9cd8-35279fc6db1a" path="/var/lib/kubelet/pods/bd537d3f-6fd4-4a89-9cd8-35279fc6db1a/volumes" Jul 25 02:07:00.788011 ip-10-0-129-35 kubenswrapper[2567]: I0725 02:07:00.787962 2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="eecb3c1c-cc3c-4a1d-a792-0edcde7c1873" path="/var/lib/kubelet/pods/eecb3c1c-cc3c-4a1d-a792-0edcde7c1873/volumes" Jul 25 02:07:03.133195 ip-10-0-129-35 kubenswrapper[2567]: I0725 02:07:03.133163 2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-a585ca-ngfpr"] Jul 25 02:07:03.135268 ip-10-0-129-35 kubenswrapper[2567]: I0725 02:07:03.135248 2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-a585ca-ngfpr"] Jul 25 02:07:04.493151 ip-10-0-129-35 kubenswrapper[2567]: I0725 02:07:04.493115 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mlpq2"] Jul 25 02:07:04.787174 ip-10-0-129-35 kubenswrapper[2567]: I0725 02:07:04.787144 2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0d10e383-6dce-482b-9ad0-48241de47ace" path="/var/lib/kubelet/pods/0d10e383-6dce-482b-9ad0-48241de47ace/volumes" Jul 25 02:07:28.986084 ip-10-0-129-35 kubenswrapper[2567]: I0725 02:07:28.986009 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mlpq2"] Jul 25 02:07:29.357496 ip-10-0-129-35 kubenswrapper[2567]: I0725 02:07:29.357463 2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-e22c40-546577f5b6-46s62"] Jul 25 02:07:29.357712 ip-10-0-129-35 kubenswrapper[2567]: I0725 02:07:29.357675 2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ipp-a-e22c40-546577f5b6-46s62" podUID="82ad8f9d-317a-421c-bd32-4e59d194db0b" containerName="payload-processing" containerID="cri-o://3e3e6482691bbd48a0276948acdd663caf8a7dbbb68ee03e2055d227026c6f12" gracePeriod=30 Jul 25 02:07:29.363821 ip-10-0-129-35 kubenswrapper[2567]: I0725 02:07:29.363791 2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-e22c40-6fcb96ddb4-lrn6x"] Jul 25 02:07:29.364059 ip-10-0-129-35 kubenswrapper[2567]: I0725 02:07:29.364013 2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-e22c40-6fcb96ddb4-lrn6x" podUID="05da5617-9ff9-497c-b28a-2281be693b86" containerName="payload-pre-processing" containerID="cri-o://b9df518b01a89ca6fc9abdccc1034d305ba2d6c703e0cdd5fe726c2229b5d675" gracePeriod=30 Jul 25 02:07:29.649349 ip-10-0-129-35 kubenswrapper[2567]: I0725 02:07:29.649314 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-a-e22c40-546577f5b6-46s62" Jul 25 02:07:29.652622 ip-10-0-129-35 kubenswrapper[2567]: I0725 02:07:29.652601 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-e22c40-6fcb96ddb4-lrn6x" Jul 25 02:07:29.708265 ip-10-0-129-35 kubenswrapper[2567]: I0725 02:07:29.708234 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qqwln\" (UniqueName: \"kubernetes.io/projected/82ad8f9d-317a-421c-bd32-4e59d194db0b-kube-api-access-qqwln\") pod \"82ad8f9d-317a-421c-bd32-4e59d194db0b\" (UID: \"82ad8f9d-317a-421c-bd32-4e59d194db0b\") " Jul 25 02:07:29.708417 ip-10-0-129-35 kubenswrapper[2567]: I0725 02:07:29.708332 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tmn9p\" (UniqueName: \"kubernetes.io/projected/05da5617-9ff9-497c-b28a-2281be693b86-kube-api-access-tmn9p\") pod \"05da5617-9ff9-497c-b28a-2281be693b86\" (UID: \"05da5617-9ff9-497c-b28a-2281be693b86\") " Jul 25 02:07:29.708492 ip-10-0-129-35 kubenswrapper[2567]: I0725 02:07:29.708432 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/82ad8f9d-317a-421c-bd32-4e59d194db0b-plugins-config-volume\") pod \"82ad8f9d-317a-421c-bd32-4e59d194db0b\" (UID: \"82ad8f9d-317a-421c-bd32-4e59d194db0b\") " Jul 25 02:07:29.708492 ip-10-0-129-35 kubenswrapper[2567]: I0725 02:07:29.708468 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/05da5617-9ff9-497c-b28a-2281be693b86-plugins-config-volume\") pod \"05da5617-9ff9-497c-b28a-2281be693b86\" (UID: \"05da5617-9ff9-497c-b28a-2281be693b86\") " Jul 25 02:07:29.708780 ip-10-0-129-35 kubenswrapper[2567]: I0725 02:07:29.708755 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/82ad8f9d-317a-421c-bd32-4e59d194db0b-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "82ad8f9d-317a-421c-bd32-4e59d194db0b" (UID: "82ad8f9d-317a-421c-bd32-4e59d194db0b"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 25 02:07:29.709066 ip-10-0-129-35 kubenswrapper[2567]: I0725 02:07:29.708813 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/05da5617-9ff9-497c-b28a-2281be693b86-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "05da5617-9ff9-497c-b28a-2281be693b86" (UID: "05da5617-9ff9-497c-b28a-2281be693b86"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 25 02:07:29.710410 ip-10-0-129-35 kubenswrapper[2567]: I0725 02:07:29.710391 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/82ad8f9d-317a-421c-bd32-4e59d194db0b-kube-api-access-qqwln" (OuterVolumeSpecName: "kube-api-access-qqwln") pod "82ad8f9d-317a-421c-bd32-4e59d194db0b" (UID: "82ad8f9d-317a-421c-bd32-4e59d194db0b"). InnerVolumeSpecName "kube-api-access-qqwln". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 25 02:07:29.710410 ip-10-0-129-35 kubenswrapper[2567]: I0725 02:07:29.710399 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/05da5617-9ff9-497c-b28a-2281be693b86-kube-api-access-tmn9p" (OuterVolumeSpecName: "kube-api-access-tmn9p") pod "05da5617-9ff9-497c-b28a-2281be693b86" (UID: "05da5617-9ff9-497c-b28a-2281be693b86"). InnerVolumeSpecName "kube-api-access-tmn9p". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 25 02:07:29.809230 ip-10-0-129-35 kubenswrapper[2567]: I0725 02:07:29.809202 2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tmn9p\" (UniqueName: \"kubernetes.io/projected/05da5617-9ff9-497c-b28a-2281be693b86-kube-api-access-tmn9p\") on node \"ip-10-0-129-35.ec2.internal\" DevicePath \"\"" Jul 25 02:07:29.809230 ip-10-0-129-35 kubenswrapper[2567]: I0725 02:07:29.809225 2567 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/82ad8f9d-317a-421c-bd32-4e59d194db0b-plugins-config-volume\") on node \"ip-10-0-129-35.ec2.internal\" DevicePath \"\"" Jul 25 02:07:29.809370 ip-10-0-129-35 kubenswrapper[2567]: I0725 02:07:29.809234 2567 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/05da5617-9ff9-497c-b28a-2281be693b86-plugins-config-volume\") on node \"ip-10-0-129-35.ec2.internal\" DevicePath \"\"" Jul 25 02:07:29.809370 ip-10-0-129-35 kubenswrapper[2567]: I0725 02:07:29.809243 2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qqwln\" (UniqueName: \"kubernetes.io/projected/82ad8f9d-317a-421c-bd32-4e59d194db0b-kube-api-access-qqwln\") on node \"ip-10-0-129-35.ec2.internal\" DevicePath \"\"" Jul 25 02:07:30.307232 ip-10-0-129-35 kubenswrapper[2567]: I0725 02:07:30.307191 2567 generic.go:356] "Generic (PLEG): container finished" podID="05da5617-9ff9-497c-b28a-2281be693b86" containerID="b9df518b01a89ca6fc9abdccc1034d305ba2d6c703e0cdd5fe726c2229b5d675" exitCode=0 Jul 25 02:07:30.307232 ip-10-0-129-35 kubenswrapper[2567]: I0725 02:07:30.307225 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-e22c40-6fcb96ddb4-lrn6x" event={"ID":"05da5617-9ff9-497c-b28a-2281be693b86","Type":"ContainerDied","Data":"b9df518b01a89ca6fc9abdccc1034d305ba2d6c703e0cdd5fe726c2229b5d675"} Jul 25 02:07:30.307802 ip-10-0-129-35 kubenswrapper[2567]: I0725 02:07:30.307237 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-e22c40-6fcb96ddb4-lrn6x" Jul 25 02:07:30.307802 ip-10-0-129-35 kubenswrapper[2567]: I0725 02:07:30.307284 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-e22c40-6fcb96ddb4-lrn6x" event={"ID":"05da5617-9ff9-497c-b28a-2281be693b86","Type":"ContainerDied","Data":"f31b8c3410d8b850df5e51069c08356f4d72d9504ec05047bd5b03f232a86a17"} Jul 25 02:07:30.307802 ip-10-0-129-35 kubenswrapper[2567]: I0725 02:07:30.307315 2567 scope.go:117] "RemoveContainer" containerID="b9df518b01a89ca6fc9abdccc1034d305ba2d6c703e0cdd5fe726c2229b5d675" Jul 25 02:07:30.308845 ip-10-0-129-35 kubenswrapper[2567]: I0725 02:07:30.308819 2567 generic.go:356] "Generic (PLEG): container finished" podID="82ad8f9d-317a-421c-bd32-4e59d194db0b" containerID="3e3e6482691bbd48a0276948acdd663caf8a7dbbb68ee03e2055d227026c6f12" exitCode=0 Jul 25 02:07:30.308966 ip-10-0-129-35 kubenswrapper[2567]: I0725 02:07:30.308864 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-a-e22c40-546577f5b6-46s62" Jul 25 02:07:30.309069 ip-10-0-129-35 kubenswrapper[2567]: I0725 02:07:30.309000 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-a-e22c40-546577f5b6-46s62" event={"ID":"82ad8f9d-317a-421c-bd32-4e59d194db0b","Type":"ContainerDied","Data":"3e3e6482691bbd48a0276948acdd663caf8a7dbbb68ee03e2055d227026c6f12"} Jul 25 02:07:30.309135 ip-10-0-129-35 kubenswrapper[2567]: I0725 02:07:30.309098 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-a-e22c40-546577f5b6-46s62" event={"ID":"82ad8f9d-317a-421c-bd32-4e59d194db0b","Type":"ContainerDied","Data":"17c9163902f341e651d8657870927bf2dd07531f19f04eca015eaa14618a6386"} Jul 25 02:07:30.317962 ip-10-0-129-35 kubenswrapper[2567]: I0725 02:07:30.317942 2567 scope.go:117] "RemoveContainer" containerID="b9df518b01a89ca6fc9abdccc1034d305ba2d6c703e0cdd5fe726c2229b5d675" Jul 25 02:07:30.318280 ip-10-0-129-35 kubenswrapper[2567]: E0725 02:07:30.318259 2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b9df518b01a89ca6fc9abdccc1034d305ba2d6c703e0cdd5fe726c2229b5d675\": container with ID starting with b9df518b01a89ca6fc9abdccc1034d305ba2d6c703e0cdd5fe726c2229b5d675 not found: ID does not exist" containerID="b9df518b01a89ca6fc9abdccc1034d305ba2d6c703e0cdd5fe726c2229b5d675" Jul 25 02:07:30.318363 ip-10-0-129-35 kubenswrapper[2567]: I0725 02:07:30.318291 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b9df518b01a89ca6fc9abdccc1034d305ba2d6c703e0cdd5fe726c2229b5d675"} err="failed to get container status \"b9df518b01a89ca6fc9abdccc1034d305ba2d6c703e0cdd5fe726c2229b5d675\": rpc error: code = NotFound desc = could not find container \"b9df518b01a89ca6fc9abdccc1034d305ba2d6c703e0cdd5fe726c2229b5d675\": container with ID starting with b9df518b01a89ca6fc9abdccc1034d305ba2d6c703e0cdd5fe726c2229b5d675 not found: ID does not exist" Jul 25 02:07:30.318363 ip-10-0-129-35 kubenswrapper[2567]: I0725 02:07:30.318321 2567 scope.go:117] "RemoveContainer" containerID="3e3e6482691bbd48a0276948acdd663caf8a7dbbb68ee03e2055d227026c6f12" Jul 25 02:07:30.326586 ip-10-0-129-35 kubenswrapper[2567]: I0725 02:07:30.326569 2567 scope.go:117] "RemoveContainer" containerID="3e3e6482691bbd48a0276948acdd663caf8a7dbbb68ee03e2055d227026c6f12" Jul 25 02:07:30.326822 ip-10-0-129-35 kubenswrapper[2567]: E0725 02:07:30.326806 2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3e3e6482691bbd48a0276948acdd663caf8a7dbbb68ee03e2055d227026c6f12\": container with ID starting with 3e3e6482691bbd48a0276948acdd663caf8a7dbbb68ee03e2055d227026c6f12 not found: ID does not exist" containerID="3e3e6482691bbd48a0276948acdd663caf8a7dbbb68ee03e2055d227026c6f12" Jul 25 02:07:30.326861 ip-10-0-129-35 kubenswrapper[2567]: I0725 02:07:30.326829 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3e3e6482691bbd48a0276948acdd663caf8a7dbbb68ee03e2055d227026c6f12"} err="failed to get container status \"3e3e6482691bbd48a0276948acdd663caf8a7dbbb68ee03e2055d227026c6f12\": rpc error: code = NotFound desc = could not find container \"3e3e6482691bbd48a0276948acdd663caf8a7dbbb68ee03e2055d227026c6f12\": container with ID starting with 3e3e6482691bbd48a0276948acdd663caf8a7dbbb68ee03e2055d227026c6f12 not found: ID does not exist" Jul 25 02:07:30.330313 ip-10-0-129-35 kubenswrapper[2567]: I0725 02:07:30.330291 2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-e22c40-546577f5b6-46s62"] Jul 25 02:07:30.334026 ip-10-0-129-35 kubenswrapper[2567]: I0725 02:07:30.334009 2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-e22c40-546577f5b6-46s62"] Jul 25 02:07:30.342933 ip-10-0-129-35 kubenswrapper[2567]: I0725 02:07:30.342905 2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-e22c40-6fcb96ddb4-lrn6x"] Jul 25 02:07:30.346730 ip-10-0-129-35 kubenswrapper[2567]: I0725 02:07:30.346713 2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-e22c40-6fcb96ddb4-lrn6x"] Jul 25 02:07:30.786681 ip-10-0-129-35 kubenswrapper[2567]: I0725 02:07:30.786655 2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="05da5617-9ff9-497c-b28a-2281be693b86" path="/var/lib/kubelet/pods/05da5617-9ff9-497c-b28a-2281be693b86/volumes" Jul 25 02:07:30.787011 ip-10-0-129-35 kubenswrapper[2567]: I0725 02:07:30.786999 2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="82ad8f9d-317a-421c-bd32-4e59d194db0b" path="/var/lib/kubelet/pods/82ad8f9d-317a-421c-bd32-4e59d194db0b/volumes" Jul 25 02:07:39.194775 ip-10-0-129-35 kubenswrapper[2567]: I0725 02:07:39.194738 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mlpq2"] Jul 25 02:08:28.535625 ip-10-0-129-35 kubenswrapper[2567]: I0725 02:08:28.535597 2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-d66e66-6688874d6b-sqj8t"] Jul 25 02:08:28.536144 ip-10-0-129-35 kubenswrapper[2567]: I0725 02:08:28.535784 2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ipp-b-d66e66-6688874d6b-sqj8t" podUID="8f444b70-c52e-42fe-a6b5-e98d324ad48d" containerName="payload-processing" containerID="cri-o://84c42dd58be3b0537fe047cb6105d59218b036e19a3a0fc2f9f79adc95162385" gracePeriod=30 Jul 25 02:08:28.544530 ip-10-0-129-35 kubenswrapper[2567]: I0725 02:08:28.544501 2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-d66e66-fc5bc655b-q24j8"] Jul 25 02:08:28.544765 ip-10-0-129-35 kubenswrapper[2567]: I0725 02:08:28.544717 2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-d66e66-fc5bc655b-q24j8" podUID="990d6e7f-18b2-42db-a5cf-f86356afad56" containerName="payload-pre-processing" containerID="cri-o://7d2fbf26d56a2ccb7c492f44c172969603884cd7605450592c739c7c1936b852" gracePeriod=30 Jul 25 02:08:28.808353 ip-10-0-129-35 kubenswrapper[2567]: I0725 02:08:28.808327 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-b-d66e66-6688874d6b-sqj8t" Jul 25 02:08:28.839443 ip-10-0-129-35 kubenswrapper[2567]: I0725 02:08:28.839421 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-d66e66-fc5bc655b-q24j8" Jul 25 02:08:28.944031 ip-10-0-129-35 kubenswrapper[2567]: I0725 02:08:28.944001 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xmp75\" (UniqueName: \"kubernetes.io/projected/990d6e7f-18b2-42db-a5cf-f86356afad56-kube-api-access-xmp75\") pod \"990d6e7f-18b2-42db-a5cf-f86356afad56\" (UID: \"990d6e7f-18b2-42db-a5cf-f86356afad56\") " Jul 25 02:08:28.944207 ip-10-0-129-35 kubenswrapper[2567]: I0725 02:08:28.944098 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/990d6e7f-18b2-42db-a5cf-f86356afad56-plugins-config-volume\") pod \"990d6e7f-18b2-42db-a5cf-f86356afad56\" (UID: \"990d6e7f-18b2-42db-a5cf-f86356afad56\") " Jul 25 02:08:28.944207 ip-10-0-129-35 kubenswrapper[2567]: I0725 02:08:28.944147 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8f444b70-c52e-42fe-a6b5-e98d324ad48d-plugins-config-volume\") pod \"8f444b70-c52e-42fe-a6b5-e98d324ad48d\" (UID: \"8f444b70-c52e-42fe-a6b5-e98d324ad48d\") " Jul 25 02:08:28.944207 ip-10-0-129-35 kubenswrapper[2567]: I0725 02:08:28.944181 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ttq4g\" (UniqueName: \"kubernetes.io/projected/8f444b70-c52e-42fe-a6b5-e98d324ad48d-kube-api-access-ttq4g\") pod \"8f444b70-c52e-42fe-a6b5-e98d324ad48d\" (UID: \"8f444b70-c52e-42fe-a6b5-e98d324ad48d\") " Jul 25 02:08:28.944545 ip-10-0-129-35 kubenswrapper[2567]: I0725 02:08:28.944524 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8f444b70-c52e-42fe-a6b5-e98d324ad48d-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "8f444b70-c52e-42fe-a6b5-e98d324ad48d" (UID: "8f444b70-c52e-42fe-a6b5-e98d324ad48d"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 25 02:08:28.944545 ip-10-0-129-35 kubenswrapper[2567]: I0725 02:08:28.944530 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/990d6e7f-18b2-42db-a5cf-f86356afad56-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "990d6e7f-18b2-42db-a5cf-f86356afad56" (UID: "990d6e7f-18b2-42db-a5cf-f86356afad56"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 25 02:08:28.946408 ip-10-0-129-35 kubenswrapper[2567]: I0725 02:08:28.946370 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8f444b70-c52e-42fe-a6b5-e98d324ad48d-kube-api-access-ttq4g" (OuterVolumeSpecName: "kube-api-access-ttq4g") pod "8f444b70-c52e-42fe-a6b5-e98d324ad48d" (UID: "8f444b70-c52e-42fe-a6b5-e98d324ad48d"). InnerVolumeSpecName "kube-api-access-ttq4g". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 25 02:08:28.946469 ip-10-0-129-35 kubenswrapper[2567]: I0725 02:08:28.946442 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/990d6e7f-18b2-42db-a5cf-f86356afad56-kube-api-access-xmp75" (OuterVolumeSpecName: "kube-api-access-xmp75") pod "990d6e7f-18b2-42db-a5cf-f86356afad56" (UID: "990d6e7f-18b2-42db-a5cf-f86356afad56"). InnerVolumeSpecName "kube-api-access-xmp75". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 25 02:08:29.045606 ip-10-0-129-35 kubenswrapper[2567]: I0725 02:08:29.045533 2567 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8f444b70-c52e-42fe-a6b5-e98d324ad48d-plugins-config-volume\") on node \"ip-10-0-129-35.ec2.internal\" DevicePath \"\"" Jul 25 02:08:29.045606 ip-10-0-129-35 kubenswrapper[2567]: I0725 02:08:29.045564 2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ttq4g\" (UniqueName: \"kubernetes.io/projected/8f444b70-c52e-42fe-a6b5-e98d324ad48d-kube-api-access-ttq4g\") on node \"ip-10-0-129-35.ec2.internal\" DevicePath \"\"" Jul 25 02:08:29.045606 ip-10-0-129-35 kubenswrapper[2567]: I0725 02:08:29.045573 2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xmp75\" (UniqueName: \"kubernetes.io/projected/990d6e7f-18b2-42db-a5cf-f86356afad56-kube-api-access-xmp75\") on node \"ip-10-0-129-35.ec2.internal\" DevicePath \"\"" Jul 25 02:08:29.045606 ip-10-0-129-35 kubenswrapper[2567]: I0725 02:08:29.045583 2567 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/990d6e7f-18b2-42db-a5cf-f86356afad56-plugins-config-volume\") on node \"ip-10-0-129-35.ec2.internal\" DevicePath \"\"" Jul 25 02:08:29.620983 ip-10-0-129-35 kubenswrapper[2567]: I0725 02:08:29.620946 2567 generic.go:356] "Generic (PLEG): container finished" podID="8f444b70-c52e-42fe-a6b5-e98d324ad48d" containerID="84c42dd58be3b0537fe047cb6105d59218b036e19a3a0fc2f9f79adc95162385" exitCode=0 Jul 25 02:08:29.621369 ip-10-0-129-35 kubenswrapper[2567]: I0725 02:08:29.620990 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-b-d66e66-6688874d6b-sqj8t" Jul 25 02:08:29.621369 ip-10-0-129-35 kubenswrapper[2567]: I0725 02:08:29.621028 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-b-d66e66-6688874d6b-sqj8t" event={"ID":"8f444b70-c52e-42fe-a6b5-e98d324ad48d","Type":"ContainerDied","Data":"84c42dd58be3b0537fe047cb6105d59218b036e19a3a0fc2f9f79adc95162385"} Jul 25 02:08:29.621369 ip-10-0-129-35 kubenswrapper[2567]: I0725 02:08:29.621080 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-b-d66e66-6688874d6b-sqj8t" event={"ID":"8f444b70-c52e-42fe-a6b5-e98d324ad48d","Type":"ContainerDied","Data":"8093ead1e1e15c8b9208aeccc6d99cb4ad03dc865045708417b83d3b9c071520"} Jul 25 02:08:29.621369 ip-10-0-129-35 kubenswrapper[2567]: I0725 02:08:29.621101 2567 scope.go:117] "RemoveContainer" containerID="84c42dd58be3b0537fe047cb6105d59218b036e19a3a0fc2f9f79adc95162385" Jul 25 02:08:29.622501 ip-10-0-129-35 kubenswrapper[2567]: I0725 02:08:29.622480 2567 generic.go:356] "Generic (PLEG): container finished" podID="990d6e7f-18b2-42db-a5cf-f86356afad56" containerID="7d2fbf26d56a2ccb7c492f44c172969603884cd7605450592c739c7c1936b852" exitCode=0 Jul 25 02:08:29.622582 ip-10-0-129-35 kubenswrapper[2567]: I0725 02:08:29.622531 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-d66e66-fc5bc655b-q24j8" event={"ID":"990d6e7f-18b2-42db-a5cf-f86356afad56","Type":"ContainerDied","Data":"7d2fbf26d56a2ccb7c492f44c172969603884cd7605450592c739c7c1936b852"} Jul 25 02:08:29.622649 ip-10-0-129-35 kubenswrapper[2567]: I0725 02:08:29.622578 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-d66e66-fc5bc655b-q24j8" event={"ID":"990d6e7f-18b2-42db-a5cf-f86356afad56","Type":"ContainerDied","Data":"58db2053cf4c44d77fe11b39e777dd431135b3a213dc4db56178b3b8d133c452"} Jul 25 02:08:29.622733 ip-10-0-129-35 kubenswrapper[2567]: I0725 02:08:29.622705 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-d66e66-fc5bc655b-q24j8" Jul 25 02:08:29.631355 ip-10-0-129-35 kubenswrapper[2567]: I0725 02:08:29.631334 2567 scope.go:117] "RemoveContainer" containerID="84c42dd58be3b0537fe047cb6105d59218b036e19a3a0fc2f9f79adc95162385" Jul 25 02:08:29.631617 ip-10-0-129-35 kubenswrapper[2567]: E0725 02:08:29.631598 2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"84c42dd58be3b0537fe047cb6105d59218b036e19a3a0fc2f9f79adc95162385\": container with ID starting with 84c42dd58be3b0537fe047cb6105d59218b036e19a3a0fc2f9f79adc95162385 not found: ID does not exist" containerID="84c42dd58be3b0537fe047cb6105d59218b036e19a3a0fc2f9f79adc95162385" Jul 25 02:08:29.631675 ip-10-0-129-35 kubenswrapper[2567]: I0725 02:08:29.631627 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"84c42dd58be3b0537fe047cb6105d59218b036e19a3a0fc2f9f79adc95162385"} err="failed to get container status \"84c42dd58be3b0537fe047cb6105d59218b036e19a3a0fc2f9f79adc95162385\": rpc error: code = NotFound desc = could not find container \"84c42dd58be3b0537fe047cb6105d59218b036e19a3a0fc2f9f79adc95162385\": container with ID starting with 84c42dd58be3b0537fe047cb6105d59218b036e19a3a0fc2f9f79adc95162385 not found: ID does not exist" Jul 25 02:08:29.631675 ip-10-0-129-35 kubenswrapper[2567]: I0725 02:08:29.631643 2567 scope.go:117] "RemoveContainer" containerID="7d2fbf26d56a2ccb7c492f44c172969603884cd7605450592c739c7c1936b852" Jul 25 02:08:29.640771 ip-10-0-129-35 kubenswrapper[2567]: I0725 02:08:29.640749 2567 scope.go:117] "RemoveContainer" containerID="7d2fbf26d56a2ccb7c492f44c172969603884cd7605450592c739c7c1936b852" Jul 25 02:08:29.641114 ip-10-0-129-35 kubenswrapper[2567]: E0725 02:08:29.641091 2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7d2fbf26d56a2ccb7c492f44c172969603884cd7605450592c739c7c1936b852\": container with ID starting with 7d2fbf26d56a2ccb7c492f44c172969603884cd7605450592c739c7c1936b852 not found: ID does not exist" containerID="7d2fbf26d56a2ccb7c492f44c172969603884cd7605450592c739c7c1936b852" Jul 25 02:08:29.641201 ip-10-0-129-35 kubenswrapper[2567]: I0725 02:08:29.641117 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7d2fbf26d56a2ccb7c492f44c172969603884cd7605450592c739c7c1936b852"} err="failed to get container status \"7d2fbf26d56a2ccb7c492f44c172969603884cd7605450592c739c7c1936b852\": rpc error: code = NotFound desc = could not find container \"7d2fbf26d56a2ccb7c492f44c172969603884cd7605450592c739c7c1936b852\": container with ID starting with 7d2fbf26d56a2ccb7c492f44c172969603884cd7605450592c739c7c1936b852 not found: ID does not exist" Jul 25 02:08:29.642764 ip-10-0-129-35 kubenswrapper[2567]: I0725 02:08:29.642746 2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-d66e66-6688874d6b-sqj8t"] Jul 25 02:08:29.646337 ip-10-0-129-35 kubenswrapper[2567]: I0725 02:08:29.646318 2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-d66e66-6688874d6b-sqj8t"] Jul 25 02:08:29.654836 ip-10-0-129-35 kubenswrapper[2567]: I0725 02:08:29.654813 2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-d66e66-fc5bc655b-q24j8"] Jul 25 02:08:29.656555 ip-10-0-129-35 kubenswrapper[2567]: I0725 02:08:29.656535 2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-d66e66-fc5bc655b-q24j8"] Jul 25 02:08:30.793522 ip-10-0-129-35 kubenswrapper[2567]: I0725 02:08:30.793492 2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8f444b70-c52e-42fe-a6b5-e98d324ad48d" path="/var/lib/kubelet/pods/8f444b70-c52e-42fe-a6b5-e98d324ad48d/volumes" Jul 25 02:08:30.793885 ip-10-0-129-35 kubenswrapper[2567]: I0725 02:08:30.793829 2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="990d6e7f-18b2-42db-a5cf-f86356afad56" path="/var/lib/kubelet/pods/990d6e7f-18b2-42db-a5cf-f86356afad56/volumes" Jul 25 02:08:31.889689 ip-10-0-129-35 kubenswrapper[2567]: I0725 02:08:31.889657 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mlpq2"] Jul 25 02:08:50.225574 ip-10-0-129-35 kubenswrapper[2567]: I0725 02:08:50.225501 2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-299af2-865774ff5d-x572k"] Jul 25 02:08:50.225987 ip-10-0-129-35 kubenswrapper[2567]: I0725 02:08:50.225728 2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-shared-a-299af2-865774ff5d-x572k" podUID="1495beb6-a0be-4300-af70-c4d924859c4b" containerName="payload-processing" containerID="cri-o://59401f86b67da9cb4349c96fe2c7c07721bdc05205e73798f8986a9c5149b5be" gracePeriod=30 Jul 25 02:08:50.232158 ip-10-0-129-35 kubenswrapper[2567]: I0725 02:08:50.232130 2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-299af2-65d57c848d-p9sbk"] Jul 25 02:08:50.232508 ip-10-0-129-35 kubenswrapper[2567]: I0725 02:08:50.232461 2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-299af2-65d57c848d-p9sbk" podUID="8003b15e-d043-4334-a7a0-a3cd53bd28d9" containerName="payload-pre-processing" containerID="cri-o://49abc71b327dcf678845acba57094e055907fe86676227dba0e76ae9ebee5197" gracePeriod=30 Jul 25 02:08:50.517943 ip-10-0-129-35 kubenswrapper[2567]: I0725 02:08:50.517918 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-299af2-865774ff5d-x572k" Jul 25 02:08:50.520743 ip-10-0-129-35 kubenswrapper[2567]: I0725 02:08:50.520724 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-299af2-65d57c848d-p9sbk" Jul 25 02:08:50.640595 ip-10-0-129-35 kubenswrapper[2567]: I0725 02:08:50.640563 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-t64rk\" (UniqueName: \"kubernetes.io/projected/1495beb6-a0be-4300-af70-c4d924859c4b-kube-api-access-t64rk\") pod \"1495beb6-a0be-4300-af70-c4d924859c4b\" (UID: \"1495beb6-a0be-4300-af70-c4d924859c4b\") " Jul 25 02:08:50.640595 ip-10-0-129-35 kubenswrapper[2567]: I0725 02:08:50.640597 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8003b15e-d043-4334-a7a0-a3cd53bd28d9-plugins-config-volume\") pod \"8003b15e-d043-4334-a7a0-a3cd53bd28d9\" (UID: \"8003b15e-d043-4334-a7a0-a3cd53bd28d9\") " Jul 25 02:08:50.640781 ip-10-0-129-35 kubenswrapper[2567]: I0725 02:08:50.640625 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-624qt\" (UniqueName: \"kubernetes.io/projected/8003b15e-d043-4334-a7a0-a3cd53bd28d9-kube-api-access-624qt\") pod \"8003b15e-d043-4334-a7a0-a3cd53bd28d9\" (UID: \"8003b15e-d043-4334-a7a0-a3cd53bd28d9\") " Jul 25 02:08:50.640829 ip-10-0-129-35 kubenswrapper[2567]: I0725 02:08:50.640806 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1495beb6-a0be-4300-af70-c4d924859c4b-plugins-config-volume\") pod \"1495beb6-a0be-4300-af70-c4d924859c4b\" (UID: \"1495beb6-a0be-4300-af70-c4d924859c4b\") " Jul 25 02:08:50.641086 ip-10-0-129-35 kubenswrapper[2567]: I0725 02:08:50.640993 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8003b15e-d043-4334-a7a0-a3cd53bd28d9-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "8003b15e-d043-4334-a7a0-a3cd53bd28d9" (UID: "8003b15e-d043-4334-a7a0-a3cd53bd28d9"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 25 02:08:50.641219 ip-10-0-129-35 kubenswrapper[2567]: I0725 02:08:50.641165 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1495beb6-a0be-4300-af70-c4d924859c4b-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "1495beb6-a0be-4300-af70-c4d924859c4b" (UID: "1495beb6-a0be-4300-af70-c4d924859c4b"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 25 02:08:50.641219 ip-10-0-129-35 kubenswrapper[2567]: I0725 02:08:50.641181 2567 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8003b15e-d043-4334-a7a0-a3cd53bd28d9-plugins-config-volume\") on node \"ip-10-0-129-35.ec2.internal\" DevicePath \"\"" Jul 25 02:08:50.642816 ip-10-0-129-35 kubenswrapper[2567]: I0725 02:08:50.642786 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1495beb6-a0be-4300-af70-c4d924859c4b-kube-api-access-t64rk" (OuterVolumeSpecName: "kube-api-access-t64rk") pod "1495beb6-a0be-4300-af70-c4d924859c4b" (UID: "1495beb6-a0be-4300-af70-c4d924859c4b"). InnerVolumeSpecName "kube-api-access-t64rk". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 25 02:08:50.642904 ip-10-0-129-35 kubenswrapper[2567]: I0725 02:08:50.642818 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8003b15e-d043-4334-a7a0-a3cd53bd28d9-kube-api-access-624qt" (OuterVolumeSpecName: "kube-api-access-624qt") pod "8003b15e-d043-4334-a7a0-a3cd53bd28d9" (UID: "8003b15e-d043-4334-a7a0-a3cd53bd28d9"). InnerVolumeSpecName "kube-api-access-624qt". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 25 02:08:50.732714 ip-10-0-129-35 kubenswrapper[2567]: I0725 02:08:50.732688 2567 generic.go:356] "Generic (PLEG): container finished" podID="8003b15e-d043-4334-a7a0-a3cd53bd28d9" containerID="49abc71b327dcf678845acba57094e055907fe86676227dba0e76ae9ebee5197" exitCode=0 Jul 25 02:08:50.732817 ip-10-0-129-35 kubenswrapper[2567]: I0725 02:08:50.732731 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-299af2-65d57c848d-p9sbk" Jul 25 02:08:50.732817 ip-10-0-129-35 kubenswrapper[2567]: I0725 02:08:50.732777 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-299af2-65d57c848d-p9sbk" event={"ID":"8003b15e-d043-4334-a7a0-a3cd53bd28d9","Type":"ContainerDied","Data":"49abc71b327dcf678845acba57094e055907fe86676227dba0e76ae9ebee5197"} Jul 25 02:08:50.732908 ip-10-0-129-35 kubenswrapper[2567]: I0725 02:08:50.732827 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-299af2-65d57c848d-p9sbk" event={"ID":"8003b15e-d043-4334-a7a0-a3cd53bd28d9","Type":"ContainerDied","Data":"e23c0d056f694d7c0d1812e271572ea21ae71e8a65b672cc0d65855cf92e441c"} Jul 25 02:08:50.732908 ip-10-0-129-35 kubenswrapper[2567]: I0725 02:08:50.732855 2567 scope.go:117] "RemoveContainer" containerID="49abc71b327dcf678845acba57094e055907fe86676227dba0e76ae9ebee5197" Jul 25 02:08:50.734120 ip-10-0-129-35 kubenswrapper[2567]: I0725 02:08:50.734097 2567 generic.go:356] "Generic (PLEG): container finished" podID="1495beb6-a0be-4300-af70-c4d924859c4b" containerID="59401f86b67da9cb4349c96fe2c7c07721bdc05205e73798f8986a9c5149b5be" exitCode=0 Jul 25 02:08:50.734227 ip-10-0-129-35 kubenswrapper[2567]: I0725 02:08:50.734139 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-299af2-865774ff5d-x572k" Jul 25 02:08:50.734227 ip-10-0-129-35 kubenswrapper[2567]: I0725 02:08:50.734162 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-299af2-865774ff5d-x572k" event={"ID":"1495beb6-a0be-4300-af70-c4d924859c4b","Type":"ContainerDied","Data":"59401f86b67da9cb4349c96fe2c7c07721bdc05205e73798f8986a9c5149b5be"} Jul 25 02:08:50.734227 ip-10-0-129-35 kubenswrapper[2567]: I0725 02:08:50.734217 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-299af2-865774ff5d-x572k" event={"ID":"1495beb6-a0be-4300-af70-c4d924859c4b","Type":"ContainerDied","Data":"5c7aaadbd907220c9227de8b1d54e8a5778a38179f0f5d5cff02575fa5435d40"} Jul 25 02:08:50.741823 ip-10-0-129-35 kubenswrapper[2567]: I0725 02:08:50.741773 2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-t64rk\" (UniqueName: \"kubernetes.io/projected/1495beb6-a0be-4300-af70-c4d924859c4b-kube-api-access-t64rk\") on node \"ip-10-0-129-35.ec2.internal\" DevicePath \"\"" Jul 25 02:08:50.741823 ip-10-0-129-35 kubenswrapper[2567]: I0725 02:08:50.741801 2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-624qt\" (UniqueName: \"kubernetes.io/projected/8003b15e-d043-4334-a7a0-a3cd53bd28d9-kube-api-access-624qt\") on node \"ip-10-0-129-35.ec2.internal\" DevicePath \"\"" Jul 25 02:08:50.741823 ip-10-0-129-35 kubenswrapper[2567]: I0725 02:08:50.741815 2567 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1495beb6-a0be-4300-af70-c4d924859c4b-plugins-config-volume\") on node \"ip-10-0-129-35.ec2.internal\" DevicePath \"\"" Jul 25 02:08:50.742073 ip-10-0-129-35 kubenswrapper[2567]: I0725 02:08:50.742059 2567 scope.go:117] "RemoveContainer" containerID="49abc71b327dcf678845acba57094e055907fe86676227dba0e76ae9ebee5197" Jul 25 02:08:50.742316 ip-10-0-129-35 kubenswrapper[2567]: E0725 02:08:50.742290 2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"49abc71b327dcf678845acba57094e055907fe86676227dba0e76ae9ebee5197\": container with ID starting with 49abc71b327dcf678845acba57094e055907fe86676227dba0e76ae9ebee5197 not found: ID does not exist" containerID="49abc71b327dcf678845acba57094e055907fe86676227dba0e76ae9ebee5197" Jul 25 02:08:50.742430 ip-10-0-129-35 kubenswrapper[2567]: I0725 02:08:50.742316 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"49abc71b327dcf678845acba57094e055907fe86676227dba0e76ae9ebee5197"} err="failed to get container status \"49abc71b327dcf678845acba57094e055907fe86676227dba0e76ae9ebee5197\": rpc error: code = NotFound desc = could not find container \"49abc71b327dcf678845acba57094e055907fe86676227dba0e76ae9ebee5197\": container with ID starting with 49abc71b327dcf678845acba57094e055907fe86676227dba0e76ae9ebee5197 not found: ID does not exist" Jul 25 02:08:50.742430 ip-10-0-129-35 kubenswrapper[2567]: I0725 02:08:50.742333 2567 scope.go:117] "RemoveContainer" containerID="59401f86b67da9cb4349c96fe2c7c07721bdc05205e73798f8986a9c5149b5be" Jul 25 02:08:50.750447 ip-10-0-129-35 kubenswrapper[2567]: I0725 02:08:50.750432 2567 scope.go:117] "RemoveContainer" containerID="59401f86b67da9cb4349c96fe2c7c07721bdc05205e73798f8986a9c5149b5be" Jul 25 02:08:50.750684 ip-10-0-129-35 kubenswrapper[2567]: E0725 02:08:50.750668 2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"59401f86b67da9cb4349c96fe2c7c07721bdc05205e73798f8986a9c5149b5be\": container with ID starting with 59401f86b67da9cb4349c96fe2c7c07721bdc05205e73798f8986a9c5149b5be not found: ID does not exist" containerID="59401f86b67da9cb4349c96fe2c7c07721bdc05205e73798f8986a9c5149b5be" Jul 25 02:08:50.750737 ip-10-0-129-35 kubenswrapper[2567]: I0725 02:08:50.750691 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"59401f86b67da9cb4349c96fe2c7c07721bdc05205e73798f8986a9c5149b5be"} err="failed to get container status \"59401f86b67da9cb4349c96fe2c7c07721bdc05205e73798f8986a9c5149b5be\": rpc error: code = NotFound desc = could not find container \"59401f86b67da9cb4349c96fe2c7c07721bdc05205e73798f8986a9c5149b5be\": container with ID starting with 59401f86b67da9cb4349c96fe2c7c07721bdc05205e73798f8986a9c5149b5be not found: ID does not exist" Jul 25 02:08:50.755938 ip-10-0-129-35 kubenswrapper[2567]: I0725 02:08:50.755920 2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-299af2-865774ff5d-x572k"] Jul 25 02:08:50.759630 ip-10-0-129-35 kubenswrapper[2567]: I0725 02:08:50.759586 2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-299af2-865774ff5d-x572k"] Jul 25 02:08:50.768826 ip-10-0-129-35 kubenswrapper[2567]: I0725 02:08:50.768809 2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-299af2-65d57c848d-p9sbk"] Jul 25 02:08:50.770501 ip-10-0-129-35 kubenswrapper[2567]: I0725 02:08:50.770484 2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-299af2-65d57c848d-p9sbk"] Jul 25 02:08:50.786850 ip-10-0-129-35 kubenswrapper[2567]: I0725 02:08:50.786827 2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1495beb6-a0be-4300-af70-c4d924859c4b" path="/var/lib/kubelet/pods/1495beb6-a0be-4300-af70-c4d924859c4b/volumes" Jul 25 02:08:50.787174 ip-10-0-129-35 kubenswrapper[2567]: I0725 02:08:50.787162 2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8003b15e-d043-4334-a7a0-a3cd53bd28d9" path="/var/lib/kubelet/pods/8003b15e-d043-4334-a7a0-a3cd53bd28d9/volumes" Jul 25 02:08:53.786034 ip-10-0-129-35 kubenswrapper[2567]: I0725 02:08:53.785995 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mlpq2"] Jul 25 02:09:12.377912 ip-10-0-129-35 kubenswrapper[2567]: I0725 02:09:12.377869 2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-ab0ae6-29749080-2l59k"] Jul 25 02:09:12.379690 ip-10-0-129-35 kubenswrapper[2567]: I0725 02:09:12.379668 2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-ab0ae6-29749080-2l59k"] Jul 25 02:09:12.404509 ip-10-0-129-35 kubenswrapper[2567]: I0725 02:09:12.404479 2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-ab0ae6-5dbc87c56-hmkr7"] Jul 25 02:09:12.404784 ip-10-0-129-35 kubenswrapper[2567]: I0725 02:09:12.404734 2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-ab0ae6-5dbc87c56-hmkr7" podUID="25d4dc23-5491-47bc-a2d7-21f6fb9144da" containerName="payload-pre-processing" containerID="cri-o://08c07c06a1f555ffc30beec85c15f2f0f09de99f78ecce682e113668632f9d7b" gracePeriod=30 Jul 25 02:09:12.667263 ip-10-0-129-35 kubenswrapper[2567]: I0725 02:09:12.667239 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-ab0ae6-5dbc87c56-hmkr7" Jul 25 02:09:12.727288 ip-10-0-129-35 kubenswrapper[2567]: I0725 02:09:12.727252 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dt2t7\" (UniqueName: \"kubernetes.io/projected/25d4dc23-5491-47bc-a2d7-21f6fb9144da-kube-api-access-dt2t7\") pod \"25d4dc23-5491-47bc-a2d7-21f6fb9144da\" (UID: \"25d4dc23-5491-47bc-a2d7-21f6fb9144da\") " Jul 25 02:09:12.727492 ip-10-0-129-35 kubenswrapper[2567]: I0725 02:09:12.727443 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/25d4dc23-5491-47bc-a2d7-21f6fb9144da-plugins-config-volume\") pod \"25d4dc23-5491-47bc-a2d7-21f6fb9144da\" (UID: \"25d4dc23-5491-47bc-a2d7-21f6fb9144da\") " Jul 25 02:09:12.727788 ip-10-0-129-35 kubenswrapper[2567]: I0725 02:09:12.727765 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/25d4dc23-5491-47bc-a2d7-21f6fb9144da-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "25d4dc23-5491-47bc-a2d7-21f6fb9144da" (UID: "25d4dc23-5491-47bc-a2d7-21f6fb9144da"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 25 02:09:12.729513 ip-10-0-129-35 kubenswrapper[2567]: I0725 02:09:12.729493 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/25d4dc23-5491-47bc-a2d7-21f6fb9144da-kube-api-access-dt2t7" (OuterVolumeSpecName: "kube-api-access-dt2t7") pod "25d4dc23-5491-47bc-a2d7-21f6fb9144da" (UID: "25d4dc23-5491-47bc-a2d7-21f6fb9144da"). InnerVolumeSpecName "kube-api-access-dt2t7". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 25 02:09:12.787331 ip-10-0-129-35 kubenswrapper[2567]: I0725 02:09:12.787300 2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="afe2c1d1-cd02-47dd-88b0-ba155e79452f" path="/var/lib/kubelet/pods/afe2c1d1-cd02-47dd-88b0-ba155e79452f/volumes" Jul 25 02:09:12.828597 ip-10-0-129-35 kubenswrapper[2567]: I0725 02:09:12.828570 2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dt2t7\" (UniqueName: \"kubernetes.io/projected/25d4dc23-5491-47bc-a2d7-21f6fb9144da-kube-api-access-dt2t7\") on node \"ip-10-0-129-35.ec2.internal\" DevicePath \"\"" Jul 25 02:09:12.828597 ip-10-0-129-35 kubenswrapper[2567]: I0725 02:09:12.828593 2567 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/25d4dc23-5491-47bc-a2d7-21f6fb9144da-plugins-config-volume\") on node \"ip-10-0-129-35.ec2.internal\" DevicePath \"\"" Jul 25 02:09:12.851109 ip-10-0-129-35 kubenswrapper[2567]: I0725 02:09:12.851080 2567 generic.go:356] "Generic (PLEG): container finished" podID="25d4dc23-5491-47bc-a2d7-21f6fb9144da" containerID="08c07c06a1f555ffc30beec85c15f2f0f09de99f78ecce682e113668632f9d7b" exitCode=0 Jul 25 02:09:12.851214 ip-10-0-129-35 kubenswrapper[2567]: I0725 02:09:12.851122 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-ab0ae6-5dbc87c56-hmkr7" Jul 25 02:09:12.851214 ip-10-0-129-35 kubenswrapper[2567]: I0725 02:09:12.851140 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-ab0ae6-5dbc87c56-hmkr7" event={"ID":"25d4dc23-5491-47bc-a2d7-21f6fb9144da","Type":"ContainerDied","Data":"08c07c06a1f555ffc30beec85c15f2f0f09de99f78ecce682e113668632f9d7b"} Jul 25 02:09:12.851214 ip-10-0-129-35 kubenswrapper[2567]: I0725 02:09:12.851188 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-ab0ae6-5dbc87c56-hmkr7" event={"ID":"25d4dc23-5491-47bc-a2d7-21f6fb9144da","Type":"ContainerDied","Data":"b286a2f5ebf4943c90fcf086c20f3fa6d1373441e40322212d04736ea63c6926"} Jul 25 02:09:12.851214 ip-10-0-129-35 kubenswrapper[2567]: I0725 02:09:12.851212 2567 scope.go:117] "RemoveContainer" containerID="08c07c06a1f555ffc30beec85c15f2f0f09de99f78ecce682e113668632f9d7b" Jul 25 02:09:12.860005 ip-10-0-129-35 kubenswrapper[2567]: I0725 02:09:12.859989 2567 scope.go:117] "RemoveContainer" containerID="08c07c06a1f555ffc30beec85c15f2f0f09de99f78ecce682e113668632f9d7b" Jul 25 02:09:12.860268 ip-10-0-129-35 kubenswrapper[2567]: E0725 02:09:12.860250 2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"08c07c06a1f555ffc30beec85c15f2f0f09de99f78ecce682e113668632f9d7b\": container with ID starting with 08c07c06a1f555ffc30beec85c15f2f0f09de99f78ecce682e113668632f9d7b not found: ID does not exist" containerID="08c07c06a1f555ffc30beec85c15f2f0f09de99f78ecce682e113668632f9d7b" Jul 25 02:09:12.860330 ip-10-0-129-35 kubenswrapper[2567]: I0725 02:09:12.860282 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"08c07c06a1f555ffc30beec85c15f2f0f09de99f78ecce682e113668632f9d7b"} err="failed to get container status \"08c07c06a1f555ffc30beec85c15f2f0f09de99f78ecce682e113668632f9d7b\": rpc error: code = NotFound desc = could not find container \"08c07c06a1f555ffc30beec85c15f2f0f09de99f78ecce682e113668632f9d7b\": container with ID starting with 08c07c06a1f555ffc30beec85c15f2f0f09de99f78ecce682e113668632f9d7b not found: ID does not exist" Jul 25 02:09:12.866137 ip-10-0-129-35 kubenswrapper[2567]: I0725 02:09:12.866113 2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-ab0ae6-5dbc87c56-hmkr7"] Jul 25 02:09:12.869498 ip-10-0-129-35 kubenswrapper[2567]: I0725 02:09:12.869478 2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-ab0ae6-5dbc87c56-hmkr7"] Jul 25 02:09:14.787140 ip-10-0-129-35 kubenswrapper[2567]: I0725 02:09:14.787105 2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="25d4dc23-5491-47bc-a2d7-21f6fb9144da" path="/var/lib/kubelet/pods/25d4dc23-5491-47bc-a2d7-21f6fb9144da/volumes" Jul 25 02:09:15.192562 ip-10-0-129-35 kubenswrapper[2567]: I0725 02:09:15.192472 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mlpq2"] Jul 25 02:09:30.543616 ip-10-0-129-35 kubenswrapper[2567]: I0725 02:09:30.543587 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7587ff6c45-nch6b_920dd835-79d2-4e0c-b48b-a44df8036f19/copy-manifests/0.log" Jul 25 02:09:30.550398 ip-10-0-129-35 kubenswrapper[2567]: I0725 02:09:30.550358 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7587ff6c45-nch6b_920dd835-79d2-4e0c-b48b-a44df8036f19/manager/0.log" Jul 25 02:09:33.553853 ip-10-0-129-35 kubenswrapper[2567]: I0725 02:09:33.553825 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-mlpq2_c3034cb0-fae0-409e-9ec4-d8b206e9c8af/limitador/0.log" Jul 25 02:09:34.165047 ip-10-0-129-35 kubenswrapper[2567]: I0725 02:09:34.165017 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-zfw2x_1599c83e-0513-4447-9e7c-db9494241eb3/discovery/0.log" Jul 25 02:09:34.893174 ip-10-0-129-35 kubenswrapper[2567]: I0725 02:09:34.893145 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-54fd59887f-g5zgr_a8cb1021-bc16-4dfc-9252-3773f7aaea5b/router/0.log" Jul 25 02:09:35.478727 ip-10-0-129-35 kubenswrapper[2567]: I0725 02:09:35.478697 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-598466548d-mxg2f_7670bdad-de73-45d6-b243-ff7d1a869ad6/main/0.log" Jul 25 02:09:35.829916 ip-10-0-129-35 kubenswrapper[2567]: I0725 02:09:35.829891 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-57fc66f697-bqrvt_9b8f9103-6f7c-4281-b6cd-dddb4a01c2b4/main/0.log" Jul 25 02:09:43.998824 ip-10-0-129-35 kubenswrapper[2567]: I0725 02:09:43.998792 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-mktch_5ada1026-5182-4a3e-9937-68258c8f240d/global-pull-secret-syncer/0.log" Jul 25 02:09:44.114137 ip-10-0-129-35 kubenswrapper[2567]: I0725 02:09:44.114111 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-t4x2l_506f2c8c-d134-4671-969c-b5d70acadef0/konnectivity-agent/0.log" Jul 25 02:09:44.153819 ip-10-0-129-35 kubenswrapper[2567]: I0725 02:09:44.153789 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-129-35.ec2.internal_edf34879cf3c142ca7dc5154417bf1b1/haproxy/0.log" Jul 25 02:09:49.414794 ip-10-0-129-35 kubenswrapper[2567]: I0725 02:09:49.414768 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-mlpq2_c3034cb0-fae0-409e-9ec4-d8b206e9c8af/limitador/0.log" Jul 25 02:09:51.027351 ip-10-0-129-35 kubenswrapper[2567]: I0725 02:09:51.027315 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_a45440d0-9aaf-45c7-9460-e77558cd671b/alertmanager/0.log" Jul 25 02:09:51.047154 ip-10-0-129-35 kubenswrapper[2567]: I0725 02:09:51.047132 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_a45440d0-9aaf-45c7-9460-e77558cd671b/config-reloader/0.log" Jul 25 02:09:51.069096 ip-10-0-129-35 kubenswrapper[2567]: I0725 02:09:51.069078 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_a45440d0-9aaf-45c7-9460-e77558cd671b/kube-rbac-proxy-web/0.log" Jul 25 02:09:51.088392 ip-10-0-129-35 kubenswrapper[2567]: I0725 02:09:51.088361 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_a45440d0-9aaf-45c7-9460-e77558cd671b/kube-rbac-proxy/0.log" Jul 25 02:09:51.107999 ip-10-0-129-35 kubenswrapper[2567]: I0725 02:09:51.107980 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_a45440d0-9aaf-45c7-9460-e77558cd671b/kube-rbac-proxy-metric/0.log" Jul 25 02:09:51.130081 ip-10-0-129-35 kubenswrapper[2567]: I0725 02:09:51.130060 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_a45440d0-9aaf-45c7-9460-e77558cd671b/prom-label-proxy/0.log" Jul 25 02:09:51.152631 ip-10-0-129-35 kubenswrapper[2567]: I0725 02:09:51.152614 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_a45440d0-9aaf-45c7-9460-e77558cd671b/init-config-reloader/0.log" Jul 25 02:09:51.190740 ip-10-0-129-35 kubenswrapper[2567]: I0725 02:09:51.190718 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-548b489cb8-f5tvk_eecc300f-3388-493d-a229-4ba749887922/cluster-monitoring-operator/0.log" Jul 25 02:09:51.316704 ip-10-0-129-35 kubenswrapper[2567]: I0725 02:09:51.316678 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-78b8677c94-n8q7h_1574c662-782a-499f-8bc4-455489f78954/metrics-server/0.log" Jul 25 02:09:51.395741 ip-10-0-129-35 kubenswrapper[2567]: I0725 02:09:51.395716 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-98zxc_e6618ca2-864b-408a-9825-84057199ae05/node-exporter/0.log" Jul 25 02:09:51.417415 ip-10-0-129-35 kubenswrapper[2567]: I0725 02:09:51.417393 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-98zxc_e6618ca2-864b-408a-9825-84057199ae05/kube-rbac-proxy/0.log" Jul 25 02:09:51.438127 ip-10-0-129-35 kubenswrapper[2567]: I0725 02:09:51.438099 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-98zxc_e6618ca2-864b-408a-9825-84057199ae05/init-textfile/0.log" Jul 25 02:09:51.985631 ip-10-0-129-35 kubenswrapper[2567]: I0725 02:09:51.985602 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-b5b6f7fcb-srjg4_f396f8e1-7b9c-43c9-9229-201466b8b34f/telemeter-client/0.log" Jul 25 02:09:52.010421 ip-10-0-129-35 kubenswrapper[2567]: I0725 02:09:52.010398 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-b5b6f7fcb-srjg4_f396f8e1-7b9c-43c9-9229-201466b8b34f/reload/0.log" Jul 25 02:09:52.037117 ip-10-0-129-35 kubenswrapper[2567]: I0725 02:09:52.037084 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-b5b6f7fcb-srjg4_f396f8e1-7b9c-43c9-9229-201466b8b34f/kube-rbac-proxy/0.log" Jul 25 02:09:52.068958 ip-10-0-129-35 kubenswrapper[2567]: I0725 02:09:52.068936 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-96d97dbb4-6f8rw_7c20369c-7b04-4440-a97f-a0d510443a66/thanos-query/0.log" Jul 25 02:09:52.088692 ip-10-0-129-35 kubenswrapper[2567]: I0725 02:09:52.088672 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-96d97dbb4-6f8rw_7c20369c-7b04-4440-a97f-a0d510443a66/kube-rbac-proxy-web/0.log" Jul 25 02:09:52.107626 ip-10-0-129-35 kubenswrapper[2567]: I0725 02:09:52.107605 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-96d97dbb4-6f8rw_7c20369c-7b04-4440-a97f-a0d510443a66/kube-rbac-proxy/0.log" Jul 25 02:09:52.126134 ip-10-0-129-35 kubenswrapper[2567]: I0725 02:09:52.126111 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-96d97dbb4-6f8rw_7c20369c-7b04-4440-a97f-a0d510443a66/prom-label-proxy/0.log" Jul 25 02:09:52.149911 ip-10-0-129-35 kubenswrapper[2567]: I0725 02:09:52.149887 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-96d97dbb4-6f8rw_7c20369c-7b04-4440-a97f-a0d510443a66/kube-rbac-proxy-rules/0.log" Jul 25 02:09:52.169947 ip-10-0-129-35 kubenswrapper[2567]: I0725 02:09:52.169927 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-96d97dbb4-6f8rw_7c20369c-7b04-4440-a97f-a0d510443a66/kube-rbac-proxy-metrics/0.log" Jul 25 02:09:53.476898 ip-10-0-129-35 kubenswrapper[2567]: I0725 02:09:53.476870 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-74c9f884b7-hnxdh_2a898496-0e3c-490b-94a6-0e05946b0313/networking-console-plugin/0.log" Jul 25 02:09:54.068426 ip-10-0-129-35 kubenswrapper[2567]: I0725 02:09:54.068396 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-s5tbd_a9cb9aa9-8f43-4b32-a7b7-4eb9afb05c90/console-operator/1.log" Jul 25 02:09:54.072623 ip-10-0-129-35 kubenswrapper[2567]: I0725 02:09:54.072599 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-s5tbd_a9cb9aa9-8f43-4b32-a7b7-4eb9afb05c90/console-operator/2.log" Jul 25 02:09:54.262873 ip-10-0-129-35 kubenswrapper[2567]: I0725 02:09:54.262839 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-qpj2w/perf-node-gather-daemonset-6gpdg"] Jul 25 02:09:54.263227 ip-10-0-129-35 kubenswrapper[2567]: I0725 02:09:54.263214 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1495beb6-a0be-4300-af70-c4d924859c4b" containerName="payload-processing" Jul 25 02:09:54.263227 ip-10-0-129-35 kubenswrapper[2567]: I0725 02:09:54.263229 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="1495beb6-a0be-4300-af70-c4d924859c4b" containerName="payload-processing" Jul 25 02:09:54.263319 ip-10-0-129-35 kubenswrapper[2567]: I0725 02:09:54.263236 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="990d6e7f-18b2-42db-a5cf-f86356afad56" containerName="payload-pre-processing" Jul 25 02:09:54.263319 ip-10-0-129-35 kubenswrapper[2567]: I0725 02:09:54.263243 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="990d6e7f-18b2-42db-a5cf-f86356afad56" containerName="payload-pre-processing" Jul 25 02:09:54.263319 ip-10-0-129-35 kubenswrapper[2567]: I0725 02:09:54.263253 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0d10e383-6dce-482b-9ad0-48241de47ace" containerName="revoke-keys" Jul 25 02:09:54.263319 ip-10-0-129-35 kubenswrapper[2567]: I0725 02:09:54.263260 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="0d10e383-6dce-482b-9ad0-48241de47ace" containerName="revoke-keys" Jul 25 02:09:54.263319 ip-10-0-129-35 kubenswrapper[2567]: I0725 02:09:54.263270 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8003b15e-d043-4334-a7a0-a3cd53bd28d9" containerName="payload-pre-processing" Jul 25 02:09:54.263319 ip-10-0-129-35 kubenswrapper[2567]: I0725 02:09:54.263275 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="8003b15e-d043-4334-a7a0-a3cd53bd28d9" containerName="payload-pre-processing" Jul 25 02:09:54.263319 ip-10-0-129-35 kubenswrapper[2567]: I0725 02:09:54.263282 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bd537d3f-6fd4-4a89-9cd8-35279fc6db1a" containerName="payload-pre-processing" Jul 25 02:09:54.263319 ip-10-0-129-35 kubenswrapper[2567]: I0725 02:09:54.263287 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="bd537d3f-6fd4-4a89-9cd8-35279fc6db1a" containerName="payload-pre-processing" Jul 25 02:09:54.263319 ip-10-0-129-35 kubenswrapper[2567]: I0725 02:09:54.263295 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="82ad8f9d-317a-421c-bd32-4e59d194db0b" containerName="payload-processing" Jul 25 02:09:54.263319 ip-10-0-129-35 kubenswrapper[2567]: I0725 02:09:54.263299 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="82ad8f9d-317a-421c-bd32-4e59d194db0b" containerName="payload-processing" Jul 25 02:09:54.263319 ip-10-0-129-35 kubenswrapper[2567]: I0725 02:09:54.263307 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="25d4dc23-5491-47bc-a2d7-21f6fb9144da" containerName="payload-pre-processing" Jul 25 02:09:54.263319 ip-10-0-129-35 kubenswrapper[2567]: I0725 02:09:54.263312 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="25d4dc23-5491-47bc-a2d7-21f6fb9144da" containerName="payload-pre-processing" Jul 25 02:09:54.263319 ip-10-0-129-35 kubenswrapper[2567]: I0725 02:09:54.263319 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="05da5617-9ff9-497c-b28a-2281be693b86" containerName="payload-pre-processing" Jul 25 02:09:54.263319 ip-10-0-129-35 kubenswrapper[2567]: I0725 02:09:54.263324 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="05da5617-9ff9-497c-b28a-2281be693b86" containerName="payload-pre-processing" Jul 25 02:09:54.263778 ip-10-0-129-35 kubenswrapper[2567]: I0725 02:09:54.263329 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="eecb3c1c-cc3c-4a1d-a792-0edcde7c1873" containerName="payload-processing" Jul 25 02:09:54.263778 ip-10-0-129-35 kubenswrapper[2567]: I0725 02:09:54.263335 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="eecb3c1c-cc3c-4a1d-a792-0edcde7c1873" containerName="payload-processing" Jul 25 02:09:54.263778 ip-10-0-129-35 kubenswrapper[2567]: I0725 02:09:54.263341 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8f444b70-c52e-42fe-a6b5-e98d324ad48d" containerName="payload-processing" Jul 25 02:09:54.263778 ip-10-0-129-35 kubenswrapper[2567]: I0725 02:09:54.263346 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="8f444b70-c52e-42fe-a6b5-e98d324ad48d" containerName="payload-processing" Jul 25 02:09:54.263778 ip-10-0-129-35 kubenswrapper[2567]: I0725 02:09:54.263424 2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="8f444b70-c52e-42fe-a6b5-e98d324ad48d" containerName="payload-processing" Jul 25 02:09:54.263778 ip-10-0-129-35 kubenswrapper[2567]: I0725 02:09:54.263431 2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="05da5617-9ff9-497c-b28a-2281be693b86" containerName="payload-pre-processing" Jul 25 02:09:54.263778 ip-10-0-129-35 kubenswrapper[2567]: I0725 02:09:54.263438 2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="990d6e7f-18b2-42db-a5cf-f86356afad56" containerName="payload-pre-processing" Jul 25 02:09:54.263778 ip-10-0-129-35 kubenswrapper[2567]: I0725 02:09:54.263445 2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="8003b15e-d043-4334-a7a0-a3cd53bd28d9" containerName="payload-pre-processing" Jul 25 02:09:54.263778 ip-10-0-129-35 kubenswrapper[2567]: I0725 02:09:54.263450 2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="bd537d3f-6fd4-4a89-9cd8-35279fc6db1a" containerName="payload-pre-processing" Jul 25 02:09:54.263778 ip-10-0-129-35 kubenswrapper[2567]: I0725 02:09:54.263455 2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="0d10e383-6dce-482b-9ad0-48241de47ace" containerName="revoke-keys" Jul 25 02:09:54.263778 ip-10-0-129-35 kubenswrapper[2567]: I0725 02:09:54.263461 2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="eecb3c1c-cc3c-4a1d-a792-0edcde7c1873" containerName="payload-processing" Jul 25 02:09:54.263778 ip-10-0-129-35 kubenswrapper[2567]: I0725 02:09:54.263467 2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="1495beb6-a0be-4300-af70-c4d924859c4b" containerName="payload-processing" Jul 25 02:09:54.263778 ip-10-0-129-35 kubenswrapper[2567]: I0725 02:09:54.263472 2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="25d4dc23-5491-47bc-a2d7-21f6fb9144da" containerName="payload-pre-processing" Jul 25 02:09:54.263778 ip-10-0-129-35 kubenswrapper[2567]: I0725 02:09:54.263477 2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="82ad8f9d-317a-421c-bd32-4e59d194db0b" containerName="payload-processing" Jul 25 02:09:54.266884 ip-10-0-129-35 kubenswrapper[2567]: I0725 02:09:54.266869 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-qpj2w/perf-node-gather-daemonset-6gpdg" Jul 25 02:09:54.269039 ip-10-0-129-35 kubenswrapper[2567]: I0725 02:09:54.269017 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-qpj2w\"/\"kube-root-ca.crt\"" Jul 25 02:09:54.269781 ip-10-0-129-35 kubenswrapper[2567]: I0725 02:09:54.269763 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-qpj2w\"/\"default-dockercfg-b5m6f\"" Jul 25 02:09:54.269781 ip-10-0-129-35 kubenswrapper[2567]: I0725 02:09:54.269766 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-qpj2w\"/\"openshift-service-ca.crt\"" Jul 25 02:09:54.276642 ip-10-0-129-35 kubenswrapper[2567]: I0725 02:09:54.276623 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-qpj2w/perf-node-gather-daemonset-6gpdg"] Jul 25 02:09:54.374035 ip-10-0-129-35 kubenswrapper[2567]: I0725 02:09:54.373966 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/85535c78-a3d2-456f-b2be-29445fc76a8d-lib-modules\") pod \"perf-node-gather-daemonset-6gpdg\" (UID: \"85535c78-a3d2-456f-b2be-29445fc76a8d\") " pod="openshift-must-gather-qpj2w/perf-node-gather-daemonset-6gpdg" Jul 25 02:09:54.374035 ip-10-0-129-35 kubenswrapper[2567]: I0725 02:09:54.374017 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9fhzg\" (UniqueName: \"kubernetes.io/projected/85535c78-a3d2-456f-b2be-29445fc76a8d-kube-api-access-9fhzg\") pod \"perf-node-gather-daemonset-6gpdg\" (UID: \"85535c78-a3d2-456f-b2be-29445fc76a8d\") " pod="openshift-must-gather-qpj2w/perf-node-gather-daemonset-6gpdg" Jul 25 02:09:54.374225 ip-10-0-129-35 kubenswrapper[2567]: I0725 02:09:54.374126 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/85535c78-a3d2-456f-b2be-29445fc76a8d-podres\") pod \"perf-node-gather-daemonset-6gpdg\" (UID: \"85535c78-a3d2-456f-b2be-29445fc76a8d\") " pod="openshift-must-gather-qpj2w/perf-node-gather-daemonset-6gpdg" Jul 25 02:09:54.374225 ip-10-0-129-35 kubenswrapper[2567]: I0725 02:09:54.374166 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/85535c78-a3d2-456f-b2be-29445fc76a8d-sys\") pod \"perf-node-gather-daemonset-6gpdg\" (UID: \"85535c78-a3d2-456f-b2be-29445fc76a8d\") " pod="openshift-must-gather-qpj2w/perf-node-gather-daemonset-6gpdg" Jul 25 02:09:54.374225 ip-10-0-129-35 kubenswrapper[2567]: I0725 02:09:54.374219 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/85535c78-a3d2-456f-b2be-29445fc76a8d-proc\") pod \"perf-node-gather-daemonset-6gpdg\" (UID: \"85535c78-a3d2-456f-b2be-29445fc76a8d\") " pod="openshift-must-gather-qpj2w/perf-node-gather-daemonset-6gpdg" Jul 25 02:09:54.475249 ip-10-0-129-35 kubenswrapper[2567]: I0725 02:09:54.475223 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9fhzg\" (UniqueName: \"kubernetes.io/projected/85535c78-a3d2-456f-b2be-29445fc76a8d-kube-api-access-9fhzg\") pod \"perf-node-gather-daemonset-6gpdg\" (UID: \"85535c78-a3d2-456f-b2be-29445fc76a8d\") " pod="openshift-must-gather-qpj2w/perf-node-gather-daemonset-6gpdg" Jul 25 02:09:54.475418 ip-10-0-129-35 kubenswrapper[2567]: I0725 02:09:54.475285 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/85535c78-a3d2-456f-b2be-29445fc76a8d-podres\") pod \"perf-node-gather-daemonset-6gpdg\" (UID: \"85535c78-a3d2-456f-b2be-29445fc76a8d\") " pod="openshift-must-gather-qpj2w/perf-node-gather-daemonset-6gpdg" Jul 25 02:09:54.475418 ip-10-0-129-35 kubenswrapper[2567]: I0725 02:09:54.475317 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/85535c78-a3d2-456f-b2be-29445fc76a8d-sys\") pod \"perf-node-gather-daemonset-6gpdg\" (UID: \"85535c78-a3d2-456f-b2be-29445fc76a8d\") " pod="openshift-must-gather-qpj2w/perf-node-gather-daemonset-6gpdg" Jul 25 02:09:54.475418 ip-10-0-129-35 kubenswrapper[2567]: I0725 02:09:54.475344 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/85535c78-a3d2-456f-b2be-29445fc76a8d-proc\") pod \"perf-node-gather-daemonset-6gpdg\" (UID: \"85535c78-a3d2-456f-b2be-29445fc76a8d\") " pod="openshift-must-gather-qpj2w/perf-node-gather-daemonset-6gpdg" Jul 25 02:09:54.475593 ip-10-0-129-35 kubenswrapper[2567]: I0725 02:09:54.475433 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/85535c78-a3d2-456f-b2be-29445fc76a8d-lib-modules\") pod \"perf-node-gather-daemonset-6gpdg\" (UID: \"85535c78-a3d2-456f-b2be-29445fc76a8d\") " pod="openshift-must-gather-qpj2w/perf-node-gather-daemonset-6gpdg" Jul 25 02:09:54.475593 ip-10-0-129-35 kubenswrapper[2567]: I0725 02:09:54.475444 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/85535c78-a3d2-456f-b2be-29445fc76a8d-sys\") pod \"perf-node-gather-daemonset-6gpdg\" (UID: \"85535c78-a3d2-456f-b2be-29445fc76a8d\") " pod="openshift-must-gather-qpj2w/perf-node-gather-daemonset-6gpdg" Jul 25 02:09:54.475593 ip-10-0-129-35 kubenswrapper[2567]: I0725 02:09:54.475490 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/85535c78-a3d2-456f-b2be-29445fc76a8d-podres\") pod \"perf-node-gather-daemonset-6gpdg\" (UID: \"85535c78-a3d2-456f-b2be-29445fc76a8d\") " pod="openshift-must-gather-qpj2w/perf-node-gather-daemonset-6gpdg" Jul 25 02:09:54.475593 ip-10-0-129-35 kubenswrapper[2567]: I0725 02:09:54.475534 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/85535c78-a3d2-456f-b2be-29445fc76a8d-proc\") pod \"perf-node-gather-daemonset-6gpdg\" (UID: \"85535c78-a3d2-456f-b2be-29445fc76a8d\") " pod="openshift-must-gather-qpj2w/perf-node-gather-daemonset-6gpdg" Jul 25 02:09:54.475722 ip-10-0-129-35 kubenswrapper[2567]: I0725 02:09:54.475589 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/85535c78-a3d2-456f-b2be-29445fc76a8d-lib-modules\") pod \"perf-node-gather-daemonset-6gpdg\" (UID: \"85535c78-a3d2-456f-b2be-29445fc76a8d\") " pod="openshift-must-gather-qpj2w/perf-node-gather-daemonset-6gpdg" Jul 25 02:09:54.482795 ip-10-0-129-35 kubenswrapper[2567]: I0725 02:09:54.482774 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9fhzg\" (UniqueName: \"kubernetes.io/projected/85535c78-a3d2-456f-b2be-29445fc76a8d-kube-api-access-9fhzg\") pod \"perf-node-gather-daemonset-6gpdg\" (UID: \"85535c78-a3d2-456f-b2be-29445fc76a8d\") " pod="openshift-must-gather-qpj2w/perf-node-gather-daemonset-6gpdg" Jul 25 02:09:54.576923 ip-10-0-129-35 kubenswrapper[2567]: I0725 02:09:54.576900 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-qpj2w/perf-node-gather-daemonset-6gpdg" Jul 25 02:09:54.606117 ip-10-0-129-35 kubenswrapper[2567]: I0725 02:09:54.606100 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-6459ff8c8b-qfbjr_7e8d9bf9-81a6-49f6-8e5b-2973c99284c5/console/0.log" Jul 25 02:09:54.642916 ip-10-0-129-35 kubenswrapper[2567]: I0725 02:09:54.642806 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-7c97dc4555-zkdh8_ada8fa7b-3483-47e1-b9da-2aa44ded12c6/download-server/0.log" Jul 25 02:09:54.712327 ip-10-0-129-35 kubenswrapper[2567]: I0725 02:09:54.712301 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-qpj2w/perf-node-gather-daemonset-6gpdg"] Jul 25 02:09:54.714977 ip-10-0-129-35 kubenswrapper[2567]: W0725 02:09:54.714949 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod85535c78_a3d2_456f_b2be_29445fc76a8d.slice/crio-59fa7aef7abaf4e4cd5ed8211a805619faddd0960ad38ed1dbfbf42826620895 WatchSource:0}: Error finding container 59fa7aef7abaf4e4cd5ed8211a805619faddd0960ad38ed1dbfbf42826620895: Status 404 returned error can't find the container with id 59fa7aef7abaf4e4cd5ed8211a805619faddd0960ad38ed1dbfbf42826620895 Jul 25 02:09:55.060632 ip-10-0-129-35 kubenswrapper[2567]: I0725 02:09:55.060603 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-qpj2w/perf-node-gather-daemonset-6gpdg" event={"ID":"85535c78-a3d2-456f-b2be-29445fc76a8d","Type":"ContainerStarted","Data":"fc7810ba9b919423976dabbdca50de015e4ca2ef3656af229d5558f4052dbda9"} Jul 25 02:09:55.060793 ip-10-0-129-35 kubenswrapper[2567]: I0725 02:09:55.060657 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-qpj2w/perf-node-gather-daemonset-6gpdg" Jul 25 02:09:55.060793 ip-10-0-129-35 kubenswrapper[2567]: I0725 02:09:55.060676 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-qpj2w/perf-node-gather-daemonset-6gpdg" event={"ID":"85535c78-a3d2-456f-b2be-29445fc76a8d","Type":"ContainerStarted","Data":"59fa7aef7abaf4e4cd5ed8211a805619faddd0960ad38ed1dbfbf42826620895"} Jul 25 02:09:55.077904 ip-10-0-129-35 kubenswrapper[2567]: I0725 02:09:55.077853 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-qpj2w/perf-node-gather-daemonset-6gpdg" podStartSLOduration=1.07783695 podStartE2EDuration="1.07783695s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-25 02:09:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-25 02:09:55.075830516 +0000 UTC m=+3480.768924935" watchObservedRunningTime="2026-07-25 02:09:55.07783695 +0000 UTC m=+3480.770931368" Jul 25 02:09:55.170713 ip-10-0-129-35 kubenswrapper[2567]: I0725 02:09:55.170686 2567 scope.go:117] "RemoveContainer" containerID="85a03c8812041b0b0b1c551940345ec78b09e6ae565d9237cb0f7aaa33853f27" Jul 25 02:09:55.305536 ip-10-0-129-35 kubenswrapper[2567]: I0725 02:09:55.305501 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-549c6d54cf-25d96_9706e509-f401-465c-b9e3-4d7495439d6d/volume-data-source-validator/0.log" Jul 25 02:09:56.280961 ip-10-0-129-35 kubenswrapper[2567]: I0725 02:09:56.280931 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-29jjm_59f19017-9df8-47ee-820e-fd8e02c1178f/dns/0.log" Jul 25 02:09:56.301923 ip-10-0-129-35 kubenswrapper[2567]: I0725 02:09:56.301891 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-29jjm_59f19017-9df8-47ee-820e-fd8e02c1178f/kube-rbac-proxy/0.log" Jul 25 02:09:56.407336 ip-10-0-129-35 kubenswrapper[2567]: I0725 02:09:56.407316 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-8cd2m_9ea66485-c377-4229-b4df-c91ec571cca5/dns-node-resolver/0.log" Jul 25 02:09:56.993558 ip-10-0-129-35 kubenswrapper[2567]: I0725 02:09:56.993533 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-c42rd_4a3b7c62-05b6-4e7f-9c84-249de675af87/node-ca/0.log" Jul 25 02:09:58.088649 ip-10-0-129-35 kubenswrapper[2567]: I0725 02:09:58.088625 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-zfw2x_1599c83e-0513-4447-9e7c-db9494241eb3/discovery/0.log" Jul 25 02:09:58.261965 ip-10-0-129-35 kubenswrapper[2567]: I0725 02:09:58.261934 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-54fd59887f-g5zgr_a8cb1021-bc16-4dfc-9252-3773f7aaea5b/router/0.log" Jul 25 02:09:59.040128 ip-10-0-129-35 kubenswrapper[2567]: I0725 02:09:59.040096 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-6qrg6_76e646a1-4d05-4518-8d13-21d3fa3bbf7d/serve-healthcheck-canary/0.log" Jul 25 02:09:59.528417 ip-10-0-129-35 kubenswrapper[2567]: I0725 02:09:59.528322 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5885fdb759-kq9tj_e456d8b2-d6d4-4b00-bc45-e046481d15bb/insights-operator/0.log" Jul 25 02:09:59.529272 ip-10-0-129-35 kubenswrapper[2567]: I0725 02:09:59.529256 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5885fdb759-kq9tj_e456d8b2-d6d4-4b00-bc45-e046481d15bb/insights-operator/1.log" Jul 25 02:09:59.548877 ip-10-0-129-35 kubenswrapper[2567]: I0725 02:09:59.548854 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-hbxst_b3afa3df-a0d8-4cd2-822c-d53a8b33ceaa/kube-rbac-proxy/0.log" Jul 25 02:09:59.571153 ip-10-0-129-35 kubenswrapper[2567]: I0725 02:09:59.571132 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-hbxst_b3afa3df-a0d8-4cd2-822c-d53a8b33ceaa/exporter/0.log" Jul 25 02:09:59.593119 ip-10-0-129-35 kubenswrapper[2567]: I0725 02:09:59.593101 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-hbxst_b3afa3df-a0d8-4cd2-822c-d53a8b33ceaa/extractor/0.log" Jul 25 02:10:01.075212 ip-10-0-129-35 kubenswrapper[2567]: I0725 02:10:01.075189 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-qpj2w/perf-node-gather-daemonset-6gpdg" Jul 25 02:10:02.336000 ip-10-0-129-35 kubenswrapper[2567]: I0725 02:10:02.335973 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7587ff6c45-nch6b_920dd835-79d2-4e0c-b48b-a44df8036f19/manager/0.log" Jul 25 02:10:02.354683 ip-10-0-129-35 kubenswrapper[2567]: I0725 02:10:02.354662 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7587ff6c45-nch6b_920dd835-79d2-4e0c-b48b-a44df8036f19/copy-manifests/0.log" Jul 25 02:10:03.813058 ip-10-0-129-35 kubenswrapper[2567]: I0725 02:10:03.813034 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-6b87879b5d-n88g9_47aa68ac-93b3-4783-8d45-45e747144e70/manager/0.log" Jul 25 02:10:04.734784 ip-10-0-129-35 kubenswrapper[2567]: I0725 02:10:04.734758 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-zfw2x_1599c83e-0513-4447-9e7c-db9494241eb3/discovery/0.log" Jul 25 02:10:04.857134 ip-10-0-129-35 kubenswrapper[2567]: I0725 02:10:04.857111 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-54fd59887f-g5zgr_a8cb1021-bc16-4dfc-9252-3773f7aaea5b/router/0.log" Jul 25 02:10:06.415504 ip-10-0-129-35 kubenswrapper[2567]: I0725 02:10:06.415472 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-zfw2x_1599c83e-0513-4447-9e7c-db9494241eb3/discovery/0.log" Jul 25 02:10:06.544639 ip-10-0-129-35 kubenswrapper[2567]: I0725 02:10:06.544611 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-54fd59887f-g5zgr_a8cb1021-bc16-4dfc-9252-3773f7aaea5b/router/0.log" Jul 25 02:10:09.241265 ip-10-0-129-35 kubenswrapper[2567]: I0725 02:10:09.241234 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-6f4d6fb6bc-27qc8_e1d86a8c-ea94-4770-8136-8448f268d6d1/kube-storage-version-migrator-operator/1.log" Jul 25 02:10:09.242513 ip-10-0-129-35 kubenswrapper[2567]: I0725 02:10:09.242488 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-6f4d6fb6bc-27qc8_e1d86a8c-ea94-4770-8136-8448f268d6d1/kube-storage-version-migrator-operator/0.log" Jul 25 02:10:10.310363 ip-10-0-129-35 kubenswrapper[2567]: I0725 02:10:10.310337 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-llm4x_799cf0dd-1f0a-455f-ac0e-d303f0360de2/kube-multus-additional-cni-plugins/0.log" Jul 25 02:10:10.329788 ip-10-0-129-35 kubenswrapper[2567]: I0725 02:10:10.329759 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-llm4x_799cf0dd-1f0a-455f-ac0e-d303f0360de2/egress-router-binary-copy/0.log" Jul 25 02:10:10.351471 ip-10-0-129-35 kubenswrapper[2567]: I0725 02:10:10.351443 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-llm4x_799cf0dd-1f0a-455f-ac0e-d303f0360de2/cni-plugins/0.log" Jul 25 02:10:10.370930 ip-10-0-129-35 kubenswrapper[2567]: I0725 02:10:10.370899 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-llm4x_799cf0dd-1f0a-455f-ac0e-d303f0360de2/bond-cni-plugin/0.log" Jul 25 02:10:10.397931 ip-10-0-129-35 kubenswrapper[2567]: I0725 02:10:10.397911 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-llm4x_799cf0dd-1f0a-455f-ac0e-d303f0360de2/routeoverride-cni/0.log" Jul 25 02:10:10.416352 ip-10-0-129-35 kubenswrapper[2567]: I0725 02:10:10.416330 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-llm4x_799cf0dd-1f0a-455f-ac0e-d303f0360de2/whereabouts-cni-bincopy/0.log" Jul 25 02:10:10.434554 ip-10-0-129-35 kubenswrapper[2567]: I0725 02:10:10.434528 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-llm4x_799cf0dd-1f0a-455f-ac0e-d303f0360de2/whereabouts-cni/0.log" Jul 25 02:10:10.643664 ip-10-0-129-35 kubenswrapper[2567]: I0725 02:10:10.643585 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-w88gj_3143c435-082e-462b-a075-5f973501e27c/kube-multus/0.log" Jul 25 02:10:10.691059 ip-10-0-129-35 kubenswrapper[2567]: I0725 02:10:10.691032 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-5nl9g_b8bf4790-0739-471e-9b16-1c2e448a8b6a/network-metrics-daemon/0.log" Jul 25 02:10:10.707174 ip-10-0-129-35 kubenswrapper[2567]: I0725 02:10:10.707141 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-5nl9g_b8bf4790-0739-471e-9b16-1c2e448a8b6a/kube-rbac-proxy/0.log"