Jul 05 19:30:33.396258 ip-10-0-133-7 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Jul 05 19:30:33.396270 ip-10-0-133-7 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Jul 05 19:30:33.396277 ip-10-0-133-7 systemd[1]: kubelet.service: Failed with result 'resources'. Jul 05 19:30:33.396588 ip-10-0-133-7 systemd[1]: Failed to start Kubernetes Kubelet. Jul 05 19:30:44.746081 ip-10-0-133-7 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. Jul 05 19:30:44.746101 ip-10-0-133-7 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot 04a8ecb795d1486080b97c8736341426 -- Jul 05 19:32:26.514267 ip-10-0-133-7 systemd[1]: Starting Kubernetes Kubelet... Jul 05 19:32:26.798494 ip-10-0-133-7 kubenswrapper[2572]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 05 19:32:26.798494 ip-10-0-133-7 kubenswrapper[2572]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 05 19:32:26.798494 ip-10-0-133-7 kubenswrapper[2572]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 05 19:32:26.798494 ip-10-0-133-7 kubenswrapper[2572]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 05 19:32:26.798494 ip-10-0-133-7 kubenswrapper[2572]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 05 19:32:26.799184 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:26.798960 2572 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 05 19:32:26.802158 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:32:26.802137 2572 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 05 19:32:26.802158 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:32:26.802156 2572 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 05 19:32:26.802158 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:32:26.802160 2572 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 05 19:32:26.802255 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:32:26.802163 2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 05 19:32:26.802255 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:32:26.802168 2572 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 05 19:32:26.802255 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:32:26.802170 2572 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 05 19:32:26.802255 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:32:26.802173 2572 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 05 19:32:26.802255 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:32:26.802176 2572 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 05 19:32:26.802255 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:32:26.802178 2572 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 05 19:32:26.802255 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:32:26.802181 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 05 19:32:26.802255 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:32:26.802184 2572 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 05 19:32:26.802255 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:32:26.802186 2572 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 05 19:32:26.802255 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:32:26.802189 2572 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 05 19:32:26.802255 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:32:26.802191 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 05 19:32:26.802255 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:32:26.802194 2572 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 05 19:32:26.802255 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:32:26.802196 2572 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 05 19:32:26.802255 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:32:26.802199 2572 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 05 19:32:26.802255 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:32:26.802201 2572 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 05 19:32:26.802255 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:32:26.802204 2572 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 05 19:32:26.802255 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:32:26.802207 2572 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 05 19:32:26.802255 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:32:26.802210 2572 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 05 19:32:26.802255 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:32:26.802212 2572 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 05 19:32:26.802255 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:32:26.802223 2572 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 05 19:32:26.802741 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:32:26.802226 2572 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 05 19:32:26.802741 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:32:26.802228 2572 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 05 19:32:26.802741 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:32:26.802231 2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 05 19:32:26.802741 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:32:26.802233 2572 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 05 19:32:26.802741 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:32:26.802237 2572 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 05 19:32:26.802741 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:32:26.802239 2572 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 05 19:32:26.802741 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:32:26.802241 2572 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 05 19:32:26.802741 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:32:26.802244 2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 05 19:32:26.802741 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:32:26.802246 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 05 19:32:26.802741 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:32:26.802249 2572 feature_gate.go:328] unrecognized feature gate: Example2 Jul 05 19:32:26.802741 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:32:26.802252 2572 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 05 19:32:26.802741 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:32:26.802255 2572 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 05 19:32:26.802741 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:32:26.802258 2572 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 05 19:32:26.802741 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:32:26.802260 2572 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 05 19:32:26.802741 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:32:26.802263 2572 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 05 19:32:26.802741 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:32:26.802268 2572 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 05 19:32:26.802741 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:32:26.802273 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 05 19:32:26.802741 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:32:26.802276 2572 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 05 19:32:26.802741 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:32:26.802279 2572 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 05 19:32:26.803236 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:32:26.802282 2572 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 05 19:32:26.803236 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:32:26.802285 2572 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 05 19:32:26.803236 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:32:26.802287 2572 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 05 19:32:26.803236 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:32:26.802290 2572 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 05 19:32:26.803236 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:32:26.802293 2572 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 05 19:32:26.803236 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:32:26.802295 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 05 19:32:26.803236 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:32:26.802298 2572 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 05 19:32:26.803236 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:32:26.802301 2572 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 05 19:32:26.803236 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:32:26.802303 2572 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 05 19:32:26.803236 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:32:26.802306 2572 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 05 19:32:26.803236 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:32:26.802308 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 05 19:32:26.803236 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:32:26.802311 2572 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 05 19:32:26.803236 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:32:26.802314 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 05 19:32:26.803236 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:32:26.802317 2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 05 19:32:26.803236 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:32:26.802322 2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 05 19:32:26.803236 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:32:26.802325 2572 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 05 19:32:26.803236 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:32:26.802330 2572 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 05 19:32:26.803236 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:32:26.802333 2572 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 05 19:32:26.803236 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:32:26.802336 2572 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 05 19:32:26.803700 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:32:26.802339 2572 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 05 19:32:26.803700 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:32:26.802342 2572 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 05 19:32:26.803700 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:32:26.802346 2572 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 05 19:32:26.803700 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:32:26.802349 2572 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 05 19:32:26.803700 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:32:26.802352 2572 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 05 19:32:26.803700 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:32:26.802354 2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 05 19:32:26.803700 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:32:26.802357 2572 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 05 19:32:26.803700 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:32:26.802359 2572 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 05 19:32:26.803700 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:32:26.802363 2572 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 05 19:32:26.803700 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:32:26.802367 2572 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 05 19:32:26.803700 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:32:26.802370 2572 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 05 19:32:26.803700 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:32:26.802373 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 05 19:32:26.803700 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:32:26.802375 2572 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 05 19:32:26.803700 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:32:26.802378 2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 05 19:32:26.803700 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:32:26.802380 2572 feature_gate.go:328] unrecognized feature gate: Example Jul 05 19:32:26.803700 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:32:26.802383 2572 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 05 19:32:26.803700 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:32:26.802386 2572 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 05 19:32:26.803700 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:32:26.802389 2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 05 19:32:26.803700 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:32:26.802392 2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 05 19:32:26.803700 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:32:26.802394 2572 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 05 19:32:26.804210 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:32:26.802397 2572 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 05 19:32:26.804210 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:32:26.802399 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 05 19:32:26.804210 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:32:26.802402 2572 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 05 19:32:26.804210 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:32:26.802404 2572 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 05 19:32:26.804210 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:32:26.802407 2572 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 05 19:32:26.804210 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:32:26.802409 2572 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 05 19:32:26.804210 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:32:26.802412 2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 05 19:32:26.804210 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:32:26.802415 2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 05 19:32:26.804210 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:32:26.802418 2572 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 05 19:32:26.804210 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:32:26.802421 2572 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 05 19:32:26.804210 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:32:26.802424 2572 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 05 19:32:26.804210 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:32:26.802426 2572 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 05 19:32:26.804210 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:32:26.802429 2572 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 05 19:32:26.804210 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:32:26.802431 2572 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 05 19:32:26.804210 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:32:26.802434 2572 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 05 19:32:26.804210 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:32:26.802437 2572 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 05 19:32:26.804210 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:32:26.802440 2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 05 19:32:26.804210 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:32:26.802442 2572 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 05 19:32:26.804210 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:32:26.803151 2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 05 19:32:26.804705 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:32:26.803158 2572 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 05 19:32:26.804705 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:32:26.803161 2572 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 05 19:32:26.804705 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:32:26.803164 2572 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 05 19:32:26.804705 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:32:26.803167 2572 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 05 19:32:26.804705 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:32:26.803170 2572 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 05 19:32:26.804705 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:32:26.803174 2572 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 05 19:32:26.804705 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:32:26.803178 2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 05 19:32:26.804705 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:32:26.803181 2572 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 05 19:32:26.804705 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:32:26.803185 2572 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 05 19:32:26.804705 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:32:26.803188 2572 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 05 19:32:26.804705 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:32:26.803190 2572 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 05 19:32:26.804705 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:32:26.803193 2572 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 05 19:32:26.804705 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:32:26.803196 2572 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 05 19:32:26.804705 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:32:26.803199 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 05 19:32:26.804705 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:32:26.803201 2572 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 05 19:32:26.804705 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:32:26.803204 2572 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 05 19:32:26.804705 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:32:26.803207 2572 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 05 19:32:26.804705 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:32:26.803210 2572 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 05 19:32:26.804705 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:32:26.803213 2572 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 05 19:32:26.805236 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:32:26.803215 2572 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 05 19:32:26.805236 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:32:26.803219 2572 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 05 19:32:26.805236 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:32:26.803222 2572 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 05 19:32:26.805236 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:32:26.803225 2572 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 05 19:32:26.805236 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:32:26.803229 2572 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 05 19:32:26.805236 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:32:26.803232 2572 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 05 19:32:26.805236 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:32:26.803236 2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 05 19:32:26.805236 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:32:26.803239 2572 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 05 19:32:26.805236 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:32:26.803242 2572 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 05 19:32:26.805236 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:32:26.803245 2572 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 05 19:32:26.805236 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:32:26.803248 2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 05 19:32:26.805236 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:32:26.803251 2572 feature_gate.go:328] unrecognized feature gate: Example2 Jul 05 19:32:26.805236 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:32:26.803254 2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 05 19:32:26.805236 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:32:26.803256 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 05 19:32:26.805236 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:32:26.803260 2572 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 05 19:32:26.805236 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:32:26.803263 2572 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 05 19:32:26.805236 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:32:26.803265 2572 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 05 19:32:26.805236 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:32:26.803268 2572 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 05 19:32:26.805236 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:32:26.803271 2572 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 05 19:32:26.805715 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:32:26.803273 2572 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 05 19:32:26.805715 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:32:26.803276 2572 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 05 19:32:26.805715 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:32:26.803278 2572 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 05 19:32:26.805715 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:32:26.803281 2572 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 05 19:32:26.805715 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:32:26.803284 2572 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 05 19:32:26.805715 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:32:26.803286 2572 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 05 19:32:26.805715 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:32:26.803289 2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 05 19:32:26.805715 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:32:26.803292 2572 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 05 19:32:26.805715 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:32:26.803295 2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 05 19:32:26.805715 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:32:26.803297 2572 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 05 19:32:26.805715 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:32:26.803300 2572 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 05 19:32:26.805715 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:32:26.803303 2572 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 05 19:32:26.805715 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:32:26.803307 2572 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 05 19:32:26.805715 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:32:26.803311 2572 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 05 19:32:26.805715 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:32:26.803314 2572 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 05 19:32:26.805715 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:32:26.803317 2572 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 05 19:32:26.805715 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:32:26.803320 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 05 19:32:26.805715 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:32:26.803322 2572 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 05 19:32:26.805715 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:32:26.803325 2572 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 05 19:32:26.806195 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:32:26.803327 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 05 19:32:26.806195 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:32:26.803330 2572 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 05 19:32:26.806195 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:32:26.803333 2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 05 19:32:26.806195 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:32:26.803336 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 05 19:32:26.806195 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:32:26.803339 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 05 19:32:26.806195 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:32:26.803341 2572 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 05 19:32:26.806195 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:32:26.803344 2572 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 05 19:32:26.806195 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:32:26.803348 2572 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 05 19:32:26.806195 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:32:26.803350 2572 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 05 19:32:26.806195 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:32:26.803353 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 05 19:32:26.806195 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:32:26.803355 2572 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 05 19:32:26.806195 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:32:26.803358 2572 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 05 19:32:26.806195 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:32:26.803361 2572 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 05 19:32:26.806195 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:32:26.803363 2572 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 05 19:32:26.806195 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:32:26.803366 2572 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 05 19:32:26.806195 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:32:26.803368 2572 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 05 19:32:26.806195 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:32:26.803371 2572 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 05 19:32:26.806195 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:32:26.803373 2572 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 05 19:32:26.806195 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:32:26.803376 2572 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 05 19:32:26.806195 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:32:26.803378 2572 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 05 19:32:26.806681 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:32:26.803381 2572 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 05 19:32:26.806681 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:32:26.803387 2572 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 05 19:32:26.806681 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:32:26.803392 2572 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 05 19:32:26.806681 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:32:26.803395 2572 feature_gate.go:328] unrecognized feature gate: Example Jul 05 19:32:26.806681 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:32:26.803398 2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 05 19:32:26.806681 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:32:26.803400 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 05 19:32:26.806681 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:32:26.803403 2572 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 05 19:32:26.806681 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:32:26.803406 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 05 19:32:26.806681 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:32:26.803409 2572 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 05 19:32:26.806681 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:32:26.803411 2572 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 05 19:32:26.806681 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:32:26.803414 2572 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 05 19:32:26.806681 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:32:26.803417 2572 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 05 19:32:26.806681 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:32:26.803420 2572 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 05 19:32:26.806681 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:32:26.803422 2572 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 05 19:32:26.806681 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:32:26.803425 2572 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 05 19:32:26.806681 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:32:26.803427 2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 05 19:32:26.806681 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:32:26.803430 2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 05 19:32:26.806681 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:32:26.803433 2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 05 19:32:26.806681 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:32:26.803435 2572 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 05 19:32:26.806681 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:32:26.803438 2572 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 05 19:32:26.807198 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:32:26.803440 2572 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 05 19:32:26.807198 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:32:26.803834 2572 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 05 19:32:26.807198 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:32:26.803840 2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 05 19:32:26.807198 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:32:26.803843 2572 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 05 19:32:26.807198 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:32:26.803846 2572 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 05 19:32:26.807198 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:32:26.803849 2572 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 05 19:32:26.807198 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:32:26.803851 2572 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 05 19:32:26.807198 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:32:26.803854 2572 feature_gate.go:328] unrecognized feature gate: Example2 Jul 05 19:32:26.807198 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:32:26.803857 2572 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 05 19:32:26.807198 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:32:26.803860 2572 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 05 19:32:26.807198 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:32:26.803862 2572 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 05 19:32:26.807198 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:32:26.803865 2572 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 05 19:32:26.807198 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:32:26.803868 2572 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 05 19:32:26.807198 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:32:26.803871 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 05 19:32:26.807198 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:32:26.803876 2572 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 05 19:32:26.807198 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:32:26.803879 2572 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 05 19:32:26.807198 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:32:26.803881 2572 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 05 19:32:26.807198 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:32:26.803884 2572 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 05 19:32:26.807198 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:32:26.803887 2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 05 19:32:26.807198 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:32:26.803890 2572 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 05 19:32:26.807690 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:32:26.803892 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 05 19:32:26.807690 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:32:26.803895 2572 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 05 19:32:26.807690 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:32:26.803898 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 05 19:32:26.807690 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:32:26.803900 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 05 19:32:26.807690 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:32:26.803903 2572 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 05 19:32:26.807690 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:32:26.803905 2572 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 05 19:32:26.807690 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:32:26.803908 2572 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 05 19:32:26.807690 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:32:26.803910 2572 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 05 19:32:26.807690 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:32:26.803915 2572 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 05 19:32:26.807690 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:32:26.803919 2572 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 05 19:32:26.807690 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:32:26.803922 2572 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 05 19:32:26.807690 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:32:26.803925 2572 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 05 19:32:26.807690 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:32:26.803928 2572 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 05 19:32:26.807690 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:32:26.803930 2572 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 05 19:32:26.807690 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:32:26.803933 2572 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 05 19:32:26.807690 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:32:26.803936 2572 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 05 19:32:26.807690 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:32:26.803938 2572 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 05 19:32:26.807690 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:32:26.803941 2572 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 05 19:32:26.807690 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:32:26.803944 2572 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 05 19:32:26.808161 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:32:26.803962 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 05 19:32:26.808161 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:32:26.803964 2572 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 05 19:32:26.808161 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:32:26.803967 2572 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 05 19:32:26.808161 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:32:26.803969 2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 05 19:32:26.808161 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:32:26.803973 2572 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 05 19:32:26.808161 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:32:26.803976 2572 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 05 19:32:26.808161 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:32:26.803979 2572 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 05 19:32:26.808161 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:32:26.803985 2572 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 05 19:32:26.808161 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:32:26.803987 2572 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 05 19:32:26.808161 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:32:26.803990 2572 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 05 19:32:26.808161 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:32:26.803992 2572 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 05 19:32:26.808161 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:32:26.803995 2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 05 19:32:26.808161 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:32:26.803998 2572 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 05 19:32:26.808161 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:32:26.804001 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 05 19:32:26.808161 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:32:26.804003 2572 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 05 19:32:26.808161 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:32:26.804006 2572 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 05 19:32:26.808161 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:32:26.804008 2572 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 05 19:32:26.808161 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:32:26.804011 2572 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 05 19:32:26.808161 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:32:26.804013 2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 05 19:32:26.808161 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:32:26.804016 2572 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 05 19:32:26.808626 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:32:26.804018 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 05 19:32:26.808626 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:32:26.804021 2572 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 05 19:32:26.808626 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:32:26.804023 2572 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 05 19:32:26.808626 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:32:26.804026 2572 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 05 19:32:26.808626 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:32:26.804029 2572 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 05 19:32:26.808626 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:32:26.804031 2572 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 05 19:32:26.808626 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:32:26.804034 2572 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 05 19:32:26.808626 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:32:26.804036 2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 05 19:32:26.808626 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:32:26.804039 2572 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 05 19:32:26.808626 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:32:26.804041 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 05 19:32:26.808626 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:32:26.804044 2572 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 05 19:32:26.808626 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:32:26.804046 2572 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 05 19:32:26.808626 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:32:26.804049 2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 05 19:32:26.808626 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:32:26.804052 2572 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 05 19:32:26.808626 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:32:26.804054 2572 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 05 19:32:26.808626 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:32:26.804056 2572 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 05 19:32:26.808626 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:32:26.804059 2572 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 05 19:32:26.808626 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:32:26.804062 2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 05 19:32:26.808626 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:32:26.804064 2572 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 05 19:32:26.808626 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:32:26.804068 2572 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 05 19:32:26.809121 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:32:26.804071 2572 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 05 19:32:26.809121 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:32:26.804074 2572 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 05 19:32:26.809121 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:32:26.804076 2572 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 05 19:32:26.809121 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:32:26.804079 2572 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 05 19:32:26.809121 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:32:26.804083 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 05 19:32:26.809121 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:32:26.804085 2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 05 19:32:26.809121 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:32:26.804089 2572 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 05 19:32:26.809121 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:32:26.804093 2572 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 05 19:32:26.809121 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:32:26.804096 2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 05 19:32:26.809121 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:32:26.804099 2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 05 19:32:26.809121 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:32:26.804102 2572 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 05 19:32:26.809121 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:32:26.804105 2572 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 05 19:32:26.809121 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:32:26.804107 2572 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 05 19:32:26.809121 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:32:26.804110 2572 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 05 19:32:26.809121 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:32:26.804112 2572 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 05 19:32:26.809121 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:32:26.804115 2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 05 19:32:26.809121 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:32:26.804118 2572 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 05 19:32:26.809121 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:32:26.804120 2572 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 05 19:32:26.809121 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:32:26.804123 2572 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 05 19:32:26.809578 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:32:26.804125 2572 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 05 19:32:26.809578 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:32:26.804128 2572 feature_gate.go:328] unrecognized feature gate: Example Jul 05 19:32:26.809578 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:26.804206 2572 flags.go:64] FLAG: --address="0.0.0.0" Jul 05 19:32:26.809578 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:26.804214 2572 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 05 19:32:26.809578 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:26.804220 2572 flags.go:64] FLAG: --anonymous-auth="true" Jul 05 19:32:26.809578 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:26.804239 2572 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 05 19:32:26.809578 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:26.804245 2572 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 05 19:32:26.809578 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:26.804250 2572 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 05 19:32:26.809578 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:26.804256 2572 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 05 19:32:26.809578 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:26.804263 2572 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 05 19:32:26.809578 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:26.804266 2572 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 05 19:32:26.809578 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:26.804269 2572 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 05 19:32:26.809578 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:26.804274 2572 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 05 19:32:26.809578 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:26.804277 2572 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 05 19:32:26.809578 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:26.804283 2572 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 05 19:32:26.809578 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:26.804286 2572 flags.go:64] FLAG: --cgroup-root="" Jul 05 19:32:26.809578 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:26.804289 2572 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 05 19:32:26.809578 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:26.804293 2572 flags.go:64] FLAG: --client-ca-file="" Jul 05 19:32:26.809578 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:26.804296 2572 flags.go:64] FLAG: --cloud-provider="external" Jul 05 19:32:26.809578 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:26.804299 2572 flags.go:64] FLAG: --cluster-dns="[]" Jul 05 19:32:26.809578 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:26.804303 2572 flags.go:64] FLAG: --cluster-domain="" Jul 05 19:32:26.809578 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:26.804306 2572 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 05 19:32:26.809578 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:26.804309 2572 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 05 19:32:26.809578 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:26.804312 2572 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 05 19:32:26.810170 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:26.804316 2572 flags.go:64] FLAG: --container-log-max-files="5" Jul 05 19:32:26.810170 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:26.804320 2572 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 05 19:32:26.810170 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:26.804323 2572 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 05 19:32:26.810170 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:26.804326 2572 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 05 19:32:26.810170 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:26.804329 2572 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 05 19:32:26.810170 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:26.804333 2572 flags.go:64] FLAG: --contention-profiling="false" Jul 05 19:32:26.810170 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:26.804336 2572 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 05 19:32:26.810170 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:26.804339 2572 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 05 19:32:26.810170 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:26.804342 2572 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 05 19:32:26.810170 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:26.804345 2572 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 05 19:32:26.810170 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:26.804349 2572 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 05 19:32:26.810170 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:26.804352 2572 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 05 19:32:26.810170 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:26.804355 2572 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 05 19:32:26.810170 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:26.804358 2572 flags.go:64] FLAG: --enable-load-reader="false" Jul 05 19:32:26.810170 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:26.804361 2572 flags.go:64] FLAG: --enable-server="true" Jul 05 19:32:26.810170 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:26.804364 2572 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 05 19:32:26.810170 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:26.804369 2572 flags.go:64] FLAG: --event-burst="100" Jul 05 19:32:26.810170 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:26.804372 2572 flags.go:64] FLAG: --event-qps="50" Jul 05 19:32:26.810170 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:26.804375 2572 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 05 19:32:26.810170 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:26.804378 2572 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 05 19:32:26.810170 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:26.804383 2572 flags.go:64] FLAG: --eviction-hard="" Jul 05 19:32:26.810170 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:26.804387 2572 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 05 19:32:26.810170 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:26.804390 2572 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 05 19:32:26.810170 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:26.804394 2572 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 05 19:32:26.810170 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:26.804397 2572 flags.go:64] FLAG: --eviction-soft="" Jul 05 19:32:26.810793 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:26.804400 2572 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 05 19:32:26.810793 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:26.804403 2572 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 05 19:32:26.810793 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:26.804406 2572 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 05 19:32:26.810793 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:26.804409 2572 flags.go:64] FLAG: --experimental-mounter-path="" Jul 05 19:32:26.810793 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:26.804412 2572 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 05 19:32:26.810793 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:26.804415 2572 flags.go:64] FLAG: --fail-swap-on="true" Jul 05 19:32:26.810793 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:26.804418 2572 flags.go:64] FLAG: --feature-gates="" Jul 05 19:32:26.810793 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:26.804421 2572 flags.go:64] FLAG: --file-check-frequency="20s" Jul 05 19:32:26.810793 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:26.804424 2572 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 05 19:32:26.810793 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:26.804427 2572 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 05 19:32:26.810793 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:26.804430 2572 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 05 19:32:26.810793 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:26.804433 2572 flags.go:64] FLAG: --healthz-port="10248" Jul 05 19:32:26.810793 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:26.804437 2572 flags.go:64] FLAG: --help="false" Jul 05 19:32:26.810793 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:26.804439 2572 flags.go:64] FLAG: --hostname-override="ip-10-0-133-7.ec2.internal" Jul 05 19:32:26.810793 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:26.804442 2572 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 05 19:32:26.810793 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:26.804445 2572 flags.go:64] FLAG: --http-check-frequency="20s" Jul 05 19:32:26.810793 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:26.804448 2572 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 05 19:32:26.810793 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:26.804452 2572 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 05 19:32:26.810793 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:26.804455 2572 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 05 19:32:26.810793 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:26.804458 2572 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 05 19:32:26.810793 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:26.804461 2572 flags.go:64] FLAG: --image-service-endpoint="" Jul 05 19:32:26.810793 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:26.804464 2572 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 05 19:32:26.810793 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:26.804466 2572 flags.go:64] FLAG: --kube-api-burst="100" Jul 05 19:32:26.811402 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:26.804469 2572 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 05 19:32:26.811402 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:26.804472 2572 flags.go:64] FLAG: --kube-api-qps="50" Jul 05 19:32:26.811402 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:26.804475 2572 flags.go:64] FLAG: --kube-reserved="" Jul 05 19:32:26.811402 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:26.804478 2572 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 05 19:32:26.811402 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:26.804482 2572 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 05 19:32:26.811402 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:26.804486 2572 flags.go:64] FLAG: --kubelet-cgroups="" Jul 05 19:32:26.811402 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:26.804488 2572 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 05 19:32:26.811402 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:26.804491 2572 flags.go:64] FLAG: --lock-file="" Jul 05 19:32:26.811402 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:26.804495 2572 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 05 19:32:26.811402 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:26.804498 2572 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 05 19:32:26.811402 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:26.804502 2572 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 05 19:32:26.811402 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:26.804507 2572 flags.go:64] FLAG: --log-json-split-stream="false" Jul 05 19:32:26.811402 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:26.804510 2572 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 05 19:32:26.811402 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:26.804513 2572 flags.go:64] FLAG: --log-text-split-stream="false" Jul 05 19:32:26.811402 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:26.804516 2572 flags.go:64] FLAG: --logging-format="text" Jul 05 19:32:26.811402 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:26.804519 2572 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 05 19:32:26.811402 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:26.804522 2572 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 05 19:32:26.811402 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:26.804525 2572 flags.go:64] FLAG: --manifest-url="" Jul 05 19:32:26.811402 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:26.804528 2572 flags.go:64] FLAG: --manifest-url-header="" Jul 05 19:32:26.811402 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:26.804533 2572 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 05 19:32:26.811402 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:26.804536 2572 flags.go:64] FLAG: --max-open-files="1000000" Jul 05 19:32:26.811402 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:26.804540 2572 flags.go:64] FLAG: --max-pods="110" Jul 05 19:32:26.811402 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:26.804543 2572 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 05 19:32:26.811402 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:26.804546 2572 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 05 19:32:26.811402 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:26.804549 2572 flags.go:64] FLAG: --memory-manager-policy="None" Jul 05 19:32:26.812051 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:26.804552 2572 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 05 19:32:26.812051 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:26.804555 2572 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 05 19:32:26.812051 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:26.804558 2572 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 05 19:32:26.812051 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:26.804561 2572 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 05 19:32:26.812051 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:26.804569 2572 flags.go:64] FLAG: --node-status-max-images="50" Jul 05 19:32:26.812051 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:26.804572 2572 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 05 19:32:26.812051 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:26.804575 2572 flags.go:64] FLAG: --oom-score-adj="-999" Jul 05 19:32:26.812051 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:26.804578 2572 flags.go:64] FLAG: --pod-cidr="" Jul 05 19:32:26.812051 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:26.804582 2572 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ce93f6b4197b9c62a26a3131f8057ffe9c9379c5079a4f62e5919b75151394e5" Jul 05 19:32:26.812051 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:26.804587 2572 flags.go:64] FLAG: --pod-manifest-path="" Jul 05 19:32:26.812051 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:26.804591 2572 flags.go:64] FLAG: --pod-max-pids="-1" Jul 05 19:32:26.812051 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:26.804594 2572 flags.go:64] FLAG: --pods-per-core="0" Jul 05 19:32:26.812051 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:26.804598 2572 flags.go:64] FLAG: --port="10250" Jul 05 19:32:26.812051 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:26.804601 2572 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 05 19:32:26.812051 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:26.804604 2572 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-079174c0fb3636d8a" Jul 05 19:32:26.812051 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:26.804608 2572 flags.go:64] FLAG: --qos-reserved="" Jul 05 19:32:26.812051 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:26.804611 2572 flags.go:64] FLAG: --read-only-port="10255" Jul 05 19:32:26.812051 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:26.804614 2572 flags.go:64] FLAG: --register-node="true" Jul 05 19:32:26.812051 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:26.804617 2572 flags.go:64] FLAG: --register-with-taints="" Jul 05 19:32:26.812051 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:26.804621 2572 flags.go:64] FLAG: --registry-burst="10" Jul 05 19:32:26.812051 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:26.804624 2572 flags.go:64] FLAG: --registry-qps="5" Jul 05 19:32:26.812051 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:26.804627 2572 flags.go:64] FLAG: --reserved-cpus="" Jul 05 19:32:26.812051 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:26.804630 2572 flags.go:64] FLAG: --reserved-memory="" Jul 05 19:32:26.812051 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:26.804633 2572 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 05 19:32:26.812051 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:26.804637 2572 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 05 19:32:26.812662 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:26.804640 2572 flags.go:64] FLAG: --rotate-certificates="false" Jul 05 19:32:26.812662 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:26.804643 2572 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 05 19:32:26.812662 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:26.804646 2572 flags.go:64] FLAG: --runonce="false" Jul 05 19:32:26.812662 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:26.804648 2572 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 05 19:32:26.812662 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:26.804651 2572 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 05 19:32:26.812662 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:26.804654 2572 flags.go:64] FLAG: --seccomp-default="false" Jul 05 19:32:26.812662 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:26.804657 2572 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 05 19:32:26.812662 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:26.804660 2572 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 05 19:32:26.812662 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:26.804663 2572 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 05 19:32:26.812662 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:26.804666 2572 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 05 19:32:26.812662 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:26.804669 2572 flags.go:64] FLAG: --storage-driver-password="root" Jul 05 19:32:26.812662 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:26.804672 2572 flags.go:64] FLAG: --storage-driver-secure="false" Jul 05 19:32:26.812662 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:26.804676 2572 flags.go:64] FLAG: --storage-driver-table="stats" Jul 05 19:32:26.812662 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:26.804679 2572 flags.go:64] FLAG: --storage-driver-user="root" Jul 05 19:32:26.812662 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:26.804682 2572 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 05 19:32:26.812662 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:26.804734 2572 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 05 19:32:26.812662 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:26.804739 2572 flags.go:64] FLAG: --system-cgroups="" Jul 05 19:32:26.812662 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:26.804742 2572 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 05 19:32:26.812662 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:26.804748 2572 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 05 19:32:26.812662 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:26.804751 2572 flags.go:64] FLAG: --tls-cert-file="" Jul 05 19:32:26.812662 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:26.804755 2572 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 05 19:32:26.812662 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:26.804759 2572 flags.go:64] FLAG: --tls-min-version="" Jul 05 19:32:26.812662 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:26.804762 2572 flags.go:64] FLAG: --tls-private-key-file="" Jul 05 19:32:26.812662 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:26.804767 2572 flags.go:64] FLAG: --topology-manager-policy="none" Jul 05 19:32:26.812662 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:26.804771 2572 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 05 19:32:26.813284 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:26.804774 2572 flags.go:64] FLAG: --topology-manager-scope="container" Jul 05 19:32:26.813284 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:26.804777 2572 flags.go:64] FLAG: --v="2" Jul 05 19:32:26.813284 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:26.804781 2572 flags.go:64] FLAG: --version="false" Jul 05 19:32:26.813284 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:26.804786 2572 flags.go:64] FLAG: --vmodule="" Jul 05 19:32:26.813284 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:26.804790 2572 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 05 19:32:26.813284 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:26.804793 2572 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 05 19:32:26.813284 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:32:26.804923 2572 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 05 19:32:26.813284 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:32:26.804928 2572 feature_gate.go:328] unrecognized feature gate: Example2 Jul 05 19:32:26.813284 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:32:26.804931 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 05 19:32:26.813284 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:32:26.804934 2572 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 05 19:32:26.813284 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:32:26.804936 2572 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 05 19:32:26.813284 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:32:26.804939 2572 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 05 19:32:26.813284 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:32:26.804942 2572 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 05 19:32:26.813284 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:32:26.804958 2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 05 19:32:26.813284 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:32:26.804962 2572 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 05 19:32:26.813284 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:32:26.804964 2572 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 05 19:32:26.813284 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:32:26.804967 2572 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 05 19:32:26.813284 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:32:26.804970 2572 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 05 19:32:26.813284 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:32:26.804973 2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 05 19:32:26.813284 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:32:26.804976 2572 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 05 19:32:26.813284 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:32:26.804979 2572 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 05 19:32:26.813798 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:32:26.804981 2572 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 05 19:32:26.813798 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:32:26.804984 2572 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 05 19:32:26.813798 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:32:26.804987 2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 05 19:32:26.813798 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:32:26.804990 2572 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 05 19:32:26.813798 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:32:26.804993 2572 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 05 19:32:26.813798 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:32:26.804995 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 05 19:32:26.813798 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:32:26.804998 2572 feature_gate.go:328] unrecognized feature gate: Example Jul 05 19:32:26.813798 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:32:26.805000 2572 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 05 19:32:26.813798 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:32:26.805003 2572 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 05 19:32:26.813798 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:32:26.805008 2572 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 05 19:32:26.813798 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:32:26.805011 2572 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 05 19:32:26.813798 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:32:26.805015 2572 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 05 19:32:26.813798 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:32:26.805018 2572 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 05 19:32:26.813798 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:32:26.805021 2572 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 05 19:32:26.813798 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:32:26.805023 2572 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 05 19:32:26.813798 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:32:26.805026 2572 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 05 19:32:26.813798 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:32:26.805028 2572 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 05 19:32:26.813798 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:32:26.805031 2572 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 05 19:32:26.813798 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:32:26.805034 2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 05 19:32:26.813798 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:32:26.805036 2572 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 05 19:32:26.814352 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:32:26.805039 2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 05 19:32:26.814352 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:32:26.805041 2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 05 19:32:26.814352 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:32:26.805044 2572 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 05 19:32:26.814352 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:32:26.805047 2572 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 05 19:32:26.814352 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:32:26.805049 2572 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 05 19:32:26.814352 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:32:26.805052 2572 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 05 19:32:26.814352 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:32:26.805055 2572 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 05 19:32:26.814352 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:32:26.805057 2572 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 05 19:32:26.814352 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:32:26.805061 2572 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 05 19:32:26.814352 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:32:26.805063 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 05 19:32:26.814352 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:32:26.805066 2572 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 05 19:32:26.814352 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:32:26.805069 2572 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 05 19:32:26.814352 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:32:26.805071 2572 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 05 19:32:26.814352 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:32:26.805074 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 05 19:32:26.814352 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:32:26.805077 2572 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 05 19:32:26.814352 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:32:26.805079 2572 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 05 19:32:26.814352 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:32:26.805082 2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 05 19:32:26.814352 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:32:26.805085 2572 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 05 19:32:26.814352 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:32:26.805087 2572 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 05 19:32:26.814352 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:32:26.805090 2572 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 05 19:32:26.814844 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:32:26.805094 2572 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 05 19:32:26.814844 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:32:26.805100 2572 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 05 19:32:26.814844 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:32:26.805103 2572 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 05 19:32:26.814844 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:32:26.805107 2572 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 05 19:32:26.814844 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:32:26.805111 2572 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 05 19:32:26.814844 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:32:26.805114 2572 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 05 19:32:26.814844 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:32:26.805117 2572 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 05 19:32:26.814844 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:32:26.805121 2572 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 05 19:32:26.814844 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:32:26.805124 2572 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 05 19:32:26.814844 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:32:26.805127 2572 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 05 19:32:26.814844 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:32:26.805130 2572 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 05 19:32:26.814844 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:32:26.805134 2572 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 05 19:32:26.814844 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:32:26.805137 2572 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 05 19:32:26.814844 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:32:26.805140 2572 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 05 19:32:26.814844 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:32:26.805143 2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 05 19:32:26.814844 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:32:26.805146 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 05 19:32:26.814844 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:32:26.805148 2572 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 05 19:32:26.814844 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:32:26.805151 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 05 19:32:26.814844 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:32:26.805153 2572 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 05 19:32:26.815338 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:32:26.805156 2572 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 05 19:32:26.815338 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:32:26.805159 2572 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 05 19:32:26.815338 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:32:26.805162 2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 05 19:32:26.815338 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:32:26.805164 2572 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 05 19:32:26.815338 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:32:26.805167 2572 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 05 19:32:26.815338 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:32:26.805169 2572 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 05 19:32:26.815338 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:32:26.805172 2572 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 05 19:32:26.815338 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:32:26.805175 2572 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 05 19:32:26.815338 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:32:26.805178 2572 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 05 19:32:26.815338 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:32:26.805180 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 05 19:32:26.815338 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:32:26.805183 2572 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 05 19:32:26.815338 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:32:26.805185 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 05 19:32:26.815338 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:32:26.805188 2572 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 05 19:32:26.815338 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:32:26.805191 2572 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 05 19:32:26.815338 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:32:26.805195 2572 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 05 19:32:26.815338 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:32:26.805198 2572 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 05 19:32:26.815338 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:32:26.805201 2572 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 05 19:32:26.815338 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:32:26.805203 2572 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 05 19:32:26.815338 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:32:26.805206 2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 05 19:32:26.815338 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:32:26.805209 2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 05 19:32:26.815831 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:32:26.805211 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 05 19:32:26.815831 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:32:26.805214 2572 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 05 19:32:26.815831 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:32:26.805216 2572 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 05 19:32:26.815831 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:32:26.805220 2572 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 05 19:32:26.815831 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:32:26.805223 2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 05 19:32:26.815831 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:26.805636 2572 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 05 19:32:26.815831 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:26.812113 2572 server.go:529] "Kubelet version" kubeletVersion="v1.34.8" Jul 05 19:32:26.815831 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:26.812137 2572 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 05 19:32:26.815831 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:26.812160 2572 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 05 19:32:26.815831 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:26.812170 2572 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 05 19:32:26.815831 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:32:26.812232 2572 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 05 19:32:26.815831 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:32:26.812238 2572 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 05 19:32:26.815831 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:32:26.812241 2572 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 05 19:32:26.815831 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:32:26.812245 2572 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 05 19:32:26.816236 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:32:26.812248 2572 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 05 19:32:26.816236 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:32:26.812250 2572 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 05 19:32:26.816236 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:32:26.812253 2572 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 05 19:32:26.816236 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:32:26.812256 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 05 19:32:26.816236 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:32:26.812259 2572 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 05 19:32:26.816236 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:32:26.812262 2572 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 05 19:32:26.816236 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:32:26.812264 2572 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 05 19:32:26.816236 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:32:26.812267 2572 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 05 19:32:26.816236 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:32:26.812270 2572 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 05 19:32:26.816236 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:32:26.812273 2572 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 05 19:32:26.816236 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:32:26.812276 2572 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 05 19:32:26.816236 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:32:26.812281 2572 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 05 19:32:26.816236 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:32:26.812285 2572 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 05 19:32:26.816236 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:32:26.812288 2572 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 05 19:32:26.816236 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:32:26.812291 2572 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 05 19:32:26.816236 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:32:26.812294 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 05 19:32:26.816236 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:32:26.812297 2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 05 19:32:26.816236 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:32:26.812299 2572 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 05 19:32:26.816236 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:32:26.812302 2572 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 05 19:32:26.816236 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:32:26.812304 2572 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 05 19:32:26.816717 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:32:26.812307 2572 feature_gate.go:328] unrecognized feature gate: Example Jul 05 19:32:26.816717 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:32:26.812310 2572 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 05 19:32:26.816717 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:32:26.812314 2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 05 19:32:26.816717 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:32:26.812318 2572 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 05 19:32:26.816717 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:32:26.812321 2572 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 05 19:32:26.816717 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:32:26.812326 2572 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 05 19:32:26.816717 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:32:26.812330 2572 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 05 19:32:26.816717 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:32:26.812333 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 05 19:32:26.816717 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:32:26.812336 2572 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 05 19:32:26.816717 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:32:26.812339 2572 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 05 19:32:26.816717 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:32:26.812342 2572 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 05 19:32:26.816717 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:32:26.812345 2572 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 05 19:32:26.816717 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:32:26.812348 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 05 19:32:26.816717 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:32:26.812351 2572 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 05 19:32:26.816717 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:32:26.812354 2572 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 05 19:32:26.816717 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:32:26.812357 2572 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 05 19:32:26.816717 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:32:26.812360 2572 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 05 19:32:26.816717 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:32:26.812363 2572 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 05 19:32:26.816717 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:32:26.812365 2572 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 05 19:32:26.817185 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:32:26.812368 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 05 19:32:26.817185 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:32:26.812371 2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 05 19:32:26.817185 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:32:26.812376 2572 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 05 19:32:26.817185 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:32:26.812380 2572 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 05 19:32:26.817185 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:32:26.812383 2572 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 05 19:32:26.817185 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:32:26.812386 2572 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 05 19:32:26.817185 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:32:26.812388 2572 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 05 19:32:26.817185 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:32:26.812391 2572 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 05 19:32:26.817185 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:32:26.812394 2572 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 05 19:32:26.817185 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:32:26.812396 2572 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 05 19:32:26.817185 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:32:26.812400 2572 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 05 19:32:26.817185 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:32:26.812402 2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 05 19:32:26.817185 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:32:26.812405 2572 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 05 19:32:26.817185 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:32:26.812408 2572 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 05 19:32:26.817185 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:32:26.812412 2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 05 19:32:26.817185 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:32:26.812415 2572 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 05 19:32:26.817185 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:32:26.812418 2572 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 05 19:32:26.817185 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:32:26.812421 2572 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 05 19:32:26.817185 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:32:26.812425 2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 05 19:32:26.817185 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:32:26.812428 2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 05 19:32:26.817661 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:32:26.812431 2572 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 05 19:32:26.817661 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:32:26.812433 2572 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 05 19:32:26.817661 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:32:26.812436 2572 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 05 19:32:26.817661 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:32:26.812439 2572 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 05 19:32:26.817661 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:32:26.812441 2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 05 19:32:26.817661 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:32:26.812444 2572 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 05 19:32:26.817661 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:32:26.812446 2572 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 05 19:32:26.817661 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:32:26.812449 2572 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 05 19:32:26.817661 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:32:26.812452 2572 feature_gate.go:328] unrecognized feature gate: Example2 Jul 05 19:32:26.817661 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:32:26.812454 2572 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 05 19:32:26.817661 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:32:26.812457 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 05 19:32:26.817661 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:32:26.812459 2572 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 05 19:32:26.817661 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:32:26.812462 2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 05 19:32:26.817661 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:32:26.812464 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 05 19:32:26.817661 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:32:26.812467 2572 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 05 19:32:26.817661 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:32:26.812470 2572 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 05 19:32:26.817661 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:32:26.812473 2572 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 05 19:32:26.817661 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:32:26.812475 2572 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 05 19:32:26.817661 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:32:26.812478 2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 05 19:32:26.817661 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:32:26.812481 2572 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 05 19:32:26.818507 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:32:26.812483 2572 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 05 19:32:26.818507 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:32:26.812487 2572 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 05 19:32:26.818507 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:32:26.812490 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 05 19:32:26.818507 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:32:26.812492 2572 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 05 19:32:26.818507 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:32:26.812495 2572 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 05 19:32:26.818507 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:32:26.812498 2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 05 19:32:26.818507 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:32:26.812501 2572 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 05 19:32:26.818507 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:32:26.812503 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 05 19:32:26.818507 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:32:26.812506 2572 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 05 19:32:26.818507 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:32:26.812509 2572 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 05 19:32:26.818507 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:32:26.812512 2572 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 05 19:32:26.818507 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:32:26.812514 2572 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 05 19:32:26.818507 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:32:26.812518 2572 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 05 19:32:26.818507 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:32:26.812521 2572 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 05 19:32:26.818507 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:32:26.812523 2572 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 05 19:32:26.818507 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:32:26.812526 2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 05 19:32:26.818911 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:26.812531 2572 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 05 19:32:26.818911 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:32:26.812659 2572 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 05 19:32:26.818911 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:32:26.812665 2572 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 05 19:32:26.818911 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:32:26.812669 2572 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 05 19:32:26.818911 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:32:26.812672 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 05 19:32:26.818911 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:32:26.812675 2572 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 05 19:32:26.818911 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:32:26.812678 2572 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 05 19:32:26.818911 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:32:26.812681 2572 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 05 19:32:26.818911 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:32:26.812684 2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 05 19:32:26.818911 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:32:26.812687 2572 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 05 19:32:26.818911 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:32:26.812690 2572 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 05 19:32:26.818911 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:32:26.812693 2572 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 05 19:32:26.818911 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:32:26.812696 2572 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 05 19:32:26.818911 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:32:26.812699 2572 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 05 19:32:26.818911 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:32:26.812701 2572 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 05 19:32:26.819336 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:32:26.812704 2572 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 05 19:32:26.819336 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:32:26.812707 2572 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 05 19:32:26.819336 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:32:26.812709 2572 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 05 19:32:26.819336 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:32:26.812712 2572 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 05 19:32:26.819336 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:32:26.812715 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 05 19:32:26.819336 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:32:26.812717 2572 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 05 19:32:26.819336 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:32:26.812720 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 05 19:32:26.819336 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:32:26.812723 2572 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 05 19:32:26.819336 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:32:26.812727 2572 feature_gate.go:328] unrecognized feature gate: Example2 Jul 05 19:32:26.819336 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:32:26.812730 2572 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 05 19:32:26.819336 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:32:26.812732 2572 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 05 19:32:26.819336 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:32:26.812736 2572 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 05 19:32:26.819336 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:32:26.812739 2572 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 05 19:32:26.819336 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:32:26.812741 2572 feature_gate.go:328] unrecognized feature gate: Example Jul 05 19:32:26.819336 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:32:26.812745 2572 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 05 19:32:26.819336 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:32:26.812748 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 05 19:32:26.819336 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:32:26.812750 2572 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 05 19:32:26.819336 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:32:26.812753 2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 05 19:32:26.819336 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:32:26.812755 2572 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 05 19:32:26.819336 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:32:26.812758 2572 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 05 19:32:26.819914 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:32:26.812761 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 05 19:32:26.819914 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:32:26.812764 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 05 19:32:26.819914 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:32:26.812766 2572 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 05 19:32:26.819914 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:32:26.812769 2572 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 05 19:32:26.819914 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:32:26.812772 2572 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 05 19:32:26.819914 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:32:26.812774 2572 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 05 19:32:26.819914 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:32:26.812777 2572 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 05 19:32:26.819914 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:32:26.812780 2572 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 05 19:32:26.819914 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:32:26.812782 2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 05 19:32:26.819914 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:32:26.812785 2572 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 05 19:32:26.819914 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:32:26.812788 2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 05 19:32:26.819914 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:32:26.812790 2572 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 05 19:32:26.819914 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:32:26.812793 2572 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 05 19:32:26.819914 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:32:26.812796 2572 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 05 19:32:26.819914 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:32:26.812798 2572 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 05 19:32:26.819914 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:32:26.812801 2572 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 05 19:32:26.819914 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:32:26.812804 2572 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 05 19:32:26.819914 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:32:26.812807 2572 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 05 19:32:26.819914 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:32:26.812809 2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 05 19:32:26.819914 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:32:26.812812 2572 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 05 19:32:26.820453 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:32:26.812815 2572 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 05 19:32:26.820453 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:32:26.812818 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 05 19:32:26.820453 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:32:26.812820 2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 05 19:32:26.820453 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:32:26.812823 2572 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 05 19:32:26.820453 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:32:26.812826 2572 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 05 19:32:26.820453 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:32:26.812829 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 05 19:32:26.820453 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:32:26.812831 2572 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 05 19:32:26.820453 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:32:26.812834 2572 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 05 19:32:26.820453 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:32:26.812837 2572 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 05 19:32:26.820453 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:32:26.812841 2572 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 05 19:32:26.820453 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:32:26.812845 2572 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 05 19:32:26.820453 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:32:26.812849 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 05 19:32:26.820453 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:32:26.812853 2572 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 05 19:32:26.820453 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:32:26.812856 2572 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 05 19:32:26.820453 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:32:26.812858 2572 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 05 19:32:26.820453 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:32:26.812861 2572 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 05 19:32:26.820453 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:32:26.812864 2572 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 05 19:32:26.820453 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:32:26.812867 2572 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 05 19:32:26.820453 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:32:26.812869 2572 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 05 19:32:26.821013 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:32:26.812872 2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 05 19:32:26.821013 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:32:26.812874 2572 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 05 19:32:26.821013 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:32:26.812877 2572 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 05 19:32:26.821013 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:32:26.812879 2572 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 05 19:32:26.821013 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:32:26.812882 2572 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 05 19:32:26.821013 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:32:26.812885 2572 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 05 19:32:26.821013 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:32:26.812887 2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 05 19:32:26.821013 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:32:26.812890 2572 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 05 19:32:26.821013 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:32:26.812893 2572 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 05 19:32:26.821013 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:32:26.812895 2572 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 05 19:32:26.821013 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:32:26.812898 2572 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 05 19:32:26.821013 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:32:26.812901 2572 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 05 19:32:26.821013 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:32:26.812904 2572 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 05 19:32:26.821013 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:32:26.812906 2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 05 19:32:26.821013 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:32:26.812909 2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 05 19:32:26.821013 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:32:26.812912 2572 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 05 19:32:26.821013 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:32:26.812914 2572 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 05 19:32:26.821013 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:32:26.812917 2572 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 05 19:32:26.821013 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:32:26.812920 2572 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 05 19:32:26.821013 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:32:26.812922 2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 05 19:32:26.821775 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:32:26.812926 2572 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 05 19:32:26.821775 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:32:26.812930 2572 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 05 19:32:26.821775 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:32:26.812933 2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 05 19:32:26.821775 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:32:26.812936 2572 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 05 19:32:26.821775 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:32:26.812939 2572 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 05 19:32:26.821775 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:32:26.812941 2572 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 05 19:32:26.821775 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:26.812960 2572 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 05 19:32:26.821775 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:26.813100 2572 server.go:962] "Client rotation is on, will bootstrap in background" Jul 05 19:32:26.821775 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:26.815004 2572 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 05 19:32:26.821775 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:26.815999 2572 server.go:1019] "Starting client certificate rotation" Jul 05 19:32:26.821775 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:26.816100 2572 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 05 19:32:26.821775 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:26.816133 2572 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 05 19:32:26.821775 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:26.817918 2572 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 05 19:32:26.823155 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:26.823133 2572 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 05 19:32:26.829657 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:26.829638 2572 log.go:25] "Validated CRI v1 runtime API" Jul 05 19:32:26.832883 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:26.832865 2572 log.go:25] "Validated CRI v1 image API" Jul 05 19:32:26.833723 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:26.833701 2572 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 05 19:32:26.836798 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:26.836772 2572 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 9cc7160d-27fd-45f5-b246-0f71b7351e0c:/dev/nvme0n1p4 dd100fb0-69f9-4c2a-8d52-6e6c99576b5d:/dev/nvme0n1p3] Jul 05 19:32:26.836858 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:26.836798 2572 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 05 19:32:26.842041 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:26.841872 2572 manager.go:216] Machine: {Timestamp:2026-07-05 19:32:26.840715963 +0000 UTC m=+0.240063422 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3104585 MemoryCapacity:33164500992 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2c340a6f78bffec0c4746925c787c3 SystemUUID:ec2c340a-6f78-bffe-c0c4-746925c787c3 BootID:04a8ecb7-95d1-4860-80b9-7c8736341426 Filesystems:[{Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582250496 Type:vfs Inodes:4048401 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:3d:cf:e2:47:4b Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:3d:cf:e2:47:4b Speed:0 Mtu:9001} {Name:ovs-system MacAddress:e2:fd:e3:3f:f0:d6 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164500992 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 05 19:32:26.842041 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:26.842027 2572 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 05 19:32:26.842173 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:26.842122 2572 manager.go:232] Version: {KernelVersion:5.14.0-570.125.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260630-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 05 19:32:26.843540 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:26.843506 2572 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 05 19:32:26.843729 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:26.843543 2572 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-133-7.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 05 19:32:26.843793 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:26.843768 2572 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 05 19:32:26.844902 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:26.844888 2572 topology_manager.go:138] "Creating topology manager with none policy" Jul 05 19:32:26.844987 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:26.844907 2572 container_manager_linux.go:309] "Creating device plugin manager" Jul 05 19:32:26.844987 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:26.844920 2572 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 05 19:32:26.845432 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:26.845420 2572 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 05 19:32:26.846381 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:26.846370 2572 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 05 19:32:26.850059 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:26.850037 2572 state_mem.go:36] "Initialized new in-memory state store" Jul 05 19:32:26.850277 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:26.850264 2572 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 05 19:32:26.850336 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:26.850306 2572 kubelet.go:486] "Attempting to sync node with API server" Jul 05 19:32:26.850336 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:26.850322 2572 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 05 19:32:26.850431 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:26.850337 2572 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 05 19:32:26.850431 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:26.850352 2572 kubelet.go:398] "Adding apiserver pod source" Jul 05 19:32:26.850431 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:26.850363 2572 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 05 19:32:26.850769 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:26.850755 2572 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 05 19:32:26.850831 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:26.850778 2572 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 05 19:32:26.852440 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:26.852422 2572 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1" Jul 05 19:32:26.853973 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:26.853937 2572 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 05 19:32:26.854020 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:26.853988 2572 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 05 19:32:26.854856 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:26.854844 2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 05 19:32:26.854903 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:26.854861 2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 05 19:32:26.854903 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:26.854867 2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 05 19:32:26.854903 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:26.854872 2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 05 19:32:26.854903 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:26.854881 2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 05 19:32:26.854903 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:26.854886 2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 05 19:32:26.854903 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:26.854895 2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 05 19:32:26.854903 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:26.854901 2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 05 19:32:26.855097 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:26.854907 2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 05 19:32:26.855097 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:26.854921 2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 05 19:32:26.855097 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:26.854933 2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 05 19:32:26.855097 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:26.854939 2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 05 19:32:26.855580 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:26.855569 2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 05 19:32:26.855580 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:26.855579 2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 05 19:32:26.858881 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:26.858857 2572 server.go:1268] "Started kubelet" Jul 05 19:32:26.859031 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:26.858962 2572 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 05 19:32:26.859031 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:26.858936 2572 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 05 19:32:26.859131 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:26.859032 2572 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 05 19:32:26.859731 ip-10-0-133-7 systemd[1]: Started Kubernetes Kubelet. Jul 05 19:32:26.862353 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:26.862324 2572 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 05 19:32:26.864435 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:26.864414 2572 server.go:310] "Adding debug handlers to kubelet server" Jul 05 19:32:26.865247 ip-10-0-133-7 kubenswrapper[2572]: E0705 19:32:26.865214 2572 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-133-7.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 05 19:32:26.865333 ip-10-0-133-7 kubenswrapper[2572]: E0705 19:32:26.865228 2572 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 05 19:32:26.865333 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:26.865311 2572 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-133-7.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 05 19:32:26.866978 ip-10-0-133-7 kubenswrapper[2572]: E0705 19:32:26.866926 2572 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 05 19:32:26.868587 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:26.868572 2572 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 05 19:32:26.868660 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:26.868589 2572 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 05 19:32:26.868760 ip-10-0-133-7 kubenswrapper[2572]: E0705 19:32:26.868708 2572 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-7.ec2.internal\" not found" Jul 05 19:32:26.869049 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:26.869030 2572 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 05 19:32:26.869175 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:26.869058 2572 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 05 19:32:26.869175 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:26.869029 2572 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 05 19:32:26.869284 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:26.869189 2572 reconstruct.go:97] "Volume reconstruction finished" Jul 05 19:32:26.869284 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:26.869198 2572 reconciler.go:29] "Reconciler: start to sync state" Jul 05 19:32:26.869617 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:26.869566 2572 factory.go:55] Registering systemd factory Jul 05 19:32:26.869617 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:26.869578 2572 factory.go:223] Registration of the systemd container factory successfully Jul 05 19:32:26.869842 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:26.869827 2572 factory.go:153] Registering CRI-O factory Jul 05 19:32:26.869913 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:26.869845 2572 factory.go:223] Registration of the crio container factory successfully Jul 05 19:32:26.869913 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:26.869896 2572 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 05 19:32:26.870021 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:26.869922 2572 factory.go:103] Registering Raw factory Jul 05 19:32:26.870021 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:26.869937 2572 manager.go:1196] Started watching for new ooms in manager Jul 05 19:32:26.870448 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:26.870434 2572 manager.go:349] Starting recovery of all containers Jul 05 19:32:26.877117 ip-10-0-133-7 kubenswrapper[2572]: E0705 19:32:26.877086 2572 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jul 05 19:32:26.877213 ip-10-0-133-7 kubenswrapper[2572]: E0705 19:32:26.877180 2572 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-133-7.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jul 05 19:32:26.878081 ip-10-0-133-7 kubenswrapper[2572]: E0705 19:32:26.877247 2572 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-133-7.ec2.internal.18bf7ba9d79907fd default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-133-7.ec2.internal,UID:ip-10-0-133-7.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-133-7.ec2.internal,},FirstTimestamp:2026-07-05 19:32:26.858825725 +0000 UTC m=+0.258173230,LastTimestamp:2026-07-05 19:32:26.858825725 +0000 UTC m=+0.258173230,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-133-7.ec2.internal,}" Jul 05 19:32:26.880591 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:26.880578 2572 manager.go:354] Recovery completed Jul 05 19:32:26.884494 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:26.884476 2572 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 05 19:32:26.886417 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:26.886399 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-7.ec2.internal" event="NodeHasSufficientMemory" Jul 05 19:32:26.886500 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:26.886436 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-7.ec2.internal" event="NodeHasNoDiskPressure" Jul 05 19:32:26.886500 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:26.886451 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-7.ec2.internal" event="NodeHasSufficientPID" Jul 05 19:32:26.887167 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:26.887153 2572 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 05 19:32:26.887167 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:26.887165 2572 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 05 19:32:26.887260 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:26.887181 2572 state_mem.go:36] "Initialized new in-memory state store" Jul 05 19:32:26.887260 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:26.887166 2572 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 05 19:32:26.887965 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:26.887938 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-7.ec2.internal" event="NodeHasSufficientMemory" Jul 05 19:32:26.888024 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:26.888005 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-7.ec2.internal" event="NodeHasNoDiskPressure" Jul 05 19:32:26.888024 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:26.888017 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-7.ec2.internal" event="NodeHasSufficientPID" Jul 05 19:32:26.889419 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:26.889404 2572 policy_none.go:49] "None policy: Start" Jul 05 19:32:26.889490 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:26.889438 2572 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 05 19:32:26.889490 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:26.889452 2572 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 05 19:32:26.889559 ip-10-0-133-7 kubenswrapper[2572]: E0705 19:32:26.889438 2572 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-133-7.ec2.internal.18bf7ba9d93e0d16 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-133-7.ec2.internal,UID:ip-10-0-133-7.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-133-7.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-133-7.ec2.internal,},FirstTimestamp:2026-07-05 19:32:26.886417686 +0000 UTC m=+0.285765145,LastTimestamp:2026-07-05 19:32:26.886417686 +0000 UTC m=+0.285765145,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-133-7.ec2.internal,}" Jul 05 19:32:26.891616 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:26.891474 2572 policy_none.go:47] "Start" Jul 05 19:32:26.895868 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:26.895849 2572 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-sjsjx" Jul 05 19:32:26.898010 ip-10-0-133-7 kubenswrapper[2572]: E0705 19:32:26.897920 2572 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-133-7.ec2.internal.18bf7ba9d93e6f38 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-133-7.ec2.internal,UID:ip-10-0-133-7.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-133-7.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-133-7.ec2.internal,},FirstTimestamp:2026-07-05 19:32:26.886442808 +0000 UTC m=+0.285790273,LastTimestamp:2026-07-05 19:32:26.886442808 +0000 UTC m=+0.285790273,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-133-7.ec2.internal,}" Jul 05 19:32:26.900635 ip-10-0-133-7 kubenswrapper[2572]: E0705 19:32:26.900569 2572 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-133-7.ec2.internal.18bf7ba9d93ea464 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-133-7.ec2.internal,UID:ip-10-0-133-7.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-133-7.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-133-7.ec2.internal,},FirstTimestamp:2026-07-05 19:32:26.88645642 +0000 UTC m=+0.285803878,LastTimestamp:2026-07-05 19:32:26.88645642 +0000 UTC m=+0.285803878,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-133-7.ec2.internal,}" Jul 05 19:32:26.903277 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:26.903258 2572 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-sjsjx" Jul 05 19:32:26.933671 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:26.933651 2572 manager.go:337] "Starting Device Plugin manager" Jul 05 19:32:26.933796 ip-10-0-133-7 kubenswrapper[2572]: E0705 19:32:26.933701 2572 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 05 19:32:26.933796 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:26.933712 2572 server.go:87] "Starting device plugin registration server" Jul 05 19:32:26.934036 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:26.934024 2572 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 05 19:32:26.934092 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:26.934041 2572 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 05 19:32:26.934152 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:26.934136 2572 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 05 19:32:26.934221 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:26.934211 2572 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 05 19:32:26.934265 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:26.934222 2572 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 05 19:32:26.934817 ip-10-0-133-7 kubenswrapper[2572]: E0705 19:32:26.934794 2572 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 05 19:32:26.934891 ip-10-0-133-7 kubenswrapper[2572]: E0705 19:32:26.934852 2572 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-133-7.ec2.internal\" not found" Jul 05 19:32:26.955034 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:26.954994 2572 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 05 19:32:26.968123 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:26.956161 2572 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 05 19:32:26.968123 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:26.956197 2572 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 05 19:32:26.968123 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:26.956222 2572 kubelet.go:2448] "Starting kubelet main sync loop" Jul 05 19:32:26.968123 ip-10-0-133-7 kubenswrapper[2572]: E0705 19:32:26.956261 2572 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jul 05 19:32:26.968123 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:26.958615 2572 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 05 19:32:27.034942 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:27.034900 2572 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 05 19:32:27.035990 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:27.035973 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-7.ec2.internal" event="NodeHasSufficientMemory" Jul 05 19:32:27.036063 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:27.036007 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-7.ec2.internal" event="NodeHasNoDiskPressure" Jul 05 19:32:27.036063 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:27.036022 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-7.ec2.internal" event="NodeHasSufficientPID" Jul 05 19:32:27.036063 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:27.036053 2572 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-133-7.ec2.internal" Jul 05 19:32:27.045434 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:27.045412 2572 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-133-7.ec2.internal" Jul 05 19:32:27.045511 ip-10-0-133-7 kubenswrapper[2572]: E0705 19:32:27.045444 2572 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-133-7.ec2.internal\": node \"ip-10-0-133-7.ec2.internal\" not found" Jul 05 19:32:27.057177 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:27.057087 2572 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-7.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-133-7.ec2.internal"] Jul 05 19:32:27.057323 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:27.057184 2572 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 05 19:32:27.058525 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:27.058501 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-7.ec2.internal" event="NodeHasSufficientMemory" Jul 05 19:32:27.058664 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:27.058545 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-7.ec2.internal" event="NodeHasNoDiskPressure" Jul 05 19:32:27.058664 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:27.058559 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-7.ec2.internal" event="NodeHasSufficientPID" Jul 05 19:32:27.061241 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:27.061218 2572 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 05 19:32:27.061369 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:27.061299 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-7.ec2.internal" Jul 05 19:32:27.061369 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:27.061343 2572 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 05 19:32:27.062097 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:27.062079 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-7.ec2.internal" event="NodeHasSufficientMemory" Jul 05 19:32:27.062200 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:27.062113 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-7.ec2.internal" event="NodeHasNoDiskPressure" Jul 05 19:32:27.062200 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:27.062128 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-7.ec2.internal" event="NodeHasSufficientPID" Jul 05 19:32:27.062200 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:27.062078 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-7.ec2.internal" event="NodeHasSufficientMemory" Jul 05 19:32:27.062200 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:27.062188 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-7.ec2.internal" event="NodeHasNoDiskPressure" Jul 05 19:32:27.062200 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:27.062201 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-7.ec2.internal" event="NodeHasSufficientPID" Jul 05 19:32:27.064737 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:27.064718 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-7.ec2.internal" Jul 05 19:32:27.064835 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:27.064753 2572 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 05 19:32:27.065585 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:27.065565 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-7.ec2.internal" event="NodeHasSufficientMemory" Jul 05 19:32:27.065676 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:27.065593 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-7.ec2.internal" event="NodeHasNoDiskPressure" Jul 05 19:32:27.065676 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:27.065603 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-7.ec2.internal" event="NodeHasSufficientPID" Jul 05 19:32:27.073382 ip-10-0-133-7 kubenswrapper[2572]: E0705 19:32:27.073357 2572 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-7.ec2.internal\" not found" Jul 05 19:32:27.092209 ip-10-0-133-7 kubenswrapper[2572]: E0705 19:32:27.092178 2572 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-133-7.ec2.internal\" not found" node="ip-10-0-133-7.ec2.internal" Jul 05 19:32:27.097365 ip-10-0-133-7 kubenswrapper[2572]: E0705 19:32:27.097340 2572 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-133-7.ec2.internal\" not found" node="ip-10-0-133-7.ec2.internal" Jul 05 19:32:27.170325 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:27.170287 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/e2bff7cbf82451b4333adfc3db2c0112-config\") pod \"kube-apiserver-proxy-ip-10-0-133-7.ec2.internal\" (UID: \"e2bff7cbf82451b4333adfc3db2c0112\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-133-7.ec2.internal" Jul 05 19:32:27.170325 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:27.170326 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/89a0e5a37365a0cf71513576d558545d-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-133-7.ec2.internal\" (UID: \"89a0e5a37365a0cf71513576d558545d\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-7.ec2.internal" Jul 05 19:32:27.170549 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:27.170354 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/89a0e5a37365a0cf71513576d558545d-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-133-7.ec2.internal\" (UID: \"89a0e5a37365a0cf71513576d558545d\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-7.ec2.internal" Jul 05 19:32:27.173603 ip-10-0-133-7 kubenswrapper[2572]: E0705 19:32:27.173578 2572 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-7.ec2.internal\" not found" Jul 05 19:32:27.271920 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:27.271886 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/e2bff7cbf82451b4333adfc3db2c0112-config\") pod \"kube-apiserver-proxy-ip-10-0-133-7.ec2.internal\" (UID: \"e2bff7cbf82451b4333adfc3db2c0112\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-133-7.ec2.internal" Jul 05 19:32:27.271920 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:27.271829 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/e2bff7cbf82451b4333adfc3db2c0112-config\") pod \"kube-apiserver-proxy-ip-10-0-133-7.ec2.internal\" (UID: \"e2bff7cbf82451b4333adfc3db2c0112\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-133-7.ec2.internal" Jul 05 19:32:27.272119 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:27.271948 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/89a0e5a37365a0cf71513576d558545d-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-133-7.ec2.internal\" (UID: \"89a0e5a37365a0cf71513576d558545d\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-7.ec2.internal" Jul 05 19:32:27.272119 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:27.272047 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/89a0e5a37365a0cf71513576d558545d-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-133-7.ec2.internal\" (UID: \"89a0e5a37365a0cf71513576d558545d\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-7.ec2.internal" Jul 05 19:32:27.272119 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:27.272021 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/89a0e5a37365a0cf71513576d558545d-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-133-7.ec2.internal\" (UID: \"89a0e5a37365a0cf71513576d558545d\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-7.ec2.internal" Jul 05 19:32:27.272119 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:27.272101 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/89a0e5a37365a0cf71513576d558545d-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-133-7.ec2.internal\" (UID: \"89a0e5a37365a0cf71513576d558545d\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-7.ec2.internal" Jul 05 19:32:27.274171 ip-10-0-133-7 kubenswrapper[2572]: E0705 19:32:27.274151 2572 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-7.ec2.internal\" not found" Jul 05 19:32:27.374432 ip-10-0-133-7 kubenswrapper[2572]: E0705 19:32:27.374366 2572 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-7.ec2.internal\" not found" Jul 05 19:32:27.395108 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:27.395063 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-7.ec2.internal" Jul 05 19:32:27.400211 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:27.400196 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-7.ec2.internal" Jul 05 19:32:27.475065 ip-10-0-133-7 kubenswrapper[2572]: E0705 19:32:27.475024 2572 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-7.ec2.internal\" not found" Jul 05 19:32:27.575945 ip-10-0-133-7 kubenswrapper[2572]: E0705 19:32:27.575914 2572 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-7.ec2.internal\" not found" Jul 05 19:32:27.676881 ip-10-0-133-7 kubenswrapper[2572]: E0705 19:32:27.676787 2572 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-7.ec2.internal\" not found" Jul 05 19:32:27.776966 ip-10-0-133-7 kubenswrapper[2572]: E0705 19:32:27.776920 2572 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-7.ec2.internal\" not found" Jul 05 19:32:27.816676 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:27.816644 2572 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 05 19:32:27.817286 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:27.816816 2572 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 05 19:32:27.877073 ip-10-0-133-7 kubenswrapper[2572]: E0705 19:32:27.877047 2572 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-7.ec2.internal\" not found" Jul 05 19:32:27.905939 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:27.905890 2572 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-04 19:27:27 +0000 UTC" deadline="2028-04-12 18:46:22.90945141 +0000 UTC" Jul 05 19:32:27.905939 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:27.905929 2572 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="15527h13m55.003526238s" Jul 05 19:32:27.965910 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:27.965869 2572 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 05 19:32:27.968885 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:27.968862 2572 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-7.ec2.internal" Jul 05 19:32:27.983163 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:27.983137 2572 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 05 19:32:27.984513 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:27.984499 2572 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-7.ec2.internal" Jul 05 19:32:27.993715 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:27.993692 2572 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 05 19:32:28.076524 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:32:28.076473 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod89a0e5a37365a0cf71513576d558545d.slice/crio-370c2871e17c5314c5827498506244e5ee28fb4840169f6b16a642c650d6d614 WatchSource:0}: Error finding container 370c2871e17c5314c5827498506244e5ee28fb4840169f6b16a642c650d6d614: Status 404 returned error can't find the container with id 370c2871e17c5314c5827498506244e5ee28fb4840169f6b16a642c650d6d614 Jul 05 19:32:28.082073 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:28.082045 2572 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 05 19:32:28.088918 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:32:28.088884 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode2bff7cbf82451b4333adfc3db2c0112.slice/crio-0df49c1f0434f50cd404e4df391c9d58e4701c05d55aed24923b6776730f6a6b WatchSource:0}: Error finding container 0df49c1f0434f50cd404e4df391c9d58e4701c05d55aed24923b6776730f6a6b: Status 404 returned error can't find the container with id 0df49c1f0434f50cd404e4df391c9d58e4701c05d55aed24923b6776730f6a6b Jul 05 19:32:28.140691 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:28.140658 2572 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 05 19:32:28.327584 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:28.327501 2572 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 05 19:32:28.853363 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:28.853327 2572 apiserver.go:52] "Watching apiserver" Jul 05 19:32:28.861665 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:28.861223 2572 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 05 19:32:28.863128 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:28.863087 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4ldzb","openshift-image-registry/node-ca-pp8zt","openshift-multus/multus-49z2k","openshift-multus/multus-additional-cni-plugins-dlr8v","openshift-network-diagnostics/network-check-target-fjdxw","openshift-network-operator/iptables-alerter-zh6wq","kube-system/global-pull-secret-syncer-k2b5v","kube-system/konnectivity-agent-6ldkn","kube-system/kube-apiserver-proxy-ip-10-0-133-7.ec2.internal","openshift-cluster-node-tuning-operator/tuned-v4bjg","openshift-dns/node-resolver-d52jr","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-7.ec2.internal","openshift-multus/network-metrics-daemon-brllj","openshift-ovn-kubernetes/ovnkube-node-jp9t6"] Jul 05 19:32:28.866517 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:28.866467 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4ldzb" Jul 05 19:32:28.871228 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:28.870136 2572 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 05 19:32:28.871228 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:28.870928 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-pp8zt" Jul 05 19:32:28.872196 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:28.871453 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-49z2k" Jul 05 19:32:28.872196 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:28.871630 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 05 19:32:28.872196 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:28.871833 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 05 19:32:28.872196 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:28.871976 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 05 19:32:28.872196 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:28.872156 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-vlrs5\"" Jul 05 19:32:28.876151 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:28.874384 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-dlr8v" Jul 05 19:32:28.876151 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:28.875276 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 05 19:32:28.876151 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:28.875464 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 05 19:32:28.876151 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:28.875697 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 05 19:32:28.876151 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:28.875852 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-mxdf7\"" Jul 05 19:32:28.876151 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:28.875919 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 05 19:32:28.876151 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:28.875938 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 05 19:32:28.876643 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:28.876204 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 05 19:32:28.876643 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:28.876247 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 05 19:32:28.876643 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:28.876448 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-9twd2\"" Jul 05 19:32:28.876791 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:28.876725 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fjdxw" Jul 05 19:32:28.876863 ip-10-0-133-7 kubenswrapper[2572]: E0705 19:32:28.876812 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fjdxw" podUID="1fd5cdc6-3c1a-4412-830c-b871c7087a35" Jul 05 19:32:28.877314 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:28.877042 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-tww8g\"" Jul 05 19:32:28.877314 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:28.877097 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 05 19:32:28.877314 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:28.877243 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 05 19:32:28.880724 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:28.879713 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-zh6wq" Jul 05 19:32:28.883065 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:28.881804 2572 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 05 19:32:28.883065 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:28.882159 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/8f5a9b06-1cac-44c1-a0fd-188c005a6199-host-var-lib-cni-multus\") pod \"multus-49z2k\" (UID: \"8f5a9b06-1cac-44c1-a0fd-188c005a6199\") " pod="openshift-multus/multus-49z2k" Jul 05 19:32:28.883065 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:28.882194 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8f5a9b06-1cac-44c1-a0fd-188c005a6199-host-var-lib-kubelet\") pod \"multus-49z2k\" (UID: \"8f5a9b06-1cac-44c1-a0fd-188c005a6199\") " pod="openshift-multus/multus-49z2k" Jul 05 19:32:28.883065 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:28.882239 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/8f5a9b06-1cac-44c1-a0fd-188c005a6199-host-run-multus-certs\") pod \"multus-49z2k\" (UID: \"8f5a9b06-1cac-44c1-a0fd-188c005a6199\") " pod="openshift-multus/multus-49z2k" Jul 05 19:32:28.883065 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:28.882268 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/4ea42695-582e-4b41-94d2-46bbaa5ec118-sys-fs\") pod \"aws-ebs-csi-driver-node-4ldzb\" (UID: \"4ea42695-582e-4b41-94d2-46bbaa5ec118\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4ldzb" Jul 05 19:32:28.883065 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:28.882295 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/8f5a9b06-1cac-44c1-a0fd-188c005a6199-cni-binary-copy\") pod \"multus-49z2k\" (UID: \"8f5a9b06-1cac-44c1-a0fd-188c005a6199\") " pod="openshift-multus/multus-49z2k" Jul 05 19:32:28.883065 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:28.882332 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-lsn9x\"" Jul 05 19:32:28.883065 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:28.882517 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 05 19:32:28.883065 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:28.882651 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 05 19:32:28.883065 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:28.882809 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 05 19:32:28.883065 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:28.882319 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/8f5a9b06-1cac-44c1-a0fd-188c005a6199-multus-conf-dir\") pod \"multus-49z2k\" (UID: \"8f5a9b06-1cac-44c1-a0fd-188c005a6199\") " pod="openshift-multus/multus-49z2k" Jul 05 19:32:28.883065 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:28.882862 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8f5a9b06-1cac-44c1-a0fd-188c005a6199-etc-kubernetes\") pod \"multus-49z2k\" (UID: \"8f5a9b06-1cac-44c1-a0fd-188c005a6199\") " pod="openshift-multus/multus-49z2k" Jul 05 19:32:28.883065 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:28.882909 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8f5a9b06-1cac-44c1-a0fd-188c005a6199-multus-cni-dir\") pod \"multus-49z2k\" (UID: \"8f5a9b06-1cac-44c1-a0fd-188c005a6199\") " pod="openshift-multus/multus-49z2k" Jul 05 19:32:28.883065 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:28.882943 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/8f5a9b06-1cac-44c1-a0fd-188c005a6199-os-release\") pod \"multus-49z2k\" (UID: \"8f5a9b06-1cac-44c1-a0fd-188c005a6199\") " pod="openshift-multus/multus-49z2k" Jul 05 19:32:28.883065 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:28.882965 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/8f5a9b06-1cac-44c1-a0fd-188c005a6199-cnibin\") pod \"multus-49z2k\" (UID: \"8f5a9b06-1cac-44c1-a0fd-188c005a6199\") " pod="openshift-multus/multus-49z2k" Jul 05 19:32:28.883065 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:28.882988 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/8f5a9b06-1cac-44c1-a0fd-188c005a6199-hostroot\") pod \"multus-49z2k\" (UID: \"8f5a9b06-1cac-44c1-a0fd-188c005a6199\") " pod="openshift-multus/multus-49z2k" Jul 05 19:32:28.883065 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:28.883011 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/4ea42695-582e-4b41-94d2-46bbaa5ec118-device-dir\") pod \"aws-ebs-csi-driver-node-4ldzb\" (UID: \"4ea42695-582e-4b41-94d2-46bbaa5ec118\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4ldzb" Jul 05 19:32:28.884082 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:28.883116 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k2b5v" Jul 05 19:32:28.884082 ip-10-0-133-7 kubenswrapper[2572]: E0705 19:32:28.883205 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-k2b5v" podUID="b256bcc8-4bdd-48db-b050-c02c368ef29d" Jul 05 19:32:28.884082 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:28.883468 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/8f5a9b06-1cac-44c1-a0fd-188c005a6199-host-run-netns\") pod \"multus-49z2k\" (UID: \"8f5a9b06-1cac-44c1-a0fd-188c005a6199\") " pod="openshift-multus/multus-49z2k" Jul 05 19:32:28.884082 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:28.883509 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fr7nk\" (UniqueName: \"kubernetes.io/projected/8f5a9b06-1cac-44c1-a0fd-188c005a6199-kube-api-access-fr7nk\") pod \"multus-49z2k\" (UID: \"8f5a9b06-1cac-44c1-a0fd-188c005a6199\") " pod="openshift-multus/multus-49z2k" Jul 05 19:32:28.884082 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:28.883536 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/4ea42695-582e-4b41-94d2-46bbaa5ec118-registration-dir\") pod \"aws-ebs-csi-driver-node-4ldzb\" (UID: \"4ea42695-582e-4b41-94d2-46bbaa5ec118\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4ldzb" Jul 05 19:32:28.884082 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:28.883570 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zr5h9\" (UniqueName: \"kubernetes.io/projected/b8af52e1-a74e-4004-8fef-45f3c97c0706-kube-api-access-zr5h9\") pod \"node-ca-pp8zt\" (UID: \"b8af52e1-a74e-4004-8fef-45f3c97c0706\") " pod="openshift-image-registry/node-ca-pp8zt" Jul 05 19:32:28.884082 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:28.883599 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/4ea42695-582e-4b41-94d2-46bbaa5ec118-socket-dir\") pod \"aws-ebs-csi-driver-node-4ldzb\" (UID: \"4ea42695-582e-4b41-94d2-46bbaa5ec118\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4ldzb" Jul 05 19:32:28.884082 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:28.883626 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/4ea42695-582e-4b41-94d2-46bbaa5ec118-etc-selinux\") pod \"aws-ebs-csi-driver-node-4ldzb\" (UID: \"4ea42695-582e-4b41-94d2-46bbaa5ec118\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4ldzb" Jul 05 19:32:28.884082 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:28.883677 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/8f5a9b06-1cac-44c1-a0fd-188c005a6199-multus-socket-dir-parent\") pod \"multus-49z2k\" (UID: \"8f5a9b06-1cac-44c1-a0fd-188c005a6199\") " pod="openshift-multus/multus-49z2k" Jul 05 19:32:28.884082 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:28.883706 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/8f5a9b06-1cac-44c1-a0fd-188c005a6199-host-run-k8s-cni-cncf-io\") pod \"multus-49z2k\" (UID: \"8f5a9b06-1cac-44c1-a0fd-188c005a6199\") " pod="openshift-multus/multus-49z2k" Jul 05 19:32:28.884082 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:28.883733 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/4ea42695-582e-4b41-94d2-46bbaa5ec118-kubelet-dir\") pod \"aws-ebs-csi-driver-node-4ldzb\" (UID: \"4ea42695-582e-4b41-94d2-46bbaa5ec118\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4ldzb" Jul 05 19:32:28.884082 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:28.883760 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b8af52e1-a74e-4004-8fef-45f3c97c0706-host\") pod \"node-ca-pp8zt\" (UID: \"b8af52e1-a74e-4004-8fef-45f3c97c0706\") " pod="openshift-image-registry/node-ca-pp8zt" Jul 05 19:32:28.884082 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:28.883785 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/b8af52e1-a74e-4004-8fef-45f3c97c0706-serviceca\") pod \"node-ca-pp8zt\" (UID: \"b8af52e1-a74e-4004-8fef-45f3c97c0706\") " pod="openshift-image-registry/node-ca-pp8zt" Jul 05 19:32:28.884082 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:28.883810 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8f5a9b06-1cac-44c1-a0fd-188c005a6199-system-cni-dir\") pod \"multus-49z2k\" (UID: \"8f5a9b06-1cac-44c1-a0fd-188c005a6199\") " pod="openshift-multus/multus-49z2k" Jul 05 19:32:28.884082 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:28.883876 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/8f5a9b06-1cac-44c1-a0fd-188c005a6199-multus-daemon-config\") pod \"multus-49z2k\" (UID: \"8f5a9b06-1cac-44c1-a0fd-188c005a6199\") " pod="openshift-multus/multus-49z2k" Jul 05 19:32:28.884082 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:28.883909 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9qp7x\" (UniqueName: \"kubernetes.io/projected/4ea42695-582e-4b41-94d2-46bbaa5ec118-kube-api-access-9qp7x\") pod \"aws-ebs-csi-driver-node-4ldzb\" (UID: \"4ea42695-582e-4b41-94d2-46bbaa5ec118\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4ldzb" Jul 05 19:32:28.884082 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:28.883937 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/8f5a9b06-1cac-44c1-a0fd-188c005a6199-host-var-lib-cni-bin\") pod \"multus-49z2k\" (UID: \"8f5a9b06-1cac-44c1-a0fd-188c005a6199\") " pod="openshift-multus/multus-49z2k" Jul 05 19:32:28.885006 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:28.884982 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-6ldkn" Jul 05 19:32:28.887478 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:28.887446 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 05 19:32:28.887710 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:28.887689 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 05 19:32:28.887801 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:28.887771 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-7wqq9\"" Jul 05 19:32:28.888600 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:28.888293 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-v4bjg" Jul 05 19:32:28.890874 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:28.890847 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 05 19:32:28.891060 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:28.890947 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-d52jr" Jul 05 19:32:28.891265 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:28.891245 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-22ppp\"" Jul 05 19:32:28.892178 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:28.891498 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 05 19:32:28.893673 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:28.893649 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-brllj" Jul 05 19:32:28.893865 ip-10-0-133-7 kubenswrapper[2572]: E0705 19:32:28.893736 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-brllj" podUID="05684556-d2e2-4157-9f17-097dee8230a0" Jul 05 19:32:28.896416 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:28.896384 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 05 19:32:28.896949 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:28.896929 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-bkj5s\"" Jul 05 19:32:28.897680 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:28.897659 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 05 19:32:28.899796 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:28.899770 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-jp9t6" Jul 05 19:32:28.902880 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:28.902854 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 05 19:32:28.902880 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:28.902873 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 05 19:32:28.903077 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:28.902873 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-wd4gh\"" Jul 05 19:32:28.903077 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:28.902854 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 05 19:32:28.903815 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:28.903796 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 05 19:32:28.903883 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:28.903863 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 05 19:32:28.903941 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:28.903902 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 05 19:32:28.910608 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:28.910579 2572 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-n4bwc" Jul 05 19:32:28.918970 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:28.918929 2572 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-n4bwc" Jul 05 19:32:28.963443 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:28.963377 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-7.ec2.internal" event={"ID":"e2bff7cbf82451b4333adfc3db2c0112","Type":"ContainerStarted","Data":"0df49c1f0434f50cd404e4df391c9d58e4701c05d55aed24923b6776730f6a6b"} Jul 05 19:32:28.968580 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:28.968533 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-7.ec2.internal" event={"ID":"89a0e5a37365a0cf71513576d558545d","Type":"ContainerStarted","Data":"370c2871e17c5314c5827498506244e5ee28fb4840169f6b16a642c650d6d614"} Jul 05 19:32:28.970498 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:28.970478 2572 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 05 19:32:28.984831 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:28.984791 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3d6f9f21-755d-491c-ac1f-f94df1e44b79-host-run-ovn-kubernetes\") pod \"ovnkube-node-jp9t6\" (UID: \"3d6f9f21-755d-491c-ac1f-f94df1e44b79\") " pod="openshift-ovn-kubernetes/ovnkube-node-jp9t6" Jul 05 19:32:28.985043 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:28.984842 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/bfb32e10-9908-43c0-90f2-629b8c81ebc8-hosts-file\") pod \"node-resolver-d52jr\" (UID: \"bfb32e10-9908-43c0-90f2-629b8c81ebc8\") " pod="openshift-dns/node-resolver-d52jr" Jul 05 19:32:28.985043 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:28.984877 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/8f5a9b06-1cac-44c1-a0fd-188c005a6199-cnibin\") pod \"multus-49z2k\" (UID: \"8f5a9b06-1cac-44c1-a0fd-188c005a6199\") " pod="openshift-multus/multus-49z2k" Jul 05 19:32:28.985043 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:28.984968 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/8f5a9b06-1cac-44c1-a0fd-188c005a6199-cnibin\") pod \"multus-49z2k\" (UID: \"8f5a9b06-1cac-44c1-a0fd-188c005a6199\") " pod="openshift-multus/multus-49z2k" Jul 05 19:32:28.985231 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:28.985048 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/3d6f9f21-755d-491c-ac1f-f94df1e44b79-ovn-node-metrics-cert\") pod \"ovnkube-node-jp9t6\" (UID: \"3d6f9f21-755d-491c-ac1f-f94df1e44b79\") " pod="openshift-ovn-kubernetes/ovnkube-node-jp9t6" Jul 05 19:32:28.985231 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:28.985097 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/3567b575-3458-4a8c-9cac-04d8c9f7d1a6-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-dlr8v\" (UID: \"3567b575-3458-4a8c-9cac-04d8c9f7d1a6\") " pod="openshift-multus/multus-additional-cni-plugins-dlr8v" Jul 05 19:32:28.985231 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:28.985124 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/fa405f18-4c0b-468d-863a-d2a5b34c65da-sys\") pod \"tuned-v4bjg\" (UID: \"fa405f18-4c0b-468d-863a-d2a5b34c65da\") " pod="openshift-cluster-node-tuning-operator/tuned-v4bjg" Jul 05 19:32:28.985231 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:28.985163 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/4ea42695-582e-4b41-94d2-46bbaa5ec118-device-dir\") pod \"aws-ebs-csi-driver-node-4ldzb\" (UID: \"4ea42695-582e-4b41-94d2-46bbaa5ec118\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4ldzb" Jul 05 19:32:28.985231 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:28.985199 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fr7nk\" (UniqueName: \"kubernetes.io/projected/8f5a9b06-1cac-44c1-a0fd-188c005a6199-kube-api-access-fr7nk\") pod \"multus-49z2k\" (UID: \"8f5a9b06-1cac-44c1-a0fd-188c005a6199\") " pod="openshift-multus/multus-49z2k" Jul 05 19:32:28.985231 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:28.985230 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/4ea42695-582e-4b41-94d2-46bbaa5ec118-device-dir\") pod \"aws-ebs-csi-driver-node-4ldzb\" (UID: \"4ea42695-582e-4b41-94d2-46bbaa5ec118\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4ldzb" Jul 05 19:32:28.985523 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:28.985231 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/3d6f9f21-755d-491c-ac1f-f94df1e44b79-host-run-netns\") pod \"ovnkube-node-jp9t6\" (UID: \"3d6f9f21-755d-491c-ac1f-f94df1e44b79\") " pod="openshift-ovn-kubernetes/ovnkube-node-jp9t6" Jul 05 19:32:28.985523 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:28.985268 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3d6f9f21-755d-491c-ac1f-f94df1e44b79-etc-openvswitch\") pod \"ovnkube-node-jp9t6\" (UID: \"3d6f9f21-755d-491c-ac1f-f94df1e44b79\") " pod="openshift-ovn-kubernetes/ovnkube-node-jp9t6" Jul 05 19:32:28.985523 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:28.985295 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/3567b575-3458-4a8c-9cac-04d8c9f7d1a6-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-dlr8v\" (UID: \"3567b575-3458-4a8c-9cac-04d8c9f7d1a6\") " pod="openshift-multus/multus-additional-cni-plugins-dlr8v" Jul 05 19:32:28.985523 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:28.985321 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/4ea42695-582e-4b41-94d2-46bbaa5ec118-registration-dir\") pod \"aws-ebs-csi-driver-node-4ldzb\" (UID: \"4ea42695-582e-4b41-94d2-46bbaa5ec118\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4ldzb" Jul 05 19:32:28.985523 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:28.985345 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zr5h9\" (UniqueName: \"kubernetes.io/projected/b8af52e1-a74e-4004-8fef-45f3c97c0706-kube-api-access-zr5h9\") pod \"node-ca-pp8zt\" (UID: \"b8af52e1-a74e-4004-8fef-45f3c97c0706\") " pod="openshift-image-registry/node-ca-pp8zt" Jul 05 19:32:28.985523 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:28.985369 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/9349dbd7-9c70-4a38-bd03-2e5bf10e1ecd-iptables-alerter-script\") pod \"iptables-alerter-zh6wq\" (UID: \"9349dbd7-9c70-4a38-bd03-2e5bf10e1ecd\") " pod="openshift-network-operator/iptables-alerter-zh6wq" Jul 05 19:32:28.985523 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:28.985395 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/fa405f18-4c0b-468d-863a-d2a5b34c65da-etc-kubernetes\") pod \"tuned-v4bjg\" (UID: \"fa405f18-4c0b-468d-863a-d2a5b34c65da\") " pod="openshift-cluster-node-tuning-operator/tuned-v4bjg" Jul 05 19:32:28.985523 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:28.985419 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/4ea42695-582e-4b41-94d2-46bbaa5ec118-socket-dir\") pod \"aws-ebs-csi-driver-node-4ldzb\" (UID: \"4ea42695-582e-4b41-94d2-46bbaa5ec118\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4ldzb" Jul 05 19:32:28.985523 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:28.985444 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/8f5a9b06-1cac-44c1-a0fd-188c005a6199-host-run-k8s-cni-cncf-io\") pod \"multus-49z2k\" (UID: \"8f5a9b06-1cac-44c1-a0fd-188c005a6199\") " pod="openshift-multus/multus-49z2k" Jul 05 19:32:28.985523 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:28.985466 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/fa405f18-4c0b-468d-863a-d2a5b34c65da-etc-modprobe-d\") pod \"tuned-v4bjg\" (UID: \"fa405f18-4c0b-468d-863a-d2a5b34c65da\") " pod="openshift-cluster-node-tuning-operator/tuned-v4bjg" Jul 05 19:32:28.985523 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:28.985492 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/4ea42695-582e-4b41-94d2-46bbaa5ec118-kubelet-dir\") pod \"aws-ebs-csi-driver-node-4ldzb\" (UID: \"4ea42695-582e-4b41-94d2-46bbaa5ec118\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4ldzb" Jul 05 19:32:28.985523 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:28.985516 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b8af52e1-a74e-4004-8fef-45f3c97c0706-host\") pod \"node-ca-pp8zt\" (UID: \"b8af52e1-a74e-4004-8fef-45f3c97c0706\") " pod="openshift-image-registry/node-ca-pp8zt" Jul 05 19:32:28.986200 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:28.985572 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/3567b575-3458-4a8c-9cac-04d8c9f7d1a6-tuning-conf-dir\") pod \"multus-additional-cni-plugins-dlr8v\" (UID: \"3567b575-3458-4a8c-9cac-04d8c9f7d1a6\") " pod="openshift-multus/multus-additional-cni-plugins-dlr8v" Jul 05 19:32:28.986200 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:28.985615 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/fa405f18-4c0b-468d-863a-d2a5b34c65da-etc-systemd\") pod \"tuned-v4bjg\" (UID: \"fa405f18-4c0b-468d-863a-d2a5b34c65da\") " pod="openshift-cluster-node-tuning-operator/tuned-v4bjg" Jul 05 19:32:28.986200 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:28.985620 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/4ea42695-582e-4b41-94d2-46bbaa5ec118-registration-dir\") pod \"aws-ebs-csi-driver-node-4ldzb\" (UID: \"4ea42695-582e-4b41-94d2-46bbaa5ec118\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4ldzb" Jul 05 19:32:28.986200 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:28.985658 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8f5a9b06-1cac-44c1-a0fd-188c005a6199-host-var-lib-kubelet\") pod \"multus-49z2k\" (UID: \"8f5a9b06-1cac-44c1-a0fd-188c005a6199\") " pod="openshift-multus/multus-49z2k" Jul 05 19:32:28.986200 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:28.985684 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/8f5a9b06-1cac-44c1-a0fd-188c005a6199-host-run-multus-certs\") pod \"multus-49z2k\" (UID: \"8f5a9b06-1cac-44c1-a0fd-188c005a6199\") " pod="openshift-multus/multus-49z2k" Jul 05 19:32:28.986200 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:28.985708 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/8f5a9b06-1cac-44c1-a0fd-188c005a6199-multus-conf-dir\") pod \"multus-49z2k\" (UID: \"8f5a9b06-1cac-44c1-a0fd-188c005a6199\") " pod="openshift-multus/multus-49z2k" Jul 05 19:32:28.986200 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:28.985744 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3567b575-3458-4a8c-9cac-04d8c9f7d1a6-system-cni-dir\") pod \"multus-additional-cni-plugins-dlr8v\" (UID: \"3567b575-3458-4a8c-9cac-04d8c9f7d1a6\") " pod="openshift-multus/multus-additional-cni-plugins-dlr8v" Jul 05 19:32:28.986200 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:28.985769 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/3567b575-3458-4a8c-9cac-04d8c9f7d1a6-cnibin\") pod \"multus-additional-cni-plugins-dlr8v\" (UID: \"3567b575-3458-4a8c-9cac-04d8c9f7d1a6\") " pod="openshift-multus/multus-additional-cni-plugins-dlr8v" Jul 05 19:32:28.986200 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:28.985807 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q7ff8\" (UniqueName: \"kubernetes.io/projected/3567b575-3458-4a8c-9cac-04d8c9f7d1a6-kube-api-access-q7ff8\") pod \"multus-additional-cni-plugins-dlr8v\" (UID: \"3567b575-3458-4a8c-9cac-04d8c9f7d1a6\") " pod="openshift-multus/multus-additional-cni-plugins-dlr8v" Jul 05 19:32:28.986200 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:28.985863 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b8af52e1-a74e-4004-8fef-45f3c97c0706-host\") pod \"node-ca-pp8zt\" (UID: \"b8af52e1-a74e-4004-8fef-45f3c97c0706\") " pod="openshift-image-registry/node-ca-pp8zt" Jul 05 19:32:28.986200 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:28.985881 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-94vwv\" (UniqueName: \"kubernetes.io/projected/9349dbd7-9c70-4a38-bd03-2e5bf10e1ecd-kube-api-access-94vwv\") pod \"iptables-alerter-zh6wq\" (UID: \"9349dbd7-9c70-4a38-bd03-2e5bf10e1ecd\") " pod="openshift-network-operator/iptables-alerter-zh6wq" Jul 05 19:32:28.986200 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:28.985945 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8f5a9b06-1cac-44c1-a0fd-188c005a6199-host-var-lib-kubelet\") pod \"multus-49z2k\" (UID: \"8f5a9b06-1cac-44c1-a0fd-188c005a6199\") " pod="openshift-multus/multus-49z2k" Jul 05 19:32:28.986200 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:28.985986 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/8f5a9b06-1cac-44c1-a0fd-188c005a6199-host-run-multus-certs\") pod \"multus-49z2k\" (UID: \"8f5a9b06-1cac-44c1-a0fd-188c005a6199\") " pod="openshift-multus/multus-49z2k" Jul 05 19:32:28.986200 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:28.986045 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/4ea42695-582e-4b41-94d2-46bbaa5ec118-socket-dir\") pod \"aws-ebs-csi-driver-node-4ldzb\" (UID: \"4ea42695-582e-4b41-94d2-46bbaa5ec118\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4ldzb" Jul 05 19:32:28.986200 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:28.986049 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/8f5a9b06-1cac-44c1-a0fd-188c005a6199-multus-conf-dir\") pod \"multus-49z2k\" (UID: \"8f5a9b06-1cac-44c1-a0fd-188c005a6199\") " pod="openshift-multus/multus-49z2k" Jul 05 19:32:28.986200 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:28.986108 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/fa405f18-4c0b-468d-863a-d2a5b34c65da-run\") pod \"tuned-v4bjg\" (UID: \"fa405f18-4c0b-468d-863a-d2a5b34c65da\") " pod="openshift-cluster-node-tuning-operator/tuned-v4bjg" Jul 05 19:32:28.986200 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:28.986109 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/8f5a9b06-1cac-44c1-a0fd-188c005a6199-host-run-k8s-cni-cncf-io\") pod \"multus-49z2k\" (UID: \"8f5a9b06-1cac-44c1-a0fd-188c005a6199\") " pod="openshift-multus/multus-49z2k" Jul 05 19:32:28.987165 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:28.986139 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/3d6f9f21-755d-491c-ac1f-f94df1e44b79-host-slash\") pod \"ovnkube-node-jp9t6\" (UID: \"3d6f9f21-755d-491c-ac1f-f94df1e44b79\") " pod="openshift-ovn-kubernetes/ovnkube-node-jp9t6" Jul 05 19:32:28.987165 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:28.986162 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/4ea42695-582e-4b41-94d2-46bbaa5ec118-kubelet-dir\") pod \"aws-ebs-csi-driver-node-4ldzb\" (UID: \"4ea42695-582e-4b41-94d2-46bbaa5ec118\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4ldzb" Jul 05 19:32:28.987165 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:28.986198 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3d6f9f21-755d-491c-ac1f-f94df1e44b79-var-lib-openvswitch\") pod \"ovnkube-node-jp9t6\" (UID: \"3d6f9f21-755d-491c-ac1f-f94df1e44b79\") " pod="openshift-ovn-kubernetes/ovnkube-node-jp9t6" Jul 05 19:32:28.987165 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:28.986225 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/b256bcc8-4bdd-48db-b050-c02c368ef29d-kubelet-config\") pod \"global-pull-secret-syncer-k2b5v\" (UID: \"b256bcc8-4bdd-48db-b050-c02c368ef29d\") " pod="kube-system/global-pull-secret-syncer-k2b5v" Jul 05 19:32:28.987165 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:28.986257 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/fa405f18-4c0b-468d-863a-d2a5b34c65da-etc-sysctl-d\") pod \"tuned-v4bjg\" (UID: \"fa405f18-4c0b-468d-863a-d2a5b34c65da\") " pod="openshift-cluster-node-tuning-operator/tuned-v4bjg" Jul 05 19:32:28.987165 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:28.986285 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/fa405f18-4c0b-468d-863a-d2a5b34c65da-var-lib-kubelet\") pod \"tuned-v4bjg\" (UID: \"fa405f18-4c0b-468d-863a-d2a5b34c65da\") " pod="openshift-cluster-node-tuning-operator/tuned-v4bjg" Jul 05 19:32:28.987165 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:28.986313 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/8f5a9b06-1cac-44c1-a0fd-188c005a6199-hostroot\") pod \"multus-49z2k\" (UID: \"8f5a9b06-1cac-44c1-a0fd-188c005a6199\") " pod="openshift-multus/multus-49z2k" Jul 05 19:32:28.987165 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:28.986345 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/3d6f9f21-755d-491c-ac1f-f94df1e44b79-systemd-units\") pod \"ovnkube-node-jp9t6\" (UID: \"3d6f9f21-755d-491c-ac1f-f94df1e44b79\") " pod="openshift-ovn-kubernetes/ovnkube-node-jp9t6" Jul 05 19:32:28.987165 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:28.986353 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/8f5a9b06-1cac-44c1-a0fd-188c005a6199-hostroot\") pod \"multus-49z2k\" (UID: \"8f5a9b06-1cac-44c1-a0fd-188c005a6199\") " pod="openshift-multus/multus-49z2k" Jul 05 19:32:28.987165 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:28.986376 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/3d6f9f21-755d-491c-ac1f-f94df1e44b79-ovnkube-config\") pod \"ovnkube-node-jp9t6\" (UID: \"3d6f9f21-755d-491c-ac1f-f94df1e44b79\") " pod="openshift-ovn-kubernetes/ovnkube-node-jp9t6" Jul 05 19:32:28.987165 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:28.986403 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/3567b575-3458-4a8c-9cac-04d8c9f7d1a6-cni-binary-copy\") pod \"multus-additional-cni-plugins-dlr8v\" (UID: \"3567b575-3458-4a8c-9cac-04d8c9f7d1a6\") " pod="openshift-multus/multus-additional-cni-plugins-dlr8v" Jul 05 19:32:28.987165 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:28.986433 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/8f5a9b06-1cac-44c1-a0fd-188c005a6199-host-run-netns\") pod \"multus-49z2k\" (UID: \"8f5a9b06-1cac-44c1-a0fd-188c005a6199\") " pod="openshift-multus/multus-49z2k" Jul 05 19:32:28.987165 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:28.986458 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/05684556-d2e2-4157-9f17-097dee8230a0-metrics-certs\") pod \"network-metrics-daemon-brllj\" (UID: \"05684556-d2e2-4157-9f17-097dee8230a0\") " pod="openshift-multus/network-metrics-daemon-brllj" Jul 05 19:32:28.987165 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:28.986494 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/8f5a9b06-1cac-44c1-a0fd-188c005a6199-host-run-netns\") pod \"multus-49z2k\" (UID: \"8f5a9b06-1cac-44c1-a0fd-188c005a6199\") " pod="openshift-multus/multus-49z2k" Jul 05 19:32:28.987165 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:28.986518 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/3d6f9f21-755d-491c-ac1f-f94df1e44b79-node-log\") pod \"ovnkube-node-jp9t6\" (UID: \"3d6f9f21-755d-491c-ac1f-f94df1e44b79\") " pod="openshift-ovn-kubernetes/ovnkube-node-jp9t6" Jul 05 19:32:28.987165 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:28.986546 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3d6f9f21-755d-491c-ac1f-f94df1e44b79-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-jp9t6\" (UID: \"3d6f9f21-755d-491c-ac1f-f94df1e44b79\") " pod="openshift-ovn-kubernetes/ovnkube-node-jp9t6" Jul 05 19:32:28.987165 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:28.986575 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/9349dbd7-9c70-4a38-bd03-2e5bf10e1ecd-host-slash\") pod \"iptables-alerter-zh6wq\" (UID: \"9349dbd7-9c70-4a38-bd03-2e5bf10e1ecd\") " pod="openshift-network-operator/iptables-alerter-zh6wq" Jul 05 19:32:28.988047 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:28.986597 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/e9938fdb-3276-474c-87c7-0386eacd806a-agent-certs\") pod \"konnectivity-agent-6ldkn\" (UID: \"e9938fdb-3276-474c-87c7-0386eacd806a\") " pod="kube-system/konnectivity-agent-6ldkn" Jul 05 19:32:28.988047 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:28.986621 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/fa405f18-4c0b-468d-863a-d2a5b34c65da-etc-sysctl-conf\") pod \"tuned-v4bjg\" (UID: \"fa405f18-4c0b-468d-863a-d2a5b34c65da\") " pod="openshift-cluster-node-tuning-operator/tuned-v4bjg" Jul 05 19:32:28.988047 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:28.986650 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/3d6f9f21-755d-491c-ac1f-f94df1e44b79-host-cni-netd\") pod \"ovnkube-node-jp9t6\" (UID: \"3d6f9f21-755d-491c-ac1f-f94df1e44b79\") " pod="openshift-ovn-kubernetes/ovnkube-node-jp9t6" Jul 05 19:32:28.988047 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:28.986674 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/3d6f9f21-755d-491c-ac1f-f94df1e44b79-env-overrides\") pod \"ovnkube-node-jp9t6\" (UID: \"3d6f9f21-755d-491c-ac1f-f94df1e44b79\") " pod="openshift-ovn-kubernetes/ovnkube-node-jp9t6" Jul 05 19:32:28.988047 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:28.986698 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vr864\" (UniqueName: \"kubernetes.io/projected/3d6f9f21-755d-491c-ac1f-f94df1e44b79-kube-api-access-vr864\") pod \"ovnkube-node-jp9t6\" (UID: \"3d6f9f21-755d-491c-ac1f-f94df1e44b79\") " pod="openshift-ovn-kubernetes/ovnkube-node-jp9t6" Jul 05 19:32:28.988047 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:28.986741 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/e9938fdb-3276-474c-87c7-0386eacd806a-konnectivity-ca\") pod \"konnectivity-agent-6ldkn\" (UID: \"e9938fdb-3276-474c-87c7-0386eacd806a\") " pod="kube-system/konnectivity-agent-6ldkn" Jul 05 19:32:28.988047 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:28.986766 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z9zp5\" (UniqueName: \"kubernetes.io/projected/fa405f18-4c0b-468d-863a-d2a5b34c65da-kube-api-access-z9zp5\") pod \"tuned-v4bjg\" (UID: \"fa405f18-4c0b-468d-863a-d2a5b34c65da\") " pod="openshift-cluster-node-tuning-operator/tuned-v4bjg" Jul 05 19:32:28.988047 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:28.986800 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/4ea42695-582e-4b41-94d2-46bbaa5ec118-etc-selinux\") pod \"aws-ebs-csi-driver-node-4ldzb\" (UID: \"4ea42695-582e-4b41-94d2-46bbaa5ec118\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4ldzb" Jul 05 19:32:28.988047 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:28.986828 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/8f5a9b06-1cac-44c1-a0fd-188c005a6199-multus-socket-dir-parent\") pod \"multus-49z2k\" (UID: \"8f5a9b06-1cac-44c1-a0fd-188c005a6199\") " pod="openshift-multus/multus-49z2k" Jul 05 19:32:28.988047 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:28.986851 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/3d6f9f21-755d-491c-ac1f-f94df1e44b79-run-ovn\") pod \"ovnkube-node-jp9t6\" (UID: \"3d6f9f21-755d-491c-ac1f-f94df1e44b79\") " pod="openshift-ovn-kubernetes/ovnkube-node-jp9t6" Jul 05 19:32:28.988047 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:28.986873 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-55jpj\" (UniqueName: \"kubernetes.io/projected/1fd5cdc6-3c1a-4412-830c-b871c7087a35-kube-api-access-55jpj\") pod \"network-check-target-fjdxw\" (UID: \"1fd5cdc6-3c1a-4412-830c-b871c7087a35\") " pod="openshift-network-diagnostics/network-check-target-fjdxw" Jul 05 19:32:28.988047 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:28.986893 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/fa405f18-4c0b-468d-863a-d2a5b34c65da-host\") pod \"tuned-v4bjg\" (UID: \"fa405f18-4c0b-468d-863a-d2a5b34c65da\") " pod="openshift-cluster-node-tuning-operator/tuned-v4bjg" Jul 05 19:32:28.988047 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:28.986915 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dwpcd\" (UniqueName: \"kubernetes.io/projected/bfb32e10-9908-43c0-90f2-629b8c81ebc8-kube-api-access-dwpcd\") pod \"node-resolver-d52jr\" (UID: \"bfb32e10-9908-43c0-90f2-629b8c81ebc8\") " pod="openshift-dns/node-resolver-d52jr" Jul 05 19:32:28.988047 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:28.986939 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/3567b575-3458-4a8c-9cac-04d8c9f7d1a6-os-release\") pod \"multus-additional-cni-plugins-dlr8v\" (UID: \"3567b575-3458-4a8c-9cac-04d8c9f7d1a6\") " pod="openshift-multus/multus-additional-cni-plugins-dlr8v" Jul 05 19:32:28.988047 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:28.986966 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/b8af52e1-a74e-4004-8fef-45f3c97c0706-serviceca\") pod \"node-ca-pp8zt\" (UID: \"b8af52e1-a74e-4004-8fef-45f3c97c0706\") " pod="openshift-image-registry/node-ca-pp8zt" Jul 05 19:32:28.988047 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:28.986989 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8f5a9b06-1cac-44c1-a0fd-188c005a6199-system-cni-dir\") pod \"multus-49z2k\" (UID: \"8f5a9b06-1cac-44c1-a0fd-188c005a6199\") " pod="openshift-multus/multus-49z2k" Jul 05 19:32:28.988047 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:28.987035 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/8f5a9b06-1cac-44c1-a0fd-188c005a6199-multus-daemon-config\") pod \"multus-49z2k\" (UID: \"8f5a9b06-1cac-44c1-a0fd-188c005a6199\") " pod="openshift-multus/multus-49z2k" Jul 05 19:32:28.988911 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:28.987055 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/8f5a9b06-1cac-44c1-a0fd-188c005a6199-multus-socket-dir-parent\") pod \"multus-49z2k\" (UID: \"8f5a9b06-1cac-44c1-a0fd-188c005a6199\") " pod="openshift-multus/multus-49z2k" Jul 05 19:32:28.988911 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:28.987061 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3d6f9f21-755d-491c-ac1f-f94df1e44b79-run-openvswitch\") pod \"ovnkube-node-jp9t6\" (UID: \"3d6f9f21-755d-491c-ac1f-f94df1e44b79\") " pod="openshift-ovn-kubernetes/ovnkube-node-jp9t6" Jul 05 19:32:28.988911 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:28.987092 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/3d6f9f21-755d-491c-ac1f-f94df1e44b79-host-cni-bin\") pod \"ovnkube-node-jp9t6\" (UID: \"3d6f9f21-755d-491c-ac1f-f94df1e44b79\") " pod="openshift-ovn-kubernetes/ovnkube-node-jp9t6" Jul 05 19:32:28.988911 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:28.986989 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/4ea42695-582e-4b41-94d2-46bbaa5ec118-etc-selinux\") pod \"aws-ebs-csi-driver-node-4ldzb\" (UID: \"4ea42695-582e-4b41-94d2-46bbaa5ec118\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4ldzb" Jul 05 19:32:28.988911 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:28.987156 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8f5a9b06-1cac-44c1-a0fd-188c005a6199-system-cni-dir\") pod \"multus-49z2k\" (UID: \"8f5a9b06-1cac-44c1-a0fd-188c005a6199\") " pod="openshift-multus/multus-49z2k" Jul 05 19:32:28.988911 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:28.987188 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/3d6f9f21-755d-491c-ac1f-f94df1e44b79-ovnkube-script-lib\") pod \"ovnkube-node-jp9t6\" (UID: \"3d6f9f21-755d-491c-ac1f-f94df1e44b79\") " pod="openshift-ovn-kubernetes/ovnkube-node-jp9t6" Jul 05 19:32:28.988911 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:28.987214 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/b256bcc8-4bdd-48db-b050-c02c368ef29d-dbus\") pod \"global-pull-secret-syncer-k2b5v\" (UID: \"b256bcc8-4bdd-48db-b050-c02c368ef29d\") " pod="kube-system/global-pull-secret-syncer-k2b5v" Jul 05 19:32:28.988911 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:28.987244 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9qp7x\" (UniqueName: \"kubernetes.io/projected/4ea42695-582e-4b41-94d2-46bbaa5ec118-kube-api-access-9qp7x\") pod \"aws-ebs-csi-driver-node-4ldzb\" (UID: \"4ea42695-582e-4b41-94d2-46bbaa5ec118\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4ldzb" Jul 05 19:32:28.988911 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:28.987304 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/8f5a9b06-1cac-44c1-a0fd-188c005a6199-host-var-lib-cni-bin\") pod \"multus-49z2k\" (UID: \"8f5a9b06-1cac-44c1-a0fd-188c005a6199\") " pod="openshift-multus/multus-49z2k" Jul 05 19:32:28.988911 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:28.987332 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/8f5a9b06-1cac-44c1-a0fd-188c005a6199-host-var-lib-cni-multus\") pod \"multus-49z2k\" (UID: \"8f5a9b06-1cac-44c1-a0fd-188c005a6199\") " pod="openshift-multus/multus-49z2k" Jul 05 19:32:28.988911 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:28.987360 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4r56v\" (UniqueName: \"kubernetes.io/projected/05684556-d2e2-4157-9f17-097dee8230a0-kube-api-access-4r56v\") pod \"network-metrics-daemon-brllj\" (UID: \"05684556-d2e2-4157-9f17-097dee8230a0\") " pod="openshift-multus/network-metrics-daemon-brllj" Jul 05 19:32:28.988911 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:28.987394 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b256bcc8-4bdd-48db-b050-c02c368ef29d-original-pull-secret\") pod \"global-pull-secret-syncer-k2b5v\" (UID: \"b256bcc8-4bdd-48db-b050-c02c368ef29d\") " pod="kube-system/global-pull-secret-syncer-k2b5v" Jul 05 19:32:28.988911 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:28.987419 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/fa405f18-4c0b-468d-863a-d2a5b34c65da-etc-sysconfig\") pod \"tuned-v4bjg\" (UID: \"fa405f18-4c0b-468d-863a-d2a5b34c65da\") " pod="openshift-cluster-node-tuning-operator/tuned-v4bjg" Jul 05 19:32:28.988911 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:28.987444 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/fa405f18-4c0b-468d-863a-d2a5b34c65da-tmp\") pod \"tuned-v4bjg\" (UID: \"fa405f18-4c0b-468d-863a-d2a5b34c65da\") " pod="openshift-cluster-node-tuning-operator/tuned-v4bjg" Jul 05 19:32:28.988911 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:28.987469 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/4ea42695-582e-4b41-94d2-46bbaa5ec118-sys-fs\") pod \"aws-ebs-csi-driver-node-4ldzb\" (UID: \"4ea42695-582e-4b41-94d2-46bbaa5ec118\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4ldzb" Jul 05 19:32:28.988911 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:28.987496 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/8f5a9b06-1cac-44c1-a0fd-188c005a6199-cni-binary-copy\") pod \"multus-49z2k\" (UID: \"8f5a9b06-1cac-44c1-a0fd-188c005a6199\") " pod="openshift-multus/multus-49z2k" Jul 05 19:32:28.988911 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:28.987578 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8f5a9b06-1cac-44c1-a0fd-188c005a6199-etc-kubernetes\") pod \"multus-49z2k\" (UID: \"8f5a9b06-1cac-44c1-a0fd-188c005a6199\") " pod="openshift-multus/multus-49z2k" Jul 05 19:32:28.989754 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:28.987607 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/3d6f9f21-755d-491c-ac1f-f94df1e44b79-host-kubelet\") pod \"ovnkube-node-jp9t6\" (UID: \"3d6f9f21-755d-491c-ac1f-f94df1e44b79\") " pod="openshift-ovn-kubernetes/ovnkube-node-jp9t6" Jul 05 19:32:28.989754 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:28.987634 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/fa405f18-4c0b-468d-863a-d2a5b34c65da-lib-modules\") pod \"tuned-v4bjg\" (UID: \"fa405f18-4c0b-468d-863a-d2a5b34c65da\") " pod="openshift-cluster-node-tuning-operator/tuned-v4bjg" Jul 05 19:32:28.989754 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:28.987658 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/fa405f18-4c0b-468d-863a-d2a5b34c65da-etc-tuned\") pod \"tuned-v4bjg\" (UID: \"fa405f18-4c0b-468d-863a-d2a5b34c65da\") " pod="openshift-cluster-node-tuning-operator/tuned-v4bjg" Jul 05 19:32:28.989754 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:28.987685 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bfb32e10-9908-43c0-90f2-629b8c81ebc8-tmp-dir\") pod \"node-resolver-d52jr\" (UID: \"bfb32e10-9908-43c0-90f2-629b8c81ebc8\") " pod="openshift-dns/node-resolver-d52jr" Jul 05 19:32:28.989754 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:28.987710 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8f5a9b06-1cac-44c1-a0fd-188c005a6199-multus-cni-dir\") pod \"multus-49z2k\" (UID: \"8f5a9b06-1cac-44c1-a0fd-188c005a6199\") " pod="openshift-multus/multus-49z2k" Jul 05 19:32:28.989754 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:28.987740 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/8f5a9b06-1cac-44c1-a0fd-188c005a6199-os-release\") pod \"multus-49z2k\" (UID: \"8f5a9b06-1cac-44c1-a0fd-188c005a6199\") " pod="openshift-multus/multus-49z2k" Jul 05 19:32:28.989754 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:28.987765 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/3d6f9f21-755d-491c-ac1f-f94df1e44b79-run-systemd\") pod \"ovnkube-node-jp9t6\" (UID: \"3d6f9f21-755d-491c-ac1f-f94df1e44b79\") " pod="openshift-ovn-kubernetes/ovnkube-node-jp9t6" Jul 05 19:32:28.989754 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:28.987792 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/3d6f9f21-755d-491c-ac1f-f94df1e44b79-log-socket\") pod \"ovnkube-node-jp9t6\" (UID: \"3d6f9f21-755d-491c-ac1f-f94df1e44b79\") " pod="openshift-ovn-kubernetes/ovnkube-node-jp9t6" Jul 05 19:32:28.989754 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:28.987906 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/4ea42695-582e-4b41-94d2-46bbaa5ec118-sys-fs\") pod \"aws-ebs-csi-driver-node-4ldzb\" (UID: \"4ea42695-582e-4b41-94d2-46bbaa5ec118\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4ldzb" Jul 05 19:32:28.989754 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:28.987952 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8f5a9b06-1cac-44c1-a0fd-188c005a6199-etc-kubernetes\") pod \"multus-49z2k\" (UID: \"8f5a9b06-1cac-44c1-a0fd-188c005a6199\") " pod="openshift-multus/multus-49z2k" Jul 05 19:32:28.989754 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:28.988140 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8f5a9b06-1cac-44c1-a0fd-188c005a6199-multus-cni-dir\") pod \"multus-49z2k\" (UID: \"8f5a9b06-1cac-44c1-a0fd-188c005a6199\") " pod="openshift-multus/multus-49z2k" Jul 05 19:32:28.989754 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:28.987714 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/8f5a9b06-1cac-44c1-a0fd-188c005a6199-multus-daemon-config\") pod \"multus-49z2k\" (UID: \"8f5a9b06-1cac-44c1-a0fd-188c005a6199\") " pod="openshift-multus/multus-49z2k" Jul 05 19:32:28.989754 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:28.988160 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/8f5a9b06-1cac-44c1-a0fd-188c005a6199-cni-binary-copy\") pod \"multus-49z2k\" (UID: \"8f5a9b06-1cac-44c1-a0fd-188c005a6199\") " pod="openshift-multus/multus-49z2k" Jul 05 19:32:28.989754 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:28.988442 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/8f5a9b06-1cac-44c1-a0fd-188c005a6199-host-var-lib-cni-bin\") pod \"multus-49z2k\" (UID: \"8f5a9b06-1cac-44c1-a0fd-188c005a6199\") " pod="openshift-multus/multus-49z2k" Jul 05 19:32:28.989754 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:28.988488 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/8f5a9b06-1cac-44c1-a0fd-188c005a6199-host-var-lib-cni-multus\") pod \"multus-49z2k\" (UID: \"8f5a9b06-1cac-44c1-a0fd-188c005a6199\") " pod="openshift-multus/multus-49z2k" Jul 05 19:32:28.989754 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:28.988595 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/b8af52e1-a74e-4004-8fef-45f3c97c0706-serviceca\") pod \"node-ca-pp8zt\" (UID: \"b8af52e1-a74e-4004-8fef-45f3c97c0706\") " pod="openshift-image-registry/node-ca-pp8zt" Jul 05 19:32:28.989754 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:28.988665 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/8f5a9b06-1cac-44c1-a0fd-188c005a6199-os-release\") pod \"multus-49z2k\" (UID: \"8f5a9b06-1cac-44c1-a0fd-188c005a6199\") " pod="openshift-multus/multus-49z2k" Jul 05 19:32:28.999907 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:28.999863 2572 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 05 19:32:29.004861 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:29.004826 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zr5h9\" (UniqueName: \"kubernetes.io/projected/b8af52e1-a74e-4004-8fef-45f3c97c0706-kube-api-access-zr5h9\") pod \"node-ca-pp8zt\" (UID: \"b8af52e1-a74e-4004-8fef-45f3c97c0706\") " pod="openshift-image-registry/node-ca-pp8zt" Jul 05 19:32:29.005039 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:29.004845 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fr7nk\" (UniqueName: \"kubernetes.io/projected/8f5a9b06-1cac-44c1-a0fd-188c005a6199-kube-api-access-fr7nk\") pod \"multus-49z2k\" (UID: \"8f5a9b06-1cac-44c1-a0fd-188c005a6199\") " pod="openshift-multus/multus-49z2k" Jul 05 19:32:29.005567 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:29.005527 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9qp7x\" (UniqueName: \"kubernetes.io/projected/4ea42695-582e-4b41-94d2-46bbaa5ec118-kube-api-access-9qp7x\") pod \"aws-ebs-csi-driver-node-4ldzb\" (UID: \"4ea42695-582e-4b41-94d2-46bbaa5ec118\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4ldzb" Jul 05 19:32:29.088142 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:29.088099 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/3d6f9f21-755d-491c-ac1f-f94df1e44b79-run-ovn\") pod \"ovnkube-node-jp9t6\" (UID: \"3d6f9f21-755d-491c-ac1f-f94df1e44b79\") " pod="openshift-ovn-kubernetes/ovnkube-node-jp9t6" Jul 05 19:32:29.088337 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:29.088153 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-55jpj\" (UniqueName: \"kubernetes.io/projected/1fd5cdc6-3c1a-4412-830c-b871c7087a35-kube-api-access-55jpj\") pod \"network-check-target-fjdxw\" (UID: \"1fd5cdc6-3c1a-4412-830c-b871c7087a35\") " pod="openshift-network-diagnostics/network-check-target-fjdxw" Jul 05 19:32:29.088337 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:29.088229 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/3d6f9f21-755d-491c-ac1f-f94df1e44b79-run-ovn\") pod \"ovnkube-node-jp9t6\" (UID: \"3d6f9f21-755d-491c-ac1f-f94df1e44b79\") " pod="openshift-ovn-kubernetes/ovnkube-node-jp9t6" Jul 05 19:32:29.088337 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:29.088283 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/fa405f18-4c0b-468d-863a-d2a5b34c65da-host\") pod \"tuned-v4bjg\" (UID: \"fa405f18-4c0b-468d-863a-d2a5b34c65da\") " pod="openshift-cluster-node-tuning-operator/tuned-v4bjg" Jul 05 19:32:29.088337 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:29.088333 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dwpcd\" (UniqueName: \"kubernetes.io/projected/bfb32e10-9908-43c0-90f2-629b8c81ebc8-kube-api-access-dwpcd\") pod \"node-resolver-d52jr\" (UID: \"bfb32e10-9908-43c0-90f2-629b8c81ebc8\") " pod="openshift-dns/node-resolver-d52jr" Jul 05 19:32:29.088591 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:29.088422 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/3567b575-3458-4a8c-9cac-04d8c9f7d1a6-os-release\") pod \"multus-additional-cni-plugins-dlr8v\" (UID: \"3567b575-3458-4a8c-9cac-04d8c9f7d1a6\") " pod="openshift-multus/multus-additional-cni-plugins-dlr8v" Jul 05 19:32:29.088591 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:29.088428 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/fa405f18-4c0b-468d-863a-d2a5b34c65da-host\") pod \"tuned-v4bjg\" (UID: \"fa405f18-4c0b-468d-863a-d2a5b34c65da\") " pod="openshift-cluster-node-tuning-operator/tuned-v4bjg" Jul 05 19:32:29.088591 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:29.088459 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3d6f9f21-755d-491c-ac1f-f94df1e44b79-run-openvswitch\") pod \"ovnkube-node-jp9t6\" (UID: \"3d6f9f21-755d-491c-ac1f-f94df1e44b79\") " pod="openshift-ovn-kubernetes/ovnkube-node-jp9t6" Jul 05 19:32:29.088591 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:29.088490 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/3d6f9f21-755d-491c-ac1f-f94df1e44b79-host-cni-bin\") pod \"ovnkube-node-jp9t6\" (UID: \"3d6f9f21-755d-491c-ac1f-f94df1e44b79\") " pod="openshift-ovn-kubernetes/ovnkube-node-jp9t6" Jul 05 19:32:29.088591 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:29.088519 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/3d6f9f21-755d-491c-ac1f-f94df1e44b79-ovnkube-script-lib\") pod \"ovnkube-node-jp9t6\" (UID: \"3d6f9f21-755d-491c-ac1f-f94df1e44b79\") " pod="openshift-ovn-kubernetes/ovnkube-node-jp9t6" Jul 05 19:32:29.088591 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:29.088527 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/3567b575-3458-4a8c-9cac-04d8c9f7d1a6-os-release\") pod \"multus-additional-cni-plugins-dlr8v\" (UID: \"3567b575-3458-4a8c-9cac-04d8c9f7d1a6\") " pod="openshift-multus/multus-additional-cni-plugins-dlr8v" Jul 05 19:32:29.088591 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:29.088546 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/b256bcc8-4bdd-48db-b050-c02c368ef29d-dbus\") pod \"global-pull-secret-syncer-k2b5v\" (UID: \"b256bcc8-4bdd-48db-b050-c02c368ef29d\") " pod="kube-system/global-pull-secret-syncer-k2b5v" Jul 05 19:32:29.088591 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:29.088579 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/3d6f9f21-755d-491c-ac1f-f94df1e44b79-host-cni-bin\") pod \"ovnkube-node-jp9t6\" (UID: \"3d6f9f21-755d-491c-ac1f-f94df1e44b79\") " pod="openshift-ovn-kubernetes/ovnkube-node-jp9t6" Jul 05 19:32:29.088591 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:29.088583 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4r56v\" (UniqueName: \"kubernetes.io/projected/05684556-d2e2-4157-9f17-097dee8230a0-kube-api-access-4r56v\") pod \"network-metrics-daemon-brllj\" (UID: \"05684556-d2e2-4157-9f17-097dee8230a0\") " pod="openshift-multus/network-metrics-daemon-brllj" Jul 05 19:32:29.089084 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:29.088611 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b256bcc8-4bdd-48db-b050-c02c368ef29d-original-pull-secret\") pod \"global-pull-secret-syncer-k2b5v\" (UID: \"b256bcc8-4bdd-48db-b050-c02c368ef29d\") " pod="kube-system/global-pull-secret-syncer-k2b5v" Jul 05 19:32:29.089084 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:29.088619 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3d6f9f21-755d-491c-ac1f-f94df1e44b79-run-openvswitch\") pod \"ovnkube-node-jp9t6\" (UID: \"3d6f9f21-755d-491c-ac1f-f94df1e44b79\") " pod="openshift-ovn-kubernetes/ovnkube-node-jp9t6" Jul 05 19:32:29.089084 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:29.088642 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/fa405f18-4c0b-468d-863a-d2a5b34c65da-etc-sysconfig\") pod \"tuned-v4bjg\" (UID: \"fa405f18-4c0b-468d-863a-d2a5b34c65da\") " pod="openshift-cluster-node-tuning-operator/tuned-v4bjg" Jul 05 19:32:29.089084 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:29.088672 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/fa405f18-4c0b-468d-863a-d2a5b34c65da-tmp\") pod \"tuned-v4bjg\" (UID: \"fa405f18-4c0b-468d-863a-d2a5b34c65da\") " pod="openshift-cluster-node-tuning-operator/tuned-v4bjg" Jul 05 19:32:29.089084 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:29.088700 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/3d6f9f21-755d-491c-ac1f-f94df1e44b79-host-kubelet\") pod \"ovnkube-node-jp9t6\" (UID: \"3d6f9f21-755d-491c-ac1f-f94df1e44b79\") " pod="openshift-ovn-kubernetes/ovnkube-node-jp9t6" Jul 05 19:32:29.089084 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:29.088726 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/fa405f18-4c0b-468d-863a-d2a5b34c65da-lib-modules\") pod \"tuned-v4bjg\" (UID: \"fa405f18-4c0b-468d-863a-d2a5b34c65da\") " pod="openshift-cluster-node-tuning-operator/tuned-v4bjg" Jul 05 19:32:29.089084 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:29.088744 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/b256bcc8-4bdd-48db-b050-c02c368ef29d-dbus\") pod \"global-pull-secret-syncer-k2b5v\" (UID: \"b256bcc8-4bdd-48db-b050-c02c368ef29d\") " pod="kube-system/global-pull-secret-syncer-k2b5v" Jul 05 19:32:29.089084 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:29.088752 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/fa405f18-4c0b-468d-863a-d2a5b34c65da-etc-tuned\") pod \"tuned-v4bjg\" (UID: \"fa405f18-4c0b-468d-863a-d2a5b34c65da\") " pod="openshift-cluster-node-tuning-operator/tuned-v4bjg" Jul 05 19:32:29.089084 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:29.088796 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bfb32e10-9908-43c0-90f2-629b8c81ebc8-tmp-dir\") pod \"node-resolver-d52jr\" (UID: \"bfb32e10-9908-43c0-90f2-629b8c81ebc8\") " pod="openshift-dns/node-resolver-d52jr" Jul 05 19:32:29.089084 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:29.088827 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/3d6f9f21-755d-491c-ac1f-f94df1e44b79-run-systemd\") pod \"ovnkube-node-jp9t6\" (UID: \"3d6f9f21-755d-491c-ac1f-f94df1e44b79\") " pod="openshift-ovn-kubernetes/ovnkube-node-jp9t6" Jul 05 19:32:29.089084 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:29.088847 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/fa405f18-4c0b-468d-863a-d2a5b34c65da-etc-sysconfig\") pod \"tuned-v4bjg\" (UID: \"fa405f18-4c0b-468d-863a-d2a5b34c65da\") " pod="openshift-cluster-node-tuning-operator/tuned-v4bjg" Jul 05 19:32:29.089084 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:29.088868 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/3d6f9f21-755d-491c-ac1f-f94df1e44b79-host-kubelet\") pod \"ovnkube-node-jp9t6\" (UID: \"3d6f9f21-755d-491c-ac1f-f94df1e44b79\") " pod="openshift-ovn-kubernetes/ovnkube-node-jp9t6" Jul 05 19:32:29.089084 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:29.088896 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/3d6f9f21-755d-491c-ac1f-f94df1e44b79-log-socket\") pod \"ovnkube-node-jp9t6\" (UID: \"3d6f9f21-755d-491c-ac1f-f94df1e44b79\") " pod="openshift-ovn-kubernetes/ovnkube-node-jp9t6" Jul 05 19:32:29.089084 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:29.088907 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/3d6f9f21-755d-491c-ac1f-f94df1e44b79-run-systemd\") pod \"ovnkube-node-jp9t6\" (UID: \"3d6f9f21-755d-491c-ac1f-f94df1e44b79\") " pod="openshift-ovn-kubernetes/ovnkube-node-jp9t6" Jul 05 19:32:29.089084 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:29.088853 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/3d6f9f21-755d-491c-ac1f-f94df1e44b79-log-socket\") pod \"ovnkube-node-jp9t6\" (UID: \"3d6f9f21-755d-491c-ac1f-f94df1e44b79\") " pod="openshift-ovn-kubernetes/ovnkube-node-jp9t6" Jul 05 19:32:29.089084 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:29.088928 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/fa405f18-4c0b-468d-863a-d2a5b34c65da-lib-modules\") pod \"tuned-v4bjg\" (UID: \"fa405f18-4c0b-468d-863a-d2a5b34c65da\") " pod="openshift-cluster-node-tuning-operator/tuned-v4bjg" Jul 05 19:32:29.089084 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:29.088947 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3d6f9f21-755d-491c-ac1f-f94df1e44b79-host-run-ovn-kubernetes\") pod \"ovnkube-node-jp9t6\" (UID: \"3d6f9f21-755d-491c-ac1f-f94df1e44b79\") " pod="openshift-ovn-kubernetes/ovnkube-node-jp9t6" Jul 05 19:32:29.089084 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:29.088975 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/bfb32e10-9908-43c0-90f2-629b8c81ebc8-hosts-file\") pod \"node-resolver-d52jr\" (UID: \"bfb32e10-9908-43c0-90f2-629b8c81ebc8\") " pod="openshift-dns/node-resolver-d52jr" Jul 05 19:32:29.090055 ip-10-0-133-7 kubenswrapper[2572]: E0705 19:32:29.088998 2572 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 05 19:32:29.090055 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:29.089006 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/3d6f9f21-755d-491c-ac1f-f94df1e44b79-ovn-node-metrics-cert\") pod \"ovnkube-node-jp9t6\" (UID: \"3d6f9f21-755d-491c-ac1f-f94df1e44b79\") " pod="openshift-ovn-kubernetes/ovnkube-node-jp9t6" Jul 05 19:32:29.090055 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:29.089048 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/3567b575-3458-4a8c-9cac-04d8c9f7d1a6-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-dlr8v\" (UID: \"3567b575-3458-4a8c-9cac-04d8c9f7d1a6\") " pod="openshift-multus/multus-additional-cni-plugins-dlr8v" Jul 05 19:32:29.090055 ip-10-0-133-7 kubenswrapper[2572]: E0705 19:32:29.089088 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b256bcc8-4bdd-48db-b050-c02c368ef29d-original-pull-secret podName:b256bcc8-4bdd-48db-b050-c02c368ef29d nodeName:}" failed. No retries permitted until 2026-07-05 19:32:29.58906286 +0000 UTC m=+2.988410307 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/b256bcc8-4bdd-48db-b050-c02c368ef29d-original-pull-secret") pod "global-pull-secret-syncer-k2b5v" (UID: "b256bcc8-4bdd-48db-b050-c02c368ef29d") : object "kube-system"/"original-pull-secret" not registered Jul 05 19:32:29.090055 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:29.089110 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/fa405f18-4c0b-468d-863a-d2a5b34c65da-sys\") pod \"tuned-v4bjg\" (UID: \"fa405f18-4c0b-468d-863a-d2a5b34c65da\") " pod="openshift-cluster-node-tuning-operator/tuned-v4bjg" Jul 05 19:32:29.090055 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:29.089154 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/3d6f9f21-755d-491c-ac1f-f94df1e44b79-host-run-netns\") pod \"ovnkube-node-jp9t6\" (UID: \"3d6f9f21-755d-491c-ac1f-f94df1e44b79\") " pod="openshift-ovn-kubernetes/ovnkube-node-jp9t6" Jul 05 19:32:29.090055 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:29.089181 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3d6f9f21-755d-491c-ac1f-f94df1e44b79-etc-openvswitch\") pod \"ovnkube-node-jp9t6\" (UID: \"3d6f9f21-755d-491c-ac1f-f94df1e44b79\") " pod="openshift-ovn-kubernetes/ovnkube-node-jp9t6" Jul 05 19:32:29.090055 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:29.089209 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/3567b575-3458-4a8c-9cac-04d8c9f7d1a6-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-dlr8v\" (UID: \"3567b575-3458-4a8c-9cac-04d8c9f7d1a6\") " pod="openshift-multus/multus-additional-cni-plugins-dlr8v" Jul 05 19:32:29.090055 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:29.089232 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3d6f9f21-755d-491c-ac1f-f94df1e44b79-host-run-ovn-kubernetes\") pod \"ovnkube-node-jp9t6\" (UID: \"3d6f9f21-755d-491c-ac1f-f94df1e44b79\") " pod="openshift-ovn-kubernetes/ovnkube-node-jp9t6" Jul 05 19:32:29.090055 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:29.089236 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/9349dbd7-9c70-4a38-bd03-2e5bf10e1ecd-iptables-alerter-script\") pod \"iptables-alerter-zh6wq\" (UID: \"9349dbd7-9c70-4a38-bd03-2e5bf10e1ecd\") " pod="openshift-network-operator/iptables-alerter-zh6wq" Jul 05 19:32:29.090055 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:29.089283 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/fa405f18-4c0b-468d-863a-d2a5b34c65da-etc-kubernetes\") pod \"tuned-v4bjg\" (UID: \"fa405f18-4c0b-468d-863a-d2a5b34c65da\") " pod="openshift-cluster-node-tuning-operator/tuned-v4bjg" Jul 05 19:32:29.090055 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:29.089316 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/fa405f18-4c0b-468d-863a-d2a5b34c65da-etc-modprobe-d\") pod \"tuned-v4bjg\" (UID: \"fa405f18-4c0b-468d-863a-d2a5b34c65da\") " pod="openshift-cluster-node-tuning-operator/tuned-v4bjg" Jul 05 19:32:29.090055 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:29.089347 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/3567b575-3458-4a8c-9cac-04d8c9f7d1a6-tuning-conf-dir\") pod \"multus-additional-cni-plugins-dlr8v\" (UID: \"3567b575-3458-4a8c-9cac-04d8c9f7d1a6\") " pod="openshift-multus/multus-additional-cni-plugins-dlr8v" Jul 05 19:32:29.090055 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:29.089381 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/fa405f18-4c0b-468d-863a-d2a5b34c65da-etc-systemd\") pod \"tuned-v4bjg\" (UID: \"fa405f18-4c0b-468d-863a-d2a5b34c65da\") " pod="openshift-cluster-node-tuning-operator/tuned-v4bjg" Jul 05 19:32:29.090055 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:29.089385 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/3d6f9f21-755d-491c-ac1f-f94df1e44b79-ovnkube-script-lib\") pod \"ovnkube-node-jp9t6\" (UID: \"3d6f9f21-755d-491c-ac1f-f94df1e44b79\") " pod="openshift-ovn-kubernetes/ovnkube-node-jp9t6" Jul 05 19:32:29.090055 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:29.089415 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3567b575-3458-4a8c-9cac-04d8c9f7d1a6-system-cni-dir\") pod \"multus-additional-cni-plugins-dlr8v\" (UID: \"3567b575-3458-4a8c-9cac-04d8c9f7d1a6\") " pod="openshift-multus/multus-additional-cni-plugins-dlr8v" Jul 05 19:32:29.090917 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:29.089443 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/3567b575-3458-4a8c-9cac-04d8c9f7d1a6-cnibin\") pod \"multus-additional-cni-plugins-dlr8v\" (UID: \"3567b575-3458-4a8c-9cac-04d8c9f7d1a6\") " pod="openshift-multus/multus-additional-cni-plugins-dlr8v" Jul 05 19:32:29.090917 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:29.089474 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q7ff8\" (UniqueName: \"kubernetes.io/projected/3567b575-3458-4a8c-9cac-04d8c9f7d1a6-kube-api-access-q7ff8\") pod \"multus-additional-cni-plugins-dlr8v\" (UID: \"3567b575-3458-4a8c-9cac-04d8c9f7d1a6\") " pod="openshift-multus/multus-additional-cni-plugins-dlr8v" Jul 05 19:32:29.090917 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:29.089466 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/fa405f18-4c0b-468d-863a-d2a5b34c65da-sys\") pod \"tuned-v4bjg\" (UID: \"fa405f18-4c0b-468d-863a-d2a5b34c65da\") " pod="openshift-cluster-node-tuning-operator/tuned-v4bjg" Jul 05 19:32:29.090917 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:29.089504 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-94vwv\" (UniqueName: \"kubernetes.io/projected/9349dbd7-9c70-4a38-bd03-2e5bf10e1ecd-kube-api-access-94vwv\") pod \"iptables-alerter-zh6wq\" (UID: \"9349dbd7-9c70-4a38-bd03-2e5bf10e1ecd\") " pod="openshift-network-operator/iptables-alerter-zh6wq" Jul 05 19:32:29.090917 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:29.089533 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/fa405f18-4c0b-468d-863a-d2a5b34c65da-run\") pod \"tuned-v4bjg\" (UID: \"fa405f18-4c0b-468d-863a-d2a5b34c65da\") " pod="openshift-cluster-node-tuning-operator/tuned-v4bjg" Jul 05 19:32:29.090917 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:29.089559 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/3d6f9f21-755d-491c-ac1f-f94df1e44b79-host-slash\") pod \"ovnkube-node-jp9t6\" (UID: \"3d6f9f21-755d-491c-ac1f-f94df1e44b79\") " pod="openshift-ovn-kubernetes/ovnkube-node-jp9t6" Jul 05 19:32:29.090917 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:29.089587 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3d6f9f21-755d-491c-ac1f-f94df1e44b79-var-lib-openvswitch\") pod \"ovnkube-node-jp9t6\" (UID: \"3d6f9f21-755d-491c-ac1f-f94df1e44b79\") " pod="openshift-ovn-kubernetes/ovnkube-node-jp9t6" Jul 05 19:32:29.090917 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:29.089613 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/b256bcc8-4bdd-48db-b050-c02c368ef29d-kubelet-config\") pod \"global-pull-secret-syncer-k2b5v\" (UID: \"b256bcc8-4bdd-48db-b050-c02c368ef29d\") " pod="kube-system/global-pull-secret-syncer-k2b5v" Jul 05 19:32:29.090917 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:29.089643 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/fa405f18-4c0b-468d-863a-d2a5b34c65da-etc-sysctl-d\") pod \"tuned-v4bjg\" (UID: \"fa405f18-4c0b-468d-863a-d2a5b34c65da\") " pod="openshift-cluster-node-tuning-operator/tuned-v4bjg" Jul 05 19:32:29.090917 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:29.089671 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/fa405f18-4c0b-468d-863a-d2a5b34c65da-var-lib-kubelet\") pod \"tuned-v4bjg\" (UID: \"fa405f18-4c0b-468d-863a-d2a5b34c65da\") " pod="openshift-cluster-node-tuning-operator/tuned-v4bjg" Jul 05 19:32:29.090917 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:29.089699 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/3567b575-3458-4a8c-9cac-04d8c9f7d1a6-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-dlr8v\" (UID: \"3567b575-3458-4a8c-9cac-04d8c9f7d1a6\") " pod="openshift-multus/multus-additional-cni-plugins-dlr8v" Jul 05 19:32:29.090917 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:29.089711 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/3d6f9f21-755d-491c-ac1f-f94df1e44b79-systemd-units\") pod \"ovnkube-node-jp9t6\" (UID: \"3d6f9f21-755d-491c-ac1f-f94df1e44b79\") " pod="openshift-ovn-kubernetes/ovnkube-node-jp9t6" Jul 05 19:32:29.090917 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:29.089718 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/fa405f18-4c0b-468d-863a-d2a5b34c65da-etc-kubernetes\") pod \"tuned-v4bjg\" (UID: \"fa405f18-4c0b-468d-863a-d2a5b34c65da\") " pod="openshift-cluster-node-tuning-operator/tuned-v4bjg" Jul 05 19:32:29.090917 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:29.089740 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/3d6f9f21-755d-491c-ac1f-f94df1e44b79-ovnkube-config\") pod \"ovnkube-node-jp9t6\" (UID: \"3d6f9f21-755d-491c-ac1f-f94df1e44b79\") " pod="openshift-ovn-kubernetes/ovnkube-node-jp9t6" Jul 05 19:32:29.090917 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:29.089761 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3d6f9f21-755d-491c-ac1f-f94df1e44b79-etc-openvswitch\") pod \"ovnkube-node-jp9t6\" (UID: \"3d6f9f21-755d-491c-ac1f-f94df1e44b79\") " pod="openshift-ovn-kubernetes/ovnkube-node-jp9t6" Jul 05 19:32:29.090917 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:29.089768 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/3567b575-3458-4a8c-9cac-04d8c9f7d1a6-cni-binary-copy\") pod \"multus-additional-cni-plugins-dlr8v\" (UID: \"3567b575-3458-4a8c-9cac-04d8c9f7d1a6\") " pod="openshift-multus/multus-additional-cni-plugins-dlr8v" Jul 05 19:32:29.090917 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:29.089798 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/05684556-d2e2-4157-9f17-097dee8230a0-metrics-certs\") pod \"network-metrics-daemon-brllj\" (UID: \"05684556-d2e2-4157-9f17-097dee8230a0\") " pod="openshift-multus/network-metrics-daemon-brllj" Jul 05 19:32:29.091799 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:29.089811 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/fa405f18-4c0b-468d-863a-d2a5b34c65da-etc-modprobe-d\") pod \"tuned-v4bjg\" (UID: \"fa405f18-4c0b-468d-863a-d2a5b34c65da\") " pod="openshift-cluster-node-tuning-operator/tuned-v4bjg" Jul 05 19:32:29.091799 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:29.089833 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/fa405f18-4c0b-468d-863a-d2a5b34c65da-etc-systemd\") pod \"tuned-v4bjg\" (UID: \"fa405f18-4c0b-468d-863a-d2a5b34c65da\") " pod="openshift-cluster-node-tuning-operator/tuned-v4bjg" Jul 05 19:32:29.091799 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:29.089851 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3567b575-3458-4a8c-9cac-04d8c9f7d1a6-system-cni-dir\") pod \"multus-additional-cni-plugins-dlr8v\" (UID: \"3567b575-3458-4a8c-9cac-04d8c9f7d1a6\") " pod="openshift-multus/multus-additional-cni-plugins-dlr8v" Jul 05 19:32:29.091799 ip-10-0-133-7 kubenswrapper[2572]: E0705 19:32:29.089902 2572 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 05 19:32:29.091799 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:29.089906 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/3d6f9f21-755d-491c-ac1f-f94df1e44b79-node-log\") pod \"ovnkube-node-jp9t6\" (UID: \"3d6f9f21-755d-491c-ac1f-f94df1e44b79\") " pod="openshift-ovn-kubernetes/ovnkube-node-jp9t6" Jul 05 19:32:29.091799 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:29.089920 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/3567b575-3458-4a8c-9cac-04d8c9f7d1a6-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-dlr8v\" (UID: \"3567b575-3458-4a8c-9cac-04d8c9f7d1a6\") " pod="openshift-multus/multus-additional-cni-plugins-dlr8v" Jul 05 19:32:29.091799 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:29.089942 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3d6f9f21-755d-491c-ac1f-f94df1e44b79-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-jp9t6\" (UID: \"3d6f9f21-755d-491c-ac1f-f94df1e44b79\") " pod="openshift-ovn-kubernetes/ovnkube-node-jp9t6" Jul 05 19:32:29.091799 ip-10-0-133-7 kubenswrapper[2572]: E0705 19:32:29.089966 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/05684556-d2e2-4157-9f17-097dee8230a0-metrics-certs podName:05684556-d2e2-4157-9f17-097dee8230a0 nodeName:}" failed. No retries permitted until 2026-07-05 19:32:29.589949398 +0000 UTC m=+2.989296873 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/05684556-d2e2-4157-9f17-097dee8230a0-metrics-certs") pod "network-metrics-daemon-brllj" (UID: "05684556-d2e2-4157-9f17-097dee8230a0") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 05 19:32:29.091799 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:29.089973 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/3567b575-3458-4a8c-9cac-04d8c9f7d1a6-tuning-conf-dir\") pod \"multus-additional-cni-plugins-dlr8v\" (UID: \"3567b575-3458-4a8c-9cac-04d8c9f7d1a6\") " pod="openshift-multus/multus-additional-cni-plugins-dlr8v" Jul 05 19:32:29.091799 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:29.089989 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/bfb32e10-9908-43c0-90f2-629b8c81ebc8-hosts-file\") pod \"node-resolver-d52jr\" (UID: \"bfb32e10-9908-43c0-90f2-629b8c81ebc8\") " pod="openshift-dns/node-resolver-d52jr" Jul 05 19:32:29.091799 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:29.090010 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/3d6f9f21-755d-491c-ac1f-f94df1e44b79-node-log\") pod \"ovnkube-node-jp9t6\" (UID: \"3d6f9f21-755d-491c-ac1f-f94df1e44b79\") " pod="openshift-ovn-kubernetes/ovnkube-node-jp9t6" Jul 05 19:32:29.091799 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:29.090053 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3d6f9f21-755d-491c-ac1f-f94df1e44b79-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-jp9t6\" (UID: \"3d6f9f21-755d-491c-ac1f-f94df1e44b79\") " pod="openshift-ovn-kubernetes/ovnkube-node-jp9t6" Jul 05 19:32:29.091799 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:29.090064 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/3d6f9f21-755d-491c-ac1f-f94df1e44b79-systemd-units\") pod \"ovnkube-node-jp9t6\" (UID: \"3d6f9f21-755d-491c-ac1f-f94df1e44b79\") " pod="openshift-ovn-kubernetes/ovnkube-node-jp9t6" Jul 05 19:32:29.091799 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:29.090058 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/fa405f18-4c0b-468d-863a-d2a5b34c65da-run\") pod \"tuned-v4bjg\" (UID: \"fa405f18-4c0b-468d-863a-d2a5b34c65da\") " pod="openshift-cluster-node-tuning-operator/tuned-v4bjg" Jul 05 19:32:29.091799 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:29.090117 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/fa405f18-4c0b-468d-863a-d2a5b34c65da-etc-sysctl-d\") pod \"tuned-v4bjg\" (UID: \"fa405f18-4c0b-468d-863a-d2a5b34c65da\") " pod="openshift-cluster-node-tuning-operator/tuned-v4bjg" Jul 05 19:32:29.091799 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:29.090120 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/9349dbd7-9c70-4a38-bd03-2e5bf10e1ecd-iptables-alerter-script\") pod \"iptables-alerter-zh6wq\" (UID: \"9349dbd7-9c70-4a38-bd03-2e5bf10e1ecd\") " pod="openshift-network-operator/iptables-alerter-zh6wq" Jul 05 19:32:29.091799 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:29.089668 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/3567b575-3458-4a8c-9cac-04d8c9f7d1a6-cnibin\") pod \"multus-additional-cni-plugins-dlr8v\" (UID: \"3567b575-3458-4a8c-9cac-04d8c9f7d1a6\") " pod="openshift-multus/multus-additional-cni-plugins-dlr8v" Jul 05 19:32:29.092675 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:29.090136 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/fa405f18-4c0b-468d-863a-d2a5b34c65da-var-lib-kubelet\") pod \"tuned-v4bjg\" (UID: \"fa405f18-4c0b-468d-863a-d2a5b34c65da\") " pod="openshift-cluster-node-tuning-operator/tuned-v4bjg" Jul 05 19:32:29.092675 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:29.090123 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/b256bcc8-4bdd-48db-b050-c02c368ef29d-kubelet-config\") pod \"global-pull-secret-syncer-k2b5v\" (UID: \"b256bcc8-4bdd-48db-b050-c02c368ef29d\") " pod="kube-system/global-pull-secret-syncer-k2b5v" Jul 05 19:32:29.092675 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:29.090152 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/3d6f9f21-755d-491c-ac1f-f94df1e44b79-host-slash\") pod \"ovnkube-node-jp9t6\" (UID: \"3d6f9f21-755d-491c-ac1f-f94df1e44b79\") " pod="openshift-ovn-kubernetes/ovnkube-node-jp9t6" Jul 05 19:32:29.092675 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:29.090164 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/9349dbd7-9c70-4a38-bd03-2e5bf10e1ecd-host-slash\") pod \"iptables-alerter-zh6wq\" (UID: \"9349dbd7-9c70-4a38-bd03-2e5bf10e1ecd\") " pod="openshift-network-operator/iptables-alerter-zh6wq" Jul 05 19:32:29.092675 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:29.090193 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/e9938fdb-3276-474c-87c7-0386eacd806a-agent-certs\") pod \"konnectivity-agent-6ldkn\" (UID: \"e9938fdb-3276-474c-87c7-0386eacd806a\") " pod="kube-system/konnectivity-agent-6ldkn" Jul 05 19:32:29.092675 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:29.090220 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/fa405f18-4c0b-468d-863a-d2a5b34c65da-etc-sysctl-conf\") pod \"tuned-v4bjg\" (UID: \"fa405f18-4c0b-468d-863a-d2a5b34c65da\") " pod="openshift-cluster-node-tuning-operator/tuned-v4bjg" Jul 05 19:32:29.092675 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:29.090245 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/3d6f9f21-755d-491c-ac1f-f94df1e44b79-host-cni-netd\") pod \"ovnkube-node-jp9t6\" (UID: \"3d6f9f21-755d-491c-ac1f-f94df1e44b79\") " pod="openshift-ovn-kubernetes/ovnkube-node-jp9t6" Jul 05 19:32:29.092675 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:29.090254 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/9349dbd7-9c70-4a38-bd03-2e5bf10e1ecd-host-slash\") pod \"iptables-alerter-zh6wq\" (UID: \"9349dbd7-9c70-4a38-bd03-2e5bf10e1ecd\") " pod="openshift-network-operator/iptables-alerter-zh6wq" Jul 05 19:32:29.092675 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:29.090193 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/3d6f9f21-755d-491c-ac1f-f94df1e44b79-host-run-netns\") pod \"ovnkube-node-jp9t6\" (UID: \"3d6f9f21-755d-491c-ac1f-f94df1e44b79\") " pod="openshift-ovn-kubernetes/ovnkube-node-jp9t6" Jul 05 19:32:29.092675 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:29.090272 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/3d6f9f21-755d-491c-ac1f-f94df1e44b79-env-overrides\") pod \"ovnkube-node-jp9t6\" (UID: \"3d6f9f21-755d-491c-ac1f-f94df1e44b79\") " pod="openshift-ovn-kubernetes/ovnkube-node-jp9t6" Jul 05 19:32:29.092675 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:29.090299 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vr864\" (UniqueName: \"kubernetes.io/projected/3d6f9f21-755d-491c-ac1f-f94df1e44b79-kube-api-access-vr864\") pod \"ovnkube-node-jp9t6\" (UID: \"3d6f9f21-755d-491c-ac1f-f94df1e44b79\") " pod="openshift-ovn-kubernetes/ovnkube-node-jp9t6" Jul 05 19:32:29.092675 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:29.090324 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/e9938fdb-3276-474c-87c7-0386eacd806a-konnectivity-ca\") pod \"konnectivity-agent-6ldkn\" (UID: \"e9938fdb-3276-474c-87c7-0386eacd806a\") " pod="kube-system/konnectivity-agent-6ldkn" Jul 05 19:32:29.092675 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:29.090348 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z9zp5\" (UniqueName: \"kubernetes.io/projected/fa405f18-4c0b-468d-863a-d2a5b34c65da-kube-api-access-z9zp5\") pod \"tuned-v4bjg\" (UID: \"fa405f18-4c0b-468d-863a-d2a5b34c65da\") " pod="openshift-cluster-node-tuning-operator/tuned-v4bjg" Jul 05 19:32:29.092675 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:29.090414 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/fa405f18-4c0b-468d-863a-d2a5b34c65da-etc-sysctl-conf\") pod \"tuned-v4bjg\" (UID: \"fa405f18-4c0b-468d-863a-d2a5b34c65da\") " pod="openshift-cluster-node-tuning-operator/tuned-v4bjg" Jul 05 19:32:29.092675 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:29.090568 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bfb32e10-9908-43c0-90f2-629b8c81ebc8-tmp-dir\") pod \"node-resolver-d52jr\" (UID: \"bfb32e10-9908-43c0-90f2-629b8c81ebc8\") " pod="openshift-dns/node-resolver-d52jr" Jul 05 19:32:29.092675 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:29.090610 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/3567b575-3458-4a8c-9cac-04d8c9f7d1a6-cni-binary-copy\") pod \"multus-additional-cni-plugins-dlr8v\" (UID: \"3567b575-3458-4a8c-9cac-04d8c9f7d1a6\") " pod="openshift-multus/multus-additional-cni-plugins-dlr8v" Jul 05 19:32:29.092675 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:29.090666 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/3d6f9f21-755d-491c-ac1f-f94df1e44b79-host-cni-netd\") pod \"ovnkube-node-jp9t6\" (UID: \"3d6f9f21-755d-491c-ac1f-f94df1e44b79\") " pod="openshift-ovn-kubernetes/ovnkube-node-jp9t6" Jul 05 19:32:29.093557 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:29.090668 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3d6f9f21-755d-491c-ac1f-f94df1e44b79-var-lib-openvswitch\") pod \"ovnkube-node-jp9t6\" (UID: \"3d6f9f21-755d-491c-ac1f-f94df1e44b79\") " pod="openshift-ovn-kubernetes/ovnkube-node-jp9t6" Jul 05 19:32:29.093557 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:29.090690 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/3d6f9f21-755d-491c-ac1f-f94df1e44b79-ovnkube-config\") pod \"ovnkube-node-jp9t6\" (UID: \"3d6f9f21-755d-491c-ac1f-f94df1e44b79\") " pod="openshift-ovn-kubernetes/ovnkube-node-jp9t6" Jul 05 19:32:29.093557 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:29.090828 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/3d6f9f21-755d-491c-ac1f-f94df1e44b79-env-overrides\") pod \"ovnkube-node-jp9t6\" (UID: \"3d6f9f21-755d-491c-ac1f-f94df1e44b79\") " pod="openshift-ovn-kubernetes/ovnkube-node-jp9t6" Jul 05 19:32:29.093557 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:29.091234 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/e9938fdb-3276-474c-87c7-0386eacd806a-konnectivity-ca\") pod \"konnectivity-agent-6ldkn\" (UID: \"e9938fdb-3276-474c-87c7-0386eacd806a\") " pod="kube-system/konnectivity-agent-6ldkn" Jul 05 19:32:29.093557 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:29.093420 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/fa405f18-4c0b-468d-863a-d2a5b34c65da-etc-tuned\") pod \"tuned-v4bjg\" (UID: \"fa405f18-4c0b-468d-863a-d2a5b34c65da\") " pod="openshift-cluster-node-tuning-operator/tuned-v4bjg" Jul 05 19:32:29.093811 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:29.093668 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/fa405f18-4c0b-468d-863a-d2a5b34c65da-tmp\") pod \"tuned-v4bjg\" (UID: \"fa405f18-4c0b-468d-863a-d2a5b34c65da\") " pod="openshift-cluster-node-tuning-operator/tuned-v4bjg" Jul 05 19:32:29.095033 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:29.094993 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/e9938fdb-3276-474c-87c7-0386eacd806a-agent-certs\") pod \"konnectivity-agent-6ldkn\" (UID: \"e9938fdb-3276-474c-87c7-0386eacd806a\") " pod="kube-system/konnectivity-agent-6ldkn" Jul 05 19:32:29.096054 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:29.095973 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/3d6f9f21-755d-491c-ac1f-f94df1e44b79-ovn-node-metrics-cert\") pod \"ovnkube-node-jp9t6\" (UID: \"3d6f9f21-755d-491c-ac1f-f94df1e44b79\") " pod="openshift-ovn-kubernetes/ovnkube-node-jp9t6" Jul 05 19:32:29.096054 ip-10-0-133-7 kubenswrapper[2572]: E0705 19:32:29.096013 2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 05 19:32:29.096054 ip-10-0-133-7 kubenswrapper[2572]: E0705 19:32:29.096033 2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 05 19:32:29.096054 ip-10-0-133-7 kubenswrapper[2572]: E0705 19:32:29.096048 2572 projected.go:196] Error preparing data for projected volume kube-api-access-55jpj for pod openshift-network-diagnostics/network-check-target-fjdxw: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 05 19:32:29.096322 ip-10-0-133-7 kubenswrapper[2572]: E0705 19:32:29.096103 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1fd5cdc6-3c1a-4412-830c-b871c7087a35-kube-api-access-55jpj podName:1fd5cdc6-3c1a-4412-830c-b871c7087a35 nodeName:}" failed. No retries permitted until 2026-07-05 19:32:29.596086629 +0000 UTC m=+2.995434099 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-55jpj" (UniqueName: "kubernetes.io/projected/1fd5cdc6-3c1a-4412-830c-b871c7087a35-kube-api-access-55jpj") pod "network-check-target-fjdxw" (UID: "1fd5cdc6-3c1a-4412-830c-b871c7087a35") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 05 19:32:29.100171 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:29.100123 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4r56v\" (UniqueName: \"kubernetes.io/projected/05684556-d2e2-4157-9f17-097dee8230a0-kube-api-access-4r56v\") pod \"network-metrics-daemon-brllj\" (UID: \"05684556-d2e2-4157-9f17-097dee8230a0\") " pod="openshift-multus/network-metrics-daemon-brllj" Jul 05 19:32:29.100300 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:29.100247 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dwpcd\" (UniqueName: \"kubernetes.io/projected/bfb32e10-9908-43c0-90f2-629b8c81ebc8-kube-api-access-dwpcd\") pod \"node-resolver-d52jr\" (UID: \"bfb32e10-9908-43c0-90f2-629b8c81ebc8\") " pod="openshift-dns/node-resolver-d52jr" Jul 05 19:32:29.104091 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:29.104006 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q7ff8\" (UniqueName: \"kubernetes.io/projected/3567b575-3458-4a8c-9cac-04d8c9f7d1a6-kube-api-access-q7ff8\") pod \"multus-additional-cni-plugins-dlr8v\" (UID: \"3567b575-3458-4a8c-9cac-04d8c9f7d1a6\") " pod="openshift-multus/multus-additional-cni-plugins-dlr8v" Jul 05 19:32:29.104664 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:29.104637 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z9zp5\" (UniqueName: \"kubernetes.io/projected/fa405f18-4c0b-468d-863a-d2a5b34c65da-kube-api-access-z9zp5\") pod \"tuned-v4bjg\" (UID: \"fa405f18-4c0b-468d-863a-d2a5b34c65da\") " pod="openshift-cluster-node-tuning-operator/tuned-v4bjg" Jul 05 19:32:29.106368 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:29.106346 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vr864\" (UniqueName: \"kubernetes.io/projected/3d6f9f21-755d-491c-ac1f-f94df1e44b79-kube-api-access-vr864\") pod \"ovnkube-node-jp9t6\" (UID: \"3d6f9f21-755d-491c-ac1f-f94df1e44b79\") " pod="openshift-ovn-kubernetes/ovnkube-node-jp9t6" Jul 05 19:32:29.106910 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:29.106882 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-94vwv\" (UniqueName: \"kubernetes.io/projected/9349dbd7-9c70-4a38-bd03-2e5bf10e1ecd-kube-api-access-94vwv\") pod \"iptables-alerter-zh6wq\" (UID: \"9349dbd7-9c70-4a38-bd03-2e5bf10e1ecd\") " pod="openshift-network-operator/iptables-alerter-zh6wq" Jul 05 19:32:29.187044 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:29.187006 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4ldzb" Jul 05 19:32:29.197849 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:32:29.197797 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4ea42695_582e_4b41_94d2_46bbaa5ec118.slice/crio-01f7378d4e6acf2ce9d6d14c7b26d4ef3c9dff6558af3aa4c71d80a813912ed0 WatchSource:0}: Error finding container 01f7378d4e6acf2ce9d6d14c7b26d4ef3c9dff6558af3aa4c71d80a813912ed0: Status 404 returned error can't find the container with id 01f7378d4e6acf2ce9d6d14c7b26d4ef3c9dff6558af3aa4c71d80a813912ed0 Jul 05 19:32:29.198626 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:29.198601 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-pp8zt" Jul 05 19:32:29.208758 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:32:29.208726 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb8af52e1_a74e_4004_8fef_45f3c97c0706.slice/crio-c88116facca695985a7ccde317399251d7791b15ac64baf5491e06e5d8b96620 WatchSource:0}: Error finding container c88116facca695985a7ccde317399251d7791b15ac64baf5491e06e5d8b96620: Status 404 returned error can't find the container with id c88116facca695985a7ccde317399251d7791b15ac64baf5491e06e5d8b96620 Jul 05 19:32:29.210933 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:29.210912 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-49z2k" Jul 05 19:32:29.219433 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:29.219374 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-dlr8v" Jul 05 19:32:29.224162 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:32:29.224115 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8f5a9b06_1cac_44c1_a0fd_188c005a6199.slice/crio-4ea608582bcdc52af699039319fcc2e4a72200b03e84035bb05f2ad7723673ed WatchSource:0}: Error finding container 4ea608582bcdc52af699039319fcc2e4a72200b03e84035bb05f2ad7723673ed: Status 404 returned error can't find the container with id 4ea608582bcdc52af699039319fcc2e4a72200b03e84035bb05f2ad7723673ed Jul 05 19:32:29.231303 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:32:29.231270 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3567b575_3458_4a8c_9cac_04d8c9f7d1a6.slice/crio-9c85c640f9af6b626d37c1ee942f82892b32b1eed22be700283f1457bc09cc1e WatchSource:0}: Error finding container 9c85c640f9af6b626d37c1ee942f82892b32b1eed22be700283f1457bc09cc1e: Status 404 returned error can't find the container with id 9c85c640f9af6b626d37c1ee942f82892b32b1eed22be700283f1457bc09cc1e Jul 05 19:32:29.237642 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:29.237614 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-zh6wq" Jul 05 19:32:29.247209 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:29.247098 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-6ldkn" Jul 05 19:32:29.252757 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:32:29.252719 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9349dbd7_9c70_4a38_bd03_2e5bf10e1ecd.slice/crio-0b4342fcce3798f3058caec6f186e568cec2c482340e251423b84bb97586bf5c WatchSource:0}: Error finding container 0b4342fcce3798f3058caec6f186e568cec2c482340e251423b84bb97586bf5c: Status 404 returned error can't find the container with id 0b4342fcce3798f3058caec6f186e568cec2c482340e251423b84bb97586bf5c Jul 05 19:32:29.259052 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:29.259025 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-v4bjg" Jul 05 19:32:29.260091 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:32:29.260065 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode9938fdb_3276_474c_87c7_0386eacd806a.slice/crio-b1f1c8005cb649a8ee26ff157791c91bce8e8feadb02edc79fd1713a1ea2d5be WatchSource:0}: Error finding container b1f1c8005cb649a8ee26ff157791c91bce8e8feadb02edc79fd1713a1ea2d5be: Status 404 returned error can't find the container with id b1f1c8005cb649a8ee26ff157791c91bce8e8feadb02edc79fd1713a1ea2d5be Jul 05 19:32:29.268508 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:29.268488 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-d52jr" Jul 05 19:32:29.270164 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:32:29.270134 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfa405f18_4c0b_468d_863a_d2a5b34c65da.slice/crio-4607cd2d238253e5ca6f65ab752a3654eb82806681942be298f665d35f77d41a WatchSource:0}: Error finding container 4607cd2d238253e5ca6f65ab752a3654eb82806681942be298f665d35f77d41a: Status 404 returned error can't find the container with id 4607cd2d238253e5ca6f65ab752a3654eb82806681942be298f665d35f77d41a Jul 05 19:32:29.276058 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:29.276033 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-jp9t6" Jul 05 19:32:29.339881 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:29.339853 2572 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 05 19:32:29.594487 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:29.594384 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/05684556-d2e2-4157-9f17-097dee8230a0-metrics-certs\") pod \"network-metrics-daemon-brllj\" (UID: \"05684556-d2e2-4157-9f17-097dee8230a0\") " pod="openshift-multus/network-metrics-daemon-brllj" Jul 05 19:32:29.594487 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:29.594453 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b256bcc8-4bdd-48db-b050-c02c368ef29d-original-pull-secret\") pod \"global-pull-secret-syncer-k2b5v\" (UID: \"b256bcc8-4bdd-48db-b050-c02c368ef29d\") " pod="kube-system/global-pull-secret-syncer-k2b5v" Jul 05 19:32:29.594727 ip-10-0-133-7 kubenswrapper[2572]: E0705 19:32:29.594594 2572 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 05 19:32:29.594727 ip-10-0-133-7 kubenswrapper[2572]: E0705 19:32:29.594670 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b256bcc8-4bdd-48db-b050-c02c368ef29d-original-pull-secret podName:b256bcc8-4bdd-48db-b050-c02c368ef29d nodeName:}" failed. No retries permitted until 2026-07-05 19:32:30.59464967 +0000 UTC m=+3.993997120 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/b256bcc8-4bdd-48db-b050-c02c368ef29d-original-pull-secret") pod "global-pull-secret-syncer-k2b5v" (UID: "b256bcc8-4bdd-48db-b050-c02c368ef29d") : object "kube-system"/"original-pull-secret" not registered Jul 05 19:32:29.594727 ip-10-0-133-7 kubenswrapper[2572]: E0705 19:32:29.594593 2572 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 05 19:32:29.594894 ip-10-0-133-7 kubenswrapper[2572]: E0705 19:32:29.594769 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/05684556-d2e2-4157-9f17-097dee8230a0-metrics-certs podName:05684556-d2e2-4157-9f17-097dee8230a0 nodeName:}" failed. No retries permitted until 2026-07-05 19:32:30.59474748 +0000 UTC m=+3.994094947 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/05684556-d2e2-4157-9f17-097dee8230a0-metrics-certs") pod "network-metrics-daemon-brllj" (UID: "05684556-d2e2-4157-9f17-097dee8230a0") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 05 19:32:29.695761 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:29.695714 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-55jpj\" (UniqueName: \"kubernetes.io/projected/1fd5cdc6-3c1a-4412-830c-b871c7087a35-kube-api-access-55jpj\") pod \"network-check-target-fjdxw\" (UID: \"1fd5cdc6-3c1a-4412-830c-b871c7087a35\") " pod="openshift-network-diagnostics/network-check-target-fjdxw" Jul 05 19:32:29.695959 ip-10-0-133-7 kubenswrapper[2572]: E0705 19:32:29.695932 2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 05 19:32:29.695959 ip-10-0-133-7 kubenswrapper[2572]: E0705 19:32:29.695957 2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 05 19:32:29.695959 ip-10-0-133-7 kubenswrapper[2572]: E0705 19:32:29.695985 2572 projected.go:196] Error preparing data for projected volume kube-api-access-55jpj for pod openshift-network-diagnostics/network-check-target-fjdxw: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 05 19:32:29.696126 ip-10-0-133-7 kubenswrapper[2572]: E0705 19:32:29.696058 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1fd5cdc6-3c1a-4412-830c-b871c7087a35-kube-api-access-55jpj podName:1fd5cdc6-3c1a-4412-830c-b871c7087a35 nodeName:}" failed. No retries permitted until 2026-07-05 19:32:30.696037046 +0000 UTC m=+4.095384519 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-55jpj" (UniqueName: "kubernetes.io/projected/1fd5cdc6-3c1a-4412-830c-b871c7087a35-kube-api-access-55jpj") pod "network-check-target-fjdxw" (UID: "1fd5cdc6-3c1a-4412-830c-b871c7087a35") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 05 19:32:29.924052 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:29.923938 2572 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-04 19:27:29 +0000 UTC" deadline="2028-01-17 06:18:17.263287026 +0000 UTC" Jul 05 19:32:29.924052 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:29.923988 2572 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13450h45m47.339303086s" Jul 05 19:32:29.971609 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:29.971573 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-v4bjg" event={"ID":"fa405f18-4c0b-468d-863a-d2a5b34c65da","Type":"ContainerStarted","Data":"4607cd2d238253e5ca6f65ab752a3654eb82806681942be298f665d35f77d41a"} Jul 05 19:32:29.972699 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:29.972674 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-6ldkn" event={"ID":"e9938fdb-3276-474c-87c7-0386eacd806a","Type":"ContainerStarted","Data":"b1f1c8005cb649a8ee26ff157791c91bce8e8feadb02edc79fd1713a1ea2d5be"} Jul 05 19:32:29.973789 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:29.973765 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-dlr8v" event={"ID":"3567b575-3458-4a8c-9cac-04d8c9f7d1a6","Type":"ContainerStarted","Data":"9c85c640f9af6b626d37c1ee942f82892b32b1eed22be700283f1457bc09cc1e"} Jul 05 19:32:29.974781 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:29.974756 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-pp8zt" event={"ID":"b8af52e1-a74e-4004-8fef-45f3c97c0706","Type":"ContainerStarted","Data":"c88116facca695985a7ccde317399251d7791b15ac64baf5491e06e5d8b96620"} Jul 05 19:32:29.975799 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:29.975780 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-zh6wq" event={"ID":"9349dbd7-9c70-4a38-bd03-2e5bf10e1ecd","Type":"ContainerStarted","Data":"0b4342fcce3798f3058caec6f186e568cec2c482340e251423b84bb97586bf5c"} Jul 05 19:32:29.976918 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:29.976897 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-49z2k" event={"ID":"8f5a9b06-1cac-44c1-a0fd-188c005a6199","Type":"ContainerStarted","Data":"4ea608582bcdc52af699039319fcc2e4a72200b03e84035bb05f2ad7723673ed"} Jul 05 19:32:29.977958 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:29.977938 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4ldzb" event={"ID":"4ea42695-582e-4b41-94d2-46bbaa5ec118","Type":"ContainerStarted","Data":"01f7378d4e6acf2ce9d6d14c7b26d4ef3c9dff6558af3aa4c71d80a813912ed0"} Jul 05 19:32:30.604103 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:30.603738 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/05684556-d2e2-4157-9f17-097dee8230a0-metrics-certs\") pod \"network-metrics-daemon-brllj\" (UID: \"05684556-d2e2-4157-9f17-097dee8230a0\") " pod="openshift-multus/network-metrics-daemon-brllj" Jul 05 19:32:30.604103 ip-10-0-133-7 kubenswrapper[2572]: E0705 19:32:30.603826 2572 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 05 19:32:30.604103 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:30.603843 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b256bcc8-4bdd-48db-b050-c02c368ef29d-original-pull-secret\") pod \"global-pull-secret-syncer-k2b5v\" (UID: \"b256bcc8-4bdd-48db-b050-c02c368ef29d\") " pod="kube-system/global-pull-secret-syncer-k2b5v" Jul 05 19:32:30.604103 ip-10-0-133-7 kubenswrapper[2572]: E0705 19:32:30.603898 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/05684556-d2e2-4157-9f17-097dee8230a0-metrics-certs podName:05684556-d2e2-4157-9f17-097dee8230a0 nodeName:}" failed. No retries permitted until 2026-07-05 19:32:32.603879452 +0000 UTC m=+6.003226904 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/05684556-d2e2-4157-9f17-097dee8230a0-metrics-certs") pod "network-metrics-daemon-brllj" (UID: "05684556-d2e2-4157-9f17-097dee8230a0") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 05 19:32:30.604103 ip-10-0-133-7 kubenswrapper[2572]: E0705 19:32:30.603983 2572 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 05 19:32:30.604103 ip-10-0-133-7 kubenswrapper[2572]: E0705 19:32:30.604062 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b256bcc8-4bdd-48db-b050-c02c368ef29d-original-pull-secret podName:b256bcc8-4bdd-48db-b050-c02c368ef29d nodeName:}" failed. No retries permitted until 2026-07-05 19:32:32.604043647 +0000 UTC m=+6.003391114 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/b256bcc8-4bdd-48db-b050-c02c368ef29d-original-pull-secret") pod "global-pull-secret-syncer-k2b5v" (UID: "b256bcc8-4bdd-48db-b050-c02c368ef29d") : object "kube-system"/"original-pull-secret" not registered Jul 05 19:32:30.704811 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:30.704380 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-55jpj\" (UniqueName: \"kubernetes.io/projected/1fd5cdc6-3c1a-4412-830c-b871c7087a35-kube-api-access-55jpj\") pod \"network-check-target-fjdxw\" (UID: \"1fd5cdc6-3c1a-4412-830c-b871c7087a35\") " pod="openshift-network-diagnostics/network-check-target-fjdxw" Jul 05 19:32:30.704811 ip-10-0-133-7 kubenswrapper[2572]: E0705 19:32:30.704695 2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 05 19:32:30.704811 ip-10-0-133-7 kubenswrapper[2572]: E0705 19:32:30.704724 2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 05 19:32:30.704811 ip-10-0-133-7 kubenswrapper[2572]: E0705 19:32:30.704739 2572 projected.go:196] Error preparing data for projected volume kube-api-access-55jpj for pod openshift-network-diagnostics/network-check-target-fjdxw: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 05 19:32:30.704811 ip-10-0-133-7 kubenswrapper[2572]: E0705 19:32:30.704807 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1fd5cdc6-3c1a-4412-830c-b871c7087a35-kube-api-access-55jpj podName:1fd5cdc6-3c1a-4412-830c-b871c7087a35 nodeName:}" failed. No retries permitted until 2026-07-05 19:32:32.704785487 +0000 UTC m=+6.104132951 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-55jpj" (UniqueName: "kubernetes.io/projected/1fd5cdc6-3c1a-4412-830c-b871c7087a35-kube-api-access-55jpj") pod "network-check-target-fjdxw" (UID: "1fd5cdc6-3c1a-4412-830c-b871c7087a35") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 05 19:32:30.924845 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:30.924666 2572 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-04 19:27:29 +0000 UTC" deadline="2027-12-31 23:36:52.927862575 +0000 UTC" Jul 05 19:32:30.924845 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:30.924729 2572 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13060h4m22.003137829s" Jul 05 19:32:30.959742 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:30.959429 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-brllj" Jul 05 19:32:30.959742 ip-10-0-133-7 kubenswrapper[2572]: E0705 19:32:30.959588 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-brllj" podUID="05684556-d2e2-4157-9f17-097dee8230a0" Jul 05 19:32:30.959742 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:30.959648 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fjdxw" Jul 05 19:32:30.960056 ip-10-0-133-7 kubenswrapper[2572]: E0705 19:32:30.959755 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fjdxw" podUID="1fd5cdc6-3c1a-4412-830c-b871c7087a35" Jul 05 19:32:30.960056 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:30.959879 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k2b5v" Jul 05 19:32:30.960056 ip-10-0-133-7 kubenswrapper[2572]: E0705 19:32:30.959983 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-k2b5v" podUID="b256bcc8-4bdd-48db-b050-c02c368ef29d" Jul 05 19:32:30.983044 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:30.982953 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-d52jr" event={"ID":"bfb32e10-9908-43c0-90f2-629b8c81ebc8","Type":"ContainerStarted","Data":"e75075f78e757badb40626b6af7056b1c968684e955686bc6ffeb9e7305480a4"} Jul 05 19:32:30.987542 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:30.987508 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-7.ec2.internal" event={"ID":"e2bff7cbf82451b4333adfc3db2c0112","Type":"ContainerStarted","Data":"0ea69401f11dc52a79da9daf5a424b6cf310e755948e32e1bbc609fc752bc62a"} Jul 05 19:32:30.993386 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:30.993275 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jp9t6" event={"ID":"3d6f9f21-755d-491c-ac1f-f94df1e44b79","Type":"ContainerStarted","Data":"b2c68a6e22b73446211dd472d813bedca22f4c3db476315faba71c382d7fca61"} Jul 05 19:32:31.004803 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:31.004476 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-7.ec2.internal" podStartSLOduration=3.004448829 podStartE2EDuration="3.004448829s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-05 19:32:28 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 19:32:31.003847891 +0000 UTC m=+4.403195364" watchObservedRunningTime="2026-07-05 19:32:31.004448829 +0000 UTC m=+4.403796302" Jul 05 19:32:32.033157 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:32.033113 2572 generic.go:356] "Generic (PLEG): container finished" podID="89a0e5a37365a0cf71513576d558545d" containerID="63bdc796a7b3503c38d64a9869a00318fd87ae76350d87985519c668eb819ec6" exitCode=0 Jul 05 19:32:32.034201 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:32.034168 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-7.ec2.internal" event={"ID":"89a0e5a37365a0cf71513576d558545d","Type":"ContainerDied","Data":"63bdc796a7b3503c38d64a9869a00318fd87ae76350d87985519c668eb819ec6"} Jul 05 19:32:32.632093 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:32.631170 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b256bcc8-4bdd-48db-b050-c02c368ef29d-original-pull-secret\") pod \"global-pull-secret-syncer-k2b5v\" (UID: \"b256bcc8-4bdd-48db-b050-c02c368ef29d\") " pod="kube-system/global-pull-secret-syncer-k2b5v" Jul 05 19:32:32.632093 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:32.631258 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/05684556-d2e2-4157-9f17-097dee8230a0-metrics-certs\") pod \"network-metrics-daemon-brllj\" (UID: \"05684556-d2e2-4157-9f17-097dee8230a0\") " pod="openshift-multus/network-metrics-daemon-brllj" Jul 05 19:32:32.632093 ip-10-0-133-7 kubenswrapper[2572]: E0705 19:32:32.631397 2572 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 05 19:32:32.632093 ip-10-0-133-7 kubenswrapper[2572]: E0705 19:32:32.631461 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/05684556-d2e2-4157-9f17-097dee8230a0-metrics-certs podName:05684556-d2e2-4157-9f17-097dee8230a0 nodeName:}" failed. No retries permitted until 2026-07-05 19:32:36.631442469 +0000 UTC m=+10.030789918 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/05684556-d2e2-4157-9f17-097dee8230a0-metrics-certs") pod "network-metrics-daemon-brllj" (UID: "05684556-d2e2-4157-9f17-097dee8230a0") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 05 19:32:32.632093 ip-10-0-133-7 kubenswrapper[2572]: E0705 19:32:32.631879 2572 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 05 19:32:32.632093 ip-10-0-133-7 kubenswrapper[2572]: E0705 19:32:32.631931 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b256bcc8-4bdd-48db-b050-c02c368ef29d-original-pull-secret podName:b256bcc8-4bdd-48db-b050-c02c368ef29d nodeName:}" failed. No retries permitted until 2026-07-05 19:32:36.631914139 +0000 UTC m=+10.031261590 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/b256bcc8-4bdd-48db-b050-c02c368ef29d-original-pull-secret") pod "global-pull-secret-syncer-k2b5v" (UID: "b256bcc8-4bdd-48db-b050-c02c368ef29d") : object "kube-system"/"original-pull-secret" not registered Jul 05 19:32:32.735321 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:32.732314 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-55jpj\" (UniqueName: \"kubernetes.io/projected/1fd5cdc6-3c1a-4412-830c-b871c7087a35-kube-api-access-55jpj\") pod \"network-check-target-fjdxw\" (UID: \"1fd5cdc6-3c1a-4412-830c-b871c7087a35\") " pod="openshift-network-diagnostics/network-check-target-fjdxw" Jul 05 19:32:32.738098 ip-10-0-133-7 kubenswrapper[2572]: E0705 19:32:32.736271 2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 05 19:32:32.738098 ip-10-0-133-7 kubenswrapper[2572]: E0705 19:32:32.736307 2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 05 19:32:32.738098 ip-10-0-133-7 kubenswrapper[2572]: E0705 19:32:32.736332 2572 projected.go:196] Error preparing data for projected volume kube-api-access-55jpj for pod openshift-network-diagnostics/network-check-target-fjdxw: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 05 19:32:32.738098 ip-10-0-133-7 kubenswrapper[2572]: E0705 19:32:32.736413 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1fd5cdc6-3c1a-4412-830c-b871c7087a35-kube-api-access-55jpj podName:1fd5cdc6-3c1a-4412-830c-b871c7087a35 nodeName:}" failed. No retries permitted until 2026-07-05 19:32:36.736383179 +0000 UTC m=+10.135730628 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-55jpj" (UniqueName: "kubernetes.io/projected/1fd5cdc6-3c1a-4412-830c-b871c7087a35-kube-api-access-55jpj") pod "network-check-target-fjdxw" (UID: "1fd5cdc6-3c1a-4412-830c-b871c7087a35") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 05 19:32:32.958253 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:32.958156 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-brllj" Jul 05 19:32:32.958434 ip-10-0-133-7 kubenswrapper[2572]: E0705 19:32:32.958319 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-brllj" podUID="05684556-d2e2-4157-9f17-097dee8230a0" Jul 05 19:32:32.958788 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:32.958766 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fjdxw" Jul 05 19:32:32.958913 ip-10-0-133-7 kubenswrapper[2572]: E0705 19:32:32.958884 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fjdxw" podUID="1fd5cdc6-3c1a-4412-830c-b871c7087a35" Jul 05 19:32:32.959028 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:32.959008 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k2b5v" Jul 05 19:32:32.959131 ip-10-0-133-7 kubenswrapper[2572]: E0705 19:32:32.959110 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-k2b5v" podUID="b256bcc8-4bdd-48db-b050-c02c368ef29d" Jul 05 19:32:33.040331 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:33.040287 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-7.ec2.internal" event={"ID":"89a0e5a37365a0cf71513576d558545d","Type":"ContainerStarted","Data":"bf60e081163baacd793f9343adb9266c01e571256f3f76ec77e338f303ffedab"} Jul 05 19:32:33.058511 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:33.058417 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-7.ec2.internal" podStartSLOduration=5.058394631 podStartE2EDuration="5.058394631s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-05 19:32:28 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 19:32:33.058109883 +0000 UTC m=+6.457457355" watchObservedRunningTime="2026-07-05 19:32:33.058394631 +0000 UTC m=+6.457742102" Jul 05 19:32:34.957780 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:34.957111 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-brllj" Jul 05 19:32:34.957780 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:34.957114 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fjdxw" Jul 05 19:32:34.957780 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:34.957279 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k2b5v" Jul 05 19:32:34.957780 ip-10-0-133-7 kubenswrapper[2572]: E0705 19:32:34.957284 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-brllj" podUID="05684556-d2e2-4157-9f17-097dee8230a0" Jul 05 19:32:34.957780 ip-10-0-133-7 kubenswrapper[2572]: E0705 19:32:34.957405 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-k2b5v" podUID="b256bcc8-4bdd-48db-b050-c02c368ef29d" Jul 05 19:32:34.957780 ip-10-0-133-7 kubenswrapper[2572]: E0705 19:32:34.957488 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fjdxw" podUID="1fd5cdc6-3c1a-4412-830c-b871c7087a35" Jul 05 19:32:36.670745 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:36.670712 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/05684556-d2e2-4157-9f17-097dee8230a0-metrics-certs\") pod \"network-metrics-daemon-brllj\" (UID: \"05684556-d2e2-4157-9f17-097dee8230a0\") " pod="openshift-multus/network-metrics-daemon-brllj" Jul 05 19:32:36.671427 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:36.670786 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b256bcc8-4bdd-48db-b050-c02c368ef29d-original-pull-secret\") pod \"global-pull-secret-syncer-k2b5v\" (UID: \"b256bcc8-4bdd-48db-b050-c02c368ef29d\") " pod="kube-system/global-pull-secret-syncer-k2b5v" Jul 05 19:32:36.671427 ip-10-0-133-7 kubenswrapper[2572]: E0705 19:32:36.670938 2572 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 05 19:32:36.671427 ip-10-0-133-7 kubenswrapper[2572]: E0705 19:32:36.671032 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/05684556-d2e2-4157-9f17-097dee8230a0-metrics-certs podName:05684556-d2e2-4157-9f17-097dee8230a0 nodeName:}" failed. No retries permitted until 2026-07-05 19:32:44.671010292 +0000 UTC m=+18.070357752 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/05684556-d2e2-4157-9f17-097dee8230a0-metrics-certs") pod "network-metrics-daemon-brllj" (UID: "05684556-d2e2-4157-9f17-097dee8230a0") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 05 19:32:36.671427 ip-10-0-133-7 kubenswrapper[2572]: E0705 19:32:36.670938 2572 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 05 19:32:36.671427 ip-10-0-133-7 kubenswrapper[2572]: E0705 19:32:36.671091 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b256bcc8-4bdd-48db-b050-c02c368ef29d-original-pull-secret podName:b256bcc8-4bdd-48db-b050-c02c368ef29d nodeName:}" failed. No retries permitted until 2026-07-05 19:32:44.671077889 +0000 UTC m=+18.070425349 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/b256bcc8-4bdd-48db-b050-c02c368ef29d-original-pull-secret") pod "global-pull-secret-syncer-k2b5v" (UID: "b256bcc8-4bdd-48db-b050-c02c368ef29d") : object "kube-system"/"original-pull-secret" not registered Jul 05 19:32:36.772189 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:36.772140 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-55jpj\" (UniqueName: \"kubernetes.io/projected/1fd5cdc6-3c1a-4412-830c-b871c7087a35-kube-api-access-55jpj\") pod \"network-check-target-fjdxw\" (UID: \"1fd5cdc6-3c1a-4412-830c-b871c7087a35\") " pod="openshift-network-diagnostics/network-check-target-fjdxw" Jul 05 19:32:36.772391 ip-10-0-133-7 kubenswrapper[2572]: E0705 19:32:36.772366 2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 05 19:32:36.772462 ip-10-0-133-7 kubenswrapper[2572]: E0705 19:32:36.772402 2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 05 19:32:36.772462 ip-10-0-133-7 kubenswrapper[2572]: E0705 19:32:36.772416 2572 projected.go:196] Error preparing data for projected volume kube-api-access-55jpj for pod openshift-network-diagnostics/network-check-target-fjdxw: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 05 19:32:36.772583 ip-10-0-133-7 kubenswrapper[2572]: E0705 19:32:36.772488 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1fd5cdc6-3c1a-4412-830c-b871c7087a35-kube-api-access-55jpj podName:1fd5cdc6-3c1a-4412-830c-b871c7087a35 nodeName:}" failed. No retries permitted until 2026-07-05 19:32:44.772465203 +0000 UTC m=+18.171812649 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-55jpj" (UniqueName: "kubernetes.io/projected/1fd5cdc6-3c1a-4412-830c-b871c7087a35-kube-api-access-55jpj") pod "network-check-target-fjdxw" (UID: "1fd5cdc6-3c1a-4412-830c-b871c7087a35") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 05 19:32:36.958812 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:36.958720 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k2b5v" Jul 05 19:32:36.959002 ip-10-0-133-7 kubenswrapper[2572]: E0705 19:32:36.958868 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-k2b5v" podUID="b256bcc8-4bdd-48db-b050-c02c368ef29d" Jul 05 19:32:36.959002 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:36.958938 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-brllj" Jul 05 19:32:36.959128 ip-10-0-133-7 kubenswrapper[2572]: E0705 19:32:36.959065 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-brllj" podUID="05684556-d2e2-4157-9f17-097dee8230a0" Jul 05 19:32:36.959726 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:36.959516 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fjdxw" Jul 05 19:32:36.959726 ip-10-0-133-7 kubenswrapper[2572]: E0705 19:32:36.959659 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fjdxw" podUID="1fd5cdc6-3c1a-4412-830c-b871c7087a35" Jul 05 19:32:38.958141 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:38.957304 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fjdxw" Jul 05 19:32:38.958141 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:38.957368 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k2b5v" Jul 05 19:32:38.958141 ip-10-0-133-7 kubenswrapper[2572]: E0705 19:32:38.957459 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fjdxw" podUID="1fd5cdc6-3c1a-4412-830c-b871c7087a35" Jul 05 19:32:38.958141 ip-10-0-133-7 kubenswrapper[2572]: E0705 19:32:38.957894 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-k2b5v" podUID="b256bcc8-4bdd-48db-b050-c02c368ef29d" Jul 05 19:32:38.958141 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:38.957963 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-brllj" Jul 05 19:32:38.958141 ip-10-0-133-7 kubenswrapper[2572]: E0705 19:32:38.958097 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-brllj" podUID="05684556-d2e2-4157-9f17-097dee8230a0" Jul 05 19:32:40.957502 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:40.957444 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fjdxw" Jul 05 19:32:40.957986 ip-10-0-133-7 kubenswrapper[2572]: E0705 19:32:40.957581 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fjdxw" podUID="1fd5cdc6-3c1a-4412-830c-b871c7087a35" Jul 05 19:32:40.957986 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:40.957651 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-brllj" Jul 05 19:32:40.957986 ip-10-0-133-7 kubenswrapper[2572]: E0705 19:32:40.957757 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-brllj" podUID="05684556-d2e2-4157-9f17-097dee8230a0" Jul 05 19:32:40.957986 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:40.957770 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k2b5v" Jul 05 19:32:40.957986 ip-10-0-133-7 kubenswrapper[2572]: E0705 19:32:40.957891 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-k2b5v" podUID="b256bcc8-4bdd-48db-b050-c02c368ef29d" Jul 05 19:32:42.957073 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:42.957029 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-brllj" Jul 05 19:32:42.957533 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:42.957029 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fjdxw" Jul 05 19:32:42.957533 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:42.957162 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k2b5v" Jul 05 19:32:42.957533 ip-10-0-133-7 kubenswrapper[2572]: E0705 19:32:42.957166 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-brllj" podUID="05684556-d2e2-4157-9f17-097dee8230a0" Jul 05 19:32:42.957533 ip-10-0-133-7 kubenswrapper[2572]: E0705 19:32:42.957251 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fjdxw" podUID="1fd5cdc6-3c1a-4412-830c-b871c7087a35" Jul 05 19:32:42.957533 ip-10-0-133-7 kubenswrapper[2572]: E0705 19:32:42.957337 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-k2b5v" podUID="b256bcc8-4bdd-48db-b050-c02c368ef29d" Jul 05 19:32:44.733527 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:44.733483 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/05684556-d2e2-4157-9f17-097dee8230a0-metrics-certs\") pod \"network-metrics-daemon-brllj\" (UID: \"05684556-d2e2-4157-9f17-097dee8230a0\") " pod="openshift-multus/network-metrics-daemon-brllj" Jul 05 19:32:44.734073 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:44.733558 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b256bcc8-4bdd-48db-b050-c02c368ef29d-original-pull-secret\") pod \"global-pull-secret-syncer-k2b5v\" (UID: \"b256bcc8-4bdd-48db-b050-c02c368ef29d\") " pod="kube-system/global-pull-secret-syncer-k2b5v" Jul 05 19:32:44.734073 ip-10-0-133-7 kubenswrapper[2572]: E0705 19:32:44.733657 2572 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 05 19:32:44.734073 ip-10-0-133-7 kubenswrapper[2572]: E0705 19:32:44.733745 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/05684556-d2e2-4157-9f17-097dee8230a0-metrics-certs podName:05684556-d2e2-4157-9f17-097dee8230a0 nodeName:}" failed. No retries permitted until 2026-07-05 19:33:00.733723287 +0000 UTC m=+34.133070743 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/05684556-d2e2-4157-9f17-097dee8230a0-metrics-certs") pod "network-metrics-daemon-brllj" (UID: "05684556-d2e2-4157-9f17-097dee8230a0") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 05 19:32:44.734073 ip-10-0-133-7 kubenswrapper[2572]: E0705 19:32:44.733663 2572 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 05 19:32:44.734073 ip-10-0-133-7 kubenswrapper[2572]: E0705 19:32:44.733811 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b256bcc8-4bdd-48db-b050-c02c368ef29d-original-pull-secret podName:b256bcc8-4bdd-48db-b050-c02c368ef29d nodeName:}" failed. No retries permitted until 2026-07-05 19:33:00.733793333 +0000 UTC m=+34.133140796 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/b256bcc8-4bdd-48db-b050-c02c368ef29d-original-pull-secret") pod "global-pull-secret-syncer-k2b5v" (UID: "b256bcc8-4bdd-48db-b050-c02c368ef29d") : object "kube-system"/"original-pull-secret" not registered Jul 05 19:32:44.834171 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:44.834135 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-55jpj\" (UniqueName: \"kubernetes.io/projected/1fd5cdc6-3c1a-4412-830c-b871c7087a35-kube-api-access-55jpj\") pod \"network-check-target-fjdxw\" (UID: \"1fd5cdc6-3c1a-4412-830c-b871c7087a35\") " pod="openshift-network-diagnostics/network-check-target-fjdxw" Jul 05 19:32:44.834354 ip-10-0-133-7 kubenswrapper[2572]: E0705 19:32:44.834335 2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 05 19:32:44.834417 ip-10-0-133-7 kubenswrapper[2572]: E0705 19:32:44.834363 2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 05 19:32:44.834417 ip-10-0-133-7 kubenswrapper[2572]: E0705 19:32:44.834377 2572 projected.go:196] Error preparing data for projected volume kube-api-access-55jpj for pod openshift-network-diagnostics/network-check-target-fjdxw: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 05 19:32:44.834500 ip-10-0-133-7 kubenswrapper[2572]: E0705 19:32:44.834443 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1fd5cdc6-3c1a-4412-830c-b871c7087a35-kube-api-access-55jpj podName:1fd5cdc6-3c1a-4412-830c-b871c7087a35 nodeName:}" failed. No retries permitted until 2026-07-05 19:33:00.83442475 +0000 UTC m=+34.233772211 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-55jpj" (UniqueName: "kubernetes.io/projected/1fd5cdc6-3c1a-4412-830c-b871c7087a35-kube-api-access-55jpj") pod "network-check-target-fjdxw" (UID: "1fd5cdc6-3c1a-4412-830c-b871c7087a35") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 05 19:32:44.956998 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:44.956962 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fjdxw" Jul 05 19:32:44.957156 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:44.956975 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k2b5v" Jul 05 19:32:44.957156 ip-10-0-133-7 kubenswrapper[2572]: E0705 19:32:44.957085 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fjdxw" podUID="1fd5cdc6-3c1a-4412-830c-b871c7087a35" Jul 05 19:32:44.957228 ip-10-0-133-7 kubenswrapper[2572]: E0705 19:32:44.957151 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-k2b5v" podUID="b256bcc8-4bdd-48db-b050-c02c368ef29d" Jul 05 19:32:44.957228 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:44.957162 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-brllj" Jul 05 19:32:44.957301 ip-10-0-133-7 kubenswrapper[2572]: E0705 19:32:44.957227 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-brllj" podUID="05684556-d2e2-4157-9f17-097dee8230a0" Jul 05 19:32:46.957180 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:46.957142 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fjdxw" Jul 05 19:32:46.957645 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:46.957304 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k2b5v" Jul 05 19:32:46.957645 ip-10-0-133-7 kubenswrapper[2572]: E0705 19:32:46.957333 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fjdxw" podUID="1fd5cdc6-3c1a-4412-830c-b871c7087a35" Jul 05 19:32:46.957645 ip-10-0-133-7 kubenswrapper[2572]: E0705 19:32:46.957428 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-k2b5v" podUID="b256bcc8-4bdd-48db-b050-c02c368ef29d" Jul 05 19:32:46.957645 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:46.957490 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-brllj" Jul 05 19:32:46.957645 ip-10-0-133-7 kubenswrapper[2572]: E0705 19:32:46.957568 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-brllj" podUID="05684556-d2e2-4157-9f17-097dee8230a0" Jul 05 19:32:48.957136 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:48.957107 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-brllj" Jul 05 19:32:48.957613 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:48.957114 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fjdxw" Jul 05 19:32:48.957613 ip-10-0-133-7 kubenswrapper[2572]: E0705 19:32:48.957247 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-brllj" podUID="05684556-d2e2-4157-9f17-097dee8230a0" Jul 05 19:32:48.957613 ip-10-0-133-7 kubenswrapper[2572]: E0705 19:32:48.957308 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fjdxw" podUID="1fd5cdc6-3c1a-4412-830c-b871c7087a35" Jul 05 19:32:48.957613 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:48.957118 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k2b5v" Jul 05 19:32:48.957613 ip-10-0-133-7 kubenswrapper[2572]: E0705 19:32:48.957433 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-k2b5v" podUID="b256bcc8-4bdd-48db-b050-c02c368ef29d" Jul 05 19:32:50.078468 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:50.078150 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-v4bjg" event={"ID":"fa405f18-4c0b-468d-863a-d2a5b34c65da","Type":"ContainerStarted","Data":"b3a982481f7b6ef38879f8ba2c8101caf0f5433346d83c0fe6c65cb72e2e5358"} Jul 05 19:32:50.079778 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:50.079734 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-6ldkn" event={"ID":"e9938fdb-3276-474c-87c7-0386eacd806a","Type":"ContainerStarted","Data":"a45c6da89d83a86816d7191f93bdd3cb6624103f56b6f9ba7ac4d33a4cd77a37"} Jul 05 19:32:50.081401 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:50.081375 2572 generic.go:356] "Generic (PLEG): container finished" podID="3567b575-3458-4a8c-9cac-04d8c9f7d1a6" containerID="7b16d093f7312aced0b3ba009669179169d20f85d705d21fda4daffe3e8fa751" exitCode=0 Jul 05 19:32:50.081512 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:50.081449 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-dlr8v" event={"ID":"3567b575-3458-4a8c-9cac-04d8c9f7d1a6","Type":"ContainerDied","Data":"7b16d093f7312aced0b3ba009669179169d20f85d705d21fda4daffe3e8fa751"} Jul 05 19:32:50.086965 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:50.086913 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-pp8zt" event={"ID":"b8af52e1-a74e-4004-8fef-45f3c97c0706","Type":"ContainerStarted","Data":"92069b4f22ba96fa27788035072aeadc7c7f29259ab0a2a21421ef1e644a480b"} Jul 05 19:32:50.088845 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:50.088820 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-d52jr" event={"ID":"bfb32e10-9908-43c0-90f2-629b8c81ebc8","Type":"ContainerStarted","Data":"bcf4fb72b37d7de09a2665d467177cef673e2ab2120a4c01d371486028e116ff"} Jul 05 19:32:50.093003 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:50.092966 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-49z2k" event={"ID":"8f5a9b06-1cac-44c1-a0fd-188c005a6199","Type":"ContainerStarted","Data":"22d52fa6966ad403739a238d551493237baa4f2bff3830bcd9558566440e238a"} Jul 05 19:32:50.095151 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:50.095121 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4ldzb" event={"ID":"4ea42695-582e-4b41-94d2-46bbaa5ec118","Type":"ContainerStarted","Data":"e773d6f6e6f8613a93e8580071861980961bc70ba2d35c459ef6bd96e6268fd7"} Jul 05 19:32:50.098080 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:50.098050 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jp9t6" event={"ID":"3d6f9f21-755d-491c-ac1f-f94df1e44b79","Type":"ContainerStarted","Data":"a86efc4cb2dc3523cbde4412ea28e5bc70b21e543ada010bbe54dae5e20f8281"} Jul 05 19:32:50.098197 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:50.098121 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jp9t6" event={"ID":"3d6f9f21-755d-491c-ac1f-f94df1e44b79","Type":"ContainerStarted","Data":"73513e83a8bcfbb761be0d1548fbfd229bb51f9a60e597a1a93b6410515f2385"} Jul 05 19:32:50.098197 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:50.098164 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jp9t6" event={"ID":"3d6f9f21-755d-491c-ac1f-f94df1e44b79","Type":"ContainerStarted","Data":"14cd071b6c2c247846368ff1aacb842e3be209eae57d5b86894f4521ca87283e"} Jul 05 19:32:50.098295 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:50.098209 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jp9t6" event={"ID":"3d6f9f21-755d-491c-ac1f-f94df1e44b79","Type":"ContainerStarted","Data":"33f1ede80f8e60ca2bf31ee76c65e200b314349ebe9ac0224aab35c8f81f3f98"} Jul 05 19:32:50.098295 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:50.098255 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jp9t6" event={"ID":"3d6f9f21-755d-491c-ac1f-f94df1e44b79","Type":"ContainerStarted","Data":"d3ed8851d127e42ae649810f4406fd9aec84d780b6cf3c9faac4564a23de07aa"} Jul 05 19:32:50.098370 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:50.098297 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jp9t6" event={"ID":"3d6f9f21-755d-491c-ac1f-f94df1e44b79","Type":"ContainerStarted","Data":"75fec1485c39198ce058b05508ddfa379eae02b277cb7976c9bf21460c58d8c2"} Jul 05 19:32:50.104070 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:50.103979 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-v4bjg" podStartSLOduration=2.030796195 podStartE2EDuration="22.103943988s" totalImagesPullingTime="20.073147793s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-05 19:32:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 19:32:50.095432242 +0000 UTC m=+23.494779709" watchObservedRunningTime="2026-07-05 19:32:50.103943988 +0000 UTC m=+23.503291469" Jul 05 19:32:50.112904 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:50.112855 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-49z2k" podStartSLOduration=1.932868875 podStartE2EDuration="22.112839446s" totalImagesPullingTime="20.179970571s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-05 19:32:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 19:32:50.112332747 +0000 UTC m=+23.511680226" watchObservedRunningTime="2026-07-05 19:32:50.112839446 +0000 UTC m=+23.512186912" Jul 05 19:32:50.151318 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:50.151288 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-6ldkn" Jul 05 19:32:50.152046 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:50.152026 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-6ldkn" Jul 05 19:32:50.156150 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:50.156112 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-pp8zt" podStartSLOduration=2.022757083 podStartE2EDuration="22.156097303s" totalImagesPullingTime="20.13334022s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-05 19:32:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 19:32:50.155544749 +0000 UTC m=+23.554892216" watchObservedRunningTime="2026-07-05 19:32:50.156097303 +0000 UTC m=+23.555444792" Jul 05 19:32:50.170202 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:50.170142 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-6ldkn" podStartSLOduration=2.086763192 podStartE2EDuration="22.170120656s" totalImagesPullingTime="20.083357464s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-05 19:32:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 19:32:50.169372822 +0000 UTC m=+23.568720283" watchObservedRunningTime="2026-07-05 19:32:50.170120656 +0000 UTC m=+23.569468128" Jul 05 19:32:50.186285 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:50.186239 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-d52jr" podStartSLOduration=3.373100468 podStartE2EDuration="22.186225238s" totalImagesPullingTime="18.81312477s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-05 19:32:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 19:32:50.185778484 +0000 UTC m=+23.585125954" watchObservedRunningTime="2026-07-05 19:32:50.186225238 +0000 UTC m=+23.585572704" Jul 05 19:32:50.957105 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:50.957080 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k2b5v" Jul 05 19:32:50.957275 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:50.957080 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-brllj" Jul 05 19:32:50.957275 ip-10-0-133-7 kubenswrapper[2572]: E0705 19:32:50.957188 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-k2b5v" podUID="b256bcc8-4bdd-48db-b050-c02c368ef29d" Jul 05 19:32:50.957275 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:50.957080 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fjdxw" Jul 05 19:32:50.957275 ip-10-0-133-7 kubenswrapper[2572]: E0705 19:32:50.957268 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-brllj" podUID="05684556-d2e2-4157-9f17-097dee8230a0" Jul 05 19:32:50.957406 ip-10-0-133-7 kubenswrapper[2572]: E0705 19:32:50.957351 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fjdxw" podUID="1fd5cdc6-3c1a-4412-830c-b871c7087a35" Jul 05 19:32:51.083500 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:51.083472 2572 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 05 19:32:51.101780 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:51.101748 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-zh6wq" event={"ID":"9349dbd7-9c70-4a38-bd03-2e5bf10e1ecd","Type":"ContainerStarted","Data":"c57b52206c4ee8b077a2278ee359b9e5a649239e779311f48919da764a9f6a88"} Jul 05 19:32:51.103563 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:51.103536 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4ldzb" event={"ID":"4ea42695-582e-4b41-94d2-46bbaa5ec118","Type":"ContainerStarted","Data":"ca92f66104a10c5e94e884292e09218afca2796940c5a3f4c76cff5a1fd84c55"} Jul 05 19:32:51.103932 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:51.103913 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-6ldkn" Jul 05 19:32:51.104298 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:51.104282 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-6ldkn" Jul 05 19:32:51.115197 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:51.115152 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-zh6wq" podStartSLOduration=3.024864539 podStartE2EDuration="23.115136374s" totalImagesPullingTime="20.090271835s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-05 19:32:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 19:32:51.115095854 +0000 UTC m=+24.514443321" watchObservedRunningTime="2026-07-05 19:32:51.115136374 +0000 UTC m=+24.514483841" Jul 05 19:32:51.950702 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:51.950590 2572 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-05T19:32:51.083492861Z","UUID":"2b8c74a2-cba6-43d7-b2e0-4ff66c513eca","Handler":null,"Name":"","Endpoint":""} Jul 05 19:32:51.952803 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:51.952775 2572 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 05 19:32:51.952992 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:51.952825 2572 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 05 19:32:52.957052 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:52.957022 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-brllj" Jul 05 19:32:52.957615 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:52.957022 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k2b5v" Jul 05 19:32:52.957615 ip-10-0-133-7 kubenswrapper[2572]: E0705 19:32:52.957166 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-brllj" podUID="05684556-d2e2-4157-9f17-097dee8230a0" Jul 05 19:32:52.957615 ip-10-0-133-7 kubenswrapper[2572]: E0705 19:32:52.957226 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-k2b5v" podUID="b256bcc8-4bdd-48db-b050-c02c368ef29d" Jul 05 19:32:52.957615 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:52.957022 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fjdxw" Jul 05 19:32:52.957615 ip-10-0-133-7 kubenswrapper[2572]: E0705 19:32:52.957343 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fjdxw" podUID="1fd5cdc6-3c1a-4412-830c-b871c7087a35" Jul 05 19:32:53.110558 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:53.110516 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4ldzb" event={"ID":"4ea42695-582e-4b41-94d2-46bbaa5ec118","Type":"ContainerStarted","Data":"b960e1c39603d55a8fa8002df209d945e106144053de73ae9677bdeedb473ee3"} Jul 05 19:32:53.113595 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:53.113569 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jp9t6" event={"ID":"3d6f9f21-755d-491c-ac1f-f94df1e44b79","Type":"ContainerStarted","Data":"ae4578268d7a14eeb509d7887a3662a8bc71f193afe9c7a51b386da2aeadd12e"} Jul 05 19:32:53.129870 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:53.129697 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4ldzb" podStartSLOduration=2.212950331 podStartE2EDuration="25.129683934s" totalImagesPullingTime="22.916733603s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-05 19:32:28 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 19:32:53.129448563 +0000 UTC m=+26.528796034" watchObservedRunningTime="2026-07-05 19:32:53.129683934 +0000 UTC m=+26.529031400" Jul 05 19:32:54.956785 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:54.956753 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k2b5v" Jul 05 19:32:54.956785 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:54.956774 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-brllj" Jul 05 19:32:54.957508 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:54.956873 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fjdxw" Jul 05 19:32:54.957508 ip-10-0-133-7 kubenswrapper[2572]: E0705 19:32:54.956887 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-k2b5v" podUID="b256bcc8-4bdd-48db-b050-c02c368ef29d" Jul 05 19:32:54.957508 ip-10-0-133-7 kubenswrapper[2572]: E0705 19:32:54.956985 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fjdxw" podUID="1fd5cdc6-3c1a-4412-830c-b871c7087a35" Jul 05 19:32:54.957508 ip-10-0-133-7 kubenswrapper[2572]: E0705 19:32:54.957048 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-brllj" podUID="05684556-d2e2-4157-9f17-097dee8230a0" Jul 05 19:32:56.123219 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:56.122978 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-dlr8v" event={"ID":"3567b575-3458-4a8c-9cac-04d8c9f7d1a6","Type":"ContainerStarted","Data":"6f1371157ede1f66a93d90ca90674e866add52ffb67a29eb4d90b7992c0e6d05"} Jul 05 19:32:56.126944 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:56.126918 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jp9t6" event={"ID":"3d6f9f21-755d-491c-ac1f-f94df1e44b79","Type":"ContainerStarted","Data":"55167261f60308e6c0b9f56da3513d7d4c50be58a7e1877c33c4a5e749726972"} Jul 05 19:32:56.127262 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:56.127235 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-jp9t6" Jul 05 19:32:56.142400 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:56.142380 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-jp9t6" Jul 05 19:32:56.165117 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:56.165080 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-jp9t6" podStartSLOduration=9.267812584 podStartE2EDuration="28.165065331s" totalImagesPullingTime="18.897252747s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-05 19:32:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 19:32:56.163696817 +0000 UTC m=+29.563044287" watchObservedRunningTime="2026-07-05 19:32:56.165065331 +0000 UTC m=+29.564412798" Jul 05 19:32:56.957868 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:56.957840 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-brllj" Jul 05 19:32:56.958177 ip-10-0-133-7 kubenswrapper[2572]: E0705 19:32:56.957967 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-brllj" podUID="05684556-d2e2-4157-9f17-097dee8230a0" Jul 05 19:32:56.958177 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:56.958120 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k2b5v" Jul 05 19:32:56.958177 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:56.958169 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fjdxw" Jul 05 19:32:56.958359 ip-10-0-133-7 kubenswrapper[2572]: E0705 19:32:56.958255 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-k2b5v" podUID="b256bcc8-4bdd-48db-b050-c02c368ef29d" Jul 05 19:32:56.958359 ip-10-0-133-7 kubenswrapper[2572]: E0705 19:32:56.958331 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fjdxw" podUID="1fd5cdc6-3c1a-4412-830c-b871c7087a35" Jul 05 19:32:57.134285 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:57.134249 2572 generic.go:356] "Generic (PLEG): container finished" podID="3567b575-3458-4a8c-9cac-04d8c9f7d1a6" containerID="6f1371157ede1f66a93d90ca90674e866add52ffb67a29eb4d90b7992c0e6d05" exitCode=0 Jul 05 19:32:57.134630 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:57.134338 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-dlr8v" event={"ID":"3567b575-3458-4a8c-9cac-04d8c9f7d1a6","Type":"ContainerDied","Data":"6f1371157ede1f66a93d90ca90674e866add52ffb67a29eb4d90b7992c0e6d05"} Jul 05 19:32:57.134892 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:57.134868 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-jp9t6" Jul 05 19:32:57.135058 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:57.134962 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-jp9t6" Jul 05 19:32:57.150182 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:57.150156 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-jp9t6" Jul 05 19:32:57.808704 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:57.808672 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-k2b5v"] Jul 05 19:32:57.808864 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:57.808818 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k2b5v" Jul 05 19:32:57.808972 ip-10-0-133-7 kubenswrapper[2572]: E0705 19:32:57.808930 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-k2b5v" podUID="b256bcc8-4bdd-48db-b050-c02c368ef29d" Jul 05 19:32:57.811786 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:57.811754 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-fjdxw"] Jul 05 19:32:57.811918 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:57.811872 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fjdxw" Jul 05 19:32:57.812027 ip-10-0-133-7 kubenswrapper[2572]: E0705 19:32:57.811995 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fjdxw" podUID="1fd5cdc6-3c1a-4412-830c-b871c7087a35" Jul 05 19:32:57.812644 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:57.812620 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-brllj"] Jul 05 19:32:57.812748 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:57.812738 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-brllj" Jul 05 19:32:57.812872 ip-10-0-133-7 kubenswrapper[2572]: E0705 19:32:57.812846 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-brllj" podUID="05684556-d2e2-4157-9f17-097dee8230a0" Jul 05 19:32:59.140881 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:59.140699 2572 generic.go:356] "Generic (PLEG): container finished" podID="3567b575-3458-4a8c-9cac-04d8c9f7d1a6" containerID="01c9d607ccc8826e97309ac2507b5e46cad0f19f062bd00b2147a6f6721cd746" exitCode=0 Jul 05 19:32:59.140881 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:59.140787 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-dlr8v" event={"ID":"3567b575-3458-4a8c-9cac-04d8c9f7d1a6","Type":"ContainerDied","Data":"01c9d607ccc8826e97309ac2507b5e46cad0f19f062bd00b2147a6f6721cd746"} Jul 05 19:32:59.956801 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:59.956769 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fjdxw" Jul 05 19:32:59.956801 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:59.956805 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k2b5v" Jul 05 19:32:59.957041 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:32:59.956805 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-brllj" Jul 05 19:32:59.957041 ip-10-0-133-7 kubenswrapper[2572]: E0705 19:32:59.956884 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fjdxw" podUID="1fd5cdc6-3c1a-4412-830c-b871c7087a35" Jul 05 19:32:59.957041 ip-10-0-133-7 kubenswrapper[2572]: E0705 19:32:59.957020 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-k2b5v" podUID="b256bcc8-4bdd-48db-b050-c02c368ef29d" Jul 05 19:32:59.957205 ip-10-0-133-7 kubenswrapper[2572]: E0705 19:32:59.957177 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-brllj" podUID="05684556-d2e2-4157-9f17-097dee8230a0" Jul 05 19:33:00.750806 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:33:00.750775 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/05684556-d2e2-4157-9f17-097dee8230a0-metrics-certs\") pod \"network-metrics-daemon-brllj\" (UID: \"05684556-d2e2-4157-9f17-097dee8230a0\") " pod="openshift-multus/network-metrics-daemon-brllj" Jul 05 19:33:00.751300 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:33:00.750825 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b256bcc8-4bdd-48db-b050-c02c368ef29d-original-pull-secret\") pod \"global-pull-secret-syncer-k2b5v\" (UID: \"b256bcc8-4bdd-48db-b050-c02c368ef29d\") " pod="kube-system/global-pull-secret-syncer-k2b5v" Jul 05 19:33:00.751300 ip-10-0-133-7 kubenswrapper[2572]: E0705 19:33:00.750913 2572 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 05 19:33:00.751300 ip-10-0-133-7 kubenswrapper[2572]: E0705 19:33:00.750916 2572 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 05 19:33:00.751300 ip-10-0-133-7 kubenswrapper[2572]: E0705 19:33:00.750983 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b256bcc8-4bdd-48db-b050-c02c368ef29d-original-pull-secret podName:b256bcc8-4bdd-48db-b050-c02c368ef29d nodeName:}" failed. No retries permitted until 2026-07-05 19:33:32.750963841 +0000 UTC m=+66.150311301 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/b256bcc8-4bdd-48db-b050-c02c368ef29d-original-pull-secret") pod "global-pull-secret-syncer-k2b5v" (UID: "b256bcc8-4bdd-48db-b050-c02c368ef29d") : object "kube-system"/"original-pull-secret" not registered Jul 05 19:33:00.751300 ip-10-0-133-7 kubenswrapper[2572]: E0705 19:33:00.751000 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/05684556-d2e2-4157-9f17-097dee8230a0-metrics-certs podName:05684556-d2e2-4157-9f17-097dee8230a0 nodeName:}" failed. No retries permitted until 2026-07-05 19:33:32.750991633 +0000 UTC m=+66.150339081 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/05684556-d2e2-4157-9f17-097dee8230a0-metrics-certs") pod "network-metrics-daemon-brllj" (UID: "05684556-d2e2-4157-9f17-097dee8230a0") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 05 19:33:00.851494 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:33:00.851464 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-55jpj\" (UniqueName: \"kubernetes.io/projected/1fd5cdc6-3c1a-4412-830c-b871c7087a35-kube-api-access-55jpj\") pod \"network-check-target-fjdxw\" (UID: \"1fd5cdc6-3c1a-4412-830c-b871c7087a35\") " pod="openshift-network-diagnostics/network-check-target-fjdxw" Jul 05 19:33:00.851647 ip-10-0-133-7 kubenswrapper[2572]: E0705 19:33:00.851584 2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 05 19:33:00.851647 ip-10-0-133-7 kubenswrapper[2572]: E0705 19:33:00.851599 2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 05 19:33:00.851647 ip-10-0-133-7 kubenswrapper[2572]: E0705 19:33:00.851608 2572 projected.go:196] Error preparing data for projected volume kube-api-access-55jpj for pod openshift-network-diagnostics/network-check-target-fjdxw: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 05 19:33:00.851757 ip-10-0-133-7 kubenswrapper[2572]: E0705 19:33:00.851651 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1fd5cdc6-3c1a-4412-830c-b871c7087a35-kube-api-access-55jpj podName:1fd5cdc6-3c1a-4412-830c-b871c7087a35 nodeName:}" failed. No retries permitted until 2026-07-05 19:33:32.851638618 +0000 UTC m=+66.250986063 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-55jpj" (UniqueName: "kubernetes.io/projected/1fd5cdc6-3c1a-4412-830c-b871c7087a35-kube-api-access-55jpj") pod "network-check-target-fjdxw" (UID: "1fd5cdc6-3c1a-4412-830c-b871c7087a35") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 05 19:33:01.147680 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:33:01.147599 2572 generic.go:356] "Generic (PLEG): container finished" podID="3567b575-3458-4a8c-9cac-04d8c9f7d1a6" containerID="68e198b2b285f09ea3322bc8862833f0b2415ace29d3bfc6384a8bb762bb1bed" exitCode=0 Jul 05 19:33:01.147680 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:33:01.147649 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-dlr8v" event={"ID":"3567b575-3458-4a8c-9cac-04d8c9f7d1a6","Type":"ContainerDied","Data":"68e198b2b285f09ea3322bc8862833f0b2415ace29d3bfc6384a8bb762bb1bed"} Jul 05 19:33:01.955325 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:33:01.955296 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-7.ec2.internal" event="NodeReady" Jul 05 19:33:01.955925 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:33:01.955460 2572 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 05 19:33:01.956483 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:33:01.956459 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k2b5v" Jul 05 19:33:01.956596 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:33:01.956459 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fjdxw" Jul 05 19:33:01.956651 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:33:01.956459 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-brllj" Jul 05 19:33:01.960038 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:33:01.960013 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-dghwm\"" Jul 05 19:33:01.960038 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:33:01.960031 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 05 19:33:01.960228 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:33:01.960058 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 05 19:33:01.960228 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:33:01.960066 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-mmzkm\"" Jul 05 19:33:01.961601 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:33:01.961072 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 05 19:33:01.961601 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:33:01.961087 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 05 19:33:02.002518 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:33:02.002480 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-7fb894c589-5k8cr"] Jul 05 19:33:02.005324 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:33:02.005297 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-7x47r"] Jul 05 19:33:02.005479 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:33:02.005368 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7fb894c589-5k8cr" Jul 05 19:33:02.007368 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:33:02.007341 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-64786d9cbb-zkn8b"] Jul 05 19:33:02.007499 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:33:02.007460 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-7x47r" Jul 05 19:33:02.008062 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:33:02.008042 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jul 05 19:33:02.008156 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:33:02.008077 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jul 05 19:33:02.008156 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:33:02.008084 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jul 05 19:33:02.008308 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:33:02.008293 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-cndlv\"" Jul 05 19:33:02.009651 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:33:02.009631 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-zkn8b" Jul 05 19:33:02.010811 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:33:02.010497 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\"" Jul 05 19:33:02.010811 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:33:02.010555 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-n9xwb\"" Jul 05 19:33:02.010811 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:33:02.010673 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\"" Jul 05 19:33:02.014394 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:33:02.014152 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\"" Jul 05 19:33:02.014394 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:33:02.014158 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 05 19:33:02.016592 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:33:02.015487 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-qltg5\"" Jul 05 19:33:02.016592 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:33:02.015627 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\"" Jul 05 19:33:02.016592 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:33:02.016061 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 05 19:33:02.016778 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:33:02.016684 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jul 05 19:33:02.016922 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:33:02.016887 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-hqbtk"] Jul 05 19:33:02.019314 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:33:02.019298 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-zg7lw"] Jul 05 19:33:02.019452 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:33:02.019423 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-hqbtk" Jul 05 19:33:02.021722 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:33:02.021701 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-6bffdf9778-r7bj5"] Jul 05 19:33:02.021847 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:33:02.021792 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\"" Jul 05 19:33:02.021847 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:33:02.021796 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-zg7lw" Jul 05 19:33:02.021968 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:33:02.021942 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\"" Jul 05 19:33:02.022591 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:33:02.022531 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\"" Jul 05 19:33:02.022874 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:33:02.022857 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-fkts5\"" Jul 05 19:33:02.024244 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:33:02.024226 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-28jcd"] Jul 05 19:33:02.024355 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:33:02.024339 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6bffdf9778-r7bj5" Jul 05 19:33:02.026630 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:33:02.026614 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-5c847dcfc4-wpgzd"] Jul 05 19:33:02.026742 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:33:02.026727 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-28jcd" Jul 05 19:33:02.029259 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:33:02.029235 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-68b757fb67-plqpb"] Jul 05 19:33:02.029366 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:33:02.029347 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5c847dcfc4-wpgzd" Jul 05 19:33:02.032544 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:33:02.032139 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\"" Jul 05 19:33:02.032544 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:33:02.032343 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\"" Jul 05 19:33:02.032828 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:33:02.032561 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-ljp4z\"" Jul 05 19:33:02.034337 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:33:02.033489 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\"" Jul 05 19:33:02.034337 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:33:02.033929 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\"" Jul 05 19:33:02.034337 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:33:02.033967 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-989f8b8dc-wkkdw"] Jul 05 19:33:02.034535 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:33:02.034361 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\"" Jul 05 19:33:02.035640 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:33:02.035238 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-njwkw\"" Jul 05 19:33:02.036183 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:33:02.035767 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\"" Jul 05 19:33:02.036799 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:33:02.036621 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\"" Jul 05 19:33:02.038859 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:33:02.037539 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\"" Jul 05 19:33:02.038859 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:33:02.037643 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\"" Jul 05 19:33:02.038859 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:33:02.038233 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-68b757fb67-plqpb" Jul 05 19:33:02.039758 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:33:02.039333 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-64786d9cbb-zkn8b"] Jul 05 19:33:02.039758 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:33:02.039378 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-7x47r"] Jul 05 19:33:02.039758 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:33:02.039413 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 05 19:33:02.039758 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:33:02.039537 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\"" Jul 05 19:33:02.039758 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:33:02.039591 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-989f8b8dc-wkkdw" Jul 05 19:33:02.039758 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:33:02.039607 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\"" Jul 05 19:33:02.039758 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:33:02.039628 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-cl5hq\"" Jul 05 19:33:02.040123 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:33:02.039840 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\"" Jul 05 19:33:02.042162 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:33:02.041537 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-7fb894c589-5k8cr"] Jul 05 19:33:02.042162 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:33:02.041689 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-ldlb4\"" Jul 05 19:33:02.042350 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:33:02.042310 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 05 19:33:02.043281 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:33:02.043260 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-7rm66\"" Jul 05 19:33:02.043757 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:33:02.043735 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\"" Jul 05 19:33:02.043897 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:33:02.043880 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\"" Jul 05 19:33:02.045257 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:33:02.045055 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-647c6ccd69-6rdf2"] Jul 05 19:33:02.047082 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:33:02.047062 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\"" Jul 05 19:33:02.048100 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:33:02.047991 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\"" Jul 05 19:33:02.048783 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:33:02.048765 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\"" Jul 05 19:33:02.050177 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:33:02.050060 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-5dxlq"] Jul 05 19:33:02.050300 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:33:02.050189 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-647c6ccd69-6rdf2" Jul 05 19:33:02.052975 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:33:02.052940 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-kspjb"] Jul 05 19:33:02.053177 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:33:02.053053 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-5dxlq" Jul 05 19:33:02.059081 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:33:02.057805 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-kspjb" Jul 05 19:33:02.059081 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:33:02.058543 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 05 19:33:02.059081 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:33:02.058607 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jul 05 19:33:02.059081 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:33:02.058689 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\"" Jul 05 19:33:02.059081 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:33:02.058770 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 05 19:33:02.059081 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:33:02.058796 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\"" Jul 05 19:33:02.059081 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:33:02.058929 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\"" Jul 05 19:33:02.059081 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:33:02.059053 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jul 05 19:33:02.059487 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:33:02.059104 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-nmmp2\"" Jul 05 19:33:02.059487 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:33:02.059262 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 05 19:33:02.059487 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:33:02.059410 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\"" Jul 05 19:33:02.059624 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:33:02.059491 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-jcsgz\"" Jul 05 19:33:02.059671 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:33:02.059628 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-42jkt\"" Jul 05 19:33:02.060316 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:33:02.060296 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-zg7lw"] Jul 05 19:33:02.061722 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:33:02.061686 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-hqbtk"] Jul 05 19:33:02.062904 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:33:02.062886 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-6bffdf9778-r7bj5"] Jul 05 19:33:02.063242 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:33:02.063220 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 05 19:33:02.063417 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:33:02.063378 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 05 19:33:02.063690 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:33:02.063671 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-n6b4c\"" Jul 05 19:33:02.064060 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:33:02.064039 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-28jcd"] Jul 05 19:33:02.064885 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:33:02.064866 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5c847dcfc4-wpgzd"] Jul 05 19:33:02.066228 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:33:02.066207 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\"" Jul 05 19:33:02.067658 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:33:02.067621 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-kspjb"] Jul 05 19:33:02.071117 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:33:02.071098 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-647c6ccd69-6rdf2"] Jul 05 19:33:02.075970 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:33:02.075940 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-989f8b8dc-wkkdw"] Jul 05 19:33:02.077189 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:33:02.077171 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-68b757fb67-plqpb"] Jul 05 19:33:02.079382 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:33:02.079356 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-5dxlq"] Jul 05 19:33:02.161759 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:33:02.161662 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f00bb4f2-e3e7-48e5-82b4-ada41ed8cd2f-service-ca-bundle\") pod \"insights-operator-5c847dcfc4-wpgzd\" (UID: \"f00bb4f2-e3e7-48e5-82b4-ada41ed8cd2f\") " pod="openshift-insights/insights-operator-5c847dcfc4-wpgzd" Jul 05 19:33:02.161759 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:33:02.161709 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/e493ebf0-e374-4035-b4cb-6777bbd88a53-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-hqbtk\" (UID: \"e493ebf0-e374-4035-b4cb-6777bbd88a53\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-hqbtk" Jul 05 19:33:02.161759 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:33:02.161740 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/f568b2ea-4b26-4337-8500-6a5daf5c7579-config\") pod \"kube-storage-version-migrator-operator-846bf668f7-28jcd\" (UID: \"f568b2ea-4b26-4337-8500-6a5daf5c7579\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-28jcd" Jul 05 19:33:02.162049 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:33:02.161764 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/be57b515-f505-458c-8585-52cecfc83ee6-config-volume\") pod \"dns-default-kspjb\" (UID: \"be57b515-f505-458c-8585-52cecfc83ee6\") " pod="openshift-dns/dns-default-kspjb" Jul 05 19:33:02.162049 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:33:02.161792 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/ac3142e8-817c-493b-b998-41ff8f4680f9-config\") pod \"console-operator-68b757fb67-plqpb\" (UID: \"ac3142e8-817c-493b-b998-41ff8f4680f9\") " pod="openshift-console-operator/console-operator-68b757fb67-plqpb" Jul 05 19:33:02.162049 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:33:02.161818 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xrcgs\" (UniqueName: \"kubernetes.io/projected/3fff4b0f-7be8-4dc8-811d-9971cafc6810-kube-api-access-xrcgs\") pod \"image-registry-7fb894c589-5k8cr\" (UID: \"3fff4b0f-7be8-4dc8-811d-9971cafc6810\") " pod="openshift-image-registry/image-registry-7fb894c589-5k8cr" Jul 05 19:33:02.162049 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:33:02.161851 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/d92912ee-635b-42af-8e2a-0bd5fc31ffc2-default-certificate\") pod \"router-default-647c6ccd69-6rdf2\" (UID: \"d92912ee-635b-42af-8e2a-0bd5fc31ffc2\") " pod="openshift-ingress/router-default-647c6ccd69-6rdf2" Jul 05 19:33:02.162049 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:33:02.161878 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/ac3142e8-817c-493b-b998-41ff8f4680f9-trusted-ca\") pod \"console-operator-68b757fb67-plqpb\" (UID: \"ac3142e8-817c-493b-b998-41ff8f4680f9\") " pod="openshift-console-operator/console-operator-68b757fb67-plqpb" Jul 05 19:33:02.162049 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:33:02.161932 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/f00bb4f2-e3e7-48e5-82b4-ada41ed8cd2f-serving-cert\") pod \"insights-operator-5c847dcfc4-wpgzd\" (UID: \"f00bb4f2-e3e7-48e5-82b4-ada41ed8cd2f\") " pod="openshift-insights/insights-operator-5c847dcfc4-wpgzd" Jul 05 19:33:02.162049 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:33:02.161978 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/ac3142e8-817c-493b-b998-41ff8f4680f9-serving-cert\") pod \"console-operator-68b757fb67-plqpb\" (UID: \"ac3142e8-817c-493b-b998-41ff8f4680f9\") " pod="openshift-console-operator/console-operator-68b757fb67-plqpb" Jul 05 19:33:02.162049 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:33:02.162005 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ac01962e-2f62-482e-92ea-3c484803817d-cert\") pod \"ingress-canary-5dxlq\" (UID: \"ac01962e-2f62-482e-92ea-3c484803817d\") " pod="openshift-ingress-canary/ingress-canary-5dxlq" Jul 05 19:33:02.162049 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:33:02.162029 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jl2zb\" (UniqueName: \"kubernetes.io/projected/d92912ee-635b-42af-8e2a-0bd5fc31ffc2-kube-api-access-jl2zb\") pod \"router-default-647c6ccd69-6rdf2\" (UID: \"d92912ee-635b-42af-8e2a-0bd5fc31ffc2\") " pod="openshift-ingress/router-default-647c6ccd69-6rdf2" Jul 05 19:33:02.162049 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:33:02.162049 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9pqfm\" (UniqueName: \"kubernetes.io/projected/1fd5a296-7d6e-475a-8e56-c50ac3e09085-kube-api-access-9pqfm\") pod \"cluster-monitoring-operator-64786d9cbb-zkn8b\" (UID: \"1fd5a296-7d6e-475a-8e56-c50ac3e09085\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-zkn8b" Jul 05 19:33:02.162502 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:33:02.162150 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-24lwp\" (UniqueName: \"kubernetes.io/projected/ac3142e8-817c-493b-b998-41ff8f4680f9-kube-api-access-24lwp\") pod \"console-operator-68b757fb67-plqpb\" (UID: \"ac3142e8-817c-493b-b998-41ff8f4680f9\") " pod="openshift-console-operator/console-operator-68b757fb67-plqpb" Jul 05 19:33:02.162502 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:33:02.162192 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/3fff4b0f-7be8-4dc8-811d-9971cafc6810-registry-tls\") pod \"image-registry-7fb894c589-5k8cr\" (UID: \"3fff4b0f-7be8-4dc8-811d-9971cafc6810\") " pod="openshift-image-registry/image-registry-7fb894c589-5k8cr" Jul 05 19:33:02.162502 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:33:02.162239 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/be57b515-f505-458c-8585-52cecfc83ee6-metrics-tls\") pod \"dns-default-kspjb\" (UID: \"be57b515-f505-458c-8585-52cecfc83ee6\") " pod="openshift-dns/dns-default-kspjb" Jul 05 19:33:02.162502 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:33:02.162267 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/3fff4b0f-7be8-4dc8-811d-9971cafc6810-ca-trust-extracted\") pod \"image-registry-7fb894c589-5k8cr\" (UID: \"3fff4b0f-7be8-4dc8-811d-9971cafc6810\") " pod="openshift-image-registry/image-registry-7fb894c589-5k8cr" Jul 05 19:33:02.162502 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:33:02.162336 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f00bb4f2-e3e7-48e5-82b4-ada41ed8cd2f-tmp\") pod \"insights-operator-5c847dcfc4-wpgzd\" (UID: \"f00bb4f2-e3e7-48e5-82b4-ada41ed8cd2f\") " pod="openshift-insights/insights-operator-5c847dcfc4-wpgzd" Jul 05 19:33:02.162502 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:33:02.162379 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4ssdh\" (UniqueName: \"kubernetes.io/projected/f00bb4f2-e3e7-48e5-82b4-ada41ed8cd2f-kube-api-access-4ssdh\") pod \"insights-operator-5c847dcfc4-wpgzd\" (UID: \"f00bb4f2-e3e7-48e5-82b4-ada41ed8cd2f\") " pod="openshift-insights/insights-operator-5c847dcfc4-wpgzd" Jul 05 19:33:02.162502 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:33:02.162422 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/f568b2ea-4b26-4337-8500-6a5daf5c7579-serving-cert\") pod \"kube-storage-version-migrator-operator-846bf668f7-28jcd\" (UID: \"f568b2ea-4b26-4337-8500-6a5daf5c7579\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-28jcd" Jul 05 19:33:02.162502 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:33:02.162464 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/7d69272b-dacb-48d0-bc9d-ab7f93673154-nginx-conf\") pod \"networking-console-plugin-6bffdf9778-r7bj5\" (UID: \"7d69272b-dacb-48d0-bc9d-ab7f93673154\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-r7bj5" Jul 05 19:33:02.162502 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:33:02.162494 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/3fff4b0f-7be8-4dc8-811d-9971cafc6810-trusted-ca\") pod \"image-registry-7fb894c589-5k8cr\" (UID: \"3fff4b0f-7be8-4dc8-811d-9971cafc6810\") " pod="openshift-image-registry/image-registry-7fb894c589-5k8cr" Jul 05 19:33:02.162901 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:33:02.162521 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ch468\" (UniqueName: \"kubernetes.io/projected/97203db6-d938-48a9-834a-81a92eaae053-kube-api-access-ch468\") pod \"service-ca-operator-5d46d9ffd4-zg7lw\" (UID: \"97203db6-d938-48a9-834a-81a92eaae053\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-zg7lw" Jul 05 19:33:02.162901 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:33:02.162543 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/be57b515-f505-458c-8585-52cecfc83ee6-tmp-dir\") pod \"dns-default-kspjb\" (UID: \"be57b515-f505-458c-8585-52cecfc83ee6\") " pod="openshift-dns/dns-default-kspjb" Jul 05 19:33:02.162901 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:33:02.162566 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cdnfl\" (UniqueName: \"kubernetes.io/projected/ac01962e-2f62-482e-92ea-3c484803817d-kube-api-access-cdnfl\") pod \"ingress-canary-5dxlq\" (UID: \"ac01962e-2f62-482e-92ea-3c484803817d\") " pod="openshift-ingress-canary/ingress-canary-5dxlq" Jul 05 19:33:02.162901 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:33:02.162597 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/97203db6-d938-48a9-834a-81a92eaae053-serving-cert\") pod \"service-ca-operator-5d46d9ffd4-zg7lw\" (UID: \"97203db6-d938-48a9-834a-81a92eaae053\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-zg7lw" Jul 05 19:33:02.162901 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:33:02.162639 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kz7n4\" (UniqueName: \"kubernetes.io/projected/e493ebf0-e374-4035-b4cb-6777bbd88a53-kube-api-access-kz7n4\") pod \"cluster-samples-operator-56fcf86bf-hqbtk\" (UID: \"e493ebf0-e374-4035-b4cb-6777bbd88a53\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-hqbtk" Jul 05 19:33:02.162901 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:33:02.162714 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gtf8d\" (UniqueName: \"kubernetes.io/projected/497d532f-61d0-4c9c-ab13-ea25538abdac-kube-api-access-gtf8d\") pod \"network-check-source-989f8b8dc-wkkdw\" (UID: \"497d532f-61d0-4c9c-ab13-ea25538abdac\") " pod="openshift-network-diagnostics/network-check-source-989f8b8dc-wkkdw" Jul 05 19:33:02.162901 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:33:02.162745 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/7d69272b-dacb-48d0-bc9d-ab7f93673154-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-r7bj5\" (UID: \"7d69272b-dacb-48d0-bc9d-ab7f93673154\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-r7bj5" Jul 05 19:33:02.162901 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:33:02.162772 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/d92912ee-635b-42af-8e2a-0bd5fc31ffc2-stats-auth\") pod \"router-default-647c6ccd69-6rdf2\" (UID: \"d92912ee-635b-42af-8e2a-0bd5fc31ffc2\") " pod="openshift-ingress/router-default-647c6ccd69-6rdf2" Jul 05 19:33:02.162901 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:33:02.162800 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hnsgk\" (UniqueName: \"kubernetes.io/projected/f568b2ea-4b26-4337-8500-6a5daf5c7579-kube-api-access-hnsgk\") pod \"kube-storage-version-migrator-operator-846bf668f7-28jcd\" (UID: \"f568b2ea-4b26-4337-8500-6a5daf5c7579\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-28jcd" Jul 05 19:33:02.162901 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:33:02.162884 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/f00bb4f2-e3e7-48e5-82b4-ada41ed8cd2f-snapshots\") pod \"insights-operator-5c847dcfc4-wpgzd\" (UID: \"f00bb4f2-e3e7-48e5-82b4-ada41ed8cd2f\") " pod="openshift-insights/insights-operator-5c847dcfc4-wpgzd" Jul 05 19:33:02.163371 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:33:02.162915 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f00bb4f2-e3e7-48e5-82b4-ada41ed8cd2f-trusted-ca-bundle\") pod \"insights-operator-5c847dcfc4-wpgzd\" (UID: \"f00bb4f2-e3e7-48e5-82b4-ada41ed8cd2f\") " pod="openshift-insights/insights-operator-5c847dcfc4-wpgzd" Jul 05 19:33:02.163371 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:33:02.163009 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/1fd5a296-7d6e-475a-8e56-c50ac3e09085-telemetry-config\") pod \"cluster-monitoring-operator-64786d9cbb-zkn8b\" (UID: \"1fd5a296-7d6e-475a-8e56-c50ac3e09085\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-zkn8b" Jul 05 19:33:02.163371 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:33:02.163036 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/1fd5a296-7d6e-475a-8e56-c50ac3e09085-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-zkn8b\" (UID: \"1fd5a296-7d6e-475a-8e56-c50ac3e09085\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-zkn8b" Jul 05 19:33:02.163371 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:33:02.163062 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/3fff4b0f-7be8-4dc8-811d-9971cafc6810-installation-pull-secrets\") pod \"image-registry-7fb894c589-5k8cr\" (UID: \"3fff4b0f-7be8-4dc8-811d-9971cafc6810\") " pod="openshift-image-registry/image-registry-7fb894c589-5k8cr" Jul 05 19:33:02.163371 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:33:02.163099 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/97203db6-d938-48a9-834a-81a92eaae053-config\") pod \"service-ca-operator-5d46d9ffd4-zg7lw\" (UID: \"97203db6-d938-48a9-834a-81a92eaae053\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-zg7lw" Jul 05 19:33:02.163371 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:33:02.163123 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d92912ee-635b-42af-8e2a-0bd5fc31ffc2-metrics-certs\") pod \"router-default-647c6ccd69-6rdf2\" (UID: \"d92912ee-635b-42af-8e2a-0bd5fc31ffc2\") " pod="openshift-ingress/router-default-647c6ccd69-6rdf2" Jul 05 19:33:02.163371 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:33:02.163148 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/3fff4b0f-7be8-4dc8-811d-9971cafc6810-bound-sa-token\") pod \"image-registry-7fb894c589-5k8cr\" (UID: \"3fff4b0f-7be8-4dc8-811d-9971cafc6810\") " pod="openshift-image-registry/image-registry-7fb894c589-5k8cr" Jul 05 19:33:02.163371 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:33:02.163172 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d92912ee-635b-42af-8e2a-0bd5fc31ffc2-service-ca-bundle\") pod \"router-default-647c6ccd69-6rdf2\" (UID: \"d92912ee-635b-42af-8e2a-0bd5fc31ffc2\") " pod="openshift-ingress/router-default-647c6ccd69-6rdf2" Jul 05 19:33:02.163371 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:33:02.163195 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tn7bq\" (UniqueName: \"kubernetes.io/projected/be57b515-f505-458c-8585-52cecfc83ee6-kube-api-access-tn7bq\") pod \"dns-default-kspjb\" (UID: \"be57b515-f505-458c-8585-52cecfc83ee6\") " pod="openshift-dns/dns-default-kspjb" Jul 05 19:33:02.163371 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:33:02.163223 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7t6tg\" (UniqueName: \"kubernetes.io/projected/8f389010-efaa-4a2a-a136-a206e6ad0cd5-kube-api-access-7t6tg\") pod \"volume-data-source-validator-5d456fdbcd-7x47r\" (UID: \"8f389010-efaa-4a2a-a136-a206e6ad0cd5\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-7x47r" Jul 05 19:33:02.163371 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:33:02.163246 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/3fff4b0f-7be8-4dc8-811d-9971cafc6810-registry-certificates\") pod \"image-registry-7fb894c589-5k8cr\" (UID: \"3fff4b0f-7be8-4dc8-811d-9971cafc6810\") " pod="openshift-image-registry/image-registry-7fb894c589-5k8cr" Jul 05 19:33:02.163371 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:33:02.163271 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/3fff4b0f-7be8-4dc8-811d-9971cafc6810-image-registry-private-configuration\") pod \"image-registry-7fb894c589-5k8cr\" (UID: \"3fff4b0f-7be8-4dc8-811d-9971cafc6810\") " pod="openshift-image-registry/image-registry-7fb894c589-5k8cr" Jul 05 19:33:02.264164 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:33:02.264133 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-24lwp\" (UniqueName: \"kubernetes.io/projected/ac3142e8-817c-493b-b998-41ff8f4680f9-kube-api-access-24lwp\") pod \"console-operator-68b757fb67-plqpb\" (UID: \"ac3142e8-817c-493b-b998-41ff8f4680f9\") " pod="openshift-console-operator/console-operator-68b757fb67-plqpb" Jul 05 19:33:02.264164 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:33:02.264167 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/3fff4b0f-7be8-4dc8-811d-9971cafc6810-registry-tls\") pod \"image-registry-7fb894c589-5k8cr\" (UID: \"3fff4b0f-7be8-4dc8-811d-9971cafc6810\") " pod="openshift-image-registry/image-registry-7fb894c589-5k8cr" Jul 05 19:33:02.264400 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:33:02.264206 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/be57b515-f505-458c-8585-52cecfc83ee6-metrics-tls\") pod \"dns-default-kspjb\" (UID: \"be57b515-f505-458c-8585-52cecfc83ee6\") " pod="openshift-dns/dns-default-kspjb" Jul 05 19:33:02.264400 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:33:02.264232 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/3fff4b0f-7be8-4dc8-811d-9971cafc6810-ca-trust-extracted\") pod \"image-registry-7fb894c589-5k8cr\" (UID: \"3fff4b0f-7be8-4dc8-811d-9971cafc6810\") " pod="openshift-image-registry/image-registry-7fb894c589-5k8cr" Jul 05 19:33:02.264400 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:33:02.264271 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f00bb4f2-e3e7-48e5-82b4-ada41ed8cd2f-tmp\") pod \"insights-operator-5c847dcfc4-wpgzd\" (UID: \"f00bb4f2-e3e7-48e5-82b4-ada41ed8cd2f\") " pod="openshift-insights/insights-operator-5c847dcfc4-wpgzd" Jul 05 19:33:02.264400 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:33:02.264298 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4ssdh\" (UniqueName: \"kubernetes.io/projected/f00bb4f2-e3e7-48e5-82b4-ada41ed8cd2f-kube-api-access-4ssdh\") pod \"insights-operator-5c847dcfc4-wpgzd\" (UID: \"f00bb4f2-e3e7-48e5-82b4-ada41ed8cd2f\") " pod="openshift-insights/insights-operator-5c847dcfc4-wpgzd" Jul 05 19:33:02.264400 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:33:02.264325 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/f568b2ea-4b26-4337-8500-6a5daf5c7579-serving-cert\") pod \"kube-storage-version-migrator-operator-846bf668f7-28jcd\" (UID: \"f568b2ea-4b26-4337-8500-6a5daf5c7579\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-28jcd" Jul 05 19:33:02.264400 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:33:02.264352 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/7d69272b-dacb-48d0-bc9d-ab7f93673154-nginx-conf\") pod \"networking-console-plugin-6bffdf9778-r7bj5\" (UID: \"7d69272b-dacb-48d0-bc9d-ab7f93673154\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-r7bj5" Jul 05 19:33:02.264400 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:33:02.264379 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/3fff4b0f-7be8-4dc8-811d-9971cafc6810-trusted-ca\") pod \"image-registry-7fb894c589-5k8cr\" (UID: \"3fff4b0f-7be8-4dc8-811d-9971cafc6810\") " pod="openshift-image-registry/image-registry-7fb894c589-5k8cr" Jul 05 19:33:02.264400 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:33:02.264404 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ch468\" (UniqueName: \"kubernetes.io/projected/97203db6-d938-48a9-834a-81a92eaae053-kube-api-access-ch468\") pod \"service-ca-operator-5d46d9ffd4-zg7lw\" (UID: \"97203db6-d938-48a9-834a-81a92eaae053\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-zg7lw" Jul 05 19:33:02.264400 ip-10-0-133-7 kubenswrapper[2572]: E0705 19:33:02.264297 2572 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 05 19:33:02.264400 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:33:02.264429 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/be57b515-f505-458c-8585-52cecfc83ee6-tmp-dir\") pod \"dns-default-kspjb\" (UID: \"be57b515-f505-458c-8585-52cecfc83ee6\") " pod="openshift-dns/dns-default-kspjb" Jul 05 19:33:02.264400 ip-10-0-133-7 kubenswrapper[2572]: E0705 19:33:02.264439 2572 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7fb894c589-5k8cr: secret "image-registry-tls" not found Jul 05 19:33:02.264400 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:33:02.264457 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cdnfl\" (UniqueName: \"kubernetes.io/projected/ac01962e-2f62-482e-92ea-3c484803817d-kube-api-access-cdnfl\") pod \"ingress-canary-5dxlq\" (UID: \"ac01962e-2f62-482e-92ea-3c484803817d\") " pod="openshift-ingress-canary/ingress-canary-5dxlq" Jul 05 19:33:02.264400 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:33:02.264482 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/97203db6-d938-48a9-834a-81a92eaae053-serving-cert\") pod \"service-ca-operator-5d46d9ffd4-zg7lw\" (UID: \"97203db6-d938-48a9-834a-81a92eaae053\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-zg7lw" Jul 05 19:33:02.265227 ip-10-0-133-7 kubenswrapper[2572]: E0705 19:33:02.264504 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3fff4b0f-7be8-4dc8-811d-9971cafc6810-registry-tls podName:3fff4b0f-7be8-4dc8-811d-9971cafc6810 nodeName:}" failed. No retries permitted until 2026-07-05 19:33:02.764485609 +0000 UTC m=+36.163833058 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/3fff4b0f-7be8-4dc8-811d-9971cafc6810-registry-tls") pod "image-registry-7fb894c589-5k8cr" (UID: "3fff4b0f-7be8-4dc8-811d-9971cafc6810") : secret "image-registry-tls" not found Jul 05 19:33:02.265227 ip-10-0-133-7 kubenswrapper[2572]: E0705 19:33:02.264332 2572 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 05 19:33:02.265227 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:33:02.264534 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kz7n4\" (UniqueName: \"kubernetes.io/projected/e493ebf0-e374-4035-b4cb-6777bbd88a53-kube-api-access-kz7n4\") pod \"cluster-samples-operator-56fcf86bf-hqbtk\" (UID: \"e493ebf0-e374-4035-b4cb-6777bbd88a53\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-hqbtk" Jul 05 19:33:02.265227 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:33:02.264566 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gtf8d\" (UniqueName: \"kubernetes.io/projected/497d532f-61d0-4c9c-ab13-ea25538abdac-kube-api-access-gtf8d\") pod \"network-check-source-989f8b8dc-wkkdw\" (UID: \"497d532f-61d0-4c9c-ab13-ea25538abdac\") " pod="openshift-network-diagnostics/network-check-source-989f8b8dc-wkkdw" Jul 05 19:33:02.265227 ip-10-0-133-7 kubenswrapper[2572]: E0705 19:33:02.264588 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/be57b515-f505-458c-8585-52cecfc83ee6-metrics-tls podName:be57b515-f505-458c-8585-52cecfc83ee6 nodeName:}" failed. No retries permitted until 2026-07-05 19:33:02.764568515 +0000 UTC m=+36.163915961 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/be57b515-f505-458c-8585-52cecfc83ee6-metrics-tls") pod "dns-default-kspjb" (UID: "be57b515-f505-458c-8585-52cecfc83ee6") : secret "dns-default-metrics-tls" not found Jul 05 19:33:02.265227 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:33:02.264632 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/7d69272b-dacb-48d0-bc9d-ab7f93673154-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-r7bj5\" (UID: \"7d69272b-dacb-48d0-bc9d-ab7f93673154\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-r7bj5" Jul 05 19:33:02.265227 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:33:02.264661 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/d92912ee-635b-42af-8e2a-0bd5fc31ffc2-stats-auth\") pod \"router-default-647c6ccd69-6rdf2\" (UID: \"d92912ee-635b-42af-8e2a-0bd5fc31ffc2\") " pod="openshift-ingress/router-default-647c6ccd69-6rdf2" Jul 05 19:33:02.265227 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:33:02.264669 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/3fff4b0f-7be8-4dc8-811d-9971cafc6810-ca-trust-extracted\") pod \"image-registry-7fb894c589-5k8cr\" (UID: \"3fff4b0f-7be8-4dc8-811d-9971cafc6810\") " pod="openshift-image-registry/image-registry-7fb894c589-5k8cr" Jul 05 19:33:02.265227 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:33:02.264694 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hnsgk\" (UniqueName: \"kubernetes.io/projected/f568b2ea-4b26-4337-8500-6a5daf5c7579-kube-api-access-hnsgk\") pod \"kube-storage-version-migrator-operator-846bf668f7-28jcd\" (UID: \"f568b2ea-4b26-4337-8500-6a5daf5c7579\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-28jcd" Jul 05 19:33:02.265227 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:33:02.264740 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/f00bb4f2-e3e7-48e5-82b4-ada41ed8cd2f-snapshots\") pod \"insights-operator-5c847dcfc4-wpgzd\" (UID: \"f00bb4f2-e3e7-48e5-82b4-ada41ed8cd2f\") " pod="openshift-insights/insights-operator-5c847dcfc4-wpgzd" Jul 05 19:33:02.265227 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:33:02.264765 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f00bb4f2-e3e7-48e5-82b4-ada41ed8cd2f-trusted-ca-bundle\") pod \"insights-operator-5c847dcfc4-wpgzd\" (UID: \"f00bb4f2-e3e7-48e5-82b4-ada41ed8cd2f\") " pod="openshift-insights/insights-operator-5c847dcfc4-wpgzd" Jul 05 19:33:02.265227 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:33:02.264794 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/1fd5a296-7d6e-475a-8e56-c50ac3e09085-telemetry-config\") pod \"cluster-monitoring-operator-64786d9cbb-zkn8b\" (UID: \"1fd5a296-7d6e-475a-8e56-c50ac3e09085\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-zkn8b" Jul 05 19:33:02.265227 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:33:02.264821 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/1fd5a296-7d6e-475a-8e56-c50ac3e09085-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-zkn8b\" (UID: \"1fd5a296-7d6e-475a-8e56-c50ac3e09085\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-zkn8b" Jul 05 19:33:02.265227 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:33:02.264837 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f00bb4f2-e3e7-48e5-82b4-ada41ed8cd2f-tmp\") pod \"insights-operator-5c847dcfc4-wpgzd\" (UID: \"f00bb4f2-e3e7-48e5-82b4-ada41ed8cd2f\") " pod="openshift-insights/insights-operator-5c847dcfc4-wpgzd" Jul 05 19:33:02.265227 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:33:02.264851 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/3fff4b0f-7be8-4dc8-811d-9971cafc6810-installation-pull-secrets\") pod \"image-registry-7fb894c589-5k8cr\" (UID: \"3fff4b0f-7be8-4dc8-811d-9971cafc6810\") " pod="openshift-image-registry/image-registry-7fb894c589-5k8cr" Jul 05 19:33:02.265994 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:33:02.264912 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/97203db6-d938-48a9-834a-81a92eaae053-config\") pod \"service-ca-operator-5d46d9ffd4-zg7lw\" (UID: \"97203db6-d938-48a9-834a-81a92eaae053\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-zg7lw" Jul 05 19:33:02.265994 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:33:02.264983 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d92912ee-635b-42af-8e2a-0bd5fc31ffc2-metrics-certs\") pod \"router-default-647c6ccd69-6rdf2\" (UID: \"d92912ee-635b-42af-8e2a-0bd5fc31ffc2\") " pod="openshift-ingress/router-default-647c6ccd69-6rdf2" Jul 05 19:33:02.265994 ip-10-0-133-7 kubenswrapper[2572]: E0705 19:33:02.265065 2572 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 05 19:33:02.265994 ip-10-0-133-7 kubenswrapper[2572]: E0705 19:33:02.265117 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d92912ee-635b-42af-8e2a-0bd5fc31ffc2-metrics-certs podName:d92912ee-635b-42af-8e2a-0bd5fc31ffc2 nodeName:}" failed. No retries permitted until 2026-07-05 19:33:02.765103578 +0000 UTC m=+36.164451036 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d92912ee-635b-42af-8e2a-0bd5fc31ffc2-metrics-certs") pod "router-default-647c6ccd69-6rdf2" (UID: "d92912ee-635b-42af-8e2a-0bd5fc31ffc2") : secret "router-metrics-certs-default" not found Jul 05 19:33:02.265994 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:33:02.265130 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/be57b515-f505-458c-8585-52cecfc83ee6-tmp-dir\") pod \"dns-default-kspjb\" (UID: \"be57b515-f505-458c-8585-52cecfc83ee6\") " pod="openshift-dns/dns-default-kspjb" Jul 05 19:33:02.265994 ip-10-0-133-7 kubenswrapper[2572]: E0705 19:33:02.265263 2572 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 05 19:33:02.265994 ip-10-0-133-7 kubenswrapper[2572]: E0705 19:33:02.265320 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7d69272b-dacb-48d0-bc9d-ab7f93673154-networking-console-plugin-cert podName:7d69272b-dacb-48d0-bc9d-ab7f93673154 nodeName:}" failed. No retries permitted until 2026-07-05 19:33:02.765305692 +0000 UTC m=+36.164653136 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/7d69272b-dacb-48d0-bc9d-ab7f93673154-networking-console-plugin-cert") pod "networking-console-plugin-6bffdf9778-r7bj5" (UID: "7d69272b-dacb-48d0-bc9d-ab7f93673154") : secret "networking-console-plugin-cert" not found Jul 05 19:33:02.265994 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:33:02.265691 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/97203db6-d938-48a9-834a-81a92eaae053-config\") pod \"service-ca-operator-5d46d9ffd4-zg7lw\" (UID: \"97203db6-d938-48a9-834a-81a92eaae053\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-zg7lw" Jul 05 19:33:02.265994 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:33:02.265725 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/3fff4b0f-7be8-4dc8-811d-9971cafc6810-trusted-ca\") pod \"image-registry-7fb894c589-5k8cr\" (UID: \"3fff4b0f-7be8-4dc8-811d-9971cafc6810\") " pod="openshift-image-registry/image-registry-7fb894c589-5k8cr" Jul 05 19:33:02.265994 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:33:02.265764 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/3fff4b0f-7be8-4dc8-811d-9971cafc6810-bound-sa-token\") pod \"image-registry-7fb894c589-5k8cr\" (UID: \"3fff4b0f-7be8-4dc8-811d-9971cafc6810\") " pod="openshift-image-registry/image-registry-7fb894c589-5k8cr" Jul 05 19:33:02.265994 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:33:02.265763 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/7d69272b-dacb-48d0-bc9d-ab7f93673154-nginx-conf\") pod \"networking-console-plugin-6bffdf9778-r7bj5\" (UID: \"7d69272b-dacb-48d0-bc9d-ab7f93673154\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-r7bj5" Jul 05 19:33:02.265994 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:33:02.265794 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d92912ee-635b-42af-8e2a-0bd5fc31ffc2-service-ca-bundle\") pod \"router-default-647c6ccd69-6rdf2\" (UID: \"d92912ee-635b-42af-8e2a-0bd5fc31ffc2\") " pod="openshift-ingress/router-default-647c6ccd69-6rdf2" Jul 05 19:33:02.265994 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:33:02.265819 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tn7bq\" (UniqueName: \"kubernetes.io/projected/be57b515-f505-458c-8585-52cecfc83ee6-kube-api-access-tn7bq\") pod \"dns-default-kspjb\" (UID: \"be57b515-f505-458c-8585-52cecfc83ee6\") " pod="openshift-dns/dns-default-kspjb" Jul 05 19:33:02.265994 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:33:02.265849 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7t6tg\" (UniqueName: \"kubernetes.io/projected/8f389010-efaa-4a2a-a136-a206e6ad0cd5-kube-api-access-7t6tg\") pod \"volume-data-source-validator-5d456fdbcd-7x47r\" (UID: \"8f389010-efaa-4a2a-a136-a206e6ad0cd5\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-7x47r" Jul 05 19:33:02.265994 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:33:02.265874 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/3fff4b0f-7be8-4dc8-811d-9971cafc6810-registry-certificates\") pod \"image-registry-7fb894c589-5k8cr\" (UID: \"3fff4b0f-7be8-4dc8-811d-9971cafc6810\") " pod="openshift-image-registry/image-registry-7fb894c589-5k8cr" Jul 05 19:33:02.265994 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:33:02.265902 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/3fff4b0f-7be8-4dc8-811d-9971cafc6810-image-registry-private-configuration\") pod \"image-registry-7fb894c589-5k8cr\" (UID: \"3fff4b0f-7be8-4dc8-811d-9971cafc6810\") " pod="openshift-image-registry/image-registry-7fb894c589-5k8cr" Jul 05 19:33:02.266743 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:33:02.265935 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f00bb4f2-e3e7-48e5-82b4-ada41ed8cd2f-service-ca-bundle\") pod \"insights-operator-5c847dcfc4-wpgzd\" (UID: \"f00bb4f2-e3e7-48e5-82b4-ada41ed8cd2f\") " pod="openshift-insights/insights-operator-5c847dcfc4-wpgzd" Jul 05 19:33:02.266743 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:33:02.265975 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/f00bb4f2-e3e7-48e5-82b4-ada41ed8cd2f-snapshots\") pod \"insights-operator-5c847dcfc4-wpgzd\" (UID: \"f00bb4f2-e3e7-48e5-82b4-ada41ed8cd2f\") " pod="openshift-insights/insights-operator-5c847dcfc4-wpgzd" Jul 05 19:33:02.266743 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:33:02.265983 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/e493ebf0-e374-4035-b4cb-6777bbd88a53-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-hqbtk\" (UID: \"e493ebf0-e374-4035-b4cb-6777bbd88a53\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-hqbtk" Jul 05 19:33:02.266743 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:33:02.266010 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/f568b2ea-4b26-4337-8500-6a5daf5c7579-config\") pod \"kube-storage-version-migrator-operator-846bf668f7-28jcd\" (UID: \"f568b2ea-4b26-4337-8500-6a5daf5c7579\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-28jcd" Jul 05 19:33:02.266743 ip-10-0-133-7 kubenswrapper[2572]: E0705 19:33:02.266070 2572 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 05 19:33:02.266743 ip-10-0-133-7 kubenswrapper[2572]: E0705 19:33:02.266109 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1fd5a296-7d6e-475a-8e56-c50ac3e09085-cluster-monitoring-operator-tls podName:1fd5a296-7d6e-475a-8e56-c50ac3e09085 nodeName:}" failed. No retries permitted until 2026-07-05 19:33:02.76609684 +0000 UTC m=+36.165444306 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/1fd5a296-7d6e-475a-8e56-c50ac3e09085-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-zkn8b" (UID: "1fd5a296-7d6e-475a-8e56-c50ac3e09085") : secret "cluster-monitoring-operator-tls" not found Jul 05 19:33:02.266743 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:33:02.266133 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/be57b515-f505-458c-8585-52cecfc83ee6-config-volume\") pod \"dns-default-kspjb\" (UID: \"be57b515-f505-458c-8585-52cecfc83ee6\") " pod="openshift-dns/dns-default-kspjb" Jul 05 19:33:02.266743 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:33:02.266161 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/ac3142e8-817c-493b-b998-41ff8f4680f9-config\") pod \"console-operator-68b757fb67-plqpb\" (UID: \"ac3142e8-817c-493b-b998-41ff8f4680f9\") " pod="openshift-console-operator/console-operator-68b757fb67-plqpb" Jul 05 19:33:02.266743 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:33:02.266189 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xrcgs\" (UniqueName: \"kubernetes.io/projected/3fff4b0f-7be8-4dc8-811d-9971cafc6810-kube-api-access-xrcgs\") pod \"image-registry-7fb894c589-5k8cr\" (UID: \"3fff4b0f-7be8-4dc8-811d-9971cafc6810\") " pod="openshift-image-registry/image-registry-7fb894c589-5k8cr" Jul 05 19:33:02.266743 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:33:02.266213 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/d92912ee-635b-42af-8e2a-0bd5fc31ffc2-default-certificate\") pod \"router-default-647c6ccd69-6rdf2\" (UID: \"d92912ee-635b-42af-8e2a-0bd5fc31ffc2\") " pod="openshift-ingress/router-default-647c6ccd69-6rdf2" Jul 05 19:33:02.266743 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:33:02.266238 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/ac3142e8-817c-493b-b998-41ff8f4680f9-trusted-ca\") pod \"console-operator-68b757fb67-plqpb\" (UID: \"ac3142e8-817c-493b-b998-41ff8f4680f9\") " pod="openshift-console-operator/console-operator-68b757fb67-plqpb" Jul 05 19:33:02.266743 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:33:02.266262 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/f00bb4f2-e3e7-48e5-82b4-ada41ed8cd2f-serving-cert\") pod \"insights-operator-5c847dcfc4-wpgzd\" (UID: \"f00bb4f2-e3e7-48e5-82b4-ada41ed8cd2f\") " pod="openshift-insights/insights-operator-5c847dcfc4-wpgzd" Jul 05 19:33:02.266743 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:33:02.266289 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/ac3142e8-817c-493b-b998-41ff8f4680f9-serving-cert\") pod \"console-operator-68b757fb67-plqpb\" (UID: \"ac3142e8-817c-493b-b998-41ff8f4680f9\") " pod="openshift-console-operator/console-operator-68b757fb67-plqpb" Jul 05 19:33:02.266743 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:33:02.266315 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ac01962e-2f62-482e-92ea-3c484803817d-cert\") pod \"ingress-canary-5dxlq\" (UID: \"ac01962e-2f62-482e-92ea-3c484803817d\") " pod="openshift-ingress-canary/ingress-canary-5dxlq" Jul 05 19:33:02.266743 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:33:02.266355 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jl2zb\" (UniqueName: \"kubernetes.io/projected/d92912ee-635b-42af-8e2a-0bd5fc31ffc2-kube-api-access-jl2zb\") pod \"router-default-647c6ccd69-6rdf2\" (UID: \"d92912ee-635b-42af-8e2a-0bd5fc31ffc2\") " pod="openshift-ingress/router-default-647c6ccd69-6rdf2" Jul 05 19:33:02.266743 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:33:02.266377 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9pqfm\" (UniqueName: \"kubernetes.io/projected/1fd5a296-7d6e-475a-8e56-c50ac3e09085-kube-api-access-9pqfm\") pod \"cluster-monitoring-operator-64786d9cbb-zkn8b\" (UID: \"1fd5a296-7d6e-475a-8e56-c50ac3e09085\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-zkn8b" Jul 05 19:33:02.267573 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:33:02.266511 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f00bb4f2-e3e7-48e5-82b4-ada41ed8cd2f-trusted-ca-bundle\") pod \"insights-operator-5c847dcfc4-wpgzd\" (UID: \"f00bb4f2-e3e7-48e5-82b4-ada41ed8cd2f\") " pod="openshift-insights/insights-operator-5c847dcfc4-wpgzd" Jul 05 19:33:02.267573 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:33:02.266598 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/1fd5a296-7d6e-475a-8e56-c50ac3e09085-telemetry-config\") pod \"cluster-monitoring-operator-64786d9cbb-zkn8b\" (UID: \"1fd5a296-7d6e-475a-8e56-c50ac3e09085\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-zkn8b" Jul 05 19:33:02.267573 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:33:02.266513 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/f568b2ea-4b26-4337-8500-6a5daf5c7579-config\") pod \"kube-storage-version-migrator-operator-846bf668f7-28jcd\" (UID: \"f568b2ea-4b26-4337-8500-6a5daf5c7579\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-28jcd" Jul 05 19:33:02.267573 ip-10-0-133-7 kubenswrapper[2572]: E0705 19:33:02.266748 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/d92912ee-635b-42af-8e2a-0bd5fc31ffc2-service-ca-bundle podName:d92912ee-635b-42af-8e2a-0bd5fc31ffc2 nodeName:}" failed. No retries permitted until 2026-07-05 19:33:02.766733581 +0000 UTC m=+36.166081044 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/d92912ee-635b-42af-8e2a-0bd5fc31ffc2-service-ca-bundle") pod "router-default-647c6ccd69-6rdf2" (UID: "d92912ee-635b-42af-8e2a-0bd5fc31ffc2") : configmap references non-existent config key: service-ca.crt Jul 05 19:33:02.267573 ip-10-0-133-7 kubenswrapper[2572]: E0705 19:33:02.267003 2572 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 05 19:33:02.267573 ip-10-0-133-7 kubenswrapper[2572]: E0705 19:33:02.267069 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e493ebf0-e374-4035-b4cb-6777bbd88a53-samples-operator-tls podName:e493ebf0-e374-4035-b4cb-6777bbd88a53 nodeName:}" failed. No retries permitted until 2026-07-05 19:33:02.767053001 +0000 UTC m=+36.166400464 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/e493ebf0-e374-4035-b4cb-6777bbd88a53-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-hqbtk" (UID: "e493ebf0-e374-4035-b4cb-6777bbd88a53") : secret "samples-operator-tls" not found Jul 05 19:33:02.267573 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:33:02.267247 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/3fff4b0f-7be8-4dc8-811d-9971cafc6810-registry-certificates\") pod \"image-registry-7fb894c589-5k8cr\" (UID: \"3fff4b0f-7be8-4dc8-811d-9971cafc6810\") " pod="openshift-image-registry/image-registry-7fb894c589-5k8cr" Jul 05 19:33:02.267573 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:33:02.267288 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f00bb4f2-e3e7-48e5-82b4-ada41ed8cd2f-service-ca-bundle\") pod \"insights-operator-5c847dcfc4-wpgzd\" (UID: \"f00bb4f2-e3e7-48e5-82b4-ada41ed8cd2f\") " pod="openshift-insights/insights-operator-5c847dcfc4-wpgzd" Jul 05 19:33:02.267573 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:33:02.267460 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/be57b515-f505-458c-8585-52cecfc83ee6-config-volume\") pod \"dns-default-kspjb\" (UID: \"be57b515-f505-458c-8585-52cecfc83ee6\") " pod="openshift-dns/dns-default-kspjb" Jul 05 19:33:02.268055 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:33:02.268035 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/ac3142e8-817c-493b-b998-41ff8f4680f9-config\") pod \"console-operator-68b757fb67-plqpb\" (UID: \"ac3142e8-817c-493b-b998-41ff8f4680f9\") " pod="openshift-console-operator/console-operator-68b757fb67-plqpb" Jul 05 19:33:02.268265 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:33:02.268236 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/ac3142e8-817c-493b-b998-41ff8f4680f9-trusted-ca\") pod \"console-operator-68b757fb67-plqpb\" (UID: \"ac3142e8-817c-493b-b998-41ff8f4680f9\") " pod="openshift-console-operator/console-operator-68b757fb67-plqpb" Jul 05 19:33:02.269978 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:33:02.269520 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/97203db6-d938-48a9-834a-81a92eaae053-serving-cert\") pod \"service-ca-operator-5d46d9ffd4-zg7lw\" (UID: \"97203db6-d938-48a9-834a-81a92eaae053\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-zg7lw" Jul 05 19:33:02.269978 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:33:02.269814 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/d92912ee-635b-42af-8e2a-0bd5fc31ffc2-stats-auth\") pod \"router-default-647c6ccd69-6rdf2\" (UID: \"d92912ee-635b-42af-8e2a-0bd5fc31ffc2\") " pod="openshift-ingress/router-default-647c6ccd69-6rdf2" Jul 05 19:33:02.270406 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:33:02.270357 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/f568b2ea-4b26-4337-8500-6a5daf5c7579-serving-cert\") pod \"kube-storage-version-migrator-operator-846bf668f7-28jcd\" (UID: \"f568b2ea-4b26-4337-8500-6a5daf5c7579\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-28jcd" Jul 05 19:33:02.271002 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:33:02.270982 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/f00bb4f2-e3e7-48e5-82b4-ada41ed8cd2f-serving-cert\") pod \"insights-operator-5c847dcfc4-wpgzd\" (UID: \"f00bb4f2-e3e7-48e5-82b4-ada41ed8cd2f\") " pod="openshift-insights/insights-operator-5c847dcfc4-wpgzd" Jul 05 19:33:02.271366 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:33:02.271279 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/ac3142e8-817c-493b-b998-41ff8f4680f9-serving-cert\") pod \"console-operator-68b757fb67-plqpb\" (UID: \"ac3142e8-817c-493b-b998-41ff8f4680f9\") " pod="openshift-console-operator/console-operator-68b757fb67-plqpb" Jul 05 19:33:02.271836 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:33:02.271810 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/3fff4b0f-7be8-4dc8-811d-9971cafc6810-installation-pull-secrets\") pod \"image-registry-7fb894c589-5k8cr\" (UID: \"3fff4b0f-7be8-4dc8-811d-9971cafc6810\") " pod="openshift-image-registry/image-registry-7fb894c589-5k8cr" Jul 05 19:33:02.271921 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:33:02.271849 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/3fff4b0f-7be8-4dc8-811d-9971cafc6810-image-registry-private-configuration\") pod \"image-registry-7fb894c589-5k8cr\" (UID: \"3fff4b0f-7be8-4dc8-811d-9971cafc6810\") " pod="openshift-image-registry/image-registry-7fb894c589-5k8cr" Jul 05 19:33:02.272663 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:33:02.272639 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ac01962e-2f62-482e-92ea-3c484803817d-cert\") pod \"ingress-canary-5dxlq\" (UID: \"ac01962e-2f62-482e-92ea-3c484803817d\") " pod="openshift-ingress-canary/ingress-canary-5dxlq" Jul 05 19:33:02.273370 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:33:02.273347 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/d92912ee-635b-42af-8e2a-0bd5fc31ffc2-default-certificate\") pod \"router-default-647c6ccd69-6rdf2\" (UID: \"d92912ee-635b-42af-8e2a-0bd5fc31ffc2\") " pod="openshift-ingress/router-default-647c6ccd69-6rdf2" Jul 05 19:33:02.274164 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:33:02.274141 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4ssdh\" (UniqueName: \"kubernetes.io/projected/f00bb4f2-e3e7-48e5-82b4-ada41ed8cd2f-kube-api-access-4ssdh\") pod \"insights-operator-5c847dcfc4-wpgzd\" (UID: \"f00bb4f2-e3e7-48e5-82b4-ada41ed8cd2f\") " pod="openshift-insights/insights-operator-5c847dcfc4-wpgzd" Jul 05 19:33:02.274685 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:33:02.274667 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-24lwp\" (UniqueName: \"kubernetes.io/projected/ac3142e8-817c-493b-b998-41ff8f4680f9-kube-api-access-24lwp\") pod \"console-operator-68b757fb67-plqpb\" (UID: \"ac3142e8-817c-493b-b998-41ff8f4680f9\") " pod="openshift-console-operator/console-operator-68b757fb67-plqpb" Jul 05 19:33:02.278721 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:33:02.278701 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tn7bq\" (UniqueName: \"kubernetes.io/projected/be57b515-f505-458c-8585-52cecfc83ee6-kube-api-access-tn7bq\") pod \"dns-default-kspjb\" (UID: \"be57b515-f505-458c-8585-52cecfc83ee6\") " pod="openshift-dns/dns-default-kspjb" Jul 05 19:33:02.282855 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:33:02.282829 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7t6tg\" (UniqueName: \"kubernetes.io/projected/8f389010-efaa-4a2a-a136-a206e6ad0cd5-kube-api-access-7t6tg\") pod \"volume-data-source-validator-5d456fdbcd-7x47r\" (UID: \"8f389010-efaa-4a2a-a136-a206e6ad0cd5\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-7x47r" Jul 05 19:33:02.283073 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:33:02.283028 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gtf8d\" (UniqueName: \"kubernetes.io/projected/497d532f-61d0-4c9c-ab13-ea25538abdac-kube-api-access-gtf8d\") pod \"network-check-source-989f8b8dc-wkkdw\" (UID: \"497d532f-61d0-4c9c-ab13-ea25538abdac\") " pod="openshift-network-diagnostics/network-check-source-989f8b8dc-wkkdw" Jul 05 19:33:02.284795 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:33:02.284680 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/3fff4b0f-7be8-4dc8-811d-9971cafc6810-bound-sa-token\") pod \"image-registry-7fb894c589-5k8cr\" (UID: \"3fff4b0f-7be8-4dc8-811d-9971cafc6810\") " pod="openshift-image-registry/image-registry-7fb894c589-5k8cr" Jul 05 19:33:02.284878 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:33:02.284836 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cdnfl\" (UniqueName: \"kubernetes.io/projected/ac01962e-2f62-482e-92ea-3c484803817d-kube-api-access-cdnfl\") pod \"ingress-canary-5dxlq\" (UID: \"ac01962e-2f62-482e-92ea-3c484803817d\") " pod="openshift-ingress-canary/ingress-canary-5dxlq" Jul 05 19:33:02.289730 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:33:02.285212 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xrcgs\" (UniqueName: \"kubernetes.io/projected/3fff4b0f-7be8-4dc8-811d-9971cafc6810-kube-api-access-xrcgs\") pod \"image-registry-7fb894c589-5k8cr\" (UID: \"3fff4b0f-7be8-4dc8-811d-9971cafc6810\") " pod="openshift-image-registry/image-registry-7fb894c589-5k8cr" Jul 05 19:33:02.289730 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:33:02.285565 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9pqfm\" (UniqueName: \"kubernetes.io/projected/1fd5a296-7d6e-475a-8e56-c50ac3e09085-kube-api-access-9pqfm\") pod \"cluster-monitoring-operator-64786d9cbb-zkn8b\" (UID: \"1fd5a296-7d6e-475a-8e56-c50ac3e09085\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-zkn8b" Jul 05 19:33:02.289730 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:33:02.285851 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hnsgk\" (UniqueName: \"kubernetes.io/projected/f568b2ea-4b26-4337-8500-6a5daf5c7579-kube-api-access-hnsgk\") pod \"kube-storage-version-migrator-operator-846bf668f7-28jcd\" (UID: \"f568b2ea-4b26-4337-8500-6a5daf5c7579\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-28jcd" Jul 05 19:33:02.289730 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:33:02.286438 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kz7n4\" (UniqueName: \"kubernetes.io/projected/e493ebf0-e374-4035-b4cb-6777bbd88a53-kube-api-access-kz7n4\") pod \"cluster-samples-operator-56fcf86bf-hqbtk\" (UID: \"e493ebf0-e374-4035-b4cb-6777bbd88a53\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-hqbtk" Jul 05 19:33:02.291872 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:33:02.291815 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ch468\" (UniqueName: \"kubernetes.io/projected/97203db6-d938-48a9-834a-81a92eaae053-kube-api-access-ch468\") pod \"service-ca-operator-5d46d9ffd4-zg7lw\" (UID: \"97203db6-d938-48a9-834a-81a92eaae053\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-zg7lw" Jul 05 19:33:02.292281 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:33:02.292261 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jl2zb\" (UniqueName: \"kubernetes.io/projected/d92912ee-635b-42af-8e2a-0bd5fc31ffc2-kube-api-access-jl2zb\") pod \"router-default-647c6ccd69-6rdf2\" (UID: \"d92912ee-635b-42af-8e2a-0bd5fc31ffc2\") " pod="openshift-ingress/router-default-647c6ccd69-6rdf2" Jul 05 19:33:02.327219 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:33:02.327185 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-7x47r" Jul 05 19:33:02.362597 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:33:02.362559 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-zg7lw" Jul 05 19:33:02.378235 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:33:02.378204 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-28jcd" Jul 05 19:33:02.386842 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:33:02.386581 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5c847dcfc4-wpgzd" Jul 05 19:33:02.394417 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:33:02.394243 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-68b757fb67-plqpb" Jul 05 19:33:02.402910 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:33:02.402542 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-989f8b8dc-wkkdw" Jul 05 19:33:02.417176 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:33:02.416904 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-5dxlq" Jul 05 19:33:02.560405 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:33:02.559579 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-7x47r"] Jul 05 19:33:02.622344 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:33:02.622313 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5c847dcfc4-wpgzd"] Jul 05 19:33:02.627713 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:33:02.626316 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-28jcd"] Jul 05 19:33:02.627713 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:33:02.627094 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-zg7lw"] Jul 05 19:33:02.629891 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:33:02.629859 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod97203db6_d938_48a9_834a_81a92eaae053.slice/crio-de11479d9abd47c2565354439bef3623d53aac6db928929a2c647e20f98241c6 WatchSource:0}: Error finding container de11479d9abd47c2565354439bef3623d53aac6db928929a2c647e20f98241c6: Status 404 returned error can't find the container with id de11479d9abd47c2565354439bef3623d53aac6db928929a2c647e20f98241c6 Jul 05 19:33:02.631422 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:33:02.631055 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf568b2ea_4b26_4337_8500_6a5daf5c7579.slice/crio-2d709a759c5ab1379f77c6c65f84f4af44c90b9c189919d72783a73b47641a74 WatchSource:0}: Error finding container 2d709a759c5ab1379f77c6c65f84f4af44c90b9c189919d72783a73b47641a74: Status 404 returned error can't find the container with id 2d709a759c5ab1379f77c6c65f84f4af44c90b9c189919d72783a73b47641a74 Jul 05 19:33:02.631422 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:33:02.631305 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf00bb4f2_e3e7_48e5_82b4_ada41ed8cd2f.slice/crio-e5ded4275f813643056a860b576660a825e9e67aed85c04e9b65025696873d29 WatchSource:0}: Error finding container e5ded4275f813643056a860b576660a825e9e67aed85c04e9b65025696873d29: Status 404 returned error can't find the container with id e5ded4275f813643056a860b576660a825e9e67aed85c04e9b65025696873d29 Jul 05 19:33:02.651644 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:33:02.651576 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-5dxlq"] Jul 05 19:33:02.654597 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:33:02.654574 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podac01962e_2f62_482e_92ea_3c484803817d.slice/crio-5b4e21d262ee1172cda8c37ab7c4b0a75ed8c6e1feea558820d04d611cee9fe1 WatchSource:0}: Error finding container 5b4e21d262ee1172cda8c37ab7c4b0a75ed8c6e1feea558820d04d611cee9fe1: Status 404 returned error can't find the container with id 5b4e21d262ee1172cda8c37ab7c4b0a75ed8c6e1feea558820d04d611cee9fe1 Jul 05 19:33:02.663182 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:33:02.663157 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-989f8b8dc-wkkdw"] Jul 05 19:33:02.666793 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:33:02.666733 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-68b757fb67-plqpb"] Jul 05 19:33:02.666928 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:33:02.666909 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod497d532f_61d0_4c9c_ab13_ea25538abdac.slice/crio-f56a86f1b941e8ef54480b2e9a992ac054eb8ab75699f2beb495361aacd7fa43 WatchSource:0}: Error finding container f56a86f1b941e8ef54480b2e9a992ac054eb8ab75699f2beb495361aacd7fa43: Status 404 returned error can't find the container with id f56a86f1b941e8ef54480b2e9a992ac054eb8ab75699f2beb495361aacd7fa43 Jul 05 19:33:02.670643 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:33:02.670607 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podac3142e8_817c_493b_b998_41ff8f4680f9.slice/crio-81510cd47b6e7cd2589212dea7ecff2229c0eba589378b8d7865be6f15fdfcec WatchSource:0}: Error finding container 81510cd47b6e7cd2589212dea7ecff2229c0eba589378b8d7865be6f15fdfcec: Status 404 returned error can't find the container with id 81510cd47b6e7cd2589212dea7ecff2229c0eba589378b8d7865be6f15fdfcec Jul 05 19:33:02.779342 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:33:02.779304 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/7d69272b-dacb-48d0-bc9d-ab7f93673154-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-r7bj5\" (UID: \"7d69272b-dacb-48d0-bc9d-ab7f93673154\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-r7bj5" Jul 05 19:33:02.779508 ip-10-0-133-7 kubenswrapper[2572]: E0705 19:33:02.779475 2572 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 05 19:33:02.779508 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:33:02.779487 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/1fd5a296-7d6e-475a-8e56-c50ac3e09085-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-zkn8b\" (UID: \"1fd5a296-7d6e-475a-8e56-c50ac3e09085\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-zkn8b" Jul 05 19:33:02.779634 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:33:02.779535 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d92912ee-635b-42af-8e2a-0bd5fc31ffc2-metrics-certs\") pod \"router-default-647c6ccd69-6rdf2\" (UID: \"d92912ee-635b-42af-8e2a-0bd5fc31ffc2\") " pod="openshift-ingress/router-default-647c6ccd69-6rdf2" Jul 05 19:33:02.779634 ip-10-0-133-7 kubenswrapper[2572]: E0705 19:33:02.779551 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7d69272b-dacb-48d0-bc9d-ab7f93673154-networking-console-plugin-cert podName:7d69272b-dacb-48d0-bc9d-ab7f93673154 nodeName:}" failed. No retries permitted until 2026-07-05 19:33:03.779531052 +0000 UTC m=+37.178878498 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/7d69272b-dacb-48d0-bc9d-ab7f93673154-networking-console-plugin-cert") pod "networking-console-plugin-6bffdf9778-r7bj5" (UID: "7d69272b-dacb-48d0-bc9d-ab7f93673154") : secret "networking-console-plugin-cert" not found Jul 05 19:33:02.779634 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:33:02.779594 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d92912ee-635b-42af-8e2a-0bd5fc31ffc2-service-ca-bundle\") pod \"router-default-647c6ccd69-6rdf2\" (UID: \"d92912ee-635b-42af-8e2a-0bd5fc31ffc2\") " pod="openshift-ingress/router-default-647c6ccd69-6rdf2" Jul 05 19:33:02.779634 ip-10-0-133-7 kubenswrapper[2572]: E0705 19:33:02.779624 2572 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 05 19:33:02.779846 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:33:02.779639 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/e493ebf0-e374-4035-b4cb-6777bbd88a53-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-hqbtk\" (UID: \"e493ebf0-e374-4035-b4cb-6777bbd88a53\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-hqbtk" Jul 05 19:33:02.779846 ip-10-0-133-7 kubenswrapper[2572]: E0705 19:33:02.779677 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1fd5a296-7d6e-475a-8e56-c50ac3e09085-cluster-monitoring-operator-tls podName:1fd5a296-7d6e-475a-8e56-c50ac3e09085 nodeName:}" failed. No retries permitted until 2026-07-05 19:33:03.779662588 +0000 UTC m=+37.179010037 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/1fd5a296-7d6e-475a-8e56-c50ac3e09085-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-zkn8b" (UID: "1fd5a296-7d6e-475a-8e56-c50ac3e09085") : secret "cluster-monitoring-operator-tls" not found Jul 05 19:33:02.779846 ip-10-0-133-7 kubenswrapper[2572]: E0705 19:33:02.779685 2572 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 05 19:33:02.779846 ip-10-0-133-7 kubenswrapper[2572]: E0705 19:33:02.779722 2572 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 05 19:33:02.779846 ip-10-0-133-7 kubenswrapper[2572]: E0705 19:33:02.779734 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d92912ee-635b-42af-8e2a-0bd5fc31ffc2-metrics-certs podName:d92912ee-635b-42af-8e2a-0bd5fc31ffc2 nodeName:}" failed. No retries permitted until 2026-07-05 19:33:03.779716988 +0000 UTC m=+37.179064452 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d92912ee-635b-42af-8e2a-0bd5fc31ffc2-metrics-certs") pod "router-default-647c6ccd69-6rdf2" (UID: "d92912ee-635b-42af-8e2a-0bd5fc31ffc2") : secret "router-metrics-certs-default" not found Jul 05 19:33:02.779846 ip-10-0-133-7 kubenswrapper[2572]: E0705 19:33:02.779768 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e493ebf0-e374-4035-b4cb-6777bbd88a53-samples-operator-tls podName:e493ebf0-e374-4035-b4cb-6777bbd88a53 nodeName:}" failed. No retries permitted until 2026-07-05 19:33:03.779753175 +0000 UTC m=+37.179100625 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/e493ebf0-e374-4035-b4cb-6777bbd88a53-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-hqbtk" (UID: "e493ebf0-e374-4035-b4cb-6777bbd88a53") : secret "samples-operator-tls" not found Jul 05 19:33:02.779846 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:33:02.779721 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/3fff4b0f-7be8-4dc8-811d-9971cafc6810-registry-tls\") pod \"image-registry-7fb894c589-5k8cr\" (UID: \"3fff4b0f-7be8-4dc8-811d-9971cafc6810\") " pod="openshift-image-registry/image-registry-7fb894c589-5k8cr" Jul 05 19:33:02.779846 ip-10-0-133-7 kubenswrapper[2572]: E0705 19:33:02.779781 2572 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 05 19:33:02.779846 ip-10-0-133-7 kubenswrapper[2572]: E0705 19:33:02.779793 2572 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7fb894c589-5k8cr: secret "image-registry-tls" not found Jul 05 19:33:02.779846 ip-10-0-133-7 kubenswrapper[2572]: E0705 19:33:02.779807 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/d92912ee-635b-42af-8e2a-0bd5fc31ffc2-service-ca-bundle podName:d92912ee-635b-42af-8e2a-0bd5fc31ffc2 nodeName:}" failed. No retries permitted until 2026-07-05 19:33:03.77979579 +0000 UTC m=+37.179143310 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/d92912ee-635b-42af-8e2a-0bd5fc31ffc2-service-ca-bundle") pod "router-default-647c6ccd69-6rdf2" (UID: "d92912ee-635b-42af-8e2a-0bd5fc31ffc2") : configmap references non-existent config key: service-ca.crt Jul 05 19:33:02.779846 ip-10-0-133-7 kubenswrapper[2572]: E0705 19:33:02.779828 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3fff4b0f-7be8-4dc8-811d-9971cafc6810-registry-tls podName:3fff4b0f-7be8-4dc8-811d-9971cafc6810 nodeName:}" failed. No retries permitted until 2026-07-05 19:33:03.779819048 +0000 UTC m=+37.179166496 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/3fff4b0f-7be8-4dc8-811d-9971cafc6810-registry-tls") pod "image-registry-7fb894c589-5k8cr" (UID: "3fff4b0f-7be8-4dc8-811d-9971cafc6810") : secret "image-registry-tls" not found Jul 05 19:33:02.780391 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:33:02.779855 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/be57b515-f505-458c-8585-52cecfc83ee6-metrics-tls\") pod \"dns-default-kspjb\" (UID: \"be57b515-f505-458c-8585-52cecfc83ee6\") " pod="openshift-dns/dns-default-kspjb" Jul 05 19:33:02.780391 ip-10-0-133-7 kubenswrapper[2572]: E0705 19:33:02.780022 2572 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 05 19:33:02.780391 ip-10-0-133-7 kubenswrapper[2572]: E0705 19:33:02.780076 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/be57b515-f505-458c-8585-52cecfc83ee6-metrics-tls podName:be57b515-f505-458c-8585-52cecfc83ee6 nodeName:}" failed. No retries permitted until 2026-07-05 19:33:03.780062141 +0000 UTC m=+37.179409589 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/be57b515-f505-458c-8585-52cecfc83ee6-metrics-tls") pod "dns-default-kspjb" (UID: "be57b515-f505-458c-8585-52cecfc83ee6") : secret "dns-default-metrics-tls" not found Jul 05 19:33:03.154447 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:33:03.154403 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-68b757fb67-plqpb" event={"ID":"ac3142e8-817c-493b-b998-41ff8f4680f9","Type":"ContainerStarted","Data":"81510cd47b6e7cd2589212dea7ecff2229c0eba589378b8d7865be6f15fdfcec"} Jul 05 19:33:03.155707 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:33:03.155675 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5c847dcfc4-wpgzd" event={"ID":"f00bb4f2-e3e7-48e5-82b4-ada41ed8cd2f","Type":"ContainerStarted","Data":"e5ded4275f813643056a860b576660a825e9e67aed85c04e9b65025696873d29"} Jul 05 19:33:03.156909 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:33:03.156885 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-28jcd" event={"ID":"f568b2ea-4b26-4337-8500-6a5daf5c7579","Type":"ContainerStarted","Data":"2d709a759c5ab1379f77c6c65f84f4af44c90b9c189919d72783a73b47641a74"} Jul 05 19:33:03.158219 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:33:03.158197 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-5dxlq" event={"ID":"ac01962e-2f62-482e-92ea-3c484803817d","Type":"ContainerStarted","Data":"5b4e21d262ee1172cda8c37ab7c4b0a75ed8c6e1feea558820d04d611cee9fe1"} Jul 05 19:33:03.159502 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:33:03.159481 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-989f8b8dc-wkkdw" event={"ID":"497d532f-61d0-4c9c-ab13-ea25538abdac","Type":"ContainerStarted","Data":"f56a86f1b941e8ef54480b2e9a992ac054eb8ab75699f2beb495361aacd7fa43"} Jul 05 19:33:03.160908 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:33:03.160878 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-zg7lw" event={"ID":"97203db6-d938-48a9-834a-81a92eaae053","Type":"ContainerStarted","Data":"de11479d9abd47c2565354439bef3623d53aac6db928929a2c647e20f98241c6"} Jul 05 19:33:03.162066 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:33:03.162042 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-7x47r" event={"ID":"8f389010-efaa-4a2a-a136-a206e6ad0cd5","Type":"ContainerStarted","Data":"0f9a5da62adff3d8274f439e6b2903e071a151f9c0e8e8410c8db6b543e19d0f"} Jul 05 19:33:03.796306 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:33:03.796267 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/7d69272b-dacb-48d0-bc9d-ab7f93673154-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-r7bj5\" (UID: \"7d69272b-dacb-48d0-bc9d-ab7f93673154\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-r7bj5" Jul 05 19:33:03.796465 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:33:03.796353 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/1fd5a296-7d6e-475a-8e56-c50ac3e09085-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-zkn8b\" (UID: \"1fd5a296-7d6e-475a-8e56-c50ac3e09085\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-zkn8b" Jul 05 19:33:03.796465 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:33:03.796396 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d92912ee-635b-42af-8e2a-0bd5fc31ffc2-metrics-certs\") pod \"router-default-647c6ccd69-6rdf2\" (UID: \"d92912ee-635b-42af-8e2a-0bd5fc31ffc2\") " pod="openshift-ingress/router-default-647c6ccd69-6rdf2" Jul 05 19:33:03.796465 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:33:03.796427 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d92912ee-635b-42af-8e2a-0bd5fc31ffc2-service-ca-bundle\") pod \"router-default-647c6ccd69-6rdf2\" (UID: \"d92912ee-635b-42af-8e2a-0bd5fc31ffc2\") " pod="openshift-ingress/router-default-647c6ccd69-6rdf2" Jul 05 19:33:03.796625 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:33:03.796472 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/e493ebf0-e374-4035-b4cb-6777bbd88a53-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-hqbtk\" (UID: \"e493ebf0-e374-4035-b4cb-6777bbd88a53\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-hqbtk" Jul 05 19:33:03.796625 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:33:03.796520 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/3fff4b0f-7be8-4dc8-811d-9971cafc6810-registry-tls\") pod \"image-registry-7fb894c589-5k8cr\" (UID: \"3fff4b0f-7be8-4dc8-811d-9971cafc6810\") " pod="openshift-image-registry/image-registry-7fb894c589-5k8cr" Jul 05 19:33:03.796625 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:33:03.796559 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/be57b515-f505-458c-8585-52cecfc83ee6-metrics-tls\") pod \"dns-default-kspjb\" (UID: \"be57b515-f505-458c-8585-52cecfc83ee6\") " pod="openshift-dns/dns-default-kspjb" Jul 05 19:33:03.796775 ip-10-0-133-7 kubenswrapper[2572]: E0705 19:33:03.796749 2572 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 05 19:33:03.796827 ip-10-0-133-7 kubenswrapper[2572]: E0705 19:33:03.796818 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/be57b515-f505-458c-8585-52cecfc83ee6-metrics-tls podName:be57b515-f505-458c-8585-52cecfc83ee6 nodeName:}" failed. No retries permitted until 2026-07-05 19:33:05.796797383 +0000 UTC m=+39.196144855 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/be57b515-f505-458c-8585-52cecfc83ee6-metrics-tls") pod "dns-default-kspjb" (UID: "be57b515-f505-458c-8585-52cecfc83ee6") : secret "dns-default-metrics-tls" not found Jul 05 19:33:03.797269 ip-10-0-133-7 kubenswrapper[2572]: E0705 19:33:03.797239 2572 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 05 19:33:03.797365 ip-10-0-133-7 kubenswrapper[2572]: E0705 19:33:03.797312 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7d69272b-dacb-48d0-bc9d-ab7f93673154-networking-console-plugin-cert podName:7d69272b-dacb-48d0-bc9d-ab7f93673154 nodeName:}" failed. No retries permitted until 2026-07-05 19:33:05.79729392 +0000 UTC m=+39.196641368 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/7d69272b-dacb-48d0-bc9d-ab7f93673154-networking-console-plugin-cert") pod "networking-console-plugin-6bffdf9778-r7bj5" (UID: "7d69272b-dacb-48d0-bc9d-ab7f93673154") : secret "networking-console-plugin-cert" not found Jul 05 19:33:03.797437 ip-10-0-133-7 kubenswrapper[2572]: E0705 19:33:03.797375 2572 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 05 19:33:03.797437 ip-10-0-133-7 kubenswrapper[2572]: E0705 19:33:03.797411 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1fd5a296-7d6e-475a-8e56-c50ac3e09085-cluster-monitoring-operator-tls podName:1fd5a296-7d6e-475a-8e56-c50ac3e09085 nodeName:}" failed. No retries permitted until 2026-07-05 19:33:05.797399882 +0000 UTC m=+39.196747329 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/1fd5a296-7d6e-475a-8e56-c50ac3e09085-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-zkn8b" (UID: "1fd5a296-7d6e-475a-8e56-c50ac3e09085") : secret "cluster-monitoring-operator-tls" not found Jul 05 19:33:03.797541 ip-10-0-133-7 kubenswrapper[2572]: E0705 19:33:03.797468 2572 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 05 19:33:03.797541 ip-10-0-133-7 kubenswrapper[2572]: E0705 19:33:03.797500 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d92912ee-635b-42af-8e2a-0bd5fc31ffc2-metrics-certs podName:d92912ee-635b-42af-8e2a-0bd5fc31ffc2 nodeName:}" failed. No retries permitted until 2026-07-05 19:33:05.797490198 +0000 UTC m=+39.196837646 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d92912ee-635b-42af-8e2a-0bd5fc31ffc2-metrics-certs") pod "router-default-647c6ccd69-6rdf2" (UID: "d92912ee-635b-42af-8e2a-0bd5fc31ffc2") : secret "router-metrics-certs-default" not found Jul 05 19:33:03.797645 ip-10-0-133-7 kubenswrapper[2572]: E0705 19:33:03.797564 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/d92912ee-635b-42af-8e2a-0bd5fc31ffc2-service-ca-bundle podName:d92912ee-635b-42af-8e2a-0bd5fc31ffc2 nodeName:}" failed. No retries permitted until 2026-07-05 19:33:05.797554302 +0000 UTC m=+39.196901766 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/d92912ee-635b-42af-8e2a-0bd5fc31ffc2-service-ca-bundle") pod "router-default-647c6ccd69-6rdf2" (UID: "d92912ee-635b-42af-8e2a-0bd5fc31ffc2") : configmap references non-existent config key: service-ca.crt Jul 05 19:33:03.797645 ip-10-0-133-7 kubenswrapper[2572]: E0705 19:33:03.797630 2572 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 05 19:33:03.797739 ip-10-0-133-7 kubenswrapper[2572]: E0705 19:33:03.797663 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e493ebf0-e374-4035-b4cb-6777bbd88a53-samples-operator-tls podName:e493ebf0-e374-4035-b4cb-6777bbd88a53 nodeName:}" failed. No retries permitted until 2026-07-05 19:33:05.797650704 +0000 UTC m=+39.196998152 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/e493ebf0-e374-4035-b4cb-6777bbd88a53-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-hqbtk" (UID: "e493ebf0-e374-4035-b4cb-6777bbd88a53") : secret "samples-operator-tls" not found Jul 05 19:33:03.797739 ip-10-0-133-7 kubenswrapper[2572]: E0705 19:33:03.797722 2572 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 05 19:33:03.797739 ip-10-0-133-7 kubenswrapper[2572]: E0705 19:33:03.797734 2572 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7fb894c589-5k8cr: secret "image-registry-tls" not found Jul 05 19:33:03.797932 ip-10-0-133-7 kubenswrapper[2572]: E0705 19:33:03.797765 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3fff4b0f-7be8-4dc8-811d-9971cafc6810-registry-tls podName:3fff4b0f-7be8-4dc8-811d-9971cafc6810 nodeName:}" failed. No retries permitted until 2026-07-05 19:33:05.797754503 +0000 UTC m=+39.197101962 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/3fff4b0f-7be8-4dc8-811d-9971cafc6810-registry-tls") pod "image-registry-7fb894c589-5k8cr" (UID: "3fff4b0f-7be8-4dc8-811d-9971cafc6810") : secret "image-registry-tls" not found Jul 05 19:33:05.187511 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:33:05.187357 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-7x47r" event={"ID":"8f389010-efaa-4a2a-a136-a206e6ad0cd5","Type":"ContainerStarted","Data":"d12d6a0212e7b1c01515c99cc04d67186df83295631dc5ee3005352e543efb5f"} Jul 05 19:33:05.204019 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:33:05.203772 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-7x47r" podStartSLOduration=4.077090419 podStartE2EDuration="6.203748488s" totalImagesPullingTime="2.126658069s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-05 19:32:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 19:33:05.202187592 +0000 UTC m=+38.601535059" watchObservedRunningTime="2026-07-05 19:33:05.203748488 +0000 UTC m=+38.603095955" Jul 05 19:33:05.817657 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:33:05.817612 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/7d69272b-dacb-48d0-bc9d-ab7f93673154-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-r7bj5\" (UID: \"7d69272b-dacb-48d0-bc9d-ab7f93673154\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-r7bj5" Jul 05 19:33:05.817833 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:33:05.817692 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/1fd5a296-7d6e-475a-8e56-c50ac3e09085-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-zkn8b\" (UID: \"1fd5a296-7d6e-475a-8e56-c50ac3e09085\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-zkn8b" Jul 05 19:33:05.817833 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:33:05.817727 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d92912ee-635b-42af-8e2a-0bd5fc31ffc2-metrics-certs\") pod \"router-default-647c6ccd69-6rdf2\" (UID: \"d92912ee-635b-42af-8e2a-0bd5fc31ffc2\") " pod="openshift-ingress/router-default-647c6ccd69-6rdf2" Jul 05 19:33:05.817833 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:33:05.817749 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d92912ee-635b-42af-8e2a-0bd5fc31ffc2-service-ca-bundle\") pod \"router-default-647c6ccd69-6rdf2\" (UID: \"d92912ee-635b-42af-8e2a-0bd5fc31ffc2\") " pod="openshift-ingress/router-default-647c6ccd69-6rdf2" Jul 05 19:33:05.817833 ip-10-0-133-7 kubenswrapper[2572]: E0705 19:33:05.817777 2572 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 05 19:33:05.817833 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:33:05.817813 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/e493ebf0-e374-4035-b4cb-6777bbd88a53-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-hqbtk\" (UID: \"e493ebf0-e374-4035-b4cb-6777bbd88a53\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-hqbtk" Jul 05 19:33:05.818140 ip-10-0-133-7 kubenswrapper[2572]: E0705 19:33:05.817844 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7d69272b-dacb-48d0-bc9d-ab7f93673154-networking-console-plugin-cert podName:7d69272b-dacb-48d0-bc9d-ab7f93673154 nodeName:}" failed. No retries permitted until 2026-07-05 19:33:09.817827697 +0000 UTC m=+43.217175142 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/7d69272b-dacb-48d0-bc9d-ab7f93673154-networking-console-plugin-cert") pod "networking-console-plugin-6bffdf9778-r7bj5" (UID: "7d69272b-dacb-48d0-bc9d-ab7f93673154") : secret "networking-console-plugin-cert" not found Jul 05 19:33:05.818140 ip-10-0-133-7 kubenswrapper[2572]: E0705 19:33:05.817851 2572 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 05 19:33:05.818140 ip-10-0-133-7 kubenswrapper[2572]: E0705 19:33:05.817883 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/d92912ee-635b-42af-8e2a-0bd5fc31ffc2-service-ca-bundle podName:d92912ee-635b-42af-8e2a-0bd5fc31ffc2 nodeName:}" failed. No retries permitted until 2026-07-05 19:33:09.817867245 +0000 UTC m=+43.217214701 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/d92912ee-635b-42af-8e2a-0bd5fc31ffc2-service-ca-bundle") pod "router-default-647c6ccd69-6rdf2" (UID: "d92912ee-635b-42af-8e2a-0bd5fc31ffc2") : configmap references non-existent config key: service-ca.crt Jul 05 19:33:05.818140 ip-10-0-133-7 kubenswrapper[2572]: E0705 19:33:05.817895 2572 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 05 19:33:05.818140 ip-10-0-133-7 kubenswrapper[2572]: E0705 19:33:05.817922 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d92912ee-635b-42af-8e2a-0bd5fc31ffc2-metrics-certs podName:d92912ee-635b-42af-8e2a-0bd5fc31ffc2 nodeName:}" failed. No retries permitted until 2026-07-05 19:33:09.817904945 +0000 UTC m=+43.217252400 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d92912ee-635b-42af-8e2a-0bd5fc31ffc2-metrics-certs") pod "router-default-647c6ccd69-6rdf2" (UID: "d92912ee-635b-42af-8e2a-0bd5fc31ffc2") : secret "router-metrics-certs-default" not found Jul 05 19:33:05.818140 ip-10-0-133-7 kubenswrapper[2572]: E0705 19:33:05.817934 2572 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 05 19:33:05.818140 ip-10-0-133-7 kubenswrapper[2572]: E0705 19:33:05.817945 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e493ebf0-e374-4035-b4cb-6777bbd88a53-samples-operator-tls podName:e493ebf0-e374-4035-b4cb-6777bbd88a53 nodeName:}" failed. No retries permitted until 2026-07-05 19:33:09.817935283 +0000 UTC m=+43.217282744 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/e493ebf0-e374-4035-b4cb-6777bbd88a53-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-hqbtk" (UID: "e493ebf0-e374-4035-b4cb-6777bbd88a53") : secret "samples-operator-tls" not found Jul 05 19:33:05.818140 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:33:05.817998 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/3fff4b0f-7be8-4dc8-811d-9971cafc6810-registry-tls\") pod \"image-registry-7fb894c589-5k8cr\" (UID: \"3fff4b0f-7be8-4dc8-811d-9971cafc6810\") " pod="openshift-image-registry/image-registry-7fb894c589-5k8cr" Jul 05 19:33:05.818140 ip-10-0-133-7 kubenswrapper[2572]: E0705 19:33:05.818011 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1fd5a296-7d6e-475a-8e56-c50ac3e09085-cluster-monitoring-operator-tls podName:1fd5a296-7d6e-475a-8e56-c50ac3e09085 nodeName:}" failed. No retries permitted until 2026-07-05 19:33:09.817995496 +0000 UTC m=+43.217342962 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/1fd5a296-7d6e-475a-8e56-c50ac3e09085-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-zkn8b" (UID: "1fd5a296-7d6e-475a-8e56-c50ac3e09085") : secret "cluster-monitoring-operator-tls" not found Jul 05 19:33:05.818140 ip-10-0-133-7 kubenswrapper[2572]: E0705 19:33:05.818070 2572 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 05 19:33:05.818140 ip-10-0-133-7 kubenswrapper[2572]: E0705 19:33:05.818081 2572 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7fb894c589-5k8cr: secret "image-registry-tls" not found Jul 05 19:33:05.818140 ip-10-0-133-7 kubenswrapper[2572]: E0705 19:33:05.818115 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3fff4b0f-7be8-4dc8-811d-9971cafc6810-registry-tls podName:3fff4b0f-7be8-4dc8-811d-9971cafc6810 nodeName:}" failed. No retries permitted until 2026-07-05 19:33:09.818104203 +0000 UTC m=+43.217451677 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/3fff4b0f-7be8-4dc8-811d-9971cafc6810-registry-tls") pod "image-registry-7fb894c589-5k8cr" (UID: "3fff4b0f-7be8-4dc8-811d-9971cafc6810") : secret "image-registry-tls" not found Jul 05 19:33:05.818140 ip-10-0-133-7 kubenswrapper[2572]: E0705 19:33:05.818118 2572 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 05 19:33:05.818140 ip-10-0-133-7 kubenswrapper[2572]: E0705 19:33:05.818147 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/be57b515-f505-458c-8585-52cecfc83ee6-metrics-tls podName:be57b515-f505-458c-8585-52cecfc83ee6 nodeName:}" failed. No retries permitted until 2026-07-05 19:33:09.818140139 +0000 UTC m=+43.217487586 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/be57b515-f505-458c-8585-52cecfc83ee6-metrics-tls") pod "dns-default-kspjb" (UID: "be57b515-f505-458c-8585-52cecfc83ee6") : secret "dns-default-metrics-tls" not found Jul 05 19:33:05.818140 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:33:05.818065 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/be57b515-f505-458c-8585-52cecfc83ee6-metrics-tls\") pod \"dns-default-kspjb\" (UID: \"be57b515-f505-458c-8585-52cecfc83ee6\") " pod="openshift-dns/dns-default-kspjb" Jul 05 19:33:09.857069 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:33:09.856851 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/7d69272b-dacb-48d0-bc9d-ab7f93673154-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-r7bj5\" (UID: \"7d69272b-dacb-48d0-bc9d-ab7f93673154\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-r7bj5" Jul 05 19:33:09.857524 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:33:09.857108 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/1fd5a296-7d6e-475a-8e56-c50ac3e09085-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-zkn8b\" (UID: \"1fd5a296-7d6e-475a-8e56-c50ac3e09085\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-zkn8b" Jul 05 19:33:09.857524 ip-10-0-133-7 kubenswrapper[2572]: E0705 19:33:09.856987 2572 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 05 19:33:09.857524 ip-10-0-133-7 kubenswrapper[2572]: E0705 19:33:09.857195 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7d69272b-dacb-48d0-bc9d-ab7f93673154-networking-console-plugin-cert podName:7d69272b-dacb-48d0-bc9d-ab7f93673154 nodeName:}" failed. No retries permitted until 2026-07-05 19:33:17.857178535 +0000 UTC m=+51.256525984 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/7d69272b-dacb-48d0-bc9d-ab7f93673154-networking-console-plugin-cert") pod "networking-console-plugin-6bffdf9778-r7bj5" (UID: "7d69272b-dacb-48d0-bc9d-ab7f93673154") : secret "networking-console-plugin-cert" not found Jul 05 19:33:09.857524 ip-10-0-133-7 kubenswrapper[2572]: E0705 19:33:09.857214 2572 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 05 19:33:09.857524 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:33:09.857138 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d92912ee-635b-42af-8e2a-0bd5fc31ffc2-metrics-certs\") pod \"router-default-647c6ccd69-6rdf2\" (UID: \"d92912ee-635b-42af-8e2a-0bd5fc31ffc2\") " pod="openshift-ingress/router-default-647c6ccd69-6rdf2" Jul 05 19:33:09.857524 ip-10-0-133-7 kubenswrapper[2572]: E0705 19:33:09.857224 2572 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 05 19:33:09.857524 ip-10-0-133-7 kubenswrapper[2572]: E0705 19:33:09.857267 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d92912ee-635b-42af-8e2a-0bd5fc31ffc2-metrics-certs podName:d92912ee-635b-42af-8e2a-0bd5fc31ffc2 nodeName:}" failed. No retries permitted until 2026-07-05 19:33:17.857251058 +0000 UTC m=+51.256598522 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d92912ee-635b-42af-8e2a-0bd5fc31ffc2-metrics-certs") pod "router-default-647c6ccd69-6rdf2" (UID: "d92912ee-635b-42af-8e2a-0bd5fc31ffc2") : secret "router-metrics-certs-default" not found Jul 05 19:33:09.857524 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:33:09.857285 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d92912ee-635b-42af-8e2a-0bd5fc31ffc2-service-ca-bundle\") pod \"router-default-647c6ccd69-6rdf2\" (UID: \"d92912ee-635b-42af-8e2a-0bd5fc31ffc2\") " pod="openshift-ingress/router-default-647c6ccd69-6rdf2" Jul 05 19:33:09.857524 ip-10-0-133-7 kubenswrapper[2572]: E0705 19:33:09.857305 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1fd5a296-7d6e-475a-8e56-c50ac3e09085-cluster-monitoring-operator-tls podName:1fd5a296-7d6e-475a-8e56-c50ac3e09085 nodeName:}" failed. No retries permitted until 2026-07-05 19:33:17.857289791 +0000 UTC m=+51.256637251 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/1fd5a296-7d6e-475a-8e56-c50ac3e09085-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-zkn8b" (UID: "1fd5a296-7d6e-475a-8e56-c50ac3e09085") : secret "cluster-monitoring-operator-tls" not found Jul 05 19:33:09.857524 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:33:09.857344 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/e493ebf0-e374-4035-b4cb-6777bbd88a53-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-hqbtk\" (UID: \"e493ebf0-e374-4035-b4cb-6777bbd88a53\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-hqbtk" Jul 05 19:33:09.857524 ip-10-0-133-7 kubenswrapper[2572]: E0705 19:33:09.857350 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/d92912ee-635b-42af-8e2a-0bd5fc31ffc2-service-ca-bundle podName:d92912ee-635b-42af-8e2a-0bd5fc31ffc2 nodeName:}" failed. No retries permitted until 2026-07-05 19:33:17.857340426 +0000 UTC m=+51.256687874 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/d92912ee-635b-42af-8e2a-0bd5fc31ffc2-service-ca-bundle") pod "router-default-647c6ccd69-6rdf2" (UID: "d92912ee-635b-42af-8e2a-0bd5fc31ffc2") : configmap references non-existent config key: service-ca.crt Jul 05 19:33:09.857524 ip-10-0-133-7 kubenswrapper[2572]: E0705 19:33:09.857406 2572 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 05 19:33:09.857524 ip-10-0-133-7 kubenswrapper[2572]: E0705 19:33:09.857434 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e493ebf0-e374-4035-b4cb-6777bbd88a53-samples-operator-tls podName:e493ebf0-e374-4035-b4cb-6777bbd88a53 nodeName:}" failed. No retries permitted until 2026-07-05 19:33:17.85742629 +0000 UTC m=+51.256773794 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/e493ebf0-e374-4035-b4cb-6777bbd88a53-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-hqbtk" (UID: "e493ebf0-e374-4035-b4cb-6777bbd88a53") : secret "samples-operator-tls" not found Jul 05 19:33:09.857524 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:33:09.857401 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/3fff4b0f-7be8-4dc8-811d-9971cafc6810-registry-tls\") pod \"image-registry-7fb894c589-5k8cr\" (UID: \"3fff4b0f-7be8-4dc8-811d-9971cafc6810\") " pod="openshift-image-registry/image-registry-7fb894c589-5k8cr" Jul 05 19:33:09.857524 ip-10-0-133-7 kubenswrapper[2572]: E0705 19:33:09.857483 2572 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 05 19:33:09.858293 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:33:09.857483 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/be57b515-f505-458c-8585-52cecfc83ee6-metrics-tls\") pod \"dns-default-kspjb\" (UID: \"be57b515-f505-458c-8585-52cecfc83ee6\") " pod="openshift-dns/dns-default-kspjb" Jul 05 19:33:09.858293 ip-10-0-133-7 kubenswrapper[2572]: E0705 19:33:09.857495 2572 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7fb894c589-5k8cr: secret "image-registry-tls" not found Jul 05 19:33:09.858293 ip-10-0-133-7 kubenswrapper[2572]: E0705 19:33:09.857525 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3fff4b0f-7be8-4dc8-811d-9971cafc6810-registry-tls podName:3fff4b0f-7be8-4dc8-811d-9971cafc6810 nodeName:}" failed. No retries permitted until 2026-07-05 19:33:17.857514121 +0000 UTC m=+51.256861584 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/3fff4b0f-7be8-4dc8-811d-9971cafc6810-registry-tls") pod "image-registry-7fb894c589-5k8cr" (UID: "3fff4b0f-7be8-4dc8-811d-9971cafc6810") : secret "image-registry-tls" not found Jul 05 19:33:09.858293 ip-10-0-133-7 kubenswrapper[2572]: E0705 19:33:09.857580 2572 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 05 19:33:09.858293 ip-10-0-133-7 kubenswrapper[2572]: E0705 19:33:09.857616 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/be57b515-f505-458c-8585-52cecfc83ee6-metrics-tls podName:be57b515-f505-458c-8585-52cecfc83ee6 nodeName:}" failed. No retries permitted until 2026-07-05 19:33:17.857605056 +0000 UTC m=+51.256952504 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/be57b515-f505-458c-8585-52cecfc83ee6-metrics-tls") pod "dns-default-kspjb" (UID: "be57b515-f505-458c-8585-52cecfc83ee6") : secret "dns-default-metrics-tls" not found Jul 05 19:33:13.211787 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:33:13.211750 2572 generic.go:356] "Generic (PLEG): container finished" podID="3567b575-3458-4a8c-9cac-04d8c9f7d1a6" containerID="d41a750a06d7fc283b5c0ce2bd63d0837d7360579fbcb5ec18c8dbe55bbbbc53" exitCode=0 Jul 05 19:33:13.212352 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:33:13.211830 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-dlr8v" event={"ID":"3567b575-3458-4a8c-9cac-04d8c9f7d1a6","Type":"ContainerDied","Data":"d41a750a06d7fc283b5c0ce2bd63d0837d7360579fbcb5ec18c8dbe55bbbbc53"} Jul 05 19:33:13.213456 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:33:13.213403 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-5dxlq" event={"ID":"ac01962e-2f62-482e-92ea-3c484803817d","Type":"ContainerStarted","Data":"331611a5bf36786c9d9b28bae3028a93b6dca03e26ef2e1d12b0e02c4e429e4d"} Jul 05 19:33:13.215417 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:33:13.215393 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-989f8b8dc-wkkdw" event={"ID":"497d532f-61d0-4c9c-ab13-ea25538abdac","Type":"ContainerStarted","Data":"542fa382fc9e63075e7af8cf505b32afaa8707c9decf8d2207d2e348b1ce6e6b"} Jul 05 19:33:13.217689 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:33:13.217640 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-zg7lw" event={"ID":"97203db6-d938-48a9-834a-81a92eaae053","Type":"ContainerStarted","Data":"27c3ae5c636e4c3169feedbefdfe789b8f4d716f93059ed072ff7c7ab4e5c58b"} Jul 05 19:33:13.219486 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:33:13.219466 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-plqpb_ac3142e8-817c-493b-b998-41ff8f4680f9/console-operator/0.log" Jul 05 19:33:13.219583 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:33:13.219500 2572 generic.go:356] "Generic (PLEG): container finished" podID="ac3142e8-817c-493b-b998-41ff8f4680f9" containerID="417860b3866206ca6c0b33a19814c664b684eb0c9de11999f97a924101fa012b" exitCode=255 Jul 05 19:33:13.219583 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:33:13.219557 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-68b757fb67-plqpb" event={"ID":"ac3142e8-817c-493b-b998-41ff8f4680f9","Type":"ContainerDied","Data":"417860b3866206ca6c0b33a19814c664b684eb0c9de11999f97a924101fa012b"} Jul 05 19:33:13.219812 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:33:13.219766 2572 scope.go:117] "RemoveContainer" containerID="417860b3866206ca6c0b33a19814c664b684eb0c9de11999f97a924101fa012b" Jul 05 19:33:13.221654 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:33:13.221635 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5c847dcfc4-wpgzd" event={"ID":"f00bb4f2-e3e7-48e5-82b4-ada41ed8cd2f","Type":"ContainerStarted","Data":"6326fe65628f8fb19938ee59d4350b0541f31b535f4b3a9bdb88dc21a371b2f7"} Jul 05 19:33:13.223190 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:33:13.223167 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-28jcd" event={"ID":"f568b2ea-4b26-4337-8500-6a5daf5c7579","Type":"ContainerStarted","Data":"f191e744d6cc0c6dd550023efb626583543efbde3697da58fa940f953d2a6109"} Jul 05 19:33:13.252324 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:33:13.251007 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-989f8b8dc-wkkdw" podStartSLOduration=4.406674393 podStartE2EDuration="14.250985093s" totalImagesPullingTime="9.8443107s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-05 19:32:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 19:33:13.250383398 +0000 UTC m=+46.649730866" watchObservedRunningTime="2026-07-05 19:33:13.250985093 +0000 UTC m=+46.650332561" Jul 05 19:33:13.265800 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:33:13.265632 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-5dxlq" podStartSLOduration=2.420214517 podStartE2EDuration="12.265594757s" totalImagesPullingTime="9.84538024s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-05 19:33:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 19:33:13.265102676 +0000 UTC m=+46.664450139" watchObservedRunningTime="2026-07-05 19:33:13.265594757 +0000 UTC m=+46.664942224" Jul 05 19:33:13.283020 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:33:13.282222 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-zg7lw" podStartSLOduration=4.412725649 podStartE2EDuration="14.282200525s" totalImagesPullingTime="9.869474876s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-05 19:32:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 19:33:13.281601378 +0000 UTC m=+46.680948861" watchObservedRunningTime="2026-07-05 19:33:13.282200525 +0000 UTC m=+46.681547994" Jul 05 19:33:13.302438 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:33:13.302045 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-28jcd" podStartSLOduration=4.434577187 podStartE2EDuration="14.302021298s" totalImagesPullingTime="9.867444111s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-05 19:32:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 19:33:13.300304247 +0000 UTC m=+46.699651728" watchObservedRunningTime="2026-07-05 19:33:13.302021298 +0000 UTC m=+46.701368767" Jul 05 19:33:13.320827 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:33:13.319475 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-5c847dcfc4-wpgzd" podStartSLOduration=4.451931212 podStartE2EDuration="14.319454846s" totalImagesPullingTime="9.867523634s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-05 19:32:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 19:33:13.318605075 +0000 UTC m=+46.717952542" watchObservedRunningTime="2026-07-05 19:33:13.319454846 +0000 UTC m=+46.718802315" Jul 05 19:33:14.037368 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:33:14.037330 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-8wfc2"] Jul 05 19:33:14.073891 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:33:14.073859 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-8wfc2" Jul 05 19:33:14.074176 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:33:14.074025 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-8wfc2"] Jul 05 19:33:14.076499 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:33:14.076471 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 05 19:33:14.076671 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:33:14.076507 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 05 19:33:14.076671 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:33:14.076573 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-phcbk\"" Jul 05 19:33:14.096273 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:33:14.096235 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/6a22c6f6-ecb4-4ff6-8525-3639d132fe72-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-8wfc2\" (UID: \"6a22c6f6-ecb4-4ff6-8525-3639d132fe72\") " pod="openshift-insights/insights-runtime-extractor-8wfc2" Jul 05 19:33:14.096273 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:33:14.096275 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/6a22c6f6-ecb4-4ff6-8525-3639d132fe72-data-volume\") pod \"insights-runtime-extractor-8wfc2\" (UID: \"6a22c6f6-ecb4-4ff6-8525-3639d132fe72\") " pod="openshift-insights/insights-runtime-extractor-8wfc2" Jul 05 19:33:14.096518 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:33:14.096294 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-59czt\" (UniqueName: \"kubernetes.io/projected/6a22c6f6-ecb4-4ff6-8525-3639d132fe72-kube-api-access-59czt\") pod \"insights-runtime-extractor-8wfc2\" (UID: \"6a22c6f6-ecb4-4ff6-8525-3639d132fe72\") " pod="openshift-insights/insights-runtime-extractor-8wfc2" Jul 05 19:33:14.096518 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:33:14.096348 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/6a22c6f6-ecb4-4ff6-8525-3639d132fe72-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-8wfc2\" (UID: \"6a22c6f6-ecb4-4ff6-8525-3639d132fe72\") " pod="openshift-insights/insights-runtime-extractor-8wfc2" Jul 05 19:33:14.096518 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:33:14.096387 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/6a22c6f6-ecb4-4ff6-8525-3639d132fe72-crio-socket\") pod \"insights-runtime-extractor-8wfc2\" (UID: \"6a22c6f6-ecb4-4ff6-8525-3639d132fe72\") " pod="openshift-insights/insights-runtime-extractor-8wfc2" Jul 05 19:33:14.197313 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:33:14.197281 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/6a22c6f6-ecb4-4ff6-8525-3639d132fe72-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-8wfc2\" (UID: \"6a22c6f6-ecb4-4ff6-8525-3639d132fe72\") " pod="openshift-insights/insights-runtime-extractor-8wfc2" Jul 05 19:33:14.197516 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:33:14.197330 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/6a22c6f6-ecb4-4ff6-8525-3639d132fe72-data-volume\") pod \"insights-runtime-extractor-8wfc2\" (UID: \"6a22c6f6-ecb4-4ff6-8525-3639d132fe72\") " pod="openshift-insights/insights-runtime-extractor-8wfc2" Jul 05 19:33:14.197516 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:33:14.197361 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-59czt\" (UniqueName: \"kubernetes.io/projected/6a22c6f6-ecb4-4ff6-8525-3639d132fe72-kube-api-access-59czt\") pod \"insights-runtime-extractor-8wfc2\" (UID: \"6a22c6f6-ecb4-4ff6-8525-3639d132fe72\") " pod="openshift-insights/insights-runtime-extractor-8wfc2" Jul 05 19:33:14.197516 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:33:14.197400 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/6a22c6f6-ecb4-4ff6-8525-3639d132fe72-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-8wfc2\" (UID: \"6a22c6f6-ecb4-4ff6-8525-3639d132fe72\") " pod="openshift-insights/insights-runtime-extractor-8wfc2" Jul 05 19:33:14.197516 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:33:14.197425 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/6a22c6f6-ecb4-4ff6-8525-3639d132fe72-crio-socket\") pod \"insights-runtime-extractor-8wfc2\" (UID: \"6a22c6f6-ecb4-4ff6-8525-3639d132fe72\") " pod="openshift-insights/insights-runtime-extractor-8wfc2" Jul 05 19:33:14.197516 ip-10-0-133-7 kubenswrapper[2572]: E0705 19:33:14.197458 2572 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 05 19:33:14.197516 ip-10-0-133-7 kubenswrapper[2572]: E0705 19:33:14.197493 2572 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 05 19:33:14.197731 ip-10-0-133-7 kubenswrapper[2572]: E0705 19:33:14.197536 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6a22c6f6-ecb4-4ff6-8525-3639d132fe72-insights-runtime-extractor-tls podName:6a22c6f6-ecb4-4ff6-8525-3639d132fe72 nodeName:}" failed. No retries permitted until 2026-07-05 19:33:14.697513424 +0000 UTC m=+48.096860889 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/6a22c6f6-ecb4-4ff6-8525-3639d132fe72-insights-runtime-extractor-tls") pod "insights-runtime-extractor-8wfc2" (UID: "6a22c6f6-ecb4-4ff6-8525-3639d132fe72") : secret "insights-runtime-extractor-tls" not found Jul 05 19:33:14.198100 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:33:14.197989 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/6a22c6f6-ecb4-4ff6-8525-3639d132fe72-crio-socket\") pod \"insights-runtime-extractor-8wfc2\" (UID: \"6a22c6f6-ecb4-4ff6-8525-3639d132fe72\") " pod="openshift-insights/insights-runtime-extractor-8wfc2" Jul 05 19:33:14.198206 ip-10-0-133-7 kubenswrapper[2572]: E0705 19:33:14.197685 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/6a22c6f6-ecb4-4ff6-8525-3639d132fe72-kube-rbac-proxy-cm podName:6a22c6f6-ecb4-4ff6-8525-3639d132fe72 nodeName:}" failed. No retries permitted until 2026-07-05 19:33:14.697667685 +0000 UTC m=+48.097015146 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/6a22c6f6-ecb4-4ff6-8525-3639d132fe72-kube-rbac-proxy-cm") pod "insights-runtime-extractor-8wfc2" (UID: "6a22c6f6-ecb4-4ff6-8525-3639d132fe72") : configmap "kube-rbac-proxy" not found Jul 05 19:33:14.199303 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:33:14.198293 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/6a22c6f6-ecb4-4ff6-8525-3639d132fe72-data-volume\") pod \"insights-runtime-extractor-8wfc2\" (UID: \"6a22c6f6-ecb4-4ff6-8525-3639d132fe72\") " pod="openshift-insights/insights-runtime-extractor-8wfc2" Jul 05 19:33:14.209504 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:33:14.209471 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-59czt\" (UniqueName: \"kubernetes.io/projected/6a22c6f6-ecb4-4ff6-8525-3639d132fe72-kube-api-access-59czt\") pod \"insights-runtime-extractor-8wfc2\" (UID: \"6a22c6f6-ecb4-4ff6-8525-3639d132fe72\") " pod="openshift-insights/insights-runtime-extractor-8wfc2" Jul 05 19:33:14.229781 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:33:14.229754 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-plqpb_ac3142e8-817c-493b-b998-41ff8f4680f9/console-operator/1.log" Jul 05 19:33:14.230259 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:33:14.230236 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-plqpb_ac3142e8-817c-493b-b998-41ff8f4680f9/console-operator/0.log" Jul 05 19:33:14.230326 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:33:14.230287 2572 generic.go:356] "Generic (PLEG): container finished" podID="ac3142e8-817c-493b-b998-41ff8f4680f9" containerID="73a925c303a23e2be7a27551ce14144398dae82439d78a3930c0558fe7e88f58" exitCode=255 Jul 05 19:33:14.230399 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:33:14.230373 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-68b757fb67-plqpb" event={"ID":"ac3142e8-817c-493b-b998-41ff8f4680f9","Type":"ContainerDied","Data":"73a925c303a23e2be7a27551ce14144398dae82439d78a3930c0558fe7e88f58"} Jul 05 19:33:14.230485 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:33:14.230470 2572 scope.go:117] "RemoveContainer" containerID="417860b3866206ca6c0b33a19814c664b684eb0c9de11999f97a924101fa012b" Jul 05 19:33:14.230710 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:33:14.230688 2572 scope.go:117] "RemoveContainer" containerID="73a925c303a23e2be7a27551ce14144398dae82439d78a3930c0558fe7e88f58" Jul 05 19:33:14.230916 ip-10-0-133-7 kubenswrapper[2572]: E0705 19:33:14.230894 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-68b757fb67-plqpb_openshift-console-operator(ac3142e8-817c-493b-b998-41ff8f4680f9)\"" pod="openshift-console-operator/console-operator-68b757fb67-plqpb" podUID="ac3142e8-817c-493b-b998-41ff8f4680f9" Jul 05 19:33:14.233850 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:33:14.233821 2572 generic.go:356] "Generic (PLEG): container finished" podID="3567b575-3458-4a8c-9cac-04d8c9f7d1a6" containerID="2b630539a3063366aa088feb5bfd2e79b2bbbcfc59a79fa52ad4ce2ff6d4d74a" exitCode=0 Jul 05 19:33:14.234007 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:33:14.233913 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-dlr8v" event={"ID":"3567b575-3458-4a8c-9cac-04d8c9f7d1a6","Type":"ContainerDied","Data":"2b630539a3063366aa088feb5bfd2e79b2bbbcfc59a79fa52ad4ce2ff6d4d74a"} Jul 05 19:33:14.705035 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:33:14.704998 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/6a22c6f6-ecb4-4ff6-8525-3639d132fe72-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-8wfc2\" (UID: \"6a22c6f6-ecb4-4ff6-8525-3639d132fe72\") " pod="openshift-insights/insights-runtime-extractor-8wfc2" Jul 05 19:33:14.705238 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:33:14.705053 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/6a22c6f6-ecb4-4ff6-8525-3639d132fe72-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-8wfc2\" (UID: \"6a22c6f6-ecb4-4ff6-8525-3639d132fe72\") " pod="openshift-insights/insights-runtime-extractor-8wfc2" Jul 05 19:33:14.705238 ip-10-0-133-7 kubenswrapper[2572]: E0705 19:33:14.705125 2572 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 05 19:33:14.705238 ip-10-0-133-7 kubenswrapper[2572]: E0705 19:33:14.705176 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/6a22c6f6-ecb4-4ff6-8525-3639d132fe72-kube-rbac-proxy-cm podName:6a22c6f6-ecb4-4ff6-8525-3639d132fe72 nodeName:}" failed. No retries permitted until 2026-07-05 19:33:15.705164076 +0000 UTC m=+49.104511525 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/6a22c6f6-ecb4-4ff6-8525-3639d132fe72-kube-rbac-proxy-cm") pod "insights-runtime-extractor-8wfc2" (UID: "6a22c6f6-ecb4-4ff6-8525-3639d132fe72") : configmap "kube-rbac-proxy" not found Jul 05 19:33:14.705238 ip-10-0-133-7 kubenswrapper[2572]: E0705 19:33:14.705174 2572 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 05 19:33:14.705238 ip-10-0-133-7 kubenswrapper[2572]: E0705 19:33:14.705240 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6a22c6f6-ecb4-4ff6-8525-3639d132fe72-insights-runtime-extractor-tls podName:6a22c6f6-ecb4-4ff6-8525-3639d132fe72 nodeName:}" failed. No retries permitted until 2026-07-05 19:33:15.705221214 +0000 UTC m=+49.104568676 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/6a22c6f6-ecb4-4ff6-8525-3639d132fe72-insights-runtime-extractor-tls") pod "insights-runtime-extractor-8wfc2" (UID: "6a22c6f6-ecb4-4ff6-8525-3639d132fe72") : secret "insights-runtime-extractor-tls" not found Jul 05 19:33:15.239439 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:33:15.239414 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-plqpb_ac3142e8-817c-493b-b998-41ff8f4680f9/console-operator/1.log" Jul 05 19:33:15.239915 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:33:15.239849 2572 scope.go:117] "RemoveContainer" containerID="73a925c303a23e2be7a27551ce14144398dae82439d78a3930c0558fe7e88f58" Jul 05 19:33:15.240094 ip-10-0-133-7 kubenswrapper[2572]: E0705 19:33:15.240071 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-68b757fb67-plqpb_openshift-console-operator(ac3142e8-817c-493b-b998-41ff8f4680f9)\"" pod="openshift-console-operator/console-operator-68b757fb67-plqpb" podUID="ac3142e8-817c-493b-b998-41ff8f4680f9" Jul 05 19:33:15.243096 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:33:15.243067 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-dlr8v" event={"ID":"3567b575-3458-4a8c-9cac-04d8c9f7d1a6","Type":"ContainerStarted","Data":"fb3c4c75a559bcd1567126e2804b26af5c5d40b67f5ace5de9546940f4c429aa"} Jul 05 19:33:15.281078 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:33:15.281017 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-dlr8v" podStartSLOduration=7.409923815 podStartE2EDuration="47.2809965s" totalImagesPullingTime="39.871072685s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-05 19:32:28 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 19:33:15.279976496 +0000 UTC m=+48.679323957" watchObservedRunningTime="2026-07-05 19:33:15.2809965 +0000 UTC m=+48.680343967" Jul 05 19:33:15.712605 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:33:15.712571 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/6a22c6f6-ecb4-4ff6-8525-3639d132fe72-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-8wfc2\" (UID: \"6a22c6f6-ecb4-4ff6-8525-3639d132fe72\") " pod="openshift-insights/insights-runtime-extractor-8wfc2" Jul 05 19:33:15.712783 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:33:15.712625 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/6a22c6f6-ecb4-4ff6-8525-3639d132fe72-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-8wfc2\" (UID: \"6a22c6f6-ecb4-4ff6-8525-3639d132fe72\") " pod="openshift-insights/insights-runtime-extractor-8wfc2" Jul 05 19:33:15.712783 ip-10-0-133-7 kubenswrapper[2572]: E0705 19:33:15.712716 2572 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 05 19:33:15.712783 ip-10-0-133-7 kubenswrapper[2572]: E0705 19:33:15.712783 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6a22c6f6-ecb4-4ff6-8525-3639d132fe72-insights-runtime-extractor-tls podName:6a22c6f6-ecb4-4ff6-8525-3639d132fe72 nodeName:}" failed. No retries permitted until 2026-07-05 19:33:17.712768382 +0000 UTC m=+51.112115830 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/6a22c6f6-ecb4-4ff6-8525-3639d132fe72-insights-runtime-extractor-tls") pod "insights-runtime-extractor-8wfc2" (UID: "6a22c6f6-ecb4-4ff6-8525-3639d132fe72") : secret "insights-runtime-extractor-tls" not found Jul 05 19:33:15.712892 ip-10-0-133-7 kubenswrapper[2572]: E0705 19:33:15.712724 2572 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 05 19:33:15.712892 ip-10-0-133-7 kubenswrapper[2572]: E0705 19:33:15.712869 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/6a22c6f6-ecb4-4ff6-8525-3639d132fe72-kube-rbac-proxy-cm podName:6a22c6f6-ecb4-4ff6-8525-3639d132fe72 nodeName:}" failed. No retries permitted until 2026-07-05 19:33:17.712855699 +0000 UTC m=+51.112203144 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/6a22c6f6-ecb4-4ff6-8525-3639d132fe72-kube-rbac-proxy-cm") pod "insights-runtime-extractor-8wfc2" (UID: "6a22c6f6-ecb4-4ff6-8525-3639d132fe72") : configmap "kube-rbac-proxy" not found Jul 05 19:33:16.026886 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:33:16.026807 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-d52jr_bfb32e10-9908-43c0-90f2-629b8c81ebc8/dns-node-resolver/0.log" Jul 05 19:33:17.230552 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:33:17.230522 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-pp8zt_b8af52e1-a74e-4004-8fef-45f3c97c0706/node-ca/0.log" Jul 05 19:33:17.627089 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:33:17.627011 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-5dxlq_ac01962e-2f62-482e-92ea-3c484803817d/serve-healthcheck-canary/0.log" Jul 05 19:33:17.732531 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:33:17.732501 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/6a22c6f6-ecb4-4ff6-8525-3639d132fe72-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-8wfc2\" (UID: \"6a22c6f6-ecb4-4ff6-8525-3639d132fe72\") " pod="openshift-insights/insights-runtime-extractor-8wfc2" Jul 05 19:33:17.732699 ip-10-0-133-7 kubenswrapper[2572]: E0705 19:33:17.732625 2572 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 05 19:33:17.732699 ip-10-0-133-7 kubenswrapper[2572]: E0705 19:33:17.732694 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/6a22c6f6-ecb4-4ff6-8525-3639d132fe72-kube-rbac-proxy-cm podName:6a22c6f6-ecb4-4ff6-8525-3639d132fe72 nodeName:}" failed. No retries permitted until 2026-07-05 19:33:21.732673231 +0000 UTC m=+55.132020693 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/6a22c6f6-ecb4-4ff6-8525-3639d132fe72-kube-rbac-proxy-cm") pod "insights-runtime-extractor-8wfc2" (UID: "6a22c6f6-ecb4-4ff6-8525-3639d132fe72") : configmap "kube-rbac-proxy" not found Jul 05 19:33:17.732807 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:33:17.732768 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/6a22c6f6-ecb4-4ff6-8525-3639d132fe72-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-8wfc2\" (UID: \"6a22c6f6-ecb4-4ff6-8525-3639d132fe72\") " pod="openshift-insights/insights-runtime-extractor-8wfc2" Jul 05 19:33:17.732893 ip-10-0-133-7 kubenswrapper[2572]: E0705 19:33:17.732882 2572 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 05 19:33:17.732937 ip-10-0-133-7 kubenswrapper[2572]: E0705 19:33:17.732920 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6a22c6f6-ecb4-4ff6-8525-3639d132fe72-insights-runtime-extractor-tls podName:6a22c6f6-ecb4-4ff6-8525-3639d132fe72 nodeName:}" failed. No retries permitted until 2026-07-05 19:33:21.732910978 +0000 UTC m=+55.132258422 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/6a22c6f6-ecb4-4ff6-8525-3639d132fe72-insights-runtime-extractor-tls") pod "insights-runtime-extractor-8wfc2" (UID: "6a22c6f6-ecb4-4ff6-8525-3639d132fe72") : secret "insights-runtime-extractor-tls" not found Jul 05 19:33:17.934124 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:33:17.934049 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/3fff4b0f-7be8-4dc8-811d-9971cafc6810-registry-tls\") pod \"image-registry-7fb894c589-5k8cr\" (UID: \"3fff4b0f-7be8-4dc8-811d-9971cafc6810\") " pod="openshift-image-registry/image-registry-7fb894c589-5k8cr" Jul 05 19:33:17.934124 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:33:17.934085 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/be57b515-f505-458c-8585-52cecfc83ee6-metrics-tls\") pod \"dns-default-kspjb\" (UID: \"be57b515-f505-458c-8585-52cecfc83ee6\") " pod="openshift-dns/dns-default-kspjb" Jul 05 19:33:17.934314 ip-10-0-133-7 kubenswrapper[2572]: E0705 19:33:17.934179 2572 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 05 19:33:17.934314 ip-10-0-133-7 kubenswrapper[2572]: E0705 19:33:17.934184 2572 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 05 19:33:17.934314 ip-10-0-133-7 kubenswrapper[2572]: E0705 19:33:17.934197 2572 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7fb894c589-5k8cr: secret "image-registry-tls" not found Jul 05 19:33:17.934314 ip-10-0-133-7 kubenswrapper[2572]: E0705 19:33:17.934219 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/be57b515-f505-458c-8585-52cecfc83ee6-metrics-tls podName:be57b515-f505-458c-8585-52cecfc83ee6 nodeName:}" failed. No retries permitted until 2026-07-05 19:33:33.934206523 +0000 UTC m=+67.333553971 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/be57b515-f505-458c-8585-52cecfc83ee6-metrics-tls") pod "dns-default-kspjb" (UID: "be57b515-f505-458c-8585-52cecfc83ee6") : secret "dns-default-metrics-tls" not found Jul 05 19:33:17.934314 ip-10-0-133-7 kubenswrapper[2572]: E0705 19:33:17.934231 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3fff4b0f-7be8-4dc8-811d-9971cafc6810-registry-tls podName:3fff4b0f-7be8-4dc8-811d-9971cafc6810 nodeName:}" failed. No retries permitted until 2026-07-05 19:33:33.934224947 +0000 UTC m=+67.333572391 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/3fff4b0f-7be8-4dc8-811d-9971cafc6810-registry-tls") pod "image-registry-7fb894c589-5k8cr" (UID: "3fff4b0f-7be8-4dc8-811d-9971cafc6810") : secret "image-registry-tls" not found Jul 05 19:33:17.934314 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:33:17.934242 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/7d69272b-dacb-48d0-bc9d-ab7f93673154-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-r7bj5\" (UID: \"7d69272b-dacb-48d0-bc9d-ab7f93673154\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-r7bj5" Jul 05 19:33:17.934314 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:33:17.934278 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/1fd5a296-7d6e-475a-8e56-c50ac3e09085-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-zkn8b\" (UID: \"1fd5a296-7d6e-475a-8e56-c50ac3e09085\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-zkn8b" Jul 05 19:33:17.934314 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:33:17.934303 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d92912ee-635b-42af-8e2a-0bd5fc31ffc2-metrics-certs\") pod \"router-default-647c6ccd69-6rdf2\" (UID: \"d92912ee-635b-42af-8e2a-0bd5fc31ffc2\") " pod="openshift-ingress/router-default-647c6ccd69-6rdf2" Jul 05 19:33:17.934628 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:33:17.934323 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d92912ee-635b-42af-8e2a-0bd5fc31ffc2-service-ca-bundle\") pod \"router-default-647c6ccd69-6rdf2\" (UID: \"d92912ee-635b-42af-8e2a-0bd5fc31ffc2\") " pod="openshift-ingress/router-default-647c6ccd69-6rdf2" Jul 05 19:33:17.934628 ip-10-0-133-7 kubenswrapper[2572]: E0705 19:33:17.934382 2572 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 05 19:33:17.934628 ip-10-0-133-7 kubenswrapper[2572]: E0705 19:33:17.934402 2572 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 05 19:33:17.934628 ip-10-0-133-7 kubenswrapper[2572]: E0705 19:33:17.934421 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/d92912ee-635b-42af-8e2a-0bd5fc31ffc2-service-ca-bundle podName:d92912ee-635b-42af-8e2a-0bd5fc31ffc2 nodeName:}" failed. No retries permitted until 2026-07-05 19:33:33.934410826 +0000 UTC m=+67.333758274 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/d92912ee-635b-42af-8e2a-0bd5fc31ffc2-service-ca-bundle") pod "router-default-647c6ccd69-6rdf2" (UID: "d92912ee-635b-42af-8e2a-0bd5fc31ffc2") : configmap references non-existent config key: service-ca.crt Jul 05 19:33:17.934628 ip-10-0-133-7 kubenswrapper[2572]: E0705 19:33:17.934437 2572 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 05 19:33:17.934628 ip-10-0-133-7 kubenswrapper[2572]: E0705 19:33:17.934441 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7d69272b-dacb-48d0-bc9d-ab7f93673154-networking-console-plugin-cert podName:7d69272b-dacb-48d0-bc9d-ab7f93673154 nodeName:}" failed. No retries permitted until 2026-07-05 19:33:33.934429049 +0000 UTC m=+67.333776494 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/7d69272b-dacb-48d0-bc9d-ab7f93673154-networking-console-plugin-cert") pod "networking-console-plugin-6bffdf9778-r7bj5" (UID: "7d69272b-dacb-48d0-bc9d-ab7f93673154") : secret "networking-console-plugin-cert" not found Jul 05 19:33:17.934628 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:33:17.934486 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/e493ebf0-e374-4035-b4cb-6777bbd88a53-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-hqbtk\" (UID: \"e493ebf0-e374-4035-b4cb-6777bbd88a53\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-hqbtk" Jul 05 19:33:17.934628 ip-10-0-133-7 kubenswrapper[2572]: E0705 19:33:17.934527 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1fd5a296-7d6e-475a-8e56-c50ac3e09085-cluster-monitoring-operator-tls podName:1fd5a296-7d6e-475a-8e56-c50ac3e09085 nodeName:}" failed. No retries permitted until 2026-07-05 19:33:33.934519994 +0000 UTC m=+67.333867443 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/1fd5a296-7d6e-475a-8e56-c50ac3e09085-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-zkn8b" (UID: "1fd5a296-7d6e-475a-8e56-c50ac3e09085") : secret "cluster-monitoring-operator-tls" not found Jul 05 19:33:17.934628 ip-10-0-133-7 kubenswrapper[2572]: E0705 19:33:17.934540 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d92912ee-635b-42af-8e2a-0bd5fc31ffc2-metrics-certs podName:d92912ee-635b-42af-8e2a-0bd5fc31ffc2 nodeName:}" failed. No retries permitted until 2026-07-05 19:33:33.934533426 +0000 UTC m=+67.333880871 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d92912ee-635b-42af-8e2a-0bd5fc31ffc2-metrics-certs") pod "router-default-647c6ccd69-6rdf2" (UID: "d92912ee-635b-42af-8e2a-0bd5fc31ffc2") : secret "router-metrics-certs-default" not found Jul 05 19:33:17.934628 ip-10-0-133-7 kubenswrapper[2572]: E0705 19:33:17.934528 2572 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 05 19:33:17.934628 ip-10-0-133-7 kubenswrapper[2572]: E0705 19:33:17.934562 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e493ebf0-e374-4035-b4cb-6777bbd88a53-samples-operator-tls podName:e493ebf0-e374-4035-b4cb-6777bbd88a53 nodeName:}" failed. No retries permitted until 2026-07-05 19:33:33.934556394 +0000 UTC m=+67.333903839 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/e493ebf0-e374-4035-b4cb-6777bbd88a53-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-hqbtk" (UID: "e493ebf0-e374-4035-b4cb-6777bbd88a53") : secret "samples-operator-tls" not found Jul 05 19:33:21.771550 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:33:21.771508 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/6a22c6f6-ecb4-4ff6-8525-3639d132fe72-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-8wfc2\" (UID: \"6a22c6f6-ecb4-4ff6-8525-3639d132fe72\") " pod="openshift-insights/insights-runtime-extractor-8wfc2" Jul 05 19:33:21.772066 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:33:21.771589 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/6a22c6f6-ecb4-4ff6-8525-3639d132fe72-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-8wfc2\" (UID: \"6a22c6f6-ecb4-4ff6-8525-3639d132fe72\") " pod="openshift-insights/insights-runtime-extractor-8wfc2" Jul 05 19:33:21.772066 ip-10-0-133-7 kubenswrapper[2572]: E0705 19:33:21.771665 2572 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 05 19:33:21.772066 ip-10-0-133-7 kubenswrapper[2572]: E0705 19:33:21.771733 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6a22c6f6-ecb4-4ff6-8525-3639d132fe72-insights-runtime-extractor-tls podName:6a22c6f6-ecb4-4ff6-8525-3639d132fe72 nodeName:}" failed. No retries permitted until 2026-07-05 19:33:29.77171808 +0000 UTC m=+63.171065529 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/6a22c6f6-ecb4-4ff6-8525-3639d132fe72-insights-runtime-extractor-tls") pod "insights-runtime-extractor-8wfc2" (UID: "6a22c6f6-ecb4-4ff6-8525-3639d132fe72") : secret "insights-runtime-extractor-tls" not found Jul 05 19:33:21.772287 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:33:21.772265 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/6a22c6f6-ecb4-4ff6-8525-3639d132fe72-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-8wfc2\" (UID: \"6a22c6f6-ecb4-4ff6-8525-3639d132fe72\") " pod="openshift-insights/insights-runtime-extractor-8wfc2" Jul 05 19:33:22.395429 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:33:22.395398 2572 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-68b757fb67-plqpb" Jul 05 19:33:22.395600 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:33:22.395476 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-68b757fb67-plqpb" Jul 05 19:33:22.395812 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:33:22.395801 2572 scope.go:117] "RemoveContainer" containerID="73a925c303a23e2be7a27551ce14144398dae82439d78a3930c0558fe7e88f58" Jul 05 19:33:22.396010 ip-10-0-133-7 kubenswrapper[2572]: E0705 19:33:22.395990 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-68b757fb67-plqpb_openshift-console-operator(ac3142e8-817c-493b-b998-41ff8f4680f9)\"" pod="openshift-console-operator/console-operator-68b757fb67-plqpb" podUID="ac3142e8-817c-493b-b998-41ff8f4680f9" Jul 05 19:33:29.151486 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:33:29.151455 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-jp9t6" Jul 05 19:33:29.851434 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:33:29.851392 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/6a22c6f6-ecb4-4ff6-8525-3639d132fe72-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-8wfc2\" (UID: \"6a22c6f6-ecb4-4ff6-8525-3639d132fe72\") " pod="openshift-insights/insights-runtime-extractor-8wfc2" Jul 05 19:33:29.853796 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:33:29.853748 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/6a22c6f6-ecb4-4ff6-8525-3639d132fe72-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-8wfc2\" (UID: \"6a22c6f6-ecb4-4ff6-8525-3639d132fe72\") " pod="openshift-insights/insights-runtime-extractor-8wfc2" Jul 05 19:33:29.987675 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:33:29.987644 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-phcbk\"" Jul 05 19:33:29.995538 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:33:29.995516 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-8wfc2" Jul 05 19:33:30.126732 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:33:30.126645 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-8wfc2"] Jul 05 19:33:30.129963 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:33:30.129914 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6a22c6f6_ecb4_4ff6_8525_3639d132fe72.slice/crio-119464367a9f399f13e51ed2dcec5f56789e9eded5c1b9156a00ae8d39e02f36 WatchSource:0}: Error finding container 119464367a9f399f13e51ed2dcec5f56789e9eded5c1b9156a00ae8d39e02f36: Status 404 returned error can't find the container with id 119464367a9f399f13e51ed2dcec5f56789e9eded5c1b9156a00ae8d39e02f36 Jul 05 19:33:30.292087 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:33:30.292050 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-8wfc2" event={"ID":"6a22c6f6-ecb4-4ff6-8525-3639d132fe72","Type":"ContainerStarted","Data":"119464367a9f399f13e51ed2dcec5f56789e9eded5c1b9156a00ae8d39e02f36"} Jul 05 19:33:32.783020 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:33:32.782979 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b256bcc8-4bdd-48db-b050-c02c368ef29d-original-pull-secret\") pod \"global-pull-secret-syncer-k2b5v\" (UID: \"b256bcc8-4bdd-48db-b050-c02c368ef29d\") " pod="kube-system/global-pull-secret-syncer-k2b5v" Jul 05 19:33:32.783432 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:33:32.783089 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/05684556-d2e2-4157-9f17-097dee8230a0-metrics-certs\") pod \"network-metrics-daemon-brllj\" (UID: \"05684556-d2e2-4157-9f17-097dee8230a0\") " pod="openshift-multus/network-metrics-daemon-brllj" Jul 05 19:33:32.785722 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:33:32.785690 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 05 19:33:32.785851 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:33:32.785756 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 05 19:33:32.796148 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:33:32.796116 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/05684556-d2e2-4157-9f17-097dee8230a0-metrics-certs\") pod \"network-metrics-daemon-brllj\" (UID: \"05684556-d2e2-4157-9f17-097dee8230a0\") " pod="openshift-multus/network-metrics-daemon-brllj" Jul 05 19:33:32.796363 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:33:32.796202 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b256bcc8-4bdd-48db-b050-c02c368ef29d-original-pull-secret\") pod \"global-pull-secret-syncer-k2b5v\" (UID: \"b256bcc8-4bdd-48db-b050-c02c368ef29d\") " pod="kube-system/global-pull-secret-syncer-k2b5v" Jul 05 19:33:32.870896 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:33:32.870839 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k2b5v" Jul 05 19:33:32.884406 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:33:32.884375 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-55jpj\" (UniqueName: \"kubernetes.io/projected/1fd5cdc6-3c1a-4412-830c-b871c7087a35-kube-api-access-55jpj\") pod \"network-check-target-fjdxw\" (UID: \"1fd5cdc6-3c1a-4412-830c-b871c7087a35\") " pod="openshift-network-diagnostics/network-check-target-fjdxw" Jul 05 19:33:32.886916 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:33:32.886889 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-55jpj\" (UniqueName: \"kubernetes.io/projected/1fd5cdc6-3c1a-4412-830c-b871c7087a35-kube-api-access-55jpj\") pod \"network-check-target-fjdxw\" (UID: \"1fd5cdc6-3c1a-4412-830c-b871c7087a35\") " pod="openshift-network-diagnostics/network-check-target-fjdxw" Jul 05 19:33:32.887138 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:33:32.887117 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-dghwm\"" Jul 05 19:33:32.895182 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:33:32.895150 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-brllj" Jul 05 19:33:32.963101 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:33:32.963072 2572 scope.go:117] "RemoveContainer" containerID="73a925c303a23e2be7a27551ce14144398dae82439d78a3930c0558fe7e88f58" Jul 05 19:33:33.182430 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:33:33.182348 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-mmzkm\"" Jul 05 19:33:33.189990 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:33:33.189938 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fjdxw" Jul 05 19:33:33.994484 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:33:33.993626 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/7d69272b-dacb-48d0-bc9d-ab7f93673154-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-r7bj5\" (UID: \"7d69272b-dacb-48d0-bc9d-ab7f93673154\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-r7bj5" Jul 05 19:33:33.994484 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:33:33.993698 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/1fd5a296-7d6e-475a-8e56-c50ac3e09085-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-zkn8b\" (UID: \"1fd5a296-7d6e-475a-8e56-c50ac3e09085\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-zkn8b" Jul 05 19:33:33.994484 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:33:33.993754 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d92912ee-635b-42af-8e2a-0bd5fc31ffc2-metrics-certs\") pod \"router-default-647c6ccd69-6rdf2\" (UID: \"d92912ee-635b-42af-8e2a-0bd5fc31ffc2\") " pod="openshift-ingress/router-default-647c6ccd69-6rdf2" Jul 05 19:33:33.994484 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:33:33.994104 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d92912ee-635b-42af-8e2a-0bd5fc31ffc2-service-ca-bundle\") pod \"router-default-647c6ccd69-6rdf2\" (UID: \"d92912ee-635b-42af-8e2a-0bd5fc31ffc2\") " pod="openshift-ingress/router-default-647c6ccd69-6rdf2" Jul 05 19:33:33.994484 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:33:33.994167 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/e493ebf0-e374-4035-b4cb-6777bbd88a53-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-hqbtk\" (UID: \"e493ebf0-e374-4035-b4cb-6777bbd88a53\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-hqbtk" Jul 05 19:33:33.994484 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:33:33.994226 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/3fff4b0f-7be8-4dc8-811d-9971cafc6810-registry-tls\") pod \"image-registry-7fb894c589-5k8cr\" (UID: \"3fff4b0f-7be8-4dc8-811d-9971cafc6810\") " pod="openshift-image-registry/image-registry-7fb894c589-5k8cr" Jul 05 19:33:33.994484 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:33:33.994256 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/be57b515-f505-458c-8585-52cecfc83ee6-metrics-tls\") pod \"dns-default-kspjb\" (UID: \"be57b515-f505-458c-8585-52cecfc83ee6\") " pod="openshift-dns/dns-default-kspjb" Jul 05 19:33:33.995261 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:33:33.994904 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d92912ee-635b-42af-8e2a-0bd5fc31ffc2-service-ca-bundle\") pod \"router-default-647c6ccd69-6rdf2\" (UID: \"d92912ee-635b-42af-8e2a-0bd5fc31ffc2\") " pod="openshift-ingress/router-default-647c6ccd69-6rdf2" Jul 05 19:33:33.997587 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:33:33.997540 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/7d69272b-dacb-48d0-bc9d-ab7f93673154-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-r7bj5\" (UID: \"7d69272b-dacb-48d0-bc9d-ab7f93673154\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-r7bj5" Jul 05 19:33:33.997698 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:33:33.997633 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/1fd5a296-7d6e-475a-8e56-c50ac3e09085-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-zkn8b\" (UID: \"1fd5a296-7d6e-475a-8e56-c50ac3e09085\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-zkn8b" Jul 05 19:33:33.998017 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:33:33.997919 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d92912ee-635b-42af-8e2a-0bd5fc31ffc2-metrics-certs\") pod \"router-default-647c6ccd69-6rdf2\" (UID: \"d92912ee-635b-42af-8e2a-0bd5fc31ffc2\") " pod="openshift-ingress/router-default-647c6ccd69-6rdf2" Jul 05 19:33:33.998017 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:33:33.997995 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/3fff4b0f-7be8-4dc8-811d-9971cafc6810-registry-tls\") pod \"image-registry-7fb894c589-5k8cr\" (UID: \"3fff4b0f-7be8-4dc8-811d-9971cafc6810\") " pod="openshift-image-registry/image-registry-7fb894c589-5k8cr" Jul 05 19:33:33.998268 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:33:33.998244 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/be57b515-f505-458c-8585-52cecfc83ee6-metrics-tls\") pod \"dns-default-kspjb\" (UID: \"be57b515-f505-458c-8585-52cecfc83ee6\") " pod="openshift-dns/dns-default-kspjb" Jul 05 19:33:33.999559 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:33:33.999517 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/e493ebf0-e374-4035-b4cb-6777bbd88a53-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-hqbtk\" (UID: \"e493ebf0-e374-4035-b4cb-6777bbd88a53\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-hqbtk" Jul 05 19:33:34.040911 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:33:34.040866 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-brllj"] Jul 05 19:33:34.046304 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:33:34.046278 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod05684556_d2e2_4157_9f17_097dee8230a0.slice/crio-fcd9076c97072e940cce8c11e2ead818dfe6b58ab08a8ace8c74f41c5c8d1db2 WatchSource:0}: Error finding container fcd9076c97072e940cce8c11e2ead818dfe6b58ab08a8ace8c74f41c5c8d1db2: Status 404 returned error can't find the container with id fcd9076c97072e940cce8c11e2ead818dfe6b58ab08a8ace8c74f41c5c8d1db2 Jul 05 19:33:34.065470 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:33:34.065449 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-k2b5v"] Jul 05 19:33:34.067122 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:33:34.067099 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-fjdxw"] Jul 05 19:33:34.068330 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:33:34.068307 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb256bcc8_4bdd_48db_b050_c02c368ef29d.slice/crio-38f712df9cd109746235825041cfe2d67083dbdb97f6733747ac11663329dbbf WatchSource:0}: Error finding container 38f712df9cd109746235825041cfe2d67083dbdb97f6733747ac11663329dbbf: Status 404 returned error can't find the container with id 38f712df9cd109746235825041cfe2d67083dbdb97f6733747ac11663329dbbf Jul 05 19:33:34.069708 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:33:34.069687 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1fd5cdc6_3c1a_4412_830c_b871c7087a35.slice/crio-b4d033090990f54432e1acb54fea119866f6640cc6ede6c3a00c39480b7ed116 WatchSource:0}: Error finding container b4d033090990f54432e1acb54fea119866f6640cc6ede6c3a00c39480b7ed116: Status 404 returned error can't find the container with id b4d033090990f54432e1acb54fea119866f6640cc6ede6c3a00c39480b7ed116 Jul 05 19:33:34.121650 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:33:34.121629 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-cndlv\"" Jul 05 19:33:34.129839 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:33:34.129814 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7fb894c589-5k8cr" Jul 05 19:33:34.147110 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:33:34.147083 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-qltg5\"" Jul 05 19:33:34.154984 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:33:34.154938 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-zkn8b" Jul 05 19:33:34.156077 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:33:34.156050 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-fkts5\"" Jul 05 19:33:34.165025 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:33:34.165003 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-hqbtk" Jul 05 19:33:34.172214 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:33:34.171966 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-njwkw\"" Jul 05 19:33:34.180524 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:33:34.179856 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6bffdf9778-r7bj5" Jul 05 19:33:34.217550 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:33:34.217292 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-42jkt\"" Jul 05 19:33:34.225795 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:33:34.225099 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-647c6ccd69-6rdf2" Jul 05 19:33:34.228455 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:33:34.228391 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-n6b4c\"" Jul 05 19:33:34.236342 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:33:34.236137 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-kspjb" Jul 05 19:33:34.321672 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:33:34.321565 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-brllj" event={"ID":"05684556-d2e2-4157-9f17-097dee8230a0","Type":"ContainerStarted","Data":"fcd9076c97072e940cce8c11e2ead818dfe6b58ab08a8ace8c74f41c5c8d1db2"} Jul 05 19:33:34.336006 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:33:34.331223 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-plqpb_ac3142e8-817c-493b-b998-41ff8f4680f9/console-operator/1.log" Jul 05 19:33:34.336006 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:33:34.331324 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-68b757fb67-plqpb" event={"ID":"ac3142e8-817c-493b-b998-41ff8f4680f9","Type":"ContainerStarted","Data":"43c3635512e1eeeac0c205fcd0edb8d958d546b7fd6f6b2422f96ce0f684ab90"} Jul 05 19:33:34.336006 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:33:34.333443 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-68b757fb67-plqpb" Jul 05 19:33:34.337134 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:33:34.336801 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-8wfc2" event={"ID":"6a22c6f6-ecb4-4ff6-8525-3639d132fe72","Type":"ContainerStarted","Data":"d5e5ef5e645bae48f4573c6f5e42ba168ef63630bf04cf2e14d5c65a64fb0af8"} Jul 05 19:33:34.343817 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:33:34.340040 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-fjdxw" event={"ID":"1fd5cdc6-3c1a-4412-830c-b871c7087a35","Type":"ContainerStarted","Data":"c287abda39319ccc109ffab83af8f094a65290db6d631c0ce772f6d730c7762f"} Jul 05 19:33:34.343817 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:33:34.340108 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-fjdxw" event={"ID":"1fd5cdc6-3c1a-4412-830c-b871c7087a35","Type":"ContainerStarted","Data":"b4d033090990f54432e1acb54fea119866f6640cc6ede6c3a00c39480b7ed116"} Jul 05 19:33:34.343817 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:33:34.340669 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-fjdxw" Jul 05 19:33:34.356562 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:33:34.356459 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-k2b5v" event={"ID":"b256bcc8-4bdd-48db-b050-c02c368ef29d","Type":"ContainerStarted","Data":"38f712df9cd109746235825041cfe2d67083dbdb97f6733747ac11663329dbbf"} Jul 05 19:33:34.373562 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:33:34.372726 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-68b757fb67-plqpb" podStartSLOduration=24.544079862 podStartE2EDuration="34.372701567s" totalImagesPullingTime="9.828621705s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-05 19:33:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 19:33:34.354576 +0000 UTC m=+67.753923473" watchObservedRunningTime="2026-07-05 19:33:34.372701567 +0000 UTC m=+67.772049036" Jul 05 19:33:34.376482 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:33:34.376427 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-fjdxw" podStartSLOduration=66.376404374 podStartE2EDuration="1m6.376404374s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-05 19:32:28 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 19:33:34.37223376 +0000 UTC m=+67.771581231" watchObservedRunningTime="2026-07-05 19:33:34.376404374 +0000 UTC m=+67.775751844" Jul 05 19:33:34.377082 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:33:34.377058 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-7fb894c589-5k8cr"] Jul 05 19:33:34.405226 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:33:34.405192 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1fd5a296_7d6e_475a_8e56_c50ac3e09085.slice/crio-3ecc745ad45142ff77a110064fbfe52f2e4497b7aa4f91c08542ffd060ba962c WatchSource:0}: Error finding container 3ecc745ad45142ff77a110064fbfe52f2e4497b7aa4f91c08542ffd060ba962c: Status 404 returned error can't find the container with id 3ecc745ad45142ff77a110064fbfe52f2e4497b7aa4f91c08542ffd060ba962c Jul 05 19:33:34.415925 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:33:34.415902 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-64786d9cbb-zkn8b"] Jul 05 19:33:34.421444 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:33:34.421374 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-hqbtk"] Jul 05 19:33:34.438873 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:33:34.438784 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-6bffdf9778-r7bj5"] Jul 05 19:33:34.453003 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:33:34.452971 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7d69272b_dacb_48d0_bc9d_ab7f93673154.slice/crio-a511ea8f1f146e80374877145850c1f42136982c7ae35eb8c52532e6cb4896b0 WatchSource:0}: Error finding container a511ea8f1f146e80374877145850c1f42136982c7ae35eb8c52532e6cb4896b0: Status 404 returned error can't find the container with id a511ea8f1f146e80374877145850c1f42136982c7ae35eb8c52532e6cb4896b0 Jul 05 19:33:34.471318 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:33:34.471279 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-647c6ccd69-6rdf2"] Jul 05 19:33:34.475192 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:33:34.475160 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd92912ee_635b_42af_8e2a_0bd5fc31ffc2.slice/crio-7f67ad63915fc6aefa5c84d5fc3dd6c76ff2322f72dd406c63df3dce8bbee101 WatchSource:0}: Error finding container 7f67ad63915fc6aefa5c84d5fc3dd6c76ff2322f72dd406c63df3dce8bbee101: Status 404 returned error can't find the container with id 7f67ad63915fc6aefa5c84d5fc3dd6c76ff2322f72dd406c63df3dce8bbee101 Jul 05 19:33:34.677385 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:33:34.677312 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-kspjb"] Jul 05 19:33:34.683754 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:33:34.683323 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbe57b515_f505_458c_8585_52cecfc83ee6.slice/crio-871545049abeab57a2d291a38ab6a41922ba506ed1392296a53f7f179c80a45d WatchSource:0}: Error finding container 871545049abeab57a2d291a38ab6a41922ba506ed1392296a53f7f179c80a45d: Status 404 returned error can't find the container with id 871545049abeab57a2d291a38ab6a41922ba506ed1392296a53f7f179c80a45d Jul 05 19:33:35.142921 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:33:35.142794 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-68b757fb67-plqpb" Jul 05 19:33:35.376680 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:33:35.376581 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-8wfc2" event={"ID":"6a22c6f6-ecb4-4ff6-8525-3639d132fe72","Type":"ContainerStarted","Data":"e3871043e9e67e97716dadf174989c41c71b5b070f41bc63e487df9c25ff485e"} Jul 05 19:33:35.379781 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:33:35.379737 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-647c6ccd69-6rdf2" event={"ID":"d92912ee-635b-42af-8e2a-0bd5fc31ffc2","Type":"ContainerStarted","Data":"600e1459166ab62d84553b306b3123aef4d7e79650f36a14ebf42f2c8e789b20"} Jul 05 19:33:35.379925 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:33:35.379793 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-647c6ccd69-6rdf2" event={"ID":"d92912ee-635b-42af-8e2a-0bd5fc31ffc2","Type":"ContainerStarted","Data":"7f67ad63915fc6aefa5c84d5fc3dd6c76ff2322f72dd406c63df3dce8bbee101"} Jul 05 19:33:35.381898 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:33:35.381871 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-hqbtk" event={"ID":"e493ebf0-e374-4035-b4cb-6777bbd88a53","Type":"ContainerStarted","Data":"4bdabc68efd68343e96151f26c9cc8dd6dfa400f10ba034f9a2572c616420360"} Jul 05 19:33:35.383532 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:33:35.383478 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-zkn8b" event={"ID":"1fd5a296-7d6e-475a-8e56-c50ac3e09085","Type":"ContainerStarted","Data":"3ecc745ad45142ff77a110064fbfe52f2e4497b7aa4f91c08542ffd060ba962c"} Jul 05 19:33:35.385172 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:33:35.385107 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-kspjb" event={"ID":"be57b515-f505-458c-8585-52cecfc83ee6","Type":"ContainerStarted","Data":"871545049abeab57a2d291a38ab6a41922ba506ed1392296a53f7f179c80a45d"} Jul 05 19:33:35.386517 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:33:35.386460 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-6bffdf9778-r7bj5" event={"ID":"7d69272b-dacb-48d0-bc9d-ab7f93673154","Type":"ContainerStarted","Data":"a511ea8f1f146e80374877145850c1f42136982c7ae35eb8c52532e6cb4896b0"} Jul 05 19:33:35.389717 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:33:35.389693 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7fb894c589-5k8cr" event={"ID":"3fff4b0f-7be8-4dc8-811d-9971cafc6810","Type":"ContainerStarted","Data":"9ebd986503f213226c98cca9605519f75bf34c8b05a65441101825c312674d2c"} Jul 05 19:33:35.389824 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:33:35.389735 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7fb894c589-5k8cr" event={"ID":"3fff4b0f-7be8-4dc8-811d-9971cafc6810","Type":"ContainerStarted","Data":"98b2b132b133c405c75f4bebf6914e138935b811618569a1909fc2922afd5f15"} Jul 05 19:33:35.390243 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:33:35.390147 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-7fb894c589-5k8cr" Jul 05 19:33:35.419439 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:33:35.419035 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-647c6ccd69-6rdf2" podStartSLOduration=35.419015418 podStartE2EDuration="35.419015418s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-05 19:33:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 19:33:35.400557445 +0000 UTC m=+68.799904915" watchObservedRunningTime="2026-07-05 19:33:35.419015418 +0000 UTC m=+68.818362886" Jul 05 19:33:35.420426 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:33:35.420004 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-7fb894c589-5k8cr" podStartSLOduration=67.419989839 podStartE2EDuration="1m7.419989839s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-05 19:32:28 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 19:33:35.418675284 +0000 UTC m=+68.818022752" watchObservedRunningTime="2026-07-05 19:33:35.419989839 +0000 UTC m=+68.819337305" Jul 05 19:33:36.225730 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:33:36.225649 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-647c6ccd69-6rdf2" Jul 05 19:33:36.229048 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:33:36.228804 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-647c6ccd69-6rdf2" Jul 05 19:33:36.398908 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:33:36.398841 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-brllj" event={"ID":"05684556-d2e2-4157-9f17-097dee8230a0","Type":"ContainerStarted","Data":"7ac0819386a29b287f02b569beeb418643e8525550f2e5bea8170e3c72bc5bfe"} Jul 05 19:33:36.400019 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:33:36.399968 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-647c6ccd69-6rdf2" Jul 05 19:33:36.400799 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:33:36.400580 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-647c6ccd69-6rdf2" Jul 05 19:33:42.424103 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:33:42.424068 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-8wfc2" event={"ID":"6a22c6f6-ecb4-4ff6-8525-3639d132fe72","Type":"ContainerStarted","Data":"7a49a08482f48ffb5cd564507b3ffd0509707d1015e6469d295123a0fa903320"} Jul 05 19:33:42.425919 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:33:42.425888 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-hqbtk" event={"ID":"e493ebf0-e374-4035-b4cb-6777bbd88a53","Type":"ContainerStarted","Data":"9540212fedd7106d59beab1e57ba790570a04474ac270861fd4e0995653aa760"} Jul 05 19:33:42.426059 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:33:42.425935 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-hqbtk" event={"ID":"e493ebf0-e374-4035-b4cb-6777bbd88a53","Type":"ContainerStarted","Data":"13b043111f4a2b646ad885538c5206f5af86d599efc224174b57a04604efaf86"} Jul 05 19:33:42.427315 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:33:42.427286 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-zkn8b" event={"ID":"1fd5a296-7d6e-475a-8e56-c50ac3e09085","Type":"ContainerStarted","Data":"6df14a5f1b6805e97d54813e2ec360ac6a5249c080f8ddf2a2d6f5c857389bb0"} Jul 05 19:33:42.428726 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:33:42.428702 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-k2b5v" event={"ID":"b256bcc8-4bdd-48db-b050-c02c368ef29d","Type":"ContainerStarted","Data":"6c88a5f9bf6225bc591f43dfc5fc3e9a07230efaaf143f0ceb9316c14ca219d0"} Jul 05 19:33:42.430428 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:33:42.430410 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-kspjb" event={"ID":"be57b515-f505-458c-8585-52cecfc83ee6","Type":"ContainerStarted","Data":"4d04a1583b4364bc93873a1d6cc8ef9bc52a562f6d16ac4f3b86ccc6d64497f6"} Jul 05 19:33:42.430533 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:33:42.430458 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-kspjb" event={"ID":"be57b515-f505-458c-8585-52cecfc83ee6","Type":"ContainerStarted","Data":"e18050216286c2c3ba2df7b74528fc626454497e5706775cd56f84419555da3a"} Jul 05 19:33:42.430533 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:33:42.430490 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-kspjb" Jul 05 19:33:42.431831 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:33:42.431808 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-6bffdf9778-r7bj5" event={"ID":"7d69272b-dacb-48d0-bc9d-ab7f93673154","Type":"ContainerStarted","Data":"fe39da4f660a7aca8cd7af7a792b51b8dc6e3c6e5ccecf2c8dc71bbf2758e23a"} Jul 05 19:33:42.433456 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:33:42.433437 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-brllj" event={"ID":"05684556-d2e2-4157-9f17-097dee8230a0","Type":"ContainerStarted","Data":"be7e91b2c5a9cf7a201d40243b1f04929c8c0500cc0601e33aa95d87d77828dd"} Jul 05 19:33:42.444036 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:33:42.443999 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-8wfc2" podStartSLOduration=17.36194689 podStartE2EDuration="28.44398638s" totalImagesPullingTime="11.08203949s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-05 19:33:14 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 19:33:42.442768766 +0000 UTC m=+75.842116235" watchObservedRunningTime="2026-07-05 19:33:42.44398638 +0000 UTC m=+75.843333847" Jul 05 19:33:42.469364 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:33:42.469313 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-kspjb" podStartSLOduration=34.747995235 podStartE2EDuration="41.469299031s" totalImagesPullingTime="6.721303796s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-05 19:33:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 19:33:42.468661138 +0000 UTC m=+75.868008604" watchObservedRunningTime="2026-07-05 19:33:42.469299031 +0000 UTC m=+75.868646498" Jul 05 19:33:42.485802 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:33:42.485759 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-k2b5v" podStartSLOduration=67.135197749 podStartE2EDuration="1m14.485748203s" totalImagesPullingTime="7.350550454s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-05 19:32:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 19:33:42.485238184 +0000 UTC m=+75.884585664" watchObservedRunningTime="2026-07-05 19:33:42.485748203 +0000 UTC m=+75.885095670" Jul 05 19:33:42.505044 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:33:42.505004 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-zkn8b" podStartSLOduration=36.576189567 podStartE2EDuration="43.504990621s" totalImagesPullingTime="6.928801054s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-05 19:32:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 19:33:42.504155011 +0000 UTC m=+75.903502479" watchObservedRunningTime="2026-07-05 19:33:42.504990621 +0000 UTC m=+75.904338113" Jul 05 19:33:42.523757 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:33:42.523719 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-hqbtk" podStartSLOduration=36.597373837 podStartE2EDuration="43.52370637s" totalImagesPullingTime="6.926332533s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-05 19:32:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 19:33:42.523287569 +0000 UTC m=+75.922635050" watchObservedRunningTime="2026-07-05 19:33:42.52370637 +0000 UTC m=+75.923053836" Jul 05 19:33:42.539645 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:33:42.539608 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-6bffdf9778-r7bj5" podStartSLOduration=35.65589201 podStartE2EDuration="42.539594624s" totalImagesPullingTime="6.883702614s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-05 19:33:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 19:33:42.538652006 +0000 UTC m=+75.937999473" watchObservedRunningTime="2026-07-05 19:33:42.539594624 +0000 UTC m=+75.938942090" Jul 05 19:33:42.555005 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:33:42.554919 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-brllj" podStartSLOduration=73.165845186 podStartE2EDuration="1m14.554901859s" totalImagesPullingTime="1.389056673s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-05 19:32:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 19:33:42.554746098 +0000 UTC m=+75.954093565" watchObservedRunningTime="2026-07-05 19:33:42.554901859 +0000 UTC m=+75.954249327" Jul 05 19:33:51.609859 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:33:51.609738 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-c5c6p"] Jul 05 19:33:51.614241 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:33:51.614220 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-c5c6p" Jul 05 19:33:51.617845 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:33:51.617789 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 05 19:33:51.617845 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:33:51.617814 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 05 19:33:51.618382 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:33:51.618366 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-frhf9\"" Jul 05 19:33:51.618532 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:33:51.618515 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 05 19:33:51.618599 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:33:51.618557 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 05 19:33:51.647381 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:33:51.647364 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/57fe8b95-63f8-4735-ac57-f21153500b04-sys\") pod \"node-exporter-c5c6p\" (UID: \"57fe8b95-63f8-4735-ac57-f21153500b04\") " pod="openshift-monitoring/node-exporter-c5c6p" Jul 05 19:33:51.647473 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:33:51.647387 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/57fe8b95-63f8-4735-ac57-f21153500b04-node-exporter-wtmp\") pod \"node-exporter-c5c6p\" (UID: \"57fe8b95-63f8-4735-ac57-f21153500b04\") " pod="openshift-monitoring/node-exporter-c5c6p" Jul 05 19:33:51.647473 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:33:51.647406 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/57fe8b95-63f8-4735-ac57-f21153500b04-node-exporter-accelerators-collector-config\") pod \"node-exporter-c5c6p\" (UID: \"57fe8b95-63f8-4735-ac57-f21153500b04\") " pod="openshift-monitoring/node-exporter-c5c6p" Jul 05 19:33:51.647473 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:33:51.647429 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/57fe8b95-63f8-4735-ac57-f21153500b04-metrics-client-ca\") pod \"node-exporter-c5c6p\" (UID: \"57fe8b95-63f8-4735-ac57-f21153500b04\") " pod="openshift-monitoring/node-exporter-c5c6p" Jul 05 19:33:51.647473 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:33:51.647452 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/57fe8b95-63f8-4735-ac57-f21153500b04-root\") pod \"node-exporter-c5c6p\" (UID: \"57fe8b95-63f8-4735-ac57-f21153500b04\") " pod="openshift-monitoring/node-exporter-c5c6p" Jul 05 19:33:51.647622 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:33:51.647525 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f4cz5\" (UniqueName: \"kubernetes.io/projected/57fe8b95-63f8-4735-ac57-f21153500b04-kube-api-access-f4cz5\") pod \"node-exporter-c5c6p\" (UID: \"57fe8b95-63f8-4735-ac57-f21153500b04\") " pod="openshift-monitoring/node-exporter-c5c6p" Jul 05 19:33:51.647622 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:33:51.647549 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/57fe8b95-63f8-4735-ac57-f21153500b04-node-exporter-tls\") pod \"node-exporter-c5c6p\" (UID: \"57fe8b95-63f8-4735-ac57-f21153500b04\") " pod="openshift-monitoring/node-exporter-c5c6p" Jul 05 19:33:51.647622 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:33:51.647571 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/57fe8b95-63f8-4735-ac57-f21153500b04-node-exporter-textfile\") pod \"node-exporter-c5c6p\" (UID: \"57fe8b95-63f8-4735-ac57-f21153500b04\") " pod="openshift-monitoring/node-exporter-c5c6p" Jul 05 19:33:51.647732 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:33:51.647643 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/57fe8b95-63f8-4735-ac57-f21153500b04-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-c5c6p\" (UID: \"57fe8b95-63f8-4735-ac57-f21153500b04\") " pod="openshift-monitoring/node-exporter-c5c6p" Jul 05 19:33:51.748751 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:33:51.748726 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/57fe8b95-63f8-4735-ac57-f21153500b04-node-exporter-tls\") pod \"node-exporter-c5c6p\" (UID: \"57fe8b95-63f8-4735-ac57-f21153500b04\") " pod="openshift-monitoring/node-exporter-c5c6p" Jul 05 19:33:51.748849 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:33:51.748757 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/57fe8b95-63f8-4735-ac57-f21153500b04-node-exporter-textfile\") pod \"node-exporter-c5c6p\" (UID: \"57fe8b95-63f8-4735-ac57-f21153500b04\") " pod="openshift-monitoring/node-exporter-c5c6p" Jul 05 19:33:51.748849 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:33:51.748784 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/57fe8b95-63f8-4735-ac57-f21153500b04-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-c5c6p\" (UID: \"57fe8b95-63f8-4735-ac57-f21153500b04\") " pod="openshift-monitoring/node-exporter-c5c6p" Jul 05 19:33:51.748849 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:33:51.748805 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/57fe8b95-63f8-4735-ac57-f21153500b04-sys\") pod \"node-exporter-c5c6p\" (UID: \"57fe8b95-63f8-4735-ac57-f21153500b04\") " pod="openshift-monitoring/node-exporter-c5c6p" Jul 05 19:33:51.748849 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:33:51.748824 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/57fe8b95-63f8-4735-ac57-f21153500b04-node-exporter-wtmp\") pod \"node-exporter-c5c6p\" (UID: \"57fe8b95-63f8-4735-ac57-f21153500b04\") " pod="openshift-monitoring/node-exporter-c5c6p" Jul 05 19:33:51.749049 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:33:51.748850 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/57fe8b95-63f8-4735-ac57-f21153500b04-node-exporter-accelerators-collector-config\") pod \"node-exporter-c5c6p\" (UID: \"57fe8b95-63f8-4735-ac57-f21153500b04\") " pod="openshift-monitoring/node-exporter-c5c6p" Jul 05 19:33:51.749049 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:33:51.748880 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/57fe8b95-63f8-4735-ac57-f21153500b04-sys\") pod \"node-exporter-c5c6p\" (UID: \"57fe8b95-63f8-4735-ac57-f21153500b04\") " pod="openshift-monitoring/node-exporter-c5c6p" Jul 05 19:33:51.749049 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:33:51.748885 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/57fe8b95-63f8-4735-ac57-f21153500b04-metrics-client-ca\") pod \"node-exporter-c5c6p\" (UID: \"57fe8b95-63f8-4735-ac57-f21153500b04\") " pod="openshift-monitoring/node-exporter-c5c6p" Jul 05 19:33:51.749049 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:33:51.748926 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/57fe8b95-63f8-4735-ac57-f21153500b04-root\") pod \"node-exporter-c5c6p\" (UID: \"57fe8b95-63f8-4735-ac57-f21153500b04\") " pod="openshift-monitoring/node-exporter-c5c6p" Jul 05 19:33:51.749049 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:33:51.748987 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/57fe8b95-63f8-4735-ac57-f21153500b04-node-exporter-wtmp\") pod \"node-exporter-c5c6p\" (UID: \"57fe8b95-63f8-4735-ac57-f21153500b04\") " pod="openshift-monitoring/node-exporter-c5c6p" Jul 05 19:33:51.749049 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:33:51.748995 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f4cz5\" (UniqueName: \"kubernetes.io/projected/57fe8b95-63f8-4735-ac57-f21153500b04-kube-api-access-f4cz5\") pod \"node-exporter-c5c6p\" (UID: \"57fe8b95-63f8-4735-ac57-f21153500b04\") " pod="openshift-monitoring/node-exporter-c5c6p" Jul 05 19:33:51.749311 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:33:51.749032 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/57fe8b95-63f8-4735-ac57-f21153500b04-root\") pod \"node-exporter-c5c6p\" (UID: \"57fe8b95-63f8-4735-ac57-f21153500b04\") " pod="openshift-monitoring/node-exporter-c5c6p" Jul 05 19:33:51.749311 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:33:51.749181 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/57fe8b95-63f8-4735-ac57-f21153500b04-node-exporter-textfile\") pod \"node-exporter-c5c6p\" (UID: \"57fe8b95-63f8-4735-ac57-f21153500b04\") " pod="openshift-monitoring/node-exporter-c5c6p" Jul 05 19:33:51.749563 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:33:51.749544 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/57fe8b95-63f8-4735-ac57-f21153500b04-metrics-client-ca\") pod \"node-exporter-c5c6p\" (UID: \"57fe8b95-63f8-4735-ac57-f21153500b04\") " pod="openshift-monitoring/node-exporter-c5c6p" Jul 05 19:33:51.749608 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:33:51.749544 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/57fe8b95-63f8-4735-ac57-f21153500b04-node-exporter-accelerators-collector-config\") pod \"node-exporter-c5c6p\" (UID: \"57fe8b95-63f8-4735-ac57-f21153500b04\") " pod="openshift-monitoring/node-exporter-c5c6p" Jul 05 19:33:51.751123 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:33:51.751107 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/57fe8b95-63f8-4735-ac57-f21153500b04-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-c5c6p\" (UID: \"57fe8b95-63f8-4735-ac57-f21153500b04\") " pod="openshift-monitoring/node-exporter-c5c6p" Jul 05 19:33:51.751218 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:33:51.751199 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/57fe8b95-63f8-4735-ac57-f21153500b04-node-exporter-tls\") pod \"node-exporter-c5c6p\" (UID: \"57fe8b95-63f8-4735-ac57-f21153500b04\") " pod="openshift-monitoring/node-exporter-c5c6p" Jul 05 19:33:51.756495 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:33:51.756471 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f4cz5\" (UniqueName: \"kubernetes.io/projected/57fe8b95-63f8-4735-ac57-f21153500b04-kube-api-access-f4cz5\") pod \"node-exporter-c5c6p\" (UID: \"57fe8b95-63f8-4735-ac57-f21153500b04\") " pod="openshift-monitoring/node-exporter-c5c6p" Jul 05 19:33:51.924203 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:33:51.924136 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-c5c6p" Jul 05 19:33:51.934858 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:33:51.934835 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod57fe8b95_63f8_4735_ac57_f21153500b04.slice/crio-c719e2541de2088a530fcc2753350b586be2445fea5c4609c4f789fa0987b79c WatchSource:0}: Error finding container c719e2541de2088a530fcc2753350b586be2445fea5c4609c4f789fa0987b79c: Status 404 returned error can't find the container with id c719e2541de2088a530fcc2753350b586be2445fea5c4609c4f789fa0987b79c Jul 05 19:33:52.440283 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:33:52.440255 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-kspjb" Jul 05 19:33:52.475908 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:33:52.475872 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-c5c6p" event={"ID":"57fe8b95-63f8-4735-ac57-f21153500b04","Type":"ContainerStarted","Data":"c719e2541de2088a530fcc2753350b586be2445fea5c4609c4f789fa0987b79c"} Jul 05 19:33:53.481190 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:33:53.481156 2572 generic.go:356] "Generic (PLEG): container finished" podID="57fe8b95-63f8-4735-ac57-f21153500b04" containerID="b0c5a9b1d0565de7a17f3f4b272127467e259cea885c7397707c39c598e9c906" exitCode=0 Jul 05 19:33:53.481638 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:33:53.481227 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-c5c6p" event={"ID":"57fe8b95-63f8-4735-ac57-f21153500b04","Type":"ContainerDied","Data":"b0c5a9b1d0565de7a17f3f4b272127467e259cea885c7397707c39c598e9c906"} Jul 05 19:33:54.487981 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:33:54.487923 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-c5c6p" event={"ID":"57fe8b95-63f8-4735-ac57-f21153500b04","Type":"ContainerStarted","Data":"bfbf5c3985df5f755ddc7e87615cc5c19f18de61c7ffb29a24e73379feed3afb"} Jul 05 19:33:54.488545 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:33:54.488038 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-c5c6p" event={"ID":"57fe8b95-63f8-4735-ac57-f21153500b04","Type":"ContainerStarted","Data":"b99766a56baa0b04b3d0ecaf13b9e2092fe146a6c1ae67a592b226bb6709bf54"} Jul 05 19:33:54.513010 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:33:54.512921 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-c5c6p" podStartSLOduration=2.402118309 podStartE2EDuration="3.512900353s" totalImagesPullingTime="1.048120859s" totalInitContainerRuntime="62.661185ms" isStatefulPod=true podCreationTimestamp="2026-07-05 19:33:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 19:33:54.512802724 +0000 UTC m=+87.912150192" watchObservedRunningTime="2026-07-05 19:33:54.512900353 +0000 UTC m=+87.912247820" Jul 05 19:33:57.407906 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:33:57.407877 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-7fb894c589-5k8cr" Jul 05 19:33:59.195237 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:33:59.195204 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-7fb894c589-5k8cr"] Jul 05 19:34:06.401698 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:34:06.401659 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-fjdxw" Jul 05 19:34:23.598083 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:34:23.598052 2572 generic.go:356] "Generic (PLEG): container finished" podID="97203db6-d938-48a9-834a-81a92eaae053" containerID="27c3ae5c636e4c3169feedbefdfe789b8f4d716f93059ed072ff7c7ab4e5c58b" exitCode=0 Jul 05 19:34:23.598457 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:34:23.598122 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-zg7lw" event={"ID":"97203db6-d938-48a9-834a-81a92eaae053","Type":"ContainerDied","Data":"27c3ae5c636e4c3169feedbefdfe789b8f4d716f93059ed072ff7c7ab4e5c58b"} Jul 05 19:34:23.598510 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:34:23.598462 2572 scope.go:117] "RemoveContainer" containerID="27c3ae5c636e4c3169feedbefdfe789b8f4d716f93059ed072ff7c7ab4e5c58b" Jul 05 19:34:23.599858 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:34:23.599764 2572 generic.go:356] "Generic (PLEG): container finished" podID="f00bb4f2-e3e7-48e5-82b4-ada41ed8cd2f" containerID="6326fe65628f8fb19938ee59d4350b0541f31b535f4b3a9bdb88dc21a371b2f7" exitCode=0 Jul 05 19:34:23.599858 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:34:23.599832 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5c847dcfc4-wpgzd" event={"ID":"f00bb4f2-e3e7-48e5-82b4-ada41ed8cd2f","Type":"ContainerDied","Data":"6326fe65628f8fb19938ee59d4350b0541f31b535f4b3a9bdb88dc21a371b2f7"} Jul 05 19:34:23.600172 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:34:23.600152 2572 scope.go:117] "RemoveContainer" containerID="6326fe65628f8fb19938ee59d4350b0541f31b535f4b3a9bdb88dc21a371b2f7" Jul 05 19:34:23.601508 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:34:23.601486 2572 generic.go:356] "Generic (PLEG): container finished" podID="f568b2ea-4b26-4337-8500-6a5daf5c7579" containerID="f191e744d6cc0c6dd550023efb626583543efbde3697da58fa940f953d2a6109" exitCode=0 Jul 05 19:34:23.601596 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:34:23.601533 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-28jcd" event={"ID":"f568b2ea-4b26-4337-8500-6a5daf5c7579","Type":"ContainerDied","Data":"f191e744d6cc0c6dd550023efb626583543efbde3697da58fa940f953d2a6109"} Jul 05 19:34:23.601865 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:34:23.601847 2572 scope.go:117] "RemoveContainer" containerID="f191e744d6cc0c6dd550023efb626583543efbde3697da58fa940f953d2a6109" Jul 05 19:34:24.215542 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:34:24.215497 2572 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-image-registry/image-registry-7fb894c589-5k8cr" podUID="3fff4b0f-7be8-4dc8-811d-9971cafc6810" containerName="registry" containerID="cri-o://9ebd986503f213226c98cca9605519f75bf34c8b05a65441101825c312674d2c" gracePeriod=30 Jul 05 19:34:24.283207 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:34:24.283183 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-647c6ccd69-6rdf2_d92912ee-635b-42af-8e2a-0bd5fc31ffc2/router/0.log" Jul 05 19:34:24.288806 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:34:24.288786 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-5dxlq_ac01962e-2f62-482e-92ea-3c484803817d/serve-healthcheck-canary/0.log" Jul 05 19:34:24.454778 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:34:24.454753 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7fb894c589-5k8cr" Jul 05 19:34:24.498183 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:34:24.498076 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/3fff4b0f-7be8-4dc8-811d-9971cafc6810-image-registry-private-configuration\") pod \"3fff4b0f-7be8-4dc8-811d-9971cafc6810\" (UID: \"3fff4b0f-7be8-4dc8-811d-9971cafc6810\") " Jul 05 19:34:24.498183 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:34:24.498117 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xrcgs\" (UniqueName: \"kubernetes.io/projected/3fff4b0f-7be8-4dc8-811d-9971cafc6810-kube-api-access-xrcgs\") pod \"3fff4b0f-7be8-4dc8-811d-9971cafc6810\" (UID: \"3fff4b0f-7be8-4dc8-811d-9971cafc6810\") " Jul 05 19:34:24.498183 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:34:24.498139 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/3fff4b0f-7be8-4dc8-811d-9971cafc6810-ca-trust-extracted\") pod \"3fff4b0f-7be8-4dc8-811d-9971cafc6810\" (UID: \"3fff4b0f-7be8-4dc8-811d-9971cafc6810\") " Jul 05 19:34:24.498183 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:34:24.498157 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/3fff4b0f-7be8-4dc8-811d-9971cafc6810-bound-sa-token\") pod \"3fff4b0f-7be8-4dc8-811d-9971cafc6810\" (UID: \"3fff4b0f-7be8-4dc8-811d-9971cafc6810\") " Jul 05 19:34:24.498183 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:34:24.498184 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/3fff4b0f-7be8-4dc8-811d-9971cafc6810-trusted-ca\") pod \"3fff4b0f-7be8-4dc8-811d-9971cafc6810\" (UID: \"3fff4b0f-7be8-4dc8-811d-9971cafc6810\") " Jul 05 19:34:24.498724 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:34:24.498221 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/3fff4b0f-7be8-4dc8-811d-9971cafc6810-registry-tls\") pod \"3fff4b0f-7be8-4dc8-811d-9971cafc6810\" (UID: \"3fff4b0f-7be8-4dc8-811d-9971cafc6810\") " Jul 05 19:34:24.498724 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:34:24.498263 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/3fff4b0f-7be8-4dc8-811d-9971cafc6810-installation-pull-secrets\") pod \"3fff4b0f-7be8-4dc8-811d-9971cafc6810\" (UID: \"3fff4b0f-7be8-4dc8-811d-9971cafc6810\") " Jul 05 19:34:24.498724 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:34:24.498289 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/3fff4b0f-7be8-4dc8-811d-9971cafc6810-registry-certificates\") pod \"3fff4b0f-7be8-4dc8-811d-9971cafc6810\" (UID: \"3fff4b0f-7be8-4dc8-811d-9971cafc6810\") " Jul 05 19:34:24.498724 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:34:24.498610 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3fff4b0f-7be8-4dc8-811d-9971cafc6810-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "3fff4b0f-7be8-4dc8-811d-9971cafc6810" (UID: "3fff4b0f-7be8-4dc8-811d-9971cafc6810"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 05 19:34:24.498931 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:34:24.498890 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3fff4b0f-7be8-4dc8-811d-9971cafc6810-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "3fff4b0f-7be8-4dc8-811d-9971cafc6810" (UID: "3fff4b0f-7be8-4dc8-811d-9971cafc6810"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 05 19:34:24.501512 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:34:24.501387 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3fff4b0f-7be8-4dc8-811d-9971cafc6810-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "3fff4b0f-7be8-4dc8-811d-9971cafc6810" (UID: "3fff4b0f-7be8-4dc8-811d-9971cafc6810"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 05 19:34:24.501512 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:34:24.501423 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3fff4b0f-7be8-4dc8-811d-9971cafc6810-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "3fff4b0f-7be8-4dc8-811d-9971cafc6810" (UID: "3fff4b0f-7be8-4dc8-811d-9971cafc6810"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 05 19:34:24.501709 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:34:24.501604 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3fff4b0f-7be8-4dc8-811d-9971cafc6810-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "3fff4b0f-7be8-4dc8-811d-9971cafc6810" (UID: "3fff4b0f-7be8-4dc8-811d-9971cafc6810"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 05 19:34:24.501820 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:34:24.501798 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3fff4b0f-7be8-4dc8-811d-9971cafc6810-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "3fff4b0f-7be8-4dc8-811d-9971cafc6810" (UID: "3fff4b0f-7be8-4dc8-811d-9971cafc6810"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 05 19:34:24.501923 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:34:24.501897 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3fff4b0f-7be8-4dc8-811d-9971cafc6810-kube-api-access-xrcgs" (OuterVolumeSpecName: "kube-api-access-xrcgs") pod "3fff4b0f-7be8-4dc8-811d-9971cafc6810" (UID: "3fff4b0f-7be8-4dc8-811d-9971cafc6810"). InnerVolumeSpecName "kube-api-access-xrcgs". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 05 19:34:24.507443 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:34:24.507420 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3fff4b0f-7be8-4dc8-811d-9971cafc6810-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "3fff4b0f-7be8-4dc8-811d-9971cafc6810" (UID: "3fff4b0f-7be8-4dc8-811d-9971cafc6810"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 05 19:34:24.599024 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:34:24.598987 2572 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/3fff4b0f-7be8-4dc8-811d-9971cafc6810-image-registry-private-configuration\") on node \"ip-10-0-133-7.ec2.internal\" DevicePath \"\"" Jul 05 19:34:24.599024 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:34:24.599019 2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xrcgs\" (UniqueName: \"kubernetes.io/projected/3fff4b0f-7be8-4dc8-811d-9971cafc6810-kube-api-access-xrcgs\") on node \"ip-10-0-133-7.ec2.internal\" DevicePath \"\"" Jul 05 19:34:24.599454 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:34:24.599035 2572 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/3fff4b0f-7be8-4dc8-811d-9971cafc6810-ca-trust-extracted\") on node \"ip-10-0-133-7.ec2.internal\" DevicePath \"\"" Jul 05 19:34:24.599454 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:34:24.599049 2572 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/3fff4b0f-7be8-4dc8-811d-9971cafc6810-bound-sa-token\") on node \"ip-10-0-133-7.ec2.internal\" DevicePath \"\"" Jul 05 19:34:24.599454 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:34:24.599062 2572 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/3fff4b0f-7be8-4dc8-811d-9971cafc6810-trusted-ca\") on node \"ip-10-0-133-7.ec2.internal\" DevicePath \"\"" Jul 05 19:34:24.599454 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:34:24.599072 2572 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/3fff4b0f-7be8-4dc8-811d-9971cafc6810-registry-tls\") on node \"ip-10-0-133-7.ec2.internal\" DevicePath \"\"" Jul 05 19:34:24.599454 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:34:24.599083 2572 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/3fff4b0f-7be8-4dc8-811d-9971cafc6810-installation-pull-secrets\") on node \"ip-10-0-133-7.ec2.internal\" DevicePath \"\"" Jul 05 19:34:24.599454 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:34:24.599095 2572 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/3fff4b0f-7be8-4dc8-811d-9971cafc6810-registry-certificates\") on node \"ip-10-0-133-7.ec2.internal\" DevicePath \"\"" Jul 05 19:34:24.606724 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:34:24.606692 2572 generic.go:356] "Generic (PLEG): container finished" podID="3fff4b0f-7be8-4dc8-811d-9971cafc6810" containerID="9ebd986503f213226c98cca9605519f75bf34c8b05a65441101825c312674d2c" exitCode=0 Jul 05 19:34:24.606909 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:34:24.606754 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7fb894c589-5k8cr" Jul 05 19:34:24.606909 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:34:24.606785 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7fb894c589-5k8cr" event={"ID":"3fff4b0f-7be8-4dc8-811d-9971cafc6810","Type":"ContainerDied","Data":"9ebd986503f213226c98cca9605519f75bf34c8b05a65441101825c312674d2c"} Jul 05 19:34:24.606909 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:34:24.606836 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7fb894c589-5k8cr" event={"ID":"3fff4b0f-7be8-4dc8-811d-9971cafc6810","Type":"ContainerDied","Data":"98b2b132b133c405c75f4bebf6914e138935b811618569a1909fc2922afd5f15"} Jul 05 19:34:24.606909 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:34:24.606864 2572 scope.go:117] "RemoveContainer" containerID="9ebd986503f213226c98cca9605519f75bf34c8b05a65441101825c312674d2c" Jul 05 19:34:24.609070 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:34:24.609043 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5c847dcfc4-wpgzd" event={"ID":"f00bb4f2-e3e7-48e5-82b4-ada41ed8cd2f","Type":"ContainerStarted","Data":"8faef00eea836416559d24b7417dffe16a6da57eaaaec5262304daf7e64d1692"} Jul 05 19:34:24.611193 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:34:24.611164 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-28jcd" event={"ID":"f568b2ea-4b26-4337-8500-6a5daf5c7579","Type":"ContainerStarted","Data":"e8621a4eddc77b45fc7e7fa4ea9b8dc6f902ba99beffccc5cfd8138063d40dad"} Jul 05 19:34:24.613253 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:34:24.613227 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-zg7lw" event={"ID":"97203db6-d938-48a9-834a-81a92eaae053","Type":"ContainerStarted","Data":"cadb29cb603de8ad46cb0c8c8edcc040398dd568138b94a14bec8157b3d9893e"} Jul 05 19:34:24.616597 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:34:24.616571 2572 scope.go:117] "RemoveContainer" containerID="9ebd986503f213226c98cca9605519f75bf34c8b05a65441101825c312674d2c" Jul 05 19:34:24.616912 ip-10-0-133-7 kubenswrapper[2572]: E0705 19:34:24.616885 2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9ebd986503f213226c98cca9605519f75bf34c8b05a65441101825c312674d2c\": container with ID starting with 9ebd986503f213226c98cca9605519f75bf34c8b05a65441101825c312674d2c not found: ID does not exist" containerID="9ebd986503f213226c98cca9605519f75bf34c8b05a65441101825c312674d2c" Jul 05 19:34:24.616988 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:34:24.616926 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9ebd986503f213226c98cca9605519f75bf34c8b05a65441101825c312674d2c"} err="failed to get container status \"9ebd986503f213226c98cca9605519f75bf34c8b05a65441101825c312674d2c\": rpc error: code = NotFound desc = could not find container \"9ebd986503f213226c98cca9605519f75bf34c8b05a65441101825c312674d2c\": container with ID starting with 9ebd986503f213226c98cca9605519f75bf34c8b05a65441101825c312674d2c not found: ID does not exist" Jul 05 19:34:24.641893 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:34:24.641864 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-7fb894c589-5k8cr"] Jul 05 19:34:24.648323 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:34:24.648289 2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-7fb894c589-5k8cr"] Jul 05 19:34:24.966493 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:34:24.966454 2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3fff4b0f-7be8-4dc8-811d-9971cafc6810" path="/var/lib/kubelet/pods/3fff4b0f-7be8-4dc8-811d-9971cafc6810/volumes" Jul 05 19:35:15.971899 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:35:15.971866 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-78cf6ddc84-cxd6m"] Jul 05 19:35:15.972375 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:35:15.972187 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3fff4b0f-7be8-4dc8-811d-9971cafc6810" containerName="registry" Jul 05 19:35:15.972375 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:35:15.972200 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="3fff4b0f-7be8-4dc8-811d-9971cafc6810" containerName="registry" Jul 05 19:35:15.972375 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:35:15.972249 2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="3fff4b0f-7be8-4dc8-811d-9971cafc6810" containerName="registry" Jul 05 19:35:15.975634 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:35:15.975616 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-78cf6ddc84-cxd6m" Jul 05 19:35:15.978234 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:35:15.978207 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\"" Jul 05 19:35:15.978380 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:35:15.978278 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-f2jff\"" Jul 05 19:35:15.978380 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:35:15.978316 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\"" Jul 05 19:35:15.978380 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:35:15.978321 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\"" Jul 05 19:35:15.978380 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:35:15.978317 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\"" Jul 05 19:35:15.978667 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:35:15.978652 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\"" Jul 05 19:35:15.981967 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:35:15.981929 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/22cae53d-beb4-40fb-871a-d8444dd2c5cd-telemeter-client-tls\") pod \"telemeter-client-78cf6ddc84-cxd6m\" (UID: \"22cae53d-beb4-40fb-871a-d8444dd2c5cd\") " pod="openshift-monitoring/telemeter-client-78cf6ddc84-cxd6m" Jul 05 19:35:15.982084 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:35:15.981999 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/22cae53d-beb4-40fb-871a-d8444dd2c5cd-telemeter-trusted-ca-bundle\") pod \"telemeter-client-78cf6ddc84-cxd6m\" (UID: \"22cae53d-beb4-40fb-871a-d8444dd2c5cd\") " pod="openshift-monitoring/telemeter-client-78cf6ddc84-cxd6m" Jul 05 19:35:15.982084 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:35:15.982036 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/22cae53d-beb4-40fb-871a-d8444dd2c5cd-secret-telemeter-client\") pod \"telemeter-client-78cf6ddc84-cxd6m\" (UID: \"22cae53d-beb4-40fb-871a-d8444dd2c5cd\") " pod="openshift-monitoring/telemeter-client-78cf6ddc84-cxd6m" Jul 05 19:35:15.982197 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:35:15.982100 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/22cae53d-beb4-40fb-871a-d8444dd2c5cd-metrics-client-ca\") pod \"telemeter-client-78cf6ddc84-cxd6m\" (UID: \"22cae53d-beb4-40fb-871a-d8444dd2c5cd\") " pod="openshift-monitoring/telemeter-client-78cf6ddc84-cxd6m" Jul 05 19:35:15.982251 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:35:15.982222 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/22cae53d-beb4-40fb-871a-d8444dd2c5cd-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-78cf6ddc84-cxd6m\" (UID: \"22cae53d-beb4-40fb-871a-d8444dd2c5cd\") " pod="openshift-monitoring/telemeter-client-78cf6ddc84-cxd6m" Jul 05 19:35:15.982339 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:35:15.982316 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/22cae53d-beb4-40fb-871a-d8444dd2c5cd-serving-certs-ca-bundle\") pod \"telemeter-client-78cf6ddc84-cxd6m\" (UID: \"22cae53d-beb4-40fb-871a-d8444dd2c5cd\") " pod="openshift-monitoring/telemeter-client-78cf6ddc84-cxd6m" Jul 05 19:35:15.982877 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:35:15.982507 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/22cae53d-beb4-40fb-871a-d8444dd2c5cd-federate-client-tls\") pod \"telemeter-client-78cf6ddc84-cxd6m\" (UID: \"22cae53d-beb4-40fb-871a-d8444dd2c5cd\") " pod="openshift-monitoring/telemeter-client-78cf6ddc84-cxd6m" Jul 05 19:35:15.982877 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:35:15.982544 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-twqfz\" (UniqueName: \"kubernetes.io/projected/22cae53d-beb4-40fb-871a-d8444dd2c5cd-kube-api-access-twqfz\") pod \"telemeter-client-78cf6ddc84-cxd6m\" (UID: \"22cae53d-beb4-40fb-871a-d8444dd2c5cd\") " pod="openshift-monitoring/telemeter-client-78cf6ddc84-cxd6m" Jul 05 19:35:15.982877 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:35:15.982710 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\"" Jul 05 19:35:15.988733 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:35:15.988703 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-78cf6ddc84-cxd6m"] Jul 05 19:35:16.083343 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:35:16.083302 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/22cae53d-beb4-40fb-871a-d8444dd2c5cd-secret-telemeter-client\") pod \"telemeter-client-78cf6ddc84-cxd6m\" (UID: \"22cae53d-beb4-40fb-871a-d8444dd2c5cd\") " pod="openshift-monitoring/telemeter-client-78cf6ddc84-cxd6m" Jul 05 19:35:16.083343 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:35:16.083347 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/22cae53d-beb4-40fb-871a-d8444dd2c5cd-metrics-client-ca\") pod \"telemeter-client-78cf6ddc84-cxd6m\" (UID: \"22cae53d-beb4-40fb-871a-d8444dd2c5cd\") " pod="openshift-monitoring/telemeter-client-78cf6ddc84-cxd6m" Jul 05 19:35:16.083596 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:35:16.083378 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/22cae53d-beb4-40fb-871a-d8444dd2c5cd-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-78cf6ddc84-cxd6m\" (UID: \"22cae53d-beb4-40fb-871a-d8444dd2c5cd\") " pod="openshift-monitoring/telemeter-client-78cf6ddc84-cxd6m" Jul 05 19:35:16.083596 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:35:16.083406 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/22cae53d-beb4-40fb-871a-d8444dd2c5cd-serving-certs-ca-bundle\") pod \"telemeter-client-78cf6ddc84-cxd6m\" (UID: \"22cae53d-beb4-40fb-871a-d8444dd2c5cd\") " pod="openshift-monitoring/telemeter-client-78cf6ddc84-cxd6m" Jul 05 19:35:16.083596 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:35:16.083427 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/22cae53d-beb4-40fb-871a-d8444dd2c5cd-federate-client-tls\") pod \"telemeter-client-78cf6ddc84-cxd6m\" (UID: \"22cae53d-beb4-40fb-871a-d8444dd2c5cd\") " pod="openshift-monitoring/telemeter-client-78cf6ddc84-cxd6m" Jul 05 19:35:16.083596 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:35:16.083442 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-twqfz\" (UniqueName: \"kubernetes.io/projected/22cae53d-beb4-40fb-871a-d8444dd2c5cd-kube-api-access-twqfz\") pod \"telemeter-client-78cf6ddc84-cxd6m\" (UID: \"22cae53d-beb4-40fb-871a-d8444dd2c5cd\") " pod="openshift-monitoring/telemeter-client-78cf6ddc84-cxd6m" Jul 05 19:35:16.083596 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:35:16.083465 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/22cae53d-beb4-40fb-871a-d8444dd2c5cd-telemeter-client-tls\") pod \"telemeter-client-78cf6ddc84-cxd6m\" (UID: \"22cae53d-beb4-40fb-871a-d8444dd2c5cd\") " pod="openshift-monitoring/telemeter-client-78cf6ddc84-cxd6m" Jul 05 19:35:16.083596 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:35:16.083480 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/22cae53d-beb4-40fb-871a-d8444dd2c5cd-telemeter-trusted-ca-bundle\") pod \"telemeter-client-78cf6ddc84-cxd6m\" (UID: \"22cae53d-beb4-40fb-871a-d8444dd2c5cd\") " pod="openshift-monitoring/telemeter-client-78cf6ddc84-cxd6m" Jul 05 19:35:16.084441 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:35:16.084405 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/22cae53d-beb4-40fb-871a-d8444dd2c5cd-metrics-client-ca\") pod \"telemeter-client-78cf6ddc84-cxd6m\" (UID: \"22cae53d-beb4-40fb-871a-d8444dd2c5cd\") " pod="openshift-monitoring/telemeter-client-78cf6ddc84-cxd6m" Jul 05 19:35:16.084583 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:35:16.084484 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/22cae53d-beb4-40fb-871a-d8444dd2c5cd-serving-certs-ca-bundle\") pod \"telemeter-client-78cf6ddc84-cxd6m\" (UID: \"22cae53d-beb4-40fb-871a-d8444dd2c5cd\") " pod="openshift-monitoring/telemeter-client-78cf6ddc84-cxd6m" Jul 05 19:35:16.084699 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:35:16.084676 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/22cae53d-beb4-40fb-871a-d8444dd2c5cd-telemeter-trusted-ca-bundle\") pod \"telemeter-client-78cf6ddc84-cxd6m\" (UID: \"22cae53d-beb4-40fb-871a-d8444dd2c5cd\") " pod="openshift-monitoring/telemeter-client-78cf6ddc84-cxd6m" Jul 05 19:35:16.086083 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:35:16.086060 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/22cae53d-beb4-40fb-871a-d8444dd2c5cd-secret-telemeter-client\") pod \"telemeter-client-78cf6ddc84-cxd6m\" (UID: \"22cae53d-beb4-40fb-871a-d8444dd2c5cd\") " pod="openshift-monitoring/telemeter-client-78cf6ddc84-cxd6m" Jul 05 19:35:16.086227 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:35:16.086204 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/22cae53d-beb4-40fb-871a-d8444dd2c5cd-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-78cf6ddc84-cxd6m\" (UID: \"22cae53d-beb4-40fb-871a-d8444dd2c5cd\") " pod="openshift-monitoring/telemeter-client-78cf6ddc84-cxd6m" Jul 05 19:35:16.086270 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:35:16.086231 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/22cae53d-beb4-40fb-871a-d8444dd2c5cd-telemeter-client-tls\") pod \"telemeter-client-78cf6ddc84-cxd6m\" (UID: \"22cae53d-beb4-40fb-871a-d8444dd2c5cd\") " pod="openshift-monitoring/telemeter-client-78cf6ddc84-cxd6m" Jul 05 19:35:16.086321 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:35:16.086302 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/22cae53d-beb4-40fb-871a-d8444dd2c5cd-federate-client-tls\") pod \"telemeter-client-78cf6ddc84-cxd6m\" (UID: \"22cae53d-beb4-40fb-871a-d8444dd2c5cd\") " pod="openshift-monitoring/telemeter-client-78cf6ddc84-cxd6m" Jul 05 19:35:16.092247 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:35:16.092225 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-twqfz\" (UniqueName: \"kubernetes.io/projected/22cae53d-beb4-40fb-871a-d8444dd2c5cd-kube-api-access-twqfz\") pod \"telemeter-client-78cf6ddc84-cxd6m\" (UID: \"22cae53d-beb4-40fb-871a-d8444dd2c5cd\") " pod="openshift-monitoring/telemeter-client-78cf6ddc84-cxd6m" Jul 05 19:35:16.285904 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:35:16.285808 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-78cf6ddc84-cxd6m" Jul 05 19:35:16.422429 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:35:16.422395 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-78cf6ddc84-cxd6m"] Jul 05 19:35:16.425916 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:35:16.425890 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod22cae53d_beb4_40fb_871a_d8444dd2c5cd.slice/crio-5798df1da3e3879f730469ee32748a009c0c53ca66734f7028a910d1fd13d558 WatchSource:0}: Error finding container 5798df1da3e3879f730469ee32748a009c0c53ca66734f7028a910d1fd13d558: Status 404 returned error can't find the container with id 5798df1da3e3879f730469ee32748a009c0c53ca66734f7028a910d1fd13d558 Jul 05 19:35:16.801722 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:35:16.801686 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-78cf6ddc84-cxd6m" event={"ID":"22cae53d-beb4-40fb-871a-d8444dd2c5cd","Type":"ContainerStarted","Data":"5798df1da3e3879f730469ee32748a009c0c53ca66734f7028a910d1fd13d558"} Jul 05 19:35:18.810236 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:35:18.810200 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-78cf6ddc84-cxd6m" event={"ID":"22cae53d-beb4-40fb-871a-d8444dd2c5cd","Type":"ContainerStarted","Data":"7895e26c2ef48ab948efdf7887ca49efc6b81d82c1d537c49b83df9b760312af"} Jul 05 19:35:19.816196 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:35:19.816095 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-78cf6ddc84-cxd6m" event={"ID":"22cae53d-beb4-40fb-871a-d8444dd2c5cd","Type":"ContainerStarted","Data":"b1a27798e56195dc8e4ab4fc6d8272acda7f4812f04f94a1a5fd77911edc5c2a"} Jul 05 19:35:19.816196 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:35:19.816164 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-78cf6ddc84-cxd6m" event={"ID":"22cae53d-beb4-40fb-871a-d8444dd2c5cd","Type":"ContainerStarted","Data":"64615bac7e70cf8664e17d879c85ba7df333295c338a718e020bfb3b92a6a576"} Jul 05 19:35:19.839824 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:35:19.839776 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-78cf6ddc84-cxd6m" podStartSLOduration=1.8697036 podStartE2EDuration="4.839760678s" totalImagesPullingTime="2.970057078s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-05 19:35:15 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 19:35:19.83857143 +0000 UTC m=+173.237918897" watchObservedRunningTime="2026-07-05 19:35:19.839760678 +0000 UTC m=+173.239108145" Jul 05 19:37:25.499485 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:37:25.499446 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6cf5f4cd98-qr2jc"] Jul 05 19:37:25.502812 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:37:25.502789 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6cf5f4cd98-qr2jc" Jul 05 19:37:25.505120 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:37:25.505096 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Jul 05 19:37:25.505264 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:37:25.505131 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Jul 05 19:37:25.505368 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:37:25.505355 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Jul 05 19:37:25.506302 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:37:25.506286 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\"" Jul 05 19:37:25.510287 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:37:25.510269 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6cf5f4cd98-qr2jc"] Jul 05 19:37:25.614240 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:37:25.614207 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-858754f95d-h895m"] Jul 05 19:37:25.617274 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:37:25.617258 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-858754f95d-h895m" Jul 05 19:37:25.619612 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:37:25.619597 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\"" Jul 05 19:37:25.627259 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:37:25.627239 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-858754f95d-h895m"] Jul 05 19:37:25.633106 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:37:25.633084 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-62tjx\" (UniqueName: \"kubernetes.io/projected/f47b2444-541d-4f68-97aa-0c7d1481298a-kube-api-access-62tjx\") pod \"managed-serviceaccount-addon-agent-6cf5f4cd98-qr2jc\" (UID: \"f47b2444-541d-4f68-97aa-0c7d1481298a\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6cf5f4cd98-qr2jc" Jul 05 19:37:25.633208 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:37:25.633120 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/f47b2444-541d-4f68-97aa-0c7d1481298a-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-6cf5f4cd98-qr2jc\" (UID: \"f47b2444-541d-4f68-97aa-0c7d1481298a\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6cf5f4cd98-qr2jc" Jul 05 19:37:25.734030 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:37:25.733995 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/f47b2444-541d-4f68-97aa-0c7d1481298a-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-6cf5f4cd98-qr2jc\" (UID: \"f47b2444-541d-4f68-97aa-0c7d1481298a\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6cf5f4cd98-qr2jc" Jul 05 19:37:25.734189 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:37:25.734059 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4tz4v\" (UniqueName: \"kubernetes.io/projected/b7b3e20f-23f0-423b-9d61-b196882a0f99-kube-api-access-4tz4v\") pod \"klusterlet-addon-workmgr-858754f95d-h895m\" (UID: \"b7b3e20f-23f0-423b-9d61-b196882a0f99\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-858754f95d-h895m" Jul 05 19:37:25.734189 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:37:25.734128 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-62tjx\" (UniqueName: \"kubernetes.io/projected/f47b2444-541d-4f68-97aa-0c7d1481298a-kube-api-access-62tjx\") pod \"managed-serviceaccount-addon-agent-6cf5f4cd98-qr2jc\" (UID: \"f47b2444-541d-4f68-97aa-0c7d1481298a\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6cf5f4cd98-qr2jc" Jul 05 19:37:25.734189 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:37:25.734173 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b7b3e20f-23f0-423b-9d61-b196882a0f99-tmp\") pod \"klusterlet-addon-workmgr-858754f95d-h895m\" (UID: \"b7b3e20f-23f0-423b-9d61-b196882a0f99\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-858754f95d-h895m" Jul 05 19:37:25.734323 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:37:25.734207 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/b7b3e20f-23f0-423b-9d61-b196882a0f99-klusterlet-config\") pod \"klusterlet-addon-workmgr-858754f95d-h895m\" (UID: \"b7b3e20f-23f0-423b-9d61-b196882a0f99\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-858754f95d-h895m" Jul 05 19:37:25.736559 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:37:25.736539 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/f47b2444-541d-4f68-97aa-0c7d1481298a-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-6cf5f4cd98-qr2jc\" (UID: \"f47b2444-541d-4f68-97aa-0c7d1481298a\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6cf5f4cd98-qr2jc" Jul 05 19:37:25.741984 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:37:25.741964 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-62tjx\" (UniqueName: \"kubernetes.io/projected/f47b2444-541d-4f68-97aa-0c7d1481298a-kube-api-access-62tjx\") pod \"managed-serviceaccount-addon-agent-6cf5f4cd98-qr2jc\" (UID: \"f47b2444-541d-4f68-97aa-0c7d1481298a\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6cf5f4cd98-qr2jc" Jul 05 19:37:25.826165 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:37:25.826093 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6cf5f4cd98-qr2jc" Jul 05 19:37:25.835238 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:37:25.835214 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4tz4v\" (UniqueName: \"kubernetes.io/projected/b7b3e20f-23f0-423b-9d61-b196882a0f99-kube-api-access-4tz4v\") pod \"klusterlet-addon-workmgr-858754f95d-h895m\" (UID: \"b7b3e20f-23f0-423b-9d61-b196882a0f99\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-858754f95d-h895m" Jul 05 19:37:25.835350 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:37:25.835260 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b7b3e20f-23f0-423b-9d61-b196882a0f99-tmp\") pod \"klusterlet-addon-workmgr-858754f95d-h895m\" (UID: \"b7b3e20f-23f0-423b-9d61-b196882a0f99\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-858754f95d-h895m" Jul 05 19:37:25.835350 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:37:25.835282 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/b7b3e20f-23f0-423b-9d61-b196882a0f99-klusterlet-config\") pod \"klusterlet-addon-workmgr-858754f95d-h895m\" (UID: \"b7b3e20f-23f0-423b-9d61-b196882a0f99\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-858754f95d-h895m" Jul 05 19:37:25.835649 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:37:25.835628 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b7b3e20f-23f0-423b-9d61-b196882a0f99-tmp\") pod \"klusterlet-addon-workmgr-858754f95d-h895m\" (UID: \"b7b3e20f-23f0-423b-9d61-b196882a0f99\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-858754f95d-h895m" Jul 05 19:37:25.837661 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:37:25.837638 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/b7b3e20f-23f0-423b-9d61-b196882a0f99-klusterlet-config\") pod \"klusterlet-addon-workmgr-858754f95d-h895m\" (UID: \"b7b3e20f-23f0-423b-9d61-b196882a0f99\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-858754f95d-h895m" Jul 05 19:37:25.843321 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:37:25.843292 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4tz4v\" (UniqueName: \"kubernetes.io/projected/b7b3e20f-23f0-423b-9d61-b196882a0f99-kube-api-access-4tz4v\") pod \"klusterlet-addon-workmgr-858754f95d-h895m\" (UID: \"b7b3e20f-23f0-423b-9d61-b196882a0f99\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-858754f95d-h895m" Jul 05 19:37:25.926346 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:37:25.926316 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-858754f95d-h895m" Jul 05 19:37:25.958542 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:37:25.958506 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6cf5f4cd98-qr2jc"] Jul 05 19:37:25.962674 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:37:25.962640 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf47b2444_541d_4f68_97aa_0c7d1481298a.slice/crio-29445fca2c7771fc41f1618486ac6e839aebc1f48d81b574281b807c92ac5bdf WatchSource:0}: Error finding container 29445fca2c7771fc41f1618486ac6e839aebc1f48d81b574281b807c92ac5bdf: Status 404 returned error can't find the container with id 29445fca2c7771fc41f1618486ac6e839aebc1f48d81b574281b807c92ac5bdf Jul 05 19:37:26.059194 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:37:26.059156 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-858754f95d-h895m"] Jul 05 19:37:26.062879 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:37:26.062842 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb7b3e20f_23f0_423b_9d61_b196882a0f99.slice/crio-6b9592aa3d16aadad3569a7364ed45781a2c150cdd7b2e05946d62474f622ed8 WatchSource:0}: Error finding container 6b9592aa3d16aadad3569a7364ed45781a2c150cdd7b2e05946d62474f622ed8: Status 404 returned error can't find the container with id 6b9592aa3d16aadad3569a7364ed45781a2c150cdd7b2e05946d62474f622ed8 Jul 05 19:37:26.257734 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:37:26.257694 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-858754f95d-h895m" event={"ID":"b7b3e20f-23f0-423b-9d61-b196882a0f99","Type":"ContainerStarted","Data":"6b9592aa3d16aadad3569a7364ed45781a2c150cdd7b2e05946d62474f622ed8"} Jul 05 19:37:26.258765 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:37:26.258741 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6cf5f4cd98-qr2jc" event={"ID":"f47b2444-541d-4f68-97aa-0c7d1481298a","Type":"ContainerStarted","Data":"29445fca2c7771fc41f1618486ac6e839aebc1f48d81b574281b807c92ac5bdf"} Jul 05 19:37:26.885351 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:37:26.885320 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-plqpb_ac3142e8-817c-493b-b998-41ff8f4680f9/console-operator/1.log" Jul 05 19:37:26.888048 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:37:26.887973 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-plqpb_ac3142e8-817c-493b-b998-41ff8f4680f9/console-operator/1.log" Jul 05 19:37:26.905180 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:37:26.905154 2572 kubelet.go:1648] "Image garbage collection succeeded" Jul 05 19:37:30.279901 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:37:30.279862 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-858754f95d-h895m" event={"ID":"b7b3e20f-23f0-423b-9d61-b196882a0f99","Type":"ContainerStarted","Data":"cf4c102e2e15e86fccd34275bea1b49a4ad7aeae6752db576f9412d275f196b7"} Jul 05 19:37:30.280442 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:37:30.280080 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-858754f95d-h895m" Jul 05 19:37:30.281827 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:37:30.281801 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6cf5f4cd98-qr2jc" event={"ID":"f47b2444-541d-4f68-97aa-0c7d1481298a","Type":"ContainerStarted","Data":"fb49fb4c1494555cbf50098fedbd21f66536d965e7e2ac6b3506448443abe06e"} Jul 05 19:37:30.282012 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:37:30.281896 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-858754f95d-h895m" Jul 05 19:37:30.296966 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:37:30.296895 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-858754f95d-h895m" podStartSLOduration=1.217232446 podStartE2EDuration="5.296877268s" totalImagesPullingTime="4.079644822s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-05 19:37:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 19:37:30.295222473 +0000 UTC m=+303.694569960" watchObservedRunningTime="2026-07-05 19:37:30.296877268 +0000 UTC m=+303.696224734" Jul 05 19:37:30.323325 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:37:30.323276 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6cf5f4cd98-qr2jc" podStartSLOduration=1.156043582 podStartE2EDuration="5.323259409s" totalImagesPullingTime="4.167215827s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-05 19:37:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 19:37:30.322572181 +0000 UTC m=+303.721919659" watchObservedRunningTime="2026-07-05 19:37:30.323259409 +0000 UTC m=+303.722606913" Jul 05 19:37:48.004068 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:37:48.004031 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-xgj99"] Jul 05 19:37:48.051996 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:37:48.051928 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-xgj99"] Jul 05 19:37:48.052175 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:37:48.052047 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-xgj99" Jul 05 19:37:48.054832 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:37:48.054811 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\"" Jul 05 19:37:48.054940 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:37:48.054811 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\"" Jul 05 19:37:48.054940 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:37:48.054836 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-kvgsg\"" Jul 05 19:37:48.220112 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:37:48.220068 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8756194a-353b-4770-8c0d-1925d19aa34b-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-xgj99\" (UID: \"8756194a-353b-4770-8c0d-1925d19aa34b\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-xgj99" Jul 05 19:37:48.220301 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:37:48.220126 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bqjcl\" (UniqueName: \"kubernetes.io/projected/8756194a-353b-4770-8c0d-1925d19aa34b-kube-api-access-bqjcl\") pod \"cert-manager-operator-controller-manager-55c444bf86-xgj99\" (UID: \"8756194a-353b-4770-8c0d-1925d19aa34b\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-xgj99" Jul 05 19:37:48.321499 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:37:48.321406 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8756194a-353b-4770-8c0d-1925d19aa34b-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-xgj99\" (UID: \"8756194a-353b-4770-8c0d-1925d19aa34b\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-xgj99" Jul 05 19:37:48.321499 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:37:48.321450 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bqjcl\" (UniqueName: \"kubernetes.io/projected/8756194a-353b-4770-8c0d-1925d19aa34b-kube-api-access-bqjcl\") pod \"cert-manager-operator-controller-manager-55c444bf86-xgj99\" (UID: \"8756194a-353b-4770-8c0d-1925d19aa34b\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-xgj99" Jul 05 19:37:48.321798 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:37:48.321779 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8756194a-353b-4770-8c0d-1925d19aa34b-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-xgj99\" (UID: \"8756194a-353b-4770-8c0d-1925d19aa34b\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-xgj99" Jul 05 19:37:48.331541 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:37:48.331519 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bqjcl\" (UniqueName: \"kubernetes.io/projected/8756194a-353b-4770-8c0d-1925d19aa34b-kube-api-access-bqjcl\") pod \"cert-manager-operator-controller-manager-55c444bf86-xgj99\" (UID: \"8756194a-353b-4770-8c0d-1925d19aa34b\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-xgj99" Jul 05 19:37:48.361172 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:37:48.361134 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-xgj99" Jul 05 19:37:48.517625 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:37:48.517591 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-xgj99"] Jul 05 19:37:48.521606 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:37:48.521574 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8756194a_353b_4770_8c0d_1925d19aa34b.slice/crio-a8d621e5c7569de9d6d303da811f62762a04dcc9181a2fa9424d77ee8519a5cd WatchSource:0}: Error finding container a8d621e5c7569de9d6d303da811f62762a04dcc9181a2fa9424d77ee8519a5cd: Status 404 returned error can't find the container with id a8d621e5c7569de9d6d303da811f62762a04dcc9181a2fa9424d77ee8519a5cd Jul 05 19:37:48.524306 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:37:48.524288 2572 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 05 19:37:49.356396 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:37:49.356356 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-xgj99" event={"ID":"8756194a-353b-4770-8c0d-1925d19aa34b","Type":"ContainerStarted","Data":"a8d621e5c7569de9d6d303da811f62762a04dcc9181a2fa9424d77ee8519a5cd"} Jul 05 19:37:51.366299 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:37:51.366266 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-xgj99" event={"ID":"8756194a-353b-4770-8c0d-1925d19aa34b","Type":"ContainerStarted","Data":"496668cfd367e4a760d6603d99dbba24d5b666078a7291a1f014033b6817456f"} Jul 05 19:37:51.387234 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:37:51.387133 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-xgj99" podStartSLOduration=1.789199861 podStartE2EDuration="4.387116379s" totalImagesPullingTime="2.597916518s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-05 19:37:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 19:37:51.386062342 +0000 UTC m=+324.785409810" watchObservedRunningTime="2026-07-05 19:37:51.387116379 +0000 UTC m=+324.786463845" Jul 05 19:38:04.008265 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:38:04.008232 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-55b4d954d5-5b2xr"] Jul 05 19:38:04.011632 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:38:04.011615 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-5b2xr" Jul 05 19:38:04.014051 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:38:04.014028 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Jul 05 19:38:04.014313 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:38:04.014294 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-4fxgm\"" Jul 05 19:38:04.015221 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:38:04.015208 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Jul 05 19:38:04.020038 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:38:04.020017 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-5b2xr"] Jul 05 19:38:04.046200 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:38:04.046168 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d50ba18f-e12e-4a6e-9532-2619f62e2c5e-bound-sa-token\") pod \"cert-manager-55b4d954d5-5b2xr\" (UID: \"d50ba18f-e12e-4a6e-9532-2619f62e2c5e\") " pod="cert-manager/cert-manager-55b4d954d5-5b2xr" Jul 05 19:38:04.046382 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:38:04.046255 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-87zg5\" (UniqueName: \"kubernetes.io/projected/d50ba18f-e12e-4a6e-9532-2619f62e2c5e-kube-api-access-87zg5\") pod \"cert-manager-55b4d954d5-5b2xr\" (UID: \"d50ba18f-e12e-4a6e-9532-2619f62e2c5e\") " pod="cert-manager/cert-manager-55b4d954d5-5b2xr" Jul 05 19:38:04.146739 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:38:04.146698 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-87zg5\" (UniqueName: \"kubernetes.io/projected/d50ba18f-e12e-4a6e-9532-2619f62e2c5e-kube-api-access-87zg5\") pod \"cert-manager-55b4d954d5-5b2xr\" (UID: \"d50ba18f-e12e-4a6e-9532-2619f62e2c5e\") " pod="cert-manager/cert-manager-55b4d954d5-5b2xr" Jul 05 19:38:04.146918 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:38:04.146775 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d50ba18f-e12e-4a6e-9532-2619f62e2c5e-bound-sa-token\") pod \"cert-manager-55b4d954d5-5b2xr\" (UID: \"d50ba18f-e12e-4a6e-9532-2619f62e2c5e\") " pod="cert-manager/cert-manager-55b4d954d5-5b2xr" Jul 05 19:38:04.154531 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:38:04.154501 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d50ba18f-e12e-4a6e-9532-2619f62e2c5e-bound-sa-token\") pod \"cert-manager-55b4d954d5-5b2xr\" (UID: \"d50ba18f-e12e-4a6e-9532-2619f62e2c5e\") " pod="cert-manager/cert-manager-55b4d954d5-5b2xr" Jul 05 19:38:04.154674 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:38:04.154602 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-87zg5\" (UniqueName: \"kubernetes.io/projected/d50ba18f-e12e-4a6e-9532-2619f62e2c5e-kube-api-access-87zg5\") pod \"cert-manager-55b4d954d5-5b2xr\" (UID: \"d50ba18f-e12e-4a6e-9532-2619f62e2c5e\") " pod="cert-manager/cert-manager-55b4d954d5-5b2xr" Jul 05 19:38:04.322233 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:38:04.322151 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-5b2xr" Jul 05 19:38:04.454528 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:38:04.454427 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-5b2xr"] Jul 05 19:38:04.462141 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:38:04.462109 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd50ba18f_e12e_4a6e_9532_2619f62e2c5e.slice/crio-48b405173ee01e02da1bf3ddd2dc96221b8c455b2d7d3841649b6be93b277af8 WatchSource:0}: Error finding container 48b405173ee01e02da1bf3ddd2dc96221b8c455b2d7d3841649b6be93b277af8: Status 404 returned error can't find the container with id 48b405173ee01e02da1bf3ddd2dc96221b8c455b2d7d3841649b6be93b277af8 Jul 05 19:38:05.425739 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:38:05.425691 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-5b2xr" event={"ID":"d50ba18f-e12e-4a6e-9532-2619f62e2c5e","Type":"ContainerStarted","Data":"48b405173ee01e02da1bf3ddd2dc96221b8c455b2d7d3841649b6be93b277af8"} Jul 05 19:38:05.870350 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:38:05.870318 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-lkbz9"] Jul 05 19:38:05.873594 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:38:05.873567 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-lkbz9" Jul 05 19:38:05.876108 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:38:05.876046 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jul 05 19:38:05.876756 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:38:05.876732 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-4qbck\"" Jul 05 19:38:05.876756 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:38:05.876739 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jul 05 19:38:05.884175 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:38:05.884144 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-lkbz9"] Jul 05 19:38:05.958008 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:38:05.957965 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/db85611d-d3f4-4c8a-b55b-69641448cf98-tmp\") pod \"openshift-lws-operator-fd8ccff4c-lkbz9\" (UID: \"db85611d-d3f4-4c8a-b55b-69641448cf98\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-lkbz9" Jul 05 19:38:05.958189 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:38:05.958058 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d6trd\" (UniqueName: \"kubernetes.io/projected/db85611d-d3f4-4c8a-b55b-69641448cf98-kube-api-access-d6trd\") pod \"openshift-lws-operator-fd8ccff4c-lkbz9\" (UID: \"db85611d-d3f4-4c8a-b55b-69641448cf98\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-lkbz9" Jul 05 19:38:06.058840 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:38:06.058796 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/db85611d-d3f4-4c8a-b55b-69641448cf98-tmp\") pod \"openshift-lws-operator-fd8ccff4c-lkbz9\" (UID: \"db85611d-d3f4-4c8a-b55b-69641448cf98\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-lkbz9" Jul 05 19:38:06.059038 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:38:06.058911 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d6trd\" (UniqueName: \"kubernetes.io/projected/db85611d-d3f4-4c8a-b55b-69641448cf98-kube-api-access-d6trd\") pod \"openshift-lws-operator-fd8ccff4c-lkbz9\" (UID: \"db85611d-d3f4-4c8a-b55b-69641448cf98\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-lkbz9" Jul 05 19:38:06.059338 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:38:06.059304 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/db85611d-d3f4-4c8a-b55b-69641448cf98-tmp\") pod \"openshift-lws-operator-fd8ccff4c-lkbz9\" (UID: \"db85611d-d3f4-4c8a-b55b-69641448cf98\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-lkbz9" Jul 05 19:38:06.067894 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:38:06.067862 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d6trd\" (UniqueName: \"kubernetes.io/projected/db85611d-d3f4-4c8a-b55b-69641448cf98-kube-api-access-d6trd\") pod \"openshift-lws-operator-fd8ccff4c-lkbz9\" (UID: \"db85611d-d3f4-4c8a-b55b-69641448cf98\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-lkbz9" Jul 05 19:38:06.185562 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:38:06.185464 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-lkbz9" Jul 05 19:38:06.864750 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:38:06.864722 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-lkbz9"] Jul 05 19:38:06.867637 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:38:06.867596 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poddb85611d_d3f4_4c8a_b55b_69641448cf98.slice/crio-5d95e310d8599006c71d5dc4f4622e615af465ec0963308a2549ebc442ebf0b5 WatchSource:0}: Error finding container 5d95e310d8599006c71d5dc4f4622e615af465ec0963308a2549ebc442ebf0b5: Status 404 returned error can't find the container with id 5d95e310d8599006c71d5dc4f4622e615af465ec0963308a2549ebc442ebf0b5 Jul 05 19:38:07.436814 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:38:07.436782 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-5b2xr" event={"ID":"d50ba18f-e12e-4a6e-9532-2619f62e2c5e","Type":"ContainerStarted","Data":"eee42e4deed92d74de744a1c1b44a6d4352c74abd128f6db451560342732c801"} Jul 05 19:38:07.438163 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:38:07.438136 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-lkbz9" event={"ID":"db85611d-d3f4-4c8a-b55b-69641448cf98","Type":"ContainerStarted","Data":"5d95e310d8599006c71d5dc4f4622e615af465ec0963308a2549ebc442ebf0b5"} Jul 05 19:38:07.452969 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:38:07.452907 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-55b4d954d5-5b2xr" podStartSLOduration=2.120770298 podStartE2EDuration="4.452893763s" totalImagesPullingTime="2.332123465s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-05 19:38:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 19:38:07.451855822 +0000 UTC m=+340.851203291" watchObservedRunningTime="2026-07-05 19:38:07.452893763 +0000 UTC m=+340.852241230" Jul 05 19:38:09.448533 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:38:09.448499 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-lkbz9" event={"ID":"db85611d-d3f4-4c8a-b55b-69641448cf98","Type":"ContainerStarted","Data":"db6016c6ca12347c3f9afbcc8f5f297a998658c30391c1d05d8c96073c12336d"} Jul 05 19:38:09.464041 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:38:09.463984 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-lkbz9" podStartSLOduration=2.019247579 podStartE2EDuration="4.463968218s" totalImagesPullingTime="2.444720639s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-05 19:38:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 19:38:09.462034401 +0000 UTC m=+342.861381975" watchObservedRunningTime="2026-07-05 19:38:09.463968218 +0000 UTC m=+342.863315684" Jul 05 19:38:25.873184 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:38:25.873111 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-547755b757-npd7k"] Jul 05 19:38:25.879878 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:38:25.879855 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-547755b757-npd7k" Jul 05 19:38:25.882930 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:38:25.882907 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jul 05 19:38:25.883161 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:38:25.883138 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jul 05 19:38:25.883161 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:38:25.883148 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jul 05 19:38:25.883315 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:38:25.883246 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jul 05 19:38:25.886527 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:38:25.886505 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-gl5hl\"" Jul 05 19:38:25.896897 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:38:25.896871 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-547755b757-npd7k"] Jul 05 19:38:25.906555 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:38:25.906528 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/034248b4-3532-46d6-a19e-626b86062099-tmp\") pod \"opendatahub-operator-controller-manager-547755b757-npd7k\" (UID: \"034248b4-3532-46d6-a19e-626b86062099\") " pod="opendatahub/opendatahub-operator-controller-manager-547755b757-npd7k" Jul 05 19:38:25.906680 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:38:25.906587 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/034248b4-3532-46d6-a19e-626b86062099-manifests\") pod \"opendatahub-operator-controller-manager-547755b757-npd7k\" (UID: \"034248b4-3532-46d6-a19e-626b86062099\") " pod="opendatahub/opendatahub-operator-controller-manager-547755b757-npd7k" Jul 05 19:38:25.906680 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:38:25.906654 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/034248b4-3532-46d6-a19e-626b86062099-apiservice-cert\") pod \"opendatahub-operator-controller-manager-547755b757-npd7k\" (UID: \"034248b4-3532-46d6-a19e-626b86062099\") " pod="opendatahub/opendatahub-operator-controller-manager-547755b757-npd7k" Jul 05 19:38:25.906680 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:38:25.906675 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p9x95\" (UniqueName: \"kubernetes.io/projected/034248b4-3532-46d6-a19e-626b86062099-kube-api-access-p9x95\") pod \"opendatahub-operator-controller-manager-547755b757-npd7k\" (UID: \"034248b4-3532-46d6-a19e-626b86062099\") " pod="opendatahub/opendatahub-operator-controller-manager-547755b757-npd7k" Jul 05 19:38:25.906903 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:38:25.906695 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/034248b4-3532-46d6-a19e-626b86062099-webhook-cert\") pod \"opendatahub-operator-controller-manager-547755b757-npd7k\" (UID: \"034248b4-3532-46d6-a19e-626b86062099\") " pod="opendatahub/opendatahub-operator-controller-manager-547755b757-npd7k" Jul 05 19:38:26.008047 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:38:26.008013 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/034248b4-3532-46d6-a19e-626b86062099-apiservice-cert\") pod \"opendatahub-operator-controller-manager-547755b757-npd7k\" (UID: \"034248b4-3532-46d6-a19e-626b86062099\") " pod="opendatahub/opendatahub-operator-controller-manager-547755b757-npd7k" Jul 05 19:38:26.008047 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:38:26.008049 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p9x95\" (UniqueName: \"kubernetes.io/projected/034248b4-3532-46d6-a19e-626b86062099-kube-api-access-p9x95\") pod \"opendatahub-operator-controller-manager-547755b757-npd7k\" (UID: \"034248b4-3532-46d6-a19e-626b86062099\") " pod="opendatahub/opendatahub-operator-controller-manager-547755b757-npd7k" Jul 05 19:38:26.008258 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:38:26.008074 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/034248b4-3532-46d6-a19e-626b86062099-webhook-cert\") pod \"opendatahub-operator-controller-manager-547755b757-npd7k\" (UID: \"034248b4-3532-46d6-a19e-626b86062099\") " pod="opendatahub/opendatahub-operator-controller-manager-547755b757-npd7k" Jul 05 19:38:26.008299 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:38:26.008278 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/034248b4-3532-46d6-a19e-626b86062099-tmp\") pod \"opendatahub-operator-controller-manager-547755b757-npd7k\" (UID: \"034248b4-3532-46d6-a19e-626b86062099\") " pod="opendatahub/opendatahub-operator-controller-manager-547755b757-npd7k" Jul 05 19:38:26.008405 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:38:26.008383 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/034248b4-3532-46d6-a19e-626b86062099-manifests\") pod \"opendatahub-operator-controller-manager-547755b757-npd7k\" (UID: \"034248b4-3532-46d6-a19e-626b86062099\") " pod="opendatahub/opendatahub-operator-controller-manager-547755b757-npd7k" Jul 05 19:38:26.008781 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:38:26.008755 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/034248b4-3532-46d6-a19e-626b86062099-manifests\") pod \"opendatahub-operator-controller-manager-547755b757-npd7k\" (UID: \"034248b4-3532-46d6-a19e-626b86062099\") " pod="opendatahub/opendatahub-operator-controller-manager-547755b757-npd7k" Jul 05 19:38:26.010466 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:38:26.010434 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/034248b4-3532-46d6-a19e-626b86062099-tmp\") pod \"opendatahub-operator-controller-manager-547755b757-npd7k\" (UID: \"034248b4-3532-46d6-a19e-626b86062099\") " pod="opendatahub/opendatahub-operator-controller-manager-547755b757-npd7k" Jul 05 19:38:26.010627 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:38:26.010609 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/034248b4-3532-46d6-a19e-626b86062099-apiservice-cert\") pod \"opendatahub-operator-controller-manager-547755b757-npd7k\" (UID: \"034248b4-3532-46d6-a19e-626b86062099\") " pod="opendatahub/opendatahub-operator-controller-manager-547755b757-npd7k" Jul 05 19:38:26.010627 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:38:26.010617 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/034248b4-3532-46d6-a19e-626b86062099-webhook-cert\") pod \"opendatahub-operator-controller-manager-547755b757-npd7k\" (UID: \"034248b4-3532-46d6-a19e-626b86062099\") " pod="opendatahub/opendatahub-operator-controller-manager-547755b757-npd7k" Jul 05 19:38:26.016048 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:38:26.016025 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p9x95\" (UniqueName: \"kubernetes.io/projected/034248b4-3532-46d6-a19e-626b86062099-kube-api-access-p9x95\") pod \"opendatahub-operator-controller-manager-547755b757-npd7k\" (UID: \"034248b4-3532-46d6-a19e-626b86062099\") " pod="opendatahub/opendatahub-operator-controller-manager-547755b757-npd7k" Jul 05 19:38:26.189864 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:38:26.189773 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-547755b757-npd7k" Jul 05 19:38:26.348892 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:38:26.348867 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-547755b757-npd7k"] Jul 05 19:38:26.351684 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:38:26.351654 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod034248b4_3532_46d6_a19e_626b86062099.slice/crio-4211e172365601d6f09c76f379945e7e87035ca284a5035e483500411d44ae01 WatchSource:0}: Error finding container 4211e172365601d6f09c76f379945e7e87035ca284a5035e483500411d44ae01: Status 404 returned error can't find the container with id 4211e172365601d6f09c76f379945e7e87035ca284a5035e483500411d44ae01 Jul 05 19:38:26.518282 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:38:26.518250 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-547755b757-npd7k" event={"ID":"034248b4-3532-46d6-a19e-626b86062099","Type":"ContainerStarted","Data":"4211e172365601d6f09c76f379945e7e87035ca284a5035e483500411d44ae01"} Jul 05 19:38:29.535878 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:38:29.535789 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-547755b757-npd7k" event={"ID":"034248b4-3532-46d6-a19e-626b86062099","Type":"ContainerStarted","Data":"5fc672bb3914f333e3039660c0455a7f58ae33802cd00c61b22cd728dbba9156"} Jul 05 19:38:30.541674 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:38:30.541634 2572 generic.go:356] "Generic (PLEG): container finished" podID="034248b4-3532-46d6-a19e-626b86062099" containerID="5fc672bb3914f333e3039660c0455a7f58ae33802cd00c61b22cd728dbba9156" exitCode=0 Jul 05 19:38:30.542145 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:38:30.541707 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-547755b757-npd7k" event={"ID":"034248b4-3532-46d6-a19e-626b86062099","Type":"ContainerDied","Data":"5fc672bb3914f333e3039660c0455a7f58ae33802cd00c61b22cd728dbba9156"} Jul 05 19:38:31.550351 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:38:31.550313 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-547755b757-npd7k" event={"ID":"034248b4-3532-46d6-a19e-626b86062099","Type":"ContainerStarted","Data":"5b60789ed0d012eb261e3118851789dceeb6fefc69844a3c06f04c87a3396b8d"} Jul 05 19:38:31.550816 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:38:31.550403 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-547755b757-npd7k" Jul 05 19:38:31.571735 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:38:31.571679 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-547755b757-npd7k" podStartSLOduration=2.223403191 podStartE2EDuration="6.57166021s" totalImagesPullingTime="3.263905426s" totalInitContainerRuntime="1.084351593s" isStatefulPod=false podCreationTimestamp="2026-07-05 19:38:25 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 19:38:31.571335255 +0000 UTC m=+364.970682722" watchObservedRunningTime="2026-07-05 19:38:31.57166021 +0000 UTC m=+364.971007677" Jul 05 19:38:42.556991 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:38:42.556941 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-547755b757-npd7k" Jul 05 19:38:46.010037 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:38:46.010002 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-nhlrw"] Jul 05 19:38:46.018870 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:38:46.018848 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-nhlrw" Jul 05 19:38:46.021706 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:38:46.021670 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-nhlrw"] Jul 05 19:38:46.021834 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:38:46.021779 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\"" Jul 05 19:38:46.021880 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:38:46.021853 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-8brsp\"" Jul 05 19:38:46.082295 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:38:46.082262 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4dc8b8e5-af24-4fc1-a9e0-52c9da79adc2-cert\") pod \"odh-model-controller-7998c67dc4-nhlrw\" (UID: \"4dc8b8e5-af24-4fc1-a9e0-52c9da79adc2\") " pod="opendatahub/odh-model-controller-7998c67dc4-nhlrw" Jul 05 19:38:46.082477 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:38:46.082303 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kx84w\" (UniqueName: \"kubernetes.io/projected/4dc8b8e5-af24-4fc1-a9e0-52c9da79adc2-kube-api-access-kx84w\") pod \"odh-model-controller-7998c67dc4-nhlrw\" (UID: \"4dc8b8e5-af24-4fc1-a9e0-52c9da79adc2\") " pod="opendatahub/odh-model-controller-7998c67dc4-nhlrw" Jul 05 19:38:46.182819 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:38:46.182771 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4dc8b8e5-af24-4fc1-a9e0-52c9da79adc2-cert\") pod \"odh-model-controller-7998c67dc4-nhlrw\" (UID: \"4dc8b8e5-af24-4fc1-a9e0-52c9da79adc2\") " pod="opendatahub/odh-model-controller-7998c67dc4-nhlrw" Jul 05 19:38:46.183017 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:38:46.182828 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kx84w\" (UniqueName: \"kubernetes.io/projected/4dc8b8e5-af24-4fc1-a9e0-52c9da79adc2-kube-api-access-kx84w\") pod \"odh-model-controller-7998c67dc4-nhlrw\" (UID: \"4dc8b8e5-af24-4fc1-a9e0-52c9da79adc2\") " pod="opendatahub/odh-model-controller-7998c67dc4-nhlrw" Jul 05 19:38:46.183017 ip-10-0-133-7 kubenswrapper[2572]: E0705 19:38:46.182975 2572 secret.go:189] Couldn't get secret opendatahub/odh-model-controller-webhook-cert: secret "odh-model-controller-webhook-cert" not found Jul 05 19:38:46.183114 ip-10-0-133-7 kubenswrapper[2572]: E0705 19:38:46.183070 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4dc8b8e5-af24-4fc1-a9e0-52c9da79adc2-cert podName:4dc8b8e5-af24-4fc1-a9e0-52c9da79adc2 nodeName:}" failed. No retries permitted until 2026-07-05 19:38:46.68304206 +0000 UTC m=+380.082389566 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/4dc8b8e5-af24-4fc1-a9e0-52c9da79adc2-cert") pod "odh-model-controller-7998c67dc4-nhlrw" (UID: "4dc8b8e5-af24-4fc1-a9e0-52c9da79adc2") : secret "odh-model-controller-webhook-cert" not found Jul 05 19:38:46.194964 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:38:46.194930 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kx84w\" (UniqueName: \"kubernetes.io/projected/4dc8b8e5-af24-4fc1-a9e0-52c9da79adc2-kube-api-access-kx84w\") pod \"odh-model-controller-7998c67dc4-nhlrw\" (UID: \"4dc8b8e5-af24-4fc1-a9e0-52c9da79adc2\") " pod="opendatahub/odh-model-controller-7998c67dc4-nhlrw" Jul 05 19:38:46.627381 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:38:46.627349 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-5m84h"] Jul 05 19:38:46.630870 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:38:46.630848 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-5m84h" Jul 05 19:38:46.635013 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:38:46.634992 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\"" Jul 05 19:38:46.635110 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:38:46.635092 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-dockercfg-gvh9k\"" Jul 05 19:38:46.648137 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:38:46.648113 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-5m84h"] Jul 05 19:38:46.687028 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:38:46.687002 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b5jrb\" (UniqueName: \"kubernetes.io/projected/4c4a0c1f-060b-41aa-b052-f481f09b194e-kube-api-access-b5jrb\") pod \"model-serving-api-54d89bd5fc-5m84h\" (UID: \"4c4a0c1f-060b-41aa-b052-f481f09b194e\") " pod="opendatahub/model-serving-api-54d89bd5fc-5m84h" Jul 05 19:38:46.687193 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:38:46.687055 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4c4a0c1f-060b-41aa-b052-f481f09b194e-tls-certs\") pod \"model-serving-api-54d89bd5fc-5m84h\" (UID: \"4c4a0c1f-060b-41aa-b052-f481f09b194e\") " pod="opendatahub/model-serving-api-54d89bd5fc-5m84h" Jul 05 19:38:46.687193 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:38:46.687112 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4dc8b8e5-af24-4fc1-a9e0-52c9da79adc2-cert\") pod \"odh-model-controller-7998c67dc4-nhlrw\" (UID: \"4dc8b8e5-af24-4fc1-a9e0-52c9da79adc2\") " pod="opendatahub/odh-model-controller-7998c67dc4-nhlrw" Jul 05 19:38:46.689532 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:38:46.689506 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4dc8b8e5-af24-4fc1-a9e0-52c9da79adc2-cert\") pod \"odh-model-controller-7998c67dc4-nhlrw\" (UID: \"4dc8b8e5-af24-4fc1-a9e0-52c9da79adc2\") " pod="opendatahub/odh-model-controller-7998c67dc4-nhlrw" Jul 05 19:38:46.787878 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:38:46.787838 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4c4a0c1f-060b-41aa-b052-f481f09b194e-tls-certs\") pod \"model-serving-api-54d89bd5fc-5m84h\" (UID: \"4c4a0c1f-060b-41aa-b052-f481f09b194e\") " pod="opendatahub/model-serving-api-54d89bd5fc-5m84h" Jul 05 19:38:46.788111 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:38:46.787909 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b5jrb\" (UniqueName: \"kubernetes.io/projected/4c4a0c1f-060b-41aa-b052-f481f09b194e-kube-api-access-b5jrb\") pod \"model-serving-api-54d89bd5fc-5m84h\" (UID: \"4c4a0c1f-060b-41aa-b052-f481f09b194e\") " pod="opendatahub/model-serving-api-54d89bd5fc-5m84h" Jul 05 19:38:46.788111 ip-10-0-133-7 kubenswrapper[2572]: E0705 19:38:46.788031 2572 secret.go:189] Couldn't get secret opendatahub/model-serving-api-tls: secret "model-serving-api-tls" not found Jul 05 19:38:46.788111 ip-10-0-133-7 kubenswrapper[2572]: E0705 19:38:46.788108 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4c4a0c1f-060b-41aa-b052-f481f09b194e-tls-certs podName:4c4a0c1f-060b-41aa-b052-f481f09b194e nodeName:}" failed. No retries permitted until 2026-07-05 19:38:47.288091487 +0000 UTC m=+380.687438931 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/4c4a0c1f-060b-41aa-b052-f481f09b194e-tls-certs") pod "model-serving-api-54d89bd5fc-5m84h" (UID: "4c4a0c1f-060b-41aa-b052-f481f09b194e") : secret "model-serving-api-tls" not found Jul 05 19:38:46.796585 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:38:46.796557 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b5jrb\" (UniqueName: \"kubernetes.io/projected/4c4a0c1f-060b-41aa-b052-f481f09b194e-kube-api-access-b5jrb\") pod \"model-serving-api-54d89bd5fc-5m84h\" (UID: \"4c4a0c1f-060b-41aa-b052-f481f09b194e\") " pod="opendatahub/model-serving-api-54d89bd5fc-5m84h" Jul 05 19:38:46.930894 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:38:46.930798 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-nhlrw" Jul 05 19:38:47.096672 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:38:47.096649 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-nhlrw"] Jul 05 19:38:47.099017 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:38:47.098989 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4dc8b8e5_af24_4fc1_a9e0_52c9da79adc2.slice/crio-e5842dffc9413b59a033c76ab99c7a6d9afa87b53967701277fa804289c799d6 WatchSource:0}: Error finding container e5842dffc9413b59a033c76ab99c7a6d9afa87b53967701277fa804289c799d6: Status 404 returned error can't find the container with id e5842dffc9413b59a033c76ab99c7a6d9afa87b53967701277fa804289c799d6 Jul 05 19:38:47.293820 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:38:47.293779 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4c4a0c1f-060b-41aa-b052-f481f09b194e-tls-certs\") pod \"model-serving-api-54d89bd5fc-5m84h\" (UID: \"4c4a0c1f-060b-41aa-b052-f481f09b194e\") " pod="opendatahub/model-serving-api-54d89bd5fc-5m84h" Jul 05 19:38:47.296211 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:38:47.296182 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4c4a0c1f-060b-41aa-b052-f481f09b194e-tls-certs\") pod \"model-serving-api-54d89bd5fc-5m84h\" (UID: \"4c4a0c1f-060b-41aa-b052-f481f09b194e\") " pod="opendatahub/model-serving-api-54d89bd5fc-5m84h" Jul 05 19:38:47.543072 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:38:47.543030 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-5m84h" Jul 05 19:38:47.619391 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:38:47.619361 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-nhlrw" event={"ID":"4dc8b8e5-af24-4fc1-a9e0-52c9da79adc2","Type":"ContainerStarted","Data":"e5842dffc9413b59a033c76ab99c7a6d9afa87b53967701277fa804289c799d6"} Jul 05 19:38:47.681039 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:38:47.680901 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-5m84h"] Jul 05 19:38:47.683669 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:38:47.683627 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4c4a0c1f_060b_41aa_b052_f481f09b194e.slice/crio-d57d3e1889f7f8b2c81b95b12905cc7611c68a864792a5aa89ab02f918016775 WatchSource:0}: Error finding container d57d3e1889f7f8b2c81b95b12905cc7611c68a864792a5aa89ab02f918016775: Status 404 returned error can't find the container with id d57d3e1889f7f8b2c81b95b12905cc7611c68a864792a5aa89ab02f918016775 Jul 05 19:38:48.627586 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:38:48.627550 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-5m84h" event={"ID":"4c4a0c1f-060b-41aa-b052-f481f09b194e","Type":"ContainerStarted","Data":"d57d3e1889f7f8b2c81b95b12905cc7611c68a864792a5aa89ab02f918016775"} Jul 05 19:38:51.643732 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:38:51.643693 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-nhlrw" event={"ID":"4dc8b8e5-af24-4fc1-a9e0-52c9da79adc2","Type":"ContainerStarted","Data":"60f68ee417725a013cedff0d288b7e9dc4fc51705f05aa0a3721c32d03563605"} Jul 05 19:38:51.644247 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:38:51.643831 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-7998c67dc4-nhlrw" Jul 05 19:38:51.645293 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:38:51.645272 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-5m84h" event={"ID":"4c4a0c1f-060b-41aa-b052-f481f09b194e","Type":"ContainerStarted","Data":"4eca0d28d52bf494d9bc20a42a44a23048fdee63ad3cf1b37e7d251ffd66f053"} Jul 05 19:38:51.645425 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:38:51.645382 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-54d89bd5fc-5m84h" Jul 05 19:38:51.659940 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:38:51.659884 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/odh-model-controller-7998c67dc4-nhlrw" podStartSLOduration=3.114338546 podStartE2EDuration="6.659864829s" totalImagesPullingTime="3.545526283s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-05 19:38:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 19:38:51.658116636 +0000 UTC m=+385.057464105" watchObservedRunningTime="2026-07-05 19:38:51.659864829 +0000 UTC m=+385.059212295" Jul 05 19:38:51.675831 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:38:51.675786 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/model-serving-api-54d89bd5fc-5m84h" podStartSLOduration=2.763777018 podStartE2EDuration="5.675772399s" totalImagesPullingTime="2.911995381s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-05 19:38:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 19:38:51.675047948 +0000 UTC m=+385.074395437" watchObservedRunningTime="2026-07-05 19:38:51.675772399 +0000 UTC m=+385.075119865" Jul 05 19:38:56.816445 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:38:56.816412 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-f6b494dcc-5jq2d"] Jul 05 19:38:56.819314 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:38:56.819295 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-f6b494dcc-5jq2d" Jul 05 19:38:56.831232 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:38:56.831207 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-jlnwq\"" Jul 05 19:38:56.831369 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:38:56.831306 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" Jul 05 19:38:56.832786 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:38:56.832766 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" Jul 05 19:38:56.849526 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:38:56.849498 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-f6b494dcc-5jq2d"] Jul 05 19:38:56.979055 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:38:56.979020 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9nhsx\" (UniqueName: \"kubernetes.io/projected/09de75a4-dddd-468f-ab55-0e1a429d0034-kube-api-access-9nhsx\") pod \"kube-auth-proxy-f6b494dcc-5jq2d\" (UID: \"09de75a4-dddd-468f-ab55-0e1a429d0034\") " pod="openshift-ingress/kube-auth-proxy-f6b494dcc-5jq2d" Jul 05 19:38:56.979250 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:38:56.979077 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/09de75a4-dddd-468f-ab55-0e1a429d0034-tls-certs\") pod \"kube-auth-proxy-f6b494dcc-5jq2d\" (UID: \"09de75a4-dddd-468f-ab55-0e1a429d0034\") " pod="openshift-ingress/kube-auth-proxy-f6b494dcc-5jq2d" Jul 05 19:38:56.979250 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:38:56.979159 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/09de75a4-dddd-468f-ab55-0e1a429d0034-tmp\") pod \"kube-auth-proxy-f6b494dcc-5jq2d\" (UID: \"09de75a4-dddd-468f-ab55-0e1a429d0034\") " pod="openshift-ingress/kube-auth-proxy-f6b494dcc-5jq2d" Jul 05 19:38:57.080698 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:38:57.080615 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9nhsx\" (UniqueName: \"kubernetes.io/projected/09de75a4-dddd-468f-ab55-0e1a429d0034-kube-api-access-9nhsx\") pod \"kube-auth-proxy-f6b494dcc-5jq2d\" (UID: \"09de75a4-dddd-468f-ab55-0e1a429d0034\") " pod="openshift-ingress/kube-auth-proxy-f6b494dcc-5jq2d" Jul 05 19:38:57.080698 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:38:57.080667 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/09de75a4-dddd-468f-ab55-0e1a429d0034-tls-certs\") pod \"kube-auth-proxy-f6b494dcc-5jq2d\" (UID: \"09de75a4-dddd-468f-ab55-0e1a429d0034\") " pod="openshift-ingress/kube-auth-proxy-f6b494dcc-5jq2d" Jul 05 19:38:57.080924 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:38:57.080712 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/09de75a4-dddd-468f-ab55-0e1a429d0034-tmp\") pod \"kube-auth-proxy-f6b494dcc-5jq2d\" (UID: \"09de75a4-dddd-468f-ab55-0e1a429d0034\") " pod="openshift-ingress/kube-auth-proxy-f6b494dcc-5jq2d" Jul 05 19:38:57.083160 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:38:57.083132 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/09de75a4-dddd-468f-ab55-0e1a429d0034-tmp\") pod \"kube-auth-proxy-f6b494dcc-5jq2d\" (UID: \"09de75a4-dddd-468f-ab55-0e1a429d0034\") " pod="openshift-ingress/kube-auth-proxy-f6b494dcc-5jq2d" Jul 05 19:38:57.083801 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:38:57.083761 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/09de75a4-dddd-468f-ab55-0e1a429d0034-tls-certs\") pod \"kube-auth-proxy-f6b494dcc-5jq2d\" (UID: \"09de75a4-dddd-468f-ab55-0e1a429d0034\") " pod="openshift-ingress/kube-auth-proxy-f6b494dcc-5jq2d" Jul 05 19:38:57.098200 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:38:57.098163 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9nhsx\" (UniqueName: \"kubernetes.io/projected/09de75a4-dddd-468f-ab55-0e1a429d0034-kube-api-access-9nhsx\") pod \"kube-auth-proxy-f6b494dcc-5jq2d\" (UID: \"09de75a4-dddd-468f-ab55-0e1a429d0034\") " pod="openshift-ingress/kube-auth-proxy-f6b494dcc-5jq2d" Jul 05 19:38:57.129035 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:38:57.129003 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-f6b494dcc-5jq2d" Jul 05 19:38:57.159284 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:38:57.159256 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-gb5pg"] Jul 05 19:38:57.162873 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:38:57.162849 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-gb5pg" Jul 05 19:38:57.167612 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:38:57.167587 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\"" Jul 05 19:38:57.168039 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:38:57.168021 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-qvg95\"" Jul 05 19:38:57.180433 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:38:57.180407 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-mrwpx"] Jul 05 19:38:57.185517 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:38:57.185490 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-gb5pg"] Jul 05 19:38:57.186065 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:38:57.186036 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-mrwpx" Jul 05 19:38:57.193962 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:38:57.193918 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-d4vg9\"" Jul 05 19:38:57.194401 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:38:57.194383 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\"" Jul 05 19:38:57.201317 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:38:57.201277 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-mrwpx"] Jul 05 19:38:57.283174 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:38:57.283121 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gjbrj\" (UniqueName: \"kubernetes.io/projected/97d61b1e-b753-4325-9c0c-567526952ea3-kube-api-access-gjbrj\") pod \"kserve-controller-manager-d6f4b65b8-gb5pg\" (UID: \"97d61b1e-b753-4325-9c0c-567526952ea3\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-gb5pg" Jul 05 19:38:57.283174 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:38:57.283183 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8c58f1f3-6c72-44cb-8014-6d39e075fb5f-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-mrwpx\" (UID: \"8c58f1f3-6c72-44cb-8014-6d39e075fb5f\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-mrwpx" Jul 05 19:38:57.283391 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:38:57.283205 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/97d61b1e-b753-4325-9c0c-567526952ea3-cert\") pod \"kserve-controller-manager-d6f4b65b8-gb5pg\" (UID: \"97d61b1e-b753-4325-9c0c-567526952ea3\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-gb5pg" Jul 05 19:38:57.283391 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:38:57.283223 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-brrsg\" (UniqueName: \"kubernetes.io/projected/8c58f1f3-6c72-44cb-8014-6d39e075fb5f-kube-api-access-brrsg\") pod \"llmisvc-controller-manager-777c6bd7d5-mrwpx\" (UID: \"8c58f1f3-6c72-44cb-8014-6d39e075fb5f\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-mrwpx" Jul 05 19:38:57.292470 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:38:57.292416 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-f6b494dcc-5jq2d"] Jul 05 19:38:57.295315 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:38:57.295288 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod09de75a4_dddd_468f_ab55_0e1a429d0034.slice/crio-b415c79942633b76ed53af1d53c8076f85645a9691d15ac4f787e77667cf72b6 WatchSource:0}: Error finding container b415c79942633b76ed53af1d53c8076f85645a9691d15ac4f787e77667cf72b6: Status 404 returned error can't find the container with id b415c79942633b76ed53af1d53c8076f85645a9691d15ac4f787e77667cf72b6 Jul 05 19:38:57.384302 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:38:57.384217 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gjbrj\" (UniqueName: \"kubernetes.io/projected/97d61b1e-b753-4325-9c0c-567526952ea3-kube-api-access-gjbrj\") pod \"kserve-controller-manager-d6f4b65b8-gb5pg\" (UID: \"97d61b1e-b753-4325-9c0c-567526952ea3\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-gb5pg" Jul 05 19:38:57.384302 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:38:57.384260 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8c58f1f3-6c72-44cb-8014-6d39e075fb5f-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-mrwpx\" (UID: \"8c58f1f3-6c72-44cb-8014-6d39e075fb5f\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-mrwpx" Jul 05 19:38:57.384302 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:38:57.384280 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/97d61b1e-b753-4325-9c0c-567526952ea3-cert\") pod \"kserve-controller-manager-d6f4b65b8-gb5pg\" (UID: \"97d61b1e-b753-4325-9c0c-567526952ea3\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-gb5pg" Jul 05 19:38:57.384536 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:38:57.384304 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-brrsg\" (UniqueName: \"kubernetes.io/projected/8c58f1f3-6c72-44cb-8014-6d39e075fb5f-kube-api-access-brrsg\") pod \"llmisvc-controller-manager-777c6bd7d5-mrwpx\" (UID: \"8c58f1f3-6c72-44cb-8014-6d39e075fb5f\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-mrwpx" Jul 05 19:38:57.384536 ip-10-0-133-7 kubenswrapper[2572]: E0705 19:38:57.384369 2572 secret.go:189] Couldn't get secret opendatahub/llmisvc-webhook-server-cert: secret "llmisvc-webhook-server-cert" not found Jul 05 19:38:57.384536 ip-10-0-133-7 kubenswrapper[2572]: E0705 19:38:57.384434 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8c58f1f3-6c72-44cb-8014-6d39e075fb5f-cert podName:8c58f1f3-6c72-44cb-8014-6d39e075fb5f nodeName:}" failed. No retries permitted until 2026-07-05 19:38:57.884415575 +0000 UTC m=+391.283763020 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/8c58f1f3-6c72-44cb-8014-6d39e075fb5f-cert") pod "llmisvc-controller-manager-777c6bd7d5-mrwpx" (UID: "8c58f1f3-6c72-44cb-8014-6d39e075fb5f") : secret "llmisvc-webhook-server-cert" not found Jul 05 19:38:57.384536 ip-10-0-133-7 kubenswrapper[2572]: E0705 19:38:57.384459 2572 secret.go:189] Couldn't get secret opendatahub/kserve-webhook-server-cert: secret "kserve-webhook-server-cert" not found Jul 05 19:38:57.384536 ip-10-0-133-7 kubenswrapper[2572]: E0705 19:38:57.384527 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/97d61b1e-b753-4325-9c0c-567526952ea3-cert podName:97d61b1e-b753-4325-9c0c-567526952ea3 nodeName:}" failed. No retries permitted until 2026-07-05 19:38:57.88451051 +0000 UTC m=+391.283857963 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/97d61b1e-b753-4325-9c0c-567526952ea3-cert") pod "kserve-controller-manager-d6f4b65b8-gb5pg" (UID: "97d61b1e-b753-4325-9c0c-567526952ea3") : secret "kserve-webhook-server-cert" not found Jul 05 19:38:57.401978 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:38:57.398995 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gjbrj\" (UniqueName: \"kubernetes.io/projected/97d61b1e-b753-4325-9c0c-567526952ea3-kube-api-access-gjbrj\") pod \"kserve-controller-manager-d6f4b65b8-gb5pg\" (UID: \"97d61b1e-b753-4325-9c0c-567526952ea3\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-gb5pg" Jul 05 19:38:57.406351 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:38:57.406308 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-brrsg\" (UniqueName: \"kubernetes.io/projected/8c58f1f3-6c72-44cb-8014-6d39e075fb5f-kube-api-access-brrsg\") pod \"llmisvc-controller-manager-777c6bd7d5-mrwpx\" (UID: \"8c58f1f3-6c72-44cb-8014-6d39e075fb5f\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-mrwpx" Jul 05 19:38:57.673750 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:38:57.673661 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-f6b494dcc-5jq2d" event={"ID":"09de75a4-dddd-468f-ab55-0e1a429d0034","Type":"ContainerStarted","Data":"b415c79942633b76ed53af1d53c8076f85645a9691d15ac4f787e77667cf72b6"} Jul 05 19:38:57.889102 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:38:57.889052 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8c58f1f3-6c72-44cb-8014-6d39e075fb5f-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-mrwpx\" (UID: \"8c58f1f3-6c72-44cb-8014-6d39e075fb5f\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-mrwpx" Jul 05 19:38:57.889102 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:38:57.889105 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/97d61b1e-b753-4325-9c0c-567526952ea3-cert\") pod \"kserve-controller-manager-d6f4b65b8-gb5pg\" (UID: \"97d61b1e-b753-4325-9c0c-567526952ea3\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-gb5pg" Jul 05 19:38:57.889591 ip-10-0-133-7 kubenswrapper[2572]: E0705 19:38:57.889286 2572 secret.go:189] Couldn't get secret opendatahub/kserve-webhook-server-cert: secret "kserve-webhook-server-cert" not found Jul 05 19:38:57.889591 ip-10-0-133-7 kubenswrapper[2572]: E0705 19:38:57.889367 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/97d61b1e-b753-4325-9c0c-567526952ea3-cert podName:97d61b1e-b753-4325-9c0c-567526952ea3 nodeName:}" failed. No retries permitted until 2026-07-05 19:38:58.889345237 +0000 UTC m=+392.288692691 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/97d61b1e-b753-4325-9c0c-567526952ea3-cert") pod "kserve-controller-manager-d6f4b65b8-gb5pg" (UID: "97d61b1e-b753-4325-9c0c-567526952ea3") : secret "kserve-webhook-server-cert" not found Jul 05 19:38:57.891928 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:38:57.891902 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8c58f1f3-6c72-44cb-8014-6d39e075fb5f-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-mrwpx\" (UID: \"8c58f1f3-6c72-44cb-8014-6d39e075fb5f\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-mrwpx" Jul 05 19:38:58.102070 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:38:58.102029 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-mrwpx" Jul 05 19:38:58.265002 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:38:58.264971 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-mrwpx"] Jul 05 19:38:58.266783 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:38:58.266752 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod8c58f1f3_6c72_44cb_8014_6d39e075fb5f.slice/crio-35a81e83f644b1724feb2c076bdaaa0428b0de38fb80a7659478792fbfa6af67 WatchSource:0}: Error finding container 35a81e83f644b1724feb2c076bdaaa0428b0de38fb80a7659478792fbfa6af67: Status 404 returned error can't find the container with id 35a81e83f644b1724feb2c076bdaaa0428b0de38fb80a7659478792fbfa6af67 Jul 05 19:38:58.680004 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:38:58.679943 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-mrwpx" event={"ID":"8c58f1f3-6c72-44cb-8014-6d39e075fb5f","Type":"ContainerStarted","Data":"35a81e83f644b1724feb2c076bdaaa0428b0de38fb80a7659478792fbfa6af67"} Jul 05 19:38:58.900166 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:38:58.900128 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/97d61b1e-b753-4325-9c0c-567526952ea3-cert\") pod \"kserve-controller-manager-d6f4b65b8-gb5pg\" (UID: \"97d61b1e-b753-4325-9c0c-567526952ea3\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-gb5pg" Jul 05 19:38:58.902507 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:38:58.902484 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/97d61b1e-b753-4325-9c0c-567526952ea3-cert\") pod \"kserve-controller-manager-d6f4b65b8-gb5pg\" (UID: \"97d61b1e-b753-4325-9c0c-567526952ea3\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-gb5pg" Jul 05 19:38:58.975888 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:38:58.975853 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-gb5pg" Jul 05 19:38:59.119343 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:38:59.119316 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-gb5pg"] Jul 05 19:38:59.121570 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:38:59.121537 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod97d61b1e_b753_4325_9c0c_567526952ea3.slice/crio-1806a285a24cfb4107e8fd851ff8f7ca1bdd1ca19d76e2e8c1861c9a76da1cfc WatchSource:0}: Error finding container 1806a285a24cfb4107e8fd851ff8f7ca1bdd1ca19d76e2e8c1861c9a76da1cfc: Status 404 returned error can't find the container with id 1806a285a24cfb4107e8fd851ff8f7ca1bdd1ca19d76e2e8c1861c9a76da1cfc Jul 05 19:38:59.306845 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:38:59.306753 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-n5c2b"] Jul 05 19:38:59.325110 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:38:59.325061 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-n5c2b"] Jul 05 19:38:59.325110 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:38:59.325204 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-n5c2b" Jul 05 19:38:59.328548 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:38:59.328042 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jul 05 19:38:59.328548 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:38:59.328197 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\"" Jul 05 19:38:59.328548 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:38:59.328362 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\"" Jul 05 19:38:59.328548 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:38:59.328433 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\"" Jul 05 19:38:59.328548 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:38:59.328467 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-5sdvf\"" Jul 05 19:38:59.506892 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:38:59.506846 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/2636f449-30fe-4448-b3e6-b80e5a9e9449-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-n5c2b\" (UID: \"2636f449-30fe-4448-b3e6-b80e5a9e9449\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-n5c2b" Jul 05 19:38:59.507105 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:38:59.506918 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/2636f449-30fe-4448-b3e6-b80e5a9e9449-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-n5c2b\" (UID: \"2636f449-30fe-4448-b3e6-b80e5a9e9449\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-n5c2b" Jul 05 19:38:59.507105 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:38:59.507061 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/2636f449-30fe-4448-b3e6-b80e5a9e9449-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-n5c2b\" (UID: \"2636f449-30fe-4448-b3e6-b80e5a9e9449\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-n5c2b" Jul 05 19:38:59.507224 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:38:59.507110 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/2636f449-30fe-4448-b3e6-b80e5a9e9449-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-n5c2b\" (UID: \"2636f449-30fe-4448-b3e6-b80e5a9e9449\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-n5c2b" Jul 05 19:38:59.507224 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:38:59.507140 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nl2d6\" (UniqueName: \"kubernetes.io/projected/2636f449-30fe-4448-b3e6-b80e5a9e9449-kube-api-access-nl2d6\") pod \"istiod-openshift-gateway-94bb8fbfd-n5c2b\" (UID: \"2636f449-30fe-4448-b3e6-b80e5a9e9449\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-n5c2b" Jul 05 19:38:59.507224 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:38:59.507173 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2636f449-30fe-4448-b3e6-b80e5a9e9449-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-n5c2b\" (UID: \"2636f449-30fe-4448-b3e6-b80e5a9e9449\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-n5c2b" Jul 05 19:38:59.507224 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:38:59.507215 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/2636f449-30fe-4448-b3e6-b80e5a9e9449-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-n5c2b\" (UID: \"2636f449-30fe-4448-b3e6-b80e5a9e9449\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-n5c2b" Jul 05 19:38:59.608633 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:38:59.608542 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/2636f449-30fe-4448-b3e6-b80e5a9e9449-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-n5c2b\" (UID: \"2636f449-30fe-4448-b3e6-b80e5a9e9449\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-n5c2b" Jul 05 19:38:59.608633 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:38:59.608602 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/2636f449-30fe-4448-b3e6-b80e5a9e9449-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-n5c2b\" (UID: \"2636f449-30fe-4448-b3e6-b80e5a9e9449\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-n5c2b" Jul 05 19:38:59.608870 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:38:59.608676 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/2636f449-30fe-4448-b3e6-b80e5a9e9449-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-n5c2b\" (UID: \"2636f449-30fe-4448-b3e6-b80e5a9e9449\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-n5c2b" Jul 05 19:38:59.608870 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:38:59.608700 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/2636f449-30fe-4448-b3e6-b80e5a9e9449-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-n5c2b\" (UID: \"2636f449-30fe-4448-b3e6-b80e5a9e9449\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-n5c2b" Jul 05 19:38:59.608870 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:38:59.608725 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nl2d6\" (UniqueName: \"kubernetes.io/projected/2636f449-30fe-4448-b3e6-b80e5a9e9449-kube-api-access-nl2d6\") pod \"istiod-openshift-gateway-94bb8fbfd-n5c2b\" (UID: \"2636f449-30fe-4448-b3e6-b80e5a9e9449\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-n5c2b" Jul 05 19:38:59.608870 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:38:59.608752 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2636f449-30fe-4448-b3e6-b80e5a9e9449-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-n5c2b\" (UID: \"2636f449-30fe-4448-b3e6-b80e5a9e9449\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-n5c2b" Jul 05 19:38:59.608870 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:38:59.608788 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/2636f449-30fe-4448-b3e6-b80e5a9e9449-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-n5c2b\" (UID: \"2636f449-30fe-4448-b3e6-b80e5a9e9449\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-n5c2b" Jul 05 19:38:59.609514 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:38:59.609487 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/2636f449-30fe-4448-b3e6-b80e5a9e9449-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-n5c2b\" (UID: \"2636f449-30fe-4448-b3e6-b80e5a9e9449\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-n5c2b" Jul 05 19:38:59.612465 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:38:59.612412 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/2636f449-30fe-4448-b3e6-b80e5a9e9449-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-n5c2b\" (UID: \"2636f449-30fe-4448-b3e6-b80e5a9e9449\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-n5c2b" Jul 05 19:38:59.612687 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:38:59.612660 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/2636f449-30fe-4448-b3e6-b80e5a9e9449-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-n5c2b\" (UID: \"2636f449-30fe-4448-b3e6-b80e5a9e9449\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-n5c2b" Jul 05 19:38:59.612916 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:38:59.612849 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/2636f449-30fe-4448-b3e6-b80e5a9e9449-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-n5c2b\" (UID: \"2636f449-30fe-4448-b3e6-b80e5a9e9449\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-n5c2b" Jul 05 19:38:59.614161 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:38:59.614133 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/2636f449-30fe-4448-b3e6-b80e5a9e9449-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-n5c2b\" (UID: \"2636f449-30fe-4448-b3e6-b80e5a9e9449\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-n5c2b" Jul 05 19:38:59.636120 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:38:59.636035 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2636f449-30fe-4448-b3e6-b80e5a9e9449-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-n5c2b\" (UID: \"2636f449-30fe-4448-b3e6-b80e5a9e9449\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-n5c2b" Jul 05 19:38:59.637391 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:38:59.636840 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nl2d6\" (UniqueName: \"kubernetes.io/projected/2636f449-30fe-4448-b3e6-b80e5a9e9449-kube-api-access-nl2d6\") pod \"istiod-openshift-gateway-94bb8fbfd-n5c2b\" (UID: \"2636f449-30fe-4448-b3e6-b80e5a9e9449\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-n5c2b" Jul 05 19:38:59.640906 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:38:59.639166 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-n5c2b" Jul 05 19:38:59.687024 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:38:59.686982 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-gb5pg" event={"ID":"97d61b1e-b753-4325-9c0c-567526952ea3","Type":"ContainerStarted","Data":"1806a285a24cfb4107e8fd851ff8f7ca1bdd1ca19d76e2e8c1861c9a76da1cfc"} Jul 05 19:38:59.952223 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:38:59.952196 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-n5c2b"] Jul 05 19:38:59.955911 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:38:59.955887 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2636f449_30fe_4448_b3e6_b80e5a9e9449.slice/crio-220ec96a358bf126a402ab1605c48d453ea0d042c6ff4da41cc900dcd4e15b7f WatchSource:0}: Error finding container 220ec96a358bf126a402ab1605c48d453ea0d042c6ff4da41cc900dcd4e15b7f: Status 404 returned error can't find the container with id 220ec96a358bf126a402ab1605c48d453ea0d042c6ff4da41cc900dcd4e15b7f Jul 05 19:39:00.697029 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:39:00.696991 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-n5c2b" event={"ID":"2636f449-30fe-4448-b3e6-b80e5a9e9449","Type":"ContainerStarted","Data":"220ec96a358bf126a402ab1605c48d453ea0d042c6ff4da41cc900dcd4e15b7f"} Jul 05 19:39:00.699163 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:39:00.699133 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-f6b494dcc-5jq2d" event={"ID":"09de75a4-dddd-468f-ab55-0e1a429d0034","Type":"ContainerStarted","Data":"fdf19de9d1802be7b9dd48741a23f93fee53626cf9bfafde8c7716de005ee1d4"} Jul 05 19:39:00.724272 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:39:00.724213 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-f6b494dcc-5jq2d" podStartSLOduration=2.107065467 podStartE2EDuration="4.724189632s" totalImagesPullingTime="2.617124165s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-05 19:38:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 19:39:00.721526041 +0000 UTC m=+394.120873507" watchObservedRunningTime="2026-07-05 19:39:00.724189632 +0000 UTC m=+394.123537100" Jul 05 19:39:02.653092 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:39:02.653061 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-7998c67dc4-nhlrw" Jul 05 19:39:02.655876 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:39:02.655852 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-54d89bd5fc-5m84h" Jul 05 19:39:03.445731 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:39:03.445650 2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 05 19:39:03.445883 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:39:03.445736 2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 05 19:39:03.717274 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:39:03.717240 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-n5c2b" event={"ID":"2636f449-30fe-4448-b3e6-b80e5a9e9449","Type":"ContainerStarted","Data":"d02ea8512fef3f6a54533ac21755fe1e03861fabaf5ffdab2a360f33526dfdc8"} Jul 05 19:39:03.717721 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:39:03.717308 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-n5c2b" Jul 05 19:39:03.718794 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:39:03.718768 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-mrwpx" event={"ID":"8c58f1f3-6c72-44cb-8014-6d39e075fb5f","Type":"ContainerStarted","Data":"9826cc1248f78312884e18f69650f216699b632ffbbe8940eb40f46624b26329"} Jul 05 19:39:03.718927 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:39:03.718819 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-mrwpx" Jul 05 19:39:03.720233 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:39:03.720210 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-gb5pg" event={"ID":"97d61b1e-b753-4325-9c0c-567526952ea3","Type":"ContainerStarted","Data":"917306b5c98c4ef8efe41dff69a021728d844554e186a2814d1fe97de86fb536"} Jul 05 19:39:03.720350 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:39:03.720339 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-gb5pg" Jul 05 19:39:03.738892 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:39:03.738847 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-n5c2b" podStartSLOduration=1.252039656 podStartE2EDuration="4.738834235s" totalImagesPullingTime="3.486794579s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-05 19:38:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 19:39:03.737415347 +0000 UTC m=+397.136762812" watchObservedRunningTime="2026-07-05 19:39:03.738834235 +0000 UTC m=+397.138181701" Jul 05 19:39:03.755312 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:39:03.755256 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-d6f4b65b8-gb5pg" podStartSLOduration=2.449095886 podStartE2EDuration="6.755235987s" totalImagesPullingTime="4.306140101s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-05 19:38:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 19:39:03.754139143 +0000 UTC m=+397.153486612" watchObservedRunningTime="2026-07-05 19:39:03.755235987 +0000 UTC m=+397.154583458" Jul 05 19:39:04.726461 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:39:04.726430 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-n5c2b" Jul 05 19:39:04.746359 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:39:04.746300 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-mrwpx" podStartSLOduration=2.578373452 podStartE2EDuration="7.746280464s" totalImagesPullingTime="5.167907012s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-05 19:38:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 19:39:03.770302266 +0000 UTC m=+397.169649732" watchObservedRunningTime="2026-07-05 19:39:04.746280464 +0000 UTC m=+398.145627931" Jul 05 19:39:34.726679 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:39:34.726648 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-mrwpx" Jul 05 19:39:34.729870 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:39:34.729847 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-gb5pg" Jul 05 19:40:41.636310 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:40:41.636279 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-dr2xp"] Jul 05 19:40:41.640294 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:40:41.640105 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-dr2xp" Jul 05 19:40:41.644096 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:40:41.644065 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jul 05 19:40:41.644317 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:40:41.644093 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-f6tz9\"" Jul 05 19:40:41.644317 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:40:41.644257 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jul 05 19:40:41.652502 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:40:41.652480 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-dr2xp"] Jul 05 19:40:41.755160 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:40:41.755127 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bxjkf\" (UniqueName: \"kubernetes.io/projected/f1736b0f-4e11-4cdc-a684-cb59f46e7e38-kube-api-access-bxjkf\") pod \"kuadrant-operator-controller-manager-86878c769f-dr2xp\" (UID: \"f1736b0f-4e11-4cdc-a684-cb59f46e7e38\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-dr2xp" Jul 05 19:40:41.755317 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:40:41.755175 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/f1736b0f-4e11-4cdc-a684-cb59f46e7e38-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-dr2xp\" (UID: \"f1736b0f-4e11-4cdc-a684-cb59f46e7e38\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-dr2xp" Jul 05 19:40:41.856441 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:40:41.856407 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/f1736b0f-4e11-4cdc-a684-cb59f46e7e38-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-dr2xp\" (UID: \"f1736b0f-4e11-4cdc-a684-cb59f46e7e38\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-dr2xp" Jul 05 19:40:41.856596 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:40:41.856471 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bxjkf\" (UniqueName: \"kubernetes.io/projected/f1736b0f-4e11-4cdc-a684-cb59f46e7e38-kube-api-access-bxjkf\") pod \"kuadrant-operator-controller-manager-86878c769f-dr2xp\" (UID: \"f1736b0f-4e11-4cdc-a684-cb59f46e7e38\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-dr2xp" Jul 05 19:40:41.856845 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:40:41.856825 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/f1736b0f-4e11-4cdc-a684-cb59f46e7e38-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-dr2xp\" (UID: \"f1736b0f-4e11-4cdc-a684-cb59f46e7e38\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-dr2xp" Jul 05 19:40:41.864541 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:40:41.864515 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bxjkf\" (UniqueName: \"kubernetes.io/projected/f1736b0f-4e11-4cdc-a684-cb59f46e7e38-kube-api-access-bxjkf\") pod \"kuadrant-operator-controller-manager-86878c769f-dr2xp\" (UID: \"f1736b0f-4e11-4cdc-a684-cb59f46e7e38\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-dr2xp" Jul 05 19:40:41.954928 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:40:41.954897 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-dr2xp" Jul 05 19:40:42.109821 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:40:42.109791 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-dr2xp"] Jul 05 19:40:42.112697 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:40:42.112661 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf1736b0f_4e11_4cdc_a684_cb59f46e7e38.slice/crio-8556fb543e974f70586c24dc4557993464d84baab374b4e828dd65b6b727a314 WatchSource:0}: Error finding container 8556fb543e974f70586c24dc4557993464d84baab374b4e828dd65b6b727a314: Status 404 returned error can't find the container with id 8556fb543e974f70586c24dc4557993464d84baab374b4e828dd65b6b727a314 Jul 05 19:40:42.173179 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:40:42.173142 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-dr2xp" event={"ID":"f1736b0f-4e11-4cdc-a684-cb59f46e7e38","Type":"ContainerStarted","Data":"8556fb543e974f70586c24dc4557993464d84baab374b4e828dd65b6b727a314"} Jul 05 19:40:47.205740 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:40:47.205703 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-dr2xp" event={"ID":"f1736b0f-4e11-4cdc-a684-cb59f46e7e38","Type":"ContainerStarted","Data":"b84aa1deffb8cf585ea4ac8680e236d9c8ee3070b80a1cf87f03cbe4cee13e29"} Jul 05 19:40:47.206240 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:40:47.205842 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-dr2xp" Jul 05 19:40:47.229440 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:40:47.229397 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-dr2xp" podStartSLOduration=2.088196091 podStartE2EDuration="6.229382085s" totalImagesPullingTime="4.141185994s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-05 19:40:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 19:40:47.227332888 +0000 UTC m=+500.626680356" watchObservedRunningTime="2026-07-05 19:40:47.229382085 +0000 UTC m=+500.628729549" Jul 05 19:40:58.212266 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:40:58.212236 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-dr2xp" Jul 05 19:41:17.425262 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:41:17.425222 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jt8wt"] Jul 05 19:41:17.431295 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:41:17.431271 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-jt8wt" Jul 05 19:41:17.434036 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:41:17.433790 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" Jul 05 19:41:17.434036 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:41:17.433825 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-kb27n\"" Jul 05 19:41:17.437235 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:41:17.437211 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jt8wt"] Jul 05 19:41:17.456466 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:41:17.456440 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-45bds\" (UniqueName: \"kubernetes.io/projected/2c3766b2-ffe9-42a7-be58-19a998af727f-kube-api-access-45bds\") pod \"limitador-limitador-54d6d988d5-jt8wt\" (UID: \"2c3766b2-ffe9-42a7-be58-19a998af727f\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-jt8wt" Jul 05 19:41:17.456592 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:41:17.456508 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/2c3766b2-ffe9-42a7-be58-19a998af727f-config-file\") pod \"limitador-limitador-54d6d988d5-jt8wt\" (UID: \"2c3766b2-ffe9-42a7-be58-19a998af727f\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-jt8wt" Jul 05 19:41:17.469557 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:41:17.469528 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jt8wt"] Jul 05 19:41:17.557898 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:41:17.557867 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-45bds\" (UniqueName: \"kubernetes.io/projected/2c3766b2-ffe9-42a7-be58-19a998af727f-kube-api-access-45bds\") pod \"limitador-limitador-54d6d988d5-jt8wt\" (UID: \"2c3766b2-ffe9-42a7-be58-19a998af727f\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-jt8wt" Jul 05 19:41:17.558121 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:41:17.557988 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/2c3766b2-ffe9-42a7-be58-19a998af727f-config-file\") pod \"limitador-limitador-54d6d988d5-jt8wt\" (UID: \"2c3766b2-ffe9-42a7-be58-19a998af727f\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-jt8wt" Jul 05 19:41:17.558627 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:41:17.558601 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/2c3766b2-ffe9-42a7-be58-19a998af727f-config-file\") pod \"limitador-limitador-54d6d988d5-jt8wt\" (UID: \"2c3766b2-ffe9-42a7-be58-19a998af727f\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-jt8wt" Jul 05 19:41:17.589637 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:41:17.589607 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-45bds\" (UniqueName: \"kubernetes.io/projected/2c3766b2-ffe9-42a7-be58-19a998af727f-kube-api-access-45bds\") pod \"limitador-limitador-54d6d988d5-jt8wt\" (UID: \"2c3766b2-ffe9-42a7-be58-19a998af727f\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-jt8wt" Jul 05 19:41:17.742550 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:41:17.742515 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-jt8wt" Jul 05 19:41:17.877248 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:41:17.877224 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jt8wt"] Jul 05 19:41:17.879520 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:41:17.879492 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2c3766b2_ffe9_42a7_be58_19a998af727f.slice/crio-2080313ee328e4651e3a749b39bd34127f6a08f20c0869cda16500d514fc4945 WatchSource:0}: Error finding container 2080313ee328e4651e3a749b39bd34127f6a08f20c0869cda16500d514fc4945: Status 404 returned error can't find the container with id 2080313ee328e4651e3a749b39bd34127f6a08f20c0869cda16500d514fc4945 Jul 05 19:41:18.361107 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:41:18.361062 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-jt8wt" event={"ID":"2c3766b2-ffe9-42a7-be58-19a998af727f","Type":"ContainerStarted","Data":"2080313ee328e4651e3a749b39bd34127f6a08f20c0869cda16500d514fc4945"} Jul 05 19:41:21.376718 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:41:21.376673 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-jt8wt" event={"ID":"2c3766b2-ffe9-42a7-be58-19a998af727f","Type":"ContainerStarted","Data":"a6560747539c5ec7173f6cff47fb1c1d777a94b3edee1514da8c6d95590cb5bb"} Jul 05 19:41:21.377130 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:41:21.376742 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-jt8wt" Jul 05 19:41:21.393700 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:41:21.393638 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-54d6d988d5-jt8wt" podStartSLOduration=1.8701215900000001 podStartE2EDuration="4.393621359s" totalImagesPullingTime="2.523499769s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-05 19:41:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 19:41:21.391383802 +0000 UTC m=+534.790731271" watchObservedRunningTime="2026-07-05 19:41:21.393621359 +0000 UTC m=+534.792968854" Jul 05 19:41:32.382736 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:41:32.382696 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-jt8wt" Jul 05 19:42:26.923579 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:42:26.923549 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-plqpb_ac3142e8-817c-493b-b998-41ff8f4680f9/console-operator/1.log" Jul 05 19:42:26.924104 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:42:26.924088 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-plqpb_ac3142e8-817c-493b-b998-41ff8f4680f9/console-operator/1.log" Jul 05 19:42:37.158791 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:42:37.158753 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jt8wt"] Jul 05 19:42:58.692053 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:42:58.691981 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jt8wt"] Jul 05 19:43:07.386774 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:43:07.386742 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jt8wt"] Jul 05 19:43:16.888098 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:43:16.888064 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jt8wt"] Jul 05 19:43:33.791173 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:43:33.791135 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jt8wt"] Jul 05 19:43:56.587470 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:43:56.587432 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jt8wt"] Jul 05 19:44:05.293618 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:44:05.293581 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jt8wt"] Jul 05 19:45:00.141888 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:45:00.141851 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-key-cleanup-29721345-qfbts"] Jul 05 19:45:00.145173 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:45:00.145157 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29721345-qfbts" Jul 05 19:45:00.147698 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:45:00.147676 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-zrsnl\"" Jul 05 19:45:00.151698 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:45:00.151673 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29721345-qfbts"] Jul 05 19:45:00.260314 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:45:00.260283 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-885x9\" (UniqueName: \"kubernetes.io/projected/66dea222-81f4-4740-b61e-ba09e57bc967-kube-api-access-885x9\") pod \"maas-api-key-cleanup-29721345-qfbts\" (UID: \"66dea222-81f4-4740-b61e-ba09e57bc967\") " pod="opendatahub/maas-api-key-cleanup-29721345-qfbts" Jul 05 19:45:00.361036 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:45:00.360997 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-885x9\" (UniqueName: \"kubernetes.io/projected/66dea222-81f4-4740-b61e-ba09e57bc967-kube-api-access-885x9\") pod \"maas-api-key-cleanup-29721345-qfbts\" (UID: \"66dea222-81f4-4740-b61e-ba09e57bc967\") " pod="opendatahub/maas-api-key-cleanup-29721345-qfbts" Jul 05 19:45:00.369275 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:45:00.369244 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-885x9\" (UniqueName: \"kubernetes.io/projected/66dea222-81f4-4740-b61e-ba09e57bc967-kube-api-access-885x9\") pod \"maas-api-key-cleanup-29721345-qfbts\" (UID: \"66dea222-81f4-4740-b61e-ba09e57bc967\") " pod="opendatahub/maas-api-key-cleanup-29721345-qfbts" Jul 05 19:45:00.457248 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:45:00.457208 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29721345-qfbts" Jul 05 19:45:00.592444 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:45:00.592418 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29721345-qfbts"] Jul 05 19:45:00.595467 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:45:00.595442 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod66dea222_81f4_4740_b61e_ba09e57bc967.slice/crio-59d6c71efdaf2021a3a4157720e1df47d8b4b70a3900f7dcdbc32d6be9fa2668 WatchSource:0}: Error finding container 59d6c71efdaf2021a3a4157720e1df47d8b4b70a3900f7dcdbc32d6be9fa2668: Status 404 returned error can't find the container with id 59d6c71efdaf2021a3a4157720e1df47d8b4b70a3900f7dcdbc32d6be9fa2668 Jul 05 19:45:00.597941 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:45:00.597923 2572 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 05 19:45:01.419028 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:45:01.418988 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29721345-qfbts" event={"ID":"66dea222-81f4-4740-b61e-ba09e57bc967","Type":"ContainerStarted","Data":"59d6c71efdaf2021a3a4157720e1df47d8b4b70a3900f7dcdbc32d6be9fa2668"} Jul 05 19:45:03.431021 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:45:03.430982 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29721345-qfbts" event={"ID":"66dea222-81f4-4740-b61e-ba09e57bc967","Type":"ContainerStarted","Data":"4a8b77071082e26ad7e222afd97f2c76c5d2548780b3b89fdcb542a633d9b137"} Jul 05 19:45:03.445968 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:45:03.445902 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-key-cleanup-29721345-qfbts" podStartSLOduration=1.459117204 podStartE2EDuration="3.445880379s" totalImagesPullingTime="1.986763175s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-05 19:45:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 19:45:03.444274973 +0000 UTC m=+756.843622441" watchObservedRunningTime="2026-07-05 19:45:03.445880379 +0000 UTC m=+756.845227848" Jul 05 19:45:04.437500 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:45:04.437464 2572 generic.go:356] "Generic (PLEG): container finished" podID="66dea222-81f4-4740-b61e-ba09e57bc967" containerID="4a8b77071082e26ad7e222afd97f2c76c5d2548780b3b89fdcb542a633d9b137" exitCode=0 Jul 05 19:45:04.438003 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:45:04.437511 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29721345-qfbts" event={"ID":"66dea222-81f4-4740-b61e-ba09e57bc967","Type":"ContainerDied","Data":"4a8b77071082e26ad7e222afd97f2c76c5d2548780b3b89fdcb542a633d9b137"} Jul 05 19:45:05.573588 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:45:05.573560 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29721345-qfbts" Jul 05 19:45:05.700549 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:45:05.700450 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-885x9\" (UniqueName: \"kubernetes.io/projected/66dea222-81f4-4740-b61e-ba09e57bc967-kube-api-access-885x9\") pod \"66dea222-81f4-4740-b61e-ba09e57bc967\" (UID: \"66dea222-81f4-4740-b61e-ba09e57bc967\") " Jul 05 19:45:05.702605 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:45:05.702576 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/66dea222-81f4-4740-b61e-ba09e57bc967-kube-api-access-885x9" (OuterVolumeSpecName: "kube-api-access-885x9") pod "66dea222-81f4-4740-b61e-ba09e57bc967" (UID: "66dea222-81f4-4740-b61e-ba09e57bc967"). InnerVolumeSpecName "kube-api-access-885x9". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 05 19:45:05.801807 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:45:05.801774 2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-885x9\" (UniqueName: \"kubernetes.io/projected/66dea222-81f4-4740-b61e-ba09e57bc967-kube-api-access-885x9\") on node \"ip-10-0-133-7.ec2.internal\" DevicePath \"\"" Jul 05 19:45:06.449061 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:45:06.449027 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29721345-qfbts" Jul 05 19:45:06.449061 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:45:06.449056 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29721345-qfbts" event={"ID":"66dea222-81f4-4740-b61e-ba09e57bc967","Type":"ContainerDied","Data":"59d6c71efdaf2021a3a4157720e1df47d8b4b70a3900f7dcdbc32d6be9fa2668"} Jul 05 19:45:06.449269 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:45:06.449098 2572 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="59d6c71efdaf2021a3a4157720e1df47d8b4b70a3900f7dcdbc32d6be9fa2668" Jul 05 19:45:21.096437 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:45:21.096400 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jt8wt"] Jul 05 19:45:32.482051 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:45:32.482010 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jt8wt"] Jul 05 19:45:42.585550 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:45:42.585516 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jt8wt"] Jul 05 19:45:52.009341 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:45:52.009264 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jt8wt"] Jul 05 19:46:03.679929 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:46:03.679893 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jt8wt"] Jul 05 19:46:29.880758 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:46:29.880722 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jt8wt"] Jul 05 19:46:43.481142 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:46:43.481102 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jt8wt"] Jul 05 19:47:17.583739 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:47:17.583693 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jt8wt"] Jul 05 19:47:26.790496 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:47:26.790403 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jt8wt"] Jul 05 19:47:26.959307 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:47:26.959269 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-plqpb_ac3142e8-817c-493b-b998-41ff8f4680f9/console-operator/1.log" Jul 05 19:47:26.959905 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:47:26.959871 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-plqpb_ac3142e8-817c-493b-b998-41ff8f4680f9/console-operator/1.log" Jul 05 19:47:34.686240 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:47:34.686205 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jt8wt"] Jul 05 19:47:45.080905 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:47:45.080872 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jt8wt"] Jul 05 19:47:54.592803 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:47:54.592763 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jt8wt"] Jul 05 19:48:04.284310 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:48:04.284271 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jt8wt"] Jul 05 19:48:15.682198 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:48:15.682162 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jt8wt"] Jul 05 19:48:22.487417 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:48:22.487383 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jt8wt"] Jul 05 19:48:29.781205 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:48:29.781171 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jt8wt"] Jul 05 19:48:38.988868 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:48:38.988833 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jt8wt"] Jul 05 19:48:50.987528 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:48:50.987445 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jt8wt"] Jul 05 19:48:59.792845 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:48:59.792806 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jt8wt"] Jul 05 19:49:22.891975 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:49:22.891920 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jt8wt"] Jul 05 19:49:32.283768 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:49:32.283734 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jt8wt"] Jul 05 19:49:49.190453 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:49:49.188516 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jt8wt"] Jul 05 19:49:59.588472 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:49:59.588438 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jt8wt"] Jul 05 19:50:08.181410 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:50:08.181376 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jt8wt"] Jul 05 19:50:17.283484 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:50:17.283438 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jt8wt"] Jul 05 19:50:25.790617 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:50:25.790536 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jt8wt"] Jul 05 19:50:53.606679 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:50:53.606645 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-dr2xp"] Jul 05 19:50:53.607315 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:50:53.606895 2572 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-dr2xp" podUID="f1736b0f-4e11-4cdc-a684-cb59f46e7e38" containerName="manager" containerID="cri-o://b84aa1deffb8cf585ea4ac8680e236d9c8ee3070b80a1cf87f03cbe4cee13e29" gracePeriod=10 Jul 05 19:50:56.122926 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:50:56.122884 2572 generic.go:356] "Generic (PLEG): container finished" podID="f1736b0f-4e11-4cdc-a684-cb59f46e7e38" containerID="b84aa1deffb8cf585ea4ac8680e236d9c8ee3070b80a1cf87f03cbe4cee13e29" exitCode=0 Jul 05 19:50:56.123356 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:50:56.122985 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-dr2xp" event={"ID":"f1736b0f-4e11-4cdc-a684-cb59f46e7e38","Type":"ContainerDied","Data":"b84aa1deffb8cf585ea4ac8680e236d9c8ee3070b80a1cf87f03cbe4cee13e29"} Jul 05 19:50:56.567273 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:50:56.567247 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-dr2xp" Jul 05 19:50:56.746268 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:50:56.746236 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/f1736b0f-4e11-4cdc-a684-cb59f46e7e38-extensions-socket-volume\") pod \"f1736b0f-4e11-4cdc-a684-cb59f46e7e38\" (UID: \"f1736b0f-4e11-4cdc-a684-cb59f46e7e38\") " Jul 05 19:50:56.746439 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:50:56.746306 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bxjkf\" (UniqueName: \"kubernetes.io/projected/f1736b0f-4e11-4cdc-a684-cb59f46e7e38-kube-api-access-bxjkf\") pod \"f1736b0f-4e11-4cdc-a684-cb59f46e7e38\" (UID: \"f1736b0f-4e11-4cdc-a684-cb59f46e7e38\") " Jul 05 19:50:56.746613 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:50:56.746590 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f1736b0f-4e11-4cdc-a684-cb59f46e7e38-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "f1736b0f-4e11-4cdc-a684-cb59f46e7e38" (UID: "f1736b0f-4e11-4cdc-a684-cb59f46e7e38"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 05 19:50:56.748654 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:50:56.748621 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f1736b0f-4e11-4cdc-a684-cb59f46e7e38-kube-api-access-bxjkf" (OuterVolumeSpecName: "kube-api-access-bxjkf") pod "f1736b0f-4e11-4cdc-a684-cb59f46e7e38" (UID: "f1736b0f-4e11-4cdc-a684-cb59f46e7e38"). InnerVolumeSpecName "kube-api-access-bxjkf". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 05 19:50:56.847732 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:50:56.847694 2572 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/f1736b0f-4e11-4cdc-a684-cb59f46e7e38-extensions-socket-volume\") on node \"ip-10-0-133-7.ec2.internal\" DevicePath \"\"" Jul 05 19:50:56.847732 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:50:56.847724 2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bxjkf\" (UniqueName: \"kubernetes.io/projected/f1736b0f-4e11-4cdc-a684-cb59f46e7e38-kube-api-access-bxjkf\") on node \"ip-10-0-133-7.ec2.internal\" DevicePath \"\"" Jul 05 19:50:57.128827 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:50:57.128744 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-dr2xp" event={"ID":"f1736b0f-4e11-4cdc-a684-cb59f46e7e38","Type":"ContainerDied","Data":"8556fb543e974f70586c24dc4557993464d84baab374b4e828dd65b6b727a314"} Jul 05 19:50:57.128827 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:50:57.128805 2572 scope.go:117] "RemoveContainer" containerID="b84aa1deffb8cf585ea4ac8680e236d9c8ee3070b80a1cf87f03cbe4cee13e29" Jul 05 19:50:57.129297 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:50:57.128749 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-dr2xp" Jul 05 19:50:57.149074 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:50:57.149047 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-dr2xp"] Jul 05 19:50:57.153189 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:50:57.153164 2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-dr2xp"] Jul 05 19:50:58.962571 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:50:58.962528 2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f1736b0f-4e11-4cdc-a684-cb59f46e7e38" path="/var/lib/kubelet/pods/f1736b0f-4e11-4cdc-a684-cb59f46e7e38/volumes" Jul 05 19:51:54.727640 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:51:54.727562 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-fhmg2"] Jul 05 19:51:54.728085 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:51:54.727921 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f1736b0f-4e11-4cdc-a684-cb59f46e7e38" containerName="manager" Jul 05 19:51:54.728085 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:51:54.727931 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="f1736b0f-4e11-4cdc-a684-cb59f46e7e38" containerName="manager" Jul 05 19:51:54.728085 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:51:54.727940 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="66dea222-81f4-4740-b61e-ba09e57bc967" containerName="cleanup" Jul 05 19:51:54.728085 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:51:54.727970 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="66dea222-81f4-4740-b61e-ba09e57bc967" containerName="cleanup" Jul 05 19:51:54.728085 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:51:54.728030 2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="66dea222-81f4-4740-b61e-ba09e57bc967" containerName="cleanup" Jul 05 19:51:54.728085 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:51:54.728039 2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="f1736b0f-4e11-4cdc-a684-cb59f46e7e38" containerName="manager" Jul 05 19:51:54.731015 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:51:54.730997 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-fhmg2" Jul 05 19:51:54.733644 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:51:54.733624 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-f6tz9\"" Jul 05 19:51:54.743183 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:51:54.743160 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-fhmg2"] Jul 05 19:51:54.824638 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:51:54.824606 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8wnkg\" (UniqueName: \"kubernetes.io/projected/3ec936c6-db14-4a04-90b5-765f91bda5db-kube-api-access-8wnkg\") pod \"kuadrant-operator-controller-manager-86878c769f-fhmg2\" (UID: \"3ec936c6-db14-4a04-90b5-765f91bda5db\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-fhmg2" Jul 05 19:51:54.824810 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:51:54.824645 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/3ec936c6-db14-4a04-90b5-765f91bda5db-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-fhmg2\" (UID: \"3ec936c6-db14-4a04-90b5-765f91bda5db\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-fhmg2" Jul 05 19:51:54.926032 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:51:54.925995 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8wnkg\" (UniqueName: \"kubernetes.io/projected/3ec936c6-db14-4a04-90b5-765f91bda5db-kube-api-access-8wnkg\") pod \"kuadrant-operator-controller-manager-86878c769f-fhmg2\" (UID: \"3ec936c6-db14-4a04-90b5-765f91bda5db\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-fhmg2" Jul 05 19:51:54.926166 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:51:54.926040 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/3ec936c6-db14-4a04-90b5-765f91bda5db-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-fhmg2\" (UID: \"3ec936c6-db14-4a04-90b5-765f91bda5db\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-fhmg2" Jul 05 19:51:54.926456 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:51:54.926437 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/3ec936c6-db14-4a04-90b5-765f91bda5db-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-fhmg2\" (UID: \"3ec936c6-db14-4a04-90b5-765f91bda5db\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-fhmg2" Jul 05 19:51:54.938933 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:51:54.938900 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8wnkg\" (UniqueName: \"kubernetes.io/projected/3ec936c6-db14-4a04-90b5-765f91bda5db-kube-api-access-8wnkg\") pod \"kuadrant-operator-controller-manager-86878c769f-fhmg2\" (UID: \"3ec936c6-db14-4a04-90b5-765f91bda5db\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-fhmg2" Jul 05 19:51:55.041112 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:51:55.041032 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-fhmg2" Jul 05 19:51:55.174809 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:51:55.174765 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-fhmg2"] Jul 05 19:51:55.178639 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:51:55.178613 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3ec936c6_db14_4a04_90b5_765f91bda5db.slice/crio-3ab271d4444f5e687d31e4c1ddfcd8009734be60d1da7a1abaa92e584a4ce21b WatchSource:0}: Error finding container 3ab271d4444f5e687d31e4c1ddfcd8009734be60d1da7a1abaa92e584a4ce21b: Status 404 returned error can't find the container with id 3ab271d4444f5e687d31e4c1ddfcd8009734be60d1da7a1abaa92e584a4ce21b Jul 05 19:51:55.401417 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:51:55.401320 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-fhmg2" event={"ID":"3ec936c6-db14-4a04-90b5-765f91bda5db","Type":"ContainerStarted","Data":"f78581b612d2110354d7cc92465915cc02c214de0a948ee1d5d9f6a92db4c0ae"} Jul 05 19:51:55.401417 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:51:55.401373 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-fhmg2" event={"ID":"3ec936c6-db14-4a04-90b5-765f91bda5db","Type":"ContainerStarted","Data":"3ab271d4444f5e687d31e4c1ddfcd8009734be60d1da7a1abaa92e584a4ce21b"} Jul 05 19:51:55.401638 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:51:55.401446 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-fhmg2" Jul 05 19:51:55.419730 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:51:55.419682 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-fhmg2" podStartSLOduration=1.419664337 podStartE2EDuration="1.419664337s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-05 19:51:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 19:51:55.417299082 +0000 UTC m=+1168.816646548" watchObservedRunningTime="2026-07-05 19:51:55.419664337 +0000 UTC m=+1168.819011802" Jul 05 19:52:06.408007 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:52:06.407944 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-fhmg2" Jul 05 19:52:14.383072 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:52:14.383029 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jt8wt"] Jul 05 19:52:25.186283 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:52:25.186242 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jt8wt"] Jul 05 19:52:26.990880 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:52:26.990851 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-plqpb_ac3142e8-817c-493b-b998-41ff8f4680f9/console-operator/1.log" Jul 05 19:52:26.991317 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:52:26.991301 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-plqpb_ac3142e8-817c-493b-b998-41ff8f4680f9/console-operator/1.log" Jul 05 19:52:35.386204 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:52:35.386170 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jt8wt"] Jul 05 19:52:42.386222 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:52:42.386184 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jt8wt"] Jul 05 19:52:53.181688 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:52:53.181653 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jt8wt"] Jul 05 19:53:01.678259 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:53:01.678222 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jt8wt"] Jul 05 19:53:11.785747 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:53:11.785711 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jt8wt"] Jul 05 19:53:22.693415 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:53:22.693341 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jt8wt"] Jul 05 19:53:32.380359 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:53:32.380319 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jt8wt"] Jul 05 19:53:42.085781 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:53:42.085739 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jt8wt"] Jul 05 19:53:54.283114 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:53:54.283078 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jt8wt"] Jul 05 19:54:01.387911 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:54:01.387872 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jt8wt"] Jul 05 19:54:20.082288 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:54:20.082256 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jt8wt"] Jul 05 19:54:28.652112 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:54:28.652075 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jt8wt"] Jul 05 19:54:39.188244 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:54:39.188210 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jt8wt"] Jul 05 19:54:50.875507 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:54:50.875421 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jt8wt"] Jul 05 19:55:04.982914 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:55:04.982877 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jt8wt"] Jul 05 19:55:13.802294 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:55:13.802258 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jt8wt"] Jul 05 19:55:22.181163 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:55:22.181127 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jt8wt"] Jul 05 19:55:31.590036 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:55:31.589993 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jt8wt"] Jul 05 19:55:41.287121 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:55:41.287089 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jt8wt"] Jul 05 19:55:50.080513 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:55:50.080479 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jt8wt"] Jul 05 19:55:55.580564 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:55:55.580524 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jt8wt"] Jul 05 19:56:04.090418 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:56:04.090380 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jt8wt"] Jul 05 19:56:12.788845 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:56:12.788811 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jt8wt"] Jul 05 19:56:21.890296 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:56:21.890203 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jt8wt"] Jul 05 19:56:32.787105 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:56:32.787057 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jt8wt"] Jul 05 19:56:43.582467 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:56:43.582431 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jt8wt"] Jul 05 19:56:52.286250 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:56:52.286210 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jt8wt"] Jul 05 19:57:03.990131 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:57:03.990086 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jt8wt"] Jul 05 19:57:15.088577 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:57:15.088534 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jt8wt"] Jul 05 19:57:27.028109 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:57:27.028076 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-plqpb_ac3142e8-817c-493b-b998-41ff8f4680f9/console-operator/1.log" Jul 05 19:57:27.028617 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:57:27.028212 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-plqpb_ac3142e8-817c-493b-b998-41ff8f4680f9/console-operator/1.log" Jul 05 19:57:28.184115 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:57:28.184078 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jt8wt"] Jul 05 19:57:36.485527 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:57:36.485487 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jt8wt"] Jul 05 19:57:49.187345 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:57:49.187260 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jt8wt"] Jul 05 19:57:57.124015 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:57:57.123975 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jt8wt"] Jul 05 19:58:04.902598 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:58:04.902561 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-ait-da958447-bbc4c6c67-hpc4l"] Jul 05 19:58:04.906003 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:58:04.905979 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-ait-da958447-bbc4c6c67-hpc4l" Jul 05 19:58:04.908453 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:58:04.908431 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-zrsnl\"" Jul 05 19:58:04.908587 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:58:04.908432 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-ait-da958447-serving-cert\"" Jul 05 19:58:04.915227 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:58:04.915160 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-ait-da958447-bbc4c6c67-hpc4l"] Jul 05 19:58:04.984167 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:58:04.984127 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k98sp\" (UniqueName: \"kubernetes.io/projected/a1adbc15-f409-451a-95a1-90e50541f6d5-kube-api-access-k98sp\") pod \"maas-api-e2e-ait-da958447-bbc4c6c67-hpc4l\" (UID: \"a1adbc15-f409-451a-95a1-90e50541f6d5\") " pod="opendatahub/maas-api-e2e-ait-da958447-bbc4c6c67-hpc4l" Jul 05 19:58:04.984364 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:58:04.984189 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a1adbc15-f409-451a-95a1-90e50541f6d5-maas-api-tls\") pod \"maas-api-e2e-ait-da958447-bbc4c6c67-hpc4l\" (UID: \"a1adbc15-f409-451a-95a1-90e50541f6d5\") " pod="opendatahub/maas-api-e2e-ait-da958447-bbc4c6c67-hpc4l" Jul 05 19:58:04.984364 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:58:04.984244 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a1adbc15-f409-451a-95a1-90e50541f6d5-openshift-service-ca\") pod \"maas-api-e2e-ait-da958447-bbc4c6c67-hpc4l\" (UID: \"a1adbc15-f409-451a-95a1-90e50541f6d5\") " pod="opendatahub/maas-api-e2e-ait-da958447-bbc4c6c67-hpc4l" Jul 05 19:58:05.084833 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:58:05.084800 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k98sp\" (UniqueName: \"kubernetes.io/projected/a1adbc15-f409-451a-95a1-90e50541f6d5-kube-api-access-k98sp\") pod \"maas-api-e2e-ait-da958447-bbc4c6c67-hpc4l\" (UID: \"a1adbc15-f409-451a-95a1-90e50541f6d5\") " pod="opendatahub/maas-api-e2e-ait-da958447-bbc4c6c67-hpc4l" Jul 05 19:58:05.085039 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:58:05.084846 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a1adbc15-f409-451a-95a1-90e50541f6d5-maas-api-tls\") pod \"maas-api-e2e-ait-da958447-bbc4c6c67-hpc4l\" (UID: \"a1adbc15-f409-451a-95a1-90e50541f6d5\") " pod="opendatahub/maas-api-e2e-ait-da958447-bbc4c6c67-hpc4l" Jul 05 19:58:05.085039 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:58:05.084875 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a1adbc15-f409-451a-95a1-90e50541f6d5-openshift-service-ca\") pod \"maas-api-e2e-ait-da958447-bbc4c6c67-hpc4l\" (UID: \"a1adbc15-f409-451a-95a1-90e50541f6d5\") " pod="opendatahub/maas-api-e2e-ait-da958447-bbc4c6c67-hpc4l" Jul 05 19:58:05.085039 ip-10-0-133-7 kubenswrapper[2572]: E0705 19:58:05.084978 2572 secret.go:189] Couldn't get secret opendatahub/maas-api-e2e-ait-da958447-serving-cert: secret "maas-api-e2e-ait-da958447-serving-cert" not found Jul 05 19:58:05.085153 ip-10-0-133-7 kubenswrapper[2572]: E0705 19:58:05.085041 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a1adbc15-f409-451a-95a1-90e50541f6d5-maas-api-tls podName:a1adbc15-f409-451a-95a1-90e50541f6d5 nodeName:}" failed. No retries permitted until 2026-07-05 19:58:05.585022757 +0000 UTC m=+1538.984370212 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/a1adbc15-f409-451a-95a1-90e50541f6d5-maas-api-tls") pod "maas-api-e2e-ait-da958447-bbc4c6c67-hpc4l" (UID: "a1adbc15-f409-451a-95a1-90e50541f6d5") : secret "maas-api-e2e-ait-da958447-serving-cert" not found Jul 05 19:58:05.085486 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:58:05.085468 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a1adbc15-f409-451a-95a1-90e50541f6d5-openshift-service-ca\") pod \"maas-api-e2e-ait-da958447-bbc4c6c67-hpc4l\" (UID: \"a1adbc15-f409-451a-95a1-90e50541f6d5\") " pod="opendatahub/maas-api-e2e-ait-da958447-bbc4c6c67-hpc4l" Jul 05 19:58:05.093602 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:58:05.093582 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k98sp\" (UniqueName: \"kubernetes.io/projected/a1adbc15-f409-451a-95a1-90e50541f6d5-kube-api-access-k98sp\") pod \"maas-api-e2e-ait-da958447-bbc4c6c67-hpc4l\" (UID: \"a1adbc15-f409-451a-95a1-90e50541f6d5\") " pod="opendatahub/maas-api-e2e-ait-da958447-bbc4c6c67-hpc4l" Jul 05 19:58:05.590362 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:58:05.590322 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a1adbc15-f409-451a-95a1-90e50541f6d5-maas-api-tls\") pod \"maas-api-e2e-ait-da958447-bbc4c6c67-hpc4l\" (UID: \"a1adbc15-f409-451a-95a1-90e50541f6d5\") " pod="opendatahub/maas-api-e2e-ait-da958447-bbc4c6c67-hpc4l" Jul 05 19:58:05.592785 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:58:05.592755 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a1adbc15-f409-451a-95a1-90e50541f6d5-maas-api-tls\") pod \"maas-api-e2e-ait-da958447-bbc4c6c67-hpc4l\" (UID: \"a1adbc15-f409-451a-95a1-90e50541f6d5\") " pod="opendatahub/maas-api-e2e-ait-da958447-bbc4c6c67-hpc4l" Jul 05 19:58:05.817903 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:58:05.817858 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-ait-da958447-bbc4c6c67-hpc4l" Jul 05 19:58:05.959165 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:58:05.959139 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-ait-da958447-bbc4c6c67-hpc4l"] Jul 05 19:58:05.961447 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:58:05.961413 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda1adbc15_f409_451a_95a1_90e50541f6d5.slice/crio-884e6e21ce2a042d04e25be148c78a2a54d0f6cb1910b4e24405a8812c125293 WatchSource:0}: Error finding container 884e6e21ce2a042d04e25be148c78a2a54d0f6cb1910b4e24405a8812c125293: Status 404 returned error can't find the container with id 884e6e21ce2a042d04e25be148c78a2a54d0f6cb1910b4e24405a8812c125293 Jul 05 19:58:05.962702 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:58:05.962683 2572 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 05 19:58:06.163602 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:58:06.163529 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-ait-da958447-bbc4c6c67-hpc4l" event={"ID":"a1adbc15-f409-451a-95a1-90e50541f6d5","Type":"ContainerStarted","Data":"884e6e21ce2a042d04e25be148c78a2a54d0f6cb1910b4e24405a8812c125293"} Jul 05 19:58:08.176873 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:58:08.176831 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-ait-da958447-bbc4c6c67-hpc4l" event={"ID":"a1adbc15-f409-451a-95a1-90e50541f6d5","Type":"ContainerStarted","Data":"29a1741306ee495a17d20b8df4d466efe049c4b234a916dc039f5362aaf19069"} Jul 05 19:58:08.177273 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:58:08.176920 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-ait-da958447-bbc4c6c67-hpc4l" Jul 05 19:58:08.192482 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:58:08.192433 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-ait-da958447-bbc4c6c67-hpc4l" podStartSLOduration=2.5379101520000003 podStartE2EDuration="4.192418221s" totalImagesPullingTime="1.654508069s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-05 19:58:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 19:58:08.191123112 +0000 UTC m=+1541.590470580" watchObservedRunningTime="2026-07-05 19:58:08.192418221 +0000 UTC m=+1541.591765688" Jul 05 19:58:10.127215 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:58:10.127185 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-ait-da958447-bbc4c6c67-hpc4l"] Jul 05 19:58:10.185415 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:58:10.185382 2572 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-ait-da958447-bbc4c6c67-hpc4l" podUID="a1adbc15-f409-451a-95a1-90e50541f6d5" containerName="maas-api" containerID="cri-o://29a1741306ee495a17d20b8df4d466efe049c4b234a916dc039f5362aaf19069" gracePeriod=30 Jul 05 19:58:10.441784 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:58:10.441758 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-ait-da958447-bbc4c6c67-hpc4l" Jul 05 19:58:10.542102 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:58:10.542072 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a1adbc15-f409-451a-95a1-90e50541f6d5-maas-api-tls\") pod \"a1adbc15-f409-451a-95a1-90e50541f6d5\" (UID: \"a1adbc15-f409-451a-95a1-90e50541f6d5\") " Jul 05 19:58:10.542266 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:58:10.542122 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-k98sp\" (UniqueName: \"kubernetes.io/projected/a1adbc15-f409-451a-95a1-90e50541f6d5-kube-api-access-k98sp\") pod \"a1adbc15-f409-451a-95a1-90e50541f6d5\" (UID: \"a1adbc15-f409-451a-95a1-90e50541f6d5\") " Jul 05 19:58:10.542266 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:58:10.542157 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a1adbc15-f409-451a-95a1-90e50541f6d5-openshift-service-ca\") pod \"a1adbc15-f409-451a-95a1-90e50541f6d5\" (UID: \"a1adbc15-f409-451a-95a1-90e50541f6d5\") " Jul 05 19:58:10.542614 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:58:10.542587 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a1adbc15-f409-451a-95a1-90e50541f6d5-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "a1adbc15-f409-451a-95a1-90e50541f6d5" (UID: "a1adbc15-f409-451a-95a1-90e50541f6d5"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 05 19:58:10.544335 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:58:10.544311 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a1adbc15-f409-451a-95a1-90e50541f6d5-kube-api-access-k98sp" (OuterVolumeSpecName: "kube-api-access-k98sp") pod "a1adbc15-f409-451a-95a1-90e50541f6d5" (UID: "a1adbc15-f409-451a-95a1-90e50541f6d5"). InnerVolumeSpecName "kube-api-access-k98sp". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 05 19:58:10.544426 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:58:10.544314 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a1adbc15-f409-451a-95a1-90e50541f6d5-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "a1adbc15-f409-451a-95a1-90e50541f6d5" (UID: "a1adbc15-f409-451a-95a1-90e50541f6d5"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 05 19:58:10.643701 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:58:10.643665 2572 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a1adbc15-f409-451a-95a1-90e50541f6d5-openshift-service-ca\") on node \"ip-10-0-133-7.ec2.internal\" DevicePath \"\"" Jul 05 19:58:10.643701 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:58:10.643697 2572 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a1adbc15-f409-451a-95a1-90e50541f6d5-maas-api-tls\") on node \"ip-10-0-133-7.ec2.internal\" DevicePath \"\"" Jul 05 19:58:10.643891 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:58:10.643709 2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-k98sp\" (UniqueName: \"kubernetes.io/projected/a1adbc15-f409-451a-95a1-90e50541f6d5-kube-api-access-k98sp\") on node \"ip-10-0-133-7.ec2.internal\" DevicePath \"\"" Jul 05 19:58:11.191790 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:58:11.191759 2572 generic.go:356] "Generic (PLEG): container finished" podID="a1adbc15-f409-451a-95a1-90e50541f6d5" containerID="29a1741306ee495a17d20b8df4d466efe049c4b234a916dc039f5362aaf19069" exitCode=0 Jul 05 19:58:11.192294 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:58:11.191812 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-ait-da958447-bbc4c6c67-hpc4l" Jul 05 19:58:11.192294 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:58:11.191850 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-ait-da958447-bbc4c6c67-hpc4l" event={"ID":"a1adbc15-f409-451a-95a1-90e50541f6d5","Type":"ContainerDied","Data":"29a1741306ee495a17d20b8df4d466efe049c4b234a916dc039f5362aaf19069"} Jul 05 19:58:11.192294 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:58:11.191909 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-ait-da958447-bbc4c6c67-hpc4l" event={"ID":"a1adbc15-f409-451a-95a1-90e50541f6d5","Type":"ContainerDied","Data":"884e6e21ce2a042d04e25be148c78a2a54d0f6cb1910b4e24405a8812c125293"} Jul 05 19:58:11.192294 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:58:11.191971 2572 scope.go:117] "RemoveContainer" containerID="29a1741306ee495a17d20b8df4d466efe049c4b234a916dc039f5362aaf19069" Jul 05 19:58:11.200741 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:58:11.200717 2572 scope.go:117] "RemoveContainer" containerID="29a1741306ee495a17d20b8df4d466efe049c4b234a916dc039f5362aaf19069" Jul 05 19:58:11.201085 ip-10-0-133-7 kubenswrapper[2572]: E0705 19:58:11.201063 2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"29a1741306ee495a17d20b8df4d466efe049c4b234a916dc039f5362aaf19069\": container with ID starting with 29a1741306ee495a17d20b8df4d466efe049c4b234a916dc039f5362aaf19069 not found: ID does not exist" containerID="29a1741306ee495a17d20b8df4d466efe049c4b234a916dc039f5362aaf19069" Jul 05 19:58:11.201141 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:58:11.201095 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"29a1741306ee495a17d20b8df4d466efe049c4b234a916dc039f5362aaf19069"} err="failed to get container status \"29a1741306ee495a17d20b8df4d466efe049c4b234a916dc039f5362aaf19069\": rpc error: code = NotFound desc = could not find container \"29a1741306ee495a17d20b8df4d466efe049c4b234a916dc039f5362aaf19069\": container with ID starting with 29a1741306ee495a17d20b8df4d466efe049c4b234a916dc039f5362aaf19069 not found: ID does not exist" Jul 05 19:58:11.208898 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:58:11.208872 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-ait-da958447-bbc4c6c67-hpc4l"] Jul 05 19:58:11.212444 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:58:11.212416 2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-ait-da958447-bbc4c6c67-hpc4l"] Jul 05 19:58:12.962654 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:58:12.962620 2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a1adbc15-f409-451a-95a1-90e50541f6d5" path="/var/lib/kubelet/pods/a1adbc15-f409-451a-95a1-90e50541f6d5/volumes" Jul 05 19:58:17.476081 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:58:17.476051 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-ait-bc72bde8-84c85c484-qp58m"] Jul 05 19:58:17.476439 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:58:17.476401 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a1adbc15-f409-451a-95a1-90e50541f6d5" containerName="maas-api" Jul 05 19:58:17.476439 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:58:17.476412 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="a1adbc15-f409-451a-95a1-90e50541f6d5" containerName="maas-api" Jul 05 19:58:17.476503 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:58:17.476486 2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="a1adbc15-f409-451a-95a1-90e50541f6d5" containerName="maas-api" Jul 05 19:58:17.481652 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:58:17.481630 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-ait-bc72bde8-84c85c484-qp58m" Jul 05 19:58:17.484090 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:58:17.484068 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-ait-bc72bde8-serving-cert\"" Jul 05 19:58:17.484218 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:58:17.484131 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-zrsnl\"" Jul 05 19:58:17.488599 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:58:17.488575 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-ait-bc72bde8-84c85c484-qp58m"] Jul 05 19:58:17.601804 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:58:17.601772 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/56d1f912-2189-4a3b-8748-dd69258c1d4b-maas-api-tls\") pod \"maas-api-e2e-ait-bc72bde8-84c85c484-qp58m\" (UID: \"56d1f912-2189-4a3b-8748-dd69258c1d4b\") " pod="opendatahub/maas-api-e2e-ait-bc72bde8-84c85c484-qp58m" Jul 05 19:58:17.601973 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:58:17.601858 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zpb9l\" (UniqueName: \"kubernetes.io/projected/56d1f912-2189-4a3b-8748-dd69258c1d4b-kube-api-access-zpb9l\") pod \"maas-api-e2e-ait-bc72bde8-84c85c484-qp58m\" (UID: \"56d1f912-2189-4a3b-8748-dd69258c1d4b\") " pod="opendatahub/maas-api-e2e-ait-bc72bde8-84c85c484-qp58m" Jul 05 19:58:17.601973 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:58:17.601882 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/56d1f912-2189-4a3b-8748-dd69258c1d4b-openshift-service-ca\") pod \"maas-api-e2e-ait-bc72bde8-84c85c484-qp58m\" (UID: \"56d1f912-2189-4a3b-8748-dd69258c1d4b\") " pod="opendatahub/maas-api-e2e-ait-bc72bde8-84c85c484-qp58m" Jul 05 19:58:17.702423 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:58:17.702392 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zpb9l\" (UniqueName: \"kubernetes.io/projected/56d1f912-2189-4a3b-8748-dd69258c1d4b-kube-api-access-zpb9l\") pod \"maas-api-e2e-ait-bc72bde8-84c85c484-qp58m\" (UID: \"56d1f912-2189-4a3b-8748-dd69258c1d4b\") " pod="opendatahub/maas-api-e2e-ait-bc72bde8-84c85c484-qp58m" Jul 05 19:58:17.702423 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:58:17.702427 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/56d1f912-2189-4a3b-8748-dd69258c1d4b-openshift-service-ca\") pod \"maas-api-e2e-ait-bc72bde8-84c85c484-qp58m\" (UID: \"56d1f912-2189-4a3b-8748-dd69258c1d4b\") " pod="opendatahub/maas-api-e2e-ait-bc72bde8-84c85c484-qp58m" Jul 05 19:58:17.702611 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:58:17.702483 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/56d1f912-2189-4a3b-8748-dd69258c1d4b-maas-api-tls\") pod \"maas-api-e2e-ait-bc72bde8-84c85c484-qp58m\" (UID: \"56d1f912-2189-4a3b-8748-dd69258c1d4b\") " pod="opendatahub/maas-api-e2e-ait-bc72bde8-84c85c484-qp58m" Jul 05 19:58:17.703312 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:58:17.703293 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/56d1f912-2189-4a3b-8748-dd69258c1d4b-openshift-service-ca\") pod \"maas-api-e2e-ait-bc72bde8-84c85c484-qp58m\" (UID: \"56d1f912-2189-4a3b-8748-dd69258c1d4b\") " pod="opendatahub/maas-api-e2e-ait-bc72bde8-84c85c484-qp58m" Jul 05 19:58:17.705028 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:58:17.705007 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/56d1f912-2189-4a3b-8748-dd69258c1d4b-maas-api-tls\") pod \"maas-api-e2e-ait-bc72bde8-84c85c484-qp58m\" (UID: \"56d1f912-2189-4a3b-8748-dd69258c1d4b\") " pod="opendatahub/maas-api-e2e-ait-bc72bde8-84c85c484-qp58m" Jul 05 19:58:17.710425 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:58:17.710405 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zpb9l\" (UniqueName: \"kubernetes.io/projected/56d1f912-2189-4a3b-8748-dd69258c1d4b-kube-api-access-zpb9l\") pod \"maas-api-e2e-ait-bc72bde8-84c85c484-qp58m\" (UID: \"56d1f912-2189-4a3b-8748-dd69258c1d4b\") " pod="opendatahub/maas-api-e2e-ait-bc72bde8-84c85c484-qp58m" Jul 05 19:58:17.795102 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:58:17.795049 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-ait-bc72bde8-84c85c484-qp58m" Jul 05 19:58:17.935233 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:58:17.935207 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-ait-bc72bde8-84c85c484-qp58m"] Jul 05 19:58:17.937701 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:58:17.937668 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod56d1f912_2189_4a3b_8748_dd69258c1d4b.slice/crio-8bd9c018067a18cd1562f09b427510eaa9f52f54f0c43fba91d3aebe8b1149d1 WatchSource:0}: Error finding container 8bd9c018067a18cd1562f09b427510eaa9f52f54f0c43fba91d3aebe8b1149d1: Status 404 returned error can't find the container with id 8bd9c018067a18cd1562f09b427510eaa9f52f54f0c43fba91d3aebe8b1149d1 Jul 05 19:58:18.228362 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:58:18.228325 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-ait-bc72bde8-84c85c484-qp58m" event={"ID":"56d1f912-2189-4a3b-8748-dd69258c1d4b","Type":"ContainerStarted","Data":"8bd9c018067a18cd1562f09b427510eaa9f52f54f0c43fba91d3aebe8b1149d1"} Jul 05 19:58:19.237040 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:58:19.236990 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-ait-bc72bde8-84c85c484-qp58m" event={"ID":"56d1f912-2189-4a3b-8748-dd69258c1d4b","Type":"ContainerStarted","Data":"ea29a828e22d52d9899f1a25ccf651b0254495a3fb1ecba6d0cb228f4fed5754"} Jul 05 19:58:19.237502 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:58:19.237157 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-ait-bc72bde8-84c85c484-qp58m" Jul 05 19:58:19.253726 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:58:19.253675 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-ait-bc72bde8-84c85c484-qp58m" podStartSLOduration=1.923890334 podStartE2EDuration="2.253657121s" totalImagesPullingTime="329.766787ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-05 19:58:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 19:58:19.252680163 +0000 UTC m=+1552.652027634" watchObservedRunningTime="2026-07-05 19:58:19.253657121 +0000 UTC m=+1552.653004587" Jul 05 19:58:20.076148 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:58:20.076103 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jt8wt"] Jul 05 19:58:22.637974 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:58:22.637118 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-ait-bc72bde8-84c85c484-qp58m"] Jul 05 19:58:22.637974 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:58:22.637346 2572 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-ait-bc72bde8-84c85c484-qp58m" podUID="56d1f912-2189-4a3b-8748-dd69258c1d4b" containerName="maas-api" containerID="cri-o://ea29a828e22d52d9899f1a25ccf651b0254495a3fb1ecba6d0cb228f4fed5754" gracePeriod=30 Jul 05 19:58:22.893806 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:58:22.893743 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-ait-bc72bde8-84c85c484-qp58m" Jul 05 19:58:22.953513 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:58:22.953483 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zpb9l\" (UniqueName: \"kubernetes.io/projected/56d1f912-2189-4a3b-8748-dd69258c1d4b-kube-api-access-zpb9l\") pod \"56d1f912-2189-4a3b-8748-dd69258c1d4b\" (UID: \"56d1f912-2189-4a3b-8748-dd69258c1d4b\") " Jul 05 19:58:22.953702 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:58:22.953531 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/56d1f912-2189-4a3b-8748-dd69258c1d4b-openshift-service-ca\") pod \"56d1f912-2189-4a3b-8748-dd69258c1d4b\" (UID: \"56d1f912-2189-4a3b-8748-dd69258c1d4b\") " Jul 05 19:58:22.953702 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:58:22.953618 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/56d1f912-2189-4a3b-8748-dd69258c1d4b-maas-api-tls\") pod \"56d1f912-2189-4a3b-8748-dd69258c1d4b\" (UID: \"56d1f912-2189-4a3b-8748-dd69258c1d4b\") " Jul 05 19:58:22.954022 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:58:22.953992 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/56d1f912-2189-4a3b-8748-dd69258c1d4b-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "56d1f912-2189-4a3b-8748-dd69258c1d4b" (UID: "56d1f912-2189-4a3b-8748-dd69258c1d4b"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 05 19:58:22.955727 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:58:22.955698 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/56d1f912-2189-4a3b-8748-dd69258c1d4b-kube-api-access-zpb9l" (OuterVolumeSpecName: "kube-api-access-zpb9l") pod "56d1f912-2189-4a3b-8748-dd69258c1d4b" (UID: "56d1f912-2189-4a3b-8748-dd69258c1d4b"). InnerVolumeSpecName "kube-api-access-zpb9l". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 05 19:58:22.955727 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:58:22.955706 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/56d1f912-2189-4a3b-8748-dd69258c1d4b-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "56d1f912-2189-4a3b-8748-dd69258c1d4b" (UID: "56d1f912-2189-4a3b-8748-dd69258c1d4b"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 05 19:58:23.054732 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:58:23.054692 2572 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/56d1f912-2189-4a3b-8748-dd69258c1d4b-maas-api-tls\") on node \"ip-10-0-133-7.ec2.internal\" DevicePath \"\"" Jul 05 19:58:23.054732 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:58:23.054727 2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zpb9l\" (UniqueName: \"kubernetes.io/projected/56d1f912-2189-4a3b-8748-dd69258c1d4b-kube-api-access-zpb9l\") on node \"ip-10-0-133-7.ec2.internal\" DevicePath \"\"" Jul 05 19:58:23.054732 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:58:23.054741 2572 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/56d1f912-2189-4a3b-8748-dd69258c1d4b-openshift-service-ca\") on node \"ip-10-0-133-7.ec2.internal\" DevicePath \"\"" Jul 05 19:58:23.257357 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:58:23.257321 2572 generic.go:356] "Generic (PLEG): container finished" podID="56d1f912-2189-4a3b-8748-dd69258c1d4b" containerID="ea29a828e22d52d9899f1a25ccf651b0254495a3fb1ecba6d0cb228f4fed5754" exitCode=0 Jul 05 19:58:23.257532 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:58:23.257369 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-ait-bc72bde8-84c85c484-qp58m" Jul 05 19:58:23.257532 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:58:23.257414 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-ait-bc72bde8-84c85c484-qp58m" event={"ID":"56d1f912-2189-4a3b-8748-dd69258c1d4b","Type":"ContainerDied","Data":"ea29a828e22d52d9899f1a25ccf651b0254495a3fb1ecba6d0cb228f4fed5754"} Jul 05 19:58:23.257532 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:58:23.257474 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-ait-bc72bde8-84c85c484-qp58m" event={"ID":"56d1f912-2189-4a3b-8748-dd69258c1d4b","Type":"ContainerDied","Data":"8bd9c018067a18cd1562f09b427510eaa9f52f54f0c43fba91d3aebe8b1149d1"} Jul 05 19:58:23.257532 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:58:23.257510 2572 scope.go:117] "RemoveContainer" containerID="ea29a828e22d52d9899f1a25ccf651b0254495a3fb1ecba6d0cb228f4fed5754" Jul 05 19:58:23.266621 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:58:23.266601 2572 scope.go:117] "RemoveContainer" containerID="ea29a828e22d52d9899f1a25ccf651b0254495a3fb1ecba6d0cb228f4fed5754" Jul 05 19:58:23.266995 ip-10-0-133-7 kubenswrapper[2572]: E0705 19:58:23.266972 2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ea29a828e22d52d9899f1a25ccf651b0254495a3fb1ecba6d0cb228f4fed5754\": container with ID starting with ea29a828e22d52d9899f1a25ccf651b0254495a3fb1ecba6d0cb228f4fed5754 not found: ID does not exist" containerID="ea29a828e22d52d9899f1a25ccf651b0254495a3fb1ecba6d0cb228f4fed5754" Jul 05 19:58:23.267080 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:58:23.267005 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ea29a828e22d52d9899f1a25ccf651b0254495a3fb1ecba6d0cb228f4fed5754"} err="failed to get container status \"ea29a828e22d52d9899f1a25ccf651b0254495a3fb1ecba6d0cb228f4fed5754\": rpc error: code = NotFound desc = could not find container \"ea29a828e22d52d9899f1a25ccf651b0254495a3fb1ecba6d0cb228f4fed5754\": container with ID starting with ea29a828e22d52d9899f1a25ccf651b0254495a3fb1ecba6d0cb228f4fed5754 not found: ID does not exist" Jul 05 19:58:23.274545 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:58:23.274522 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-ait-bc72bde8-84c85c484-qp58m"] Jul 05 19:58:23.277775 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:58:23.277750 2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-ait-bc72bde8-84c85c484-qp58m"] Jul 05 19:58:24.963771 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:58:24.963737 2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="56d1f912-2189-4a3b-8748-dd69258c1d4b" path="/var/lib/kubelet/pods/56d1f912-2189-4a3b-8748-dd69258c1d4b/volumes" Jul 05 19:58:30.384165 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:58:30.384129 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jt8wt"] Jul 05 19:58:35.799816 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:58:35.799770 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-derive-b6596a5d-7ccb87547b-z8476"] Jul 05 19:58:35.800447 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:58:35.800427 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="56d1f912-2189-4a3b-8748-dd69258c1d4b" containerName="maas-api" Jul 05 19:58:35.800515 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:58:35.800452 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="56d1f912-2189-4a3b-8748-dd69258c1d4b" containerName="maas-api" Jul 05 19:58:35.800558 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:58:35.800546 2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="56d1f912-2189-4a3b-8748-dd69258c1d4b" containerName="maas-api" Jul 05 19:58:35.803992 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:58:35.803943 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-derive-b6596a5d-7ccb87547b-z8476" Jul 05 19:58:35.806450 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:58:35.806422 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-derive-b6596a5d-serving-cert\"" Jul 05 19:58:35.806572 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:58:35.806475 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-zrsnl\"" Jul 05 19:58:35.813192 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:58:35.813165 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-derive-b6596a5d-7ccb87547b-z8476"] Jul 05 19:58:35.979161 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:58:35.979118 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/cf5b2b4c-3fa7-4785-ae65-ffb19258ec5d-maas-api-tls\") pod \"maas-api-e2e-derive-b6596a5d-7ccb87547b-z8476\" (UID: \"cf5b2b4c-3fa7-4785-ae65-ffb19258ec5d\") " pod="opendatahub/maas-api-e2e-derive-b6596a5d-7ccb87547b-z8476" Jul 05 19:58:35.979344 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:58:35.979170 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/cf5b2b4c-3fa7-4785-ae65-ffb19258ec5d-openshift-service-ca\") pod \"maas-api-e2e-derive-b6596a5d-7ccb87547b-z8476\" (UID: \"cf5b2b4c-3fa7-4785-ae65-ffb19258ec5d\") " pod="opendatahub/maas-api-e2e-derive-b6596a5d-7ccb87547b-z8476" Jul 05 19:58:35.979344 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:58:35.979251 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dkgvz\" (UniqueName: \"kubernetes.io/projected/cf5b2b4c-3fa7-4785-ae65-ffb19258ec5d-kube-api-access-dkgvz\") pod \"maas-api-e2e-derive-b6596a5d-7ccb87547b-z8476\" (UID: \"cf5b2b4c-3fa7-4785-ae65-ffb19258ec5d\") " pod="opendatahub/maas-api-e2e-derive-b6596a5d-7ccb87547b-z8476" Jul 05 19:58:36.080220 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:58:36.080130 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dkgvz\" (UniqueName: \"kubernetes.io/projected/cf5b2b4c-3fa7-4785-ae65-ffb19258ec5d-kube-api-access-dkgvz\") pod \"maas-api-e2e-derive-b6596a5d-7ccb87547b-z8476\" (UID: \"cf5b2b4c-3fa7-4785-ae65-ffb19258ec5d\") " pod="opendatahub/maas-api-e2e-derive-b6596a5d-7ccb87547b-z8476" Jul 05 19:58:36.080407 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:58:36.080229 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/cf5b2b4c-3fa7-4785-ae65-ffb19258ec5d-maas-api-tls\") pod \"maas-api-e2e-derive-b6596a5d-7ccb87547b-z8476\" (UID: \"cf5b2b4c-3fa7-4785-ae65-ffb19258ec5d\") " pod="opendatahub/maas-api-e2e-derive-b6596a5d-7ccb87547b-z8476" Jul 05 19:58:36.080407 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:58:36.080260 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/cf5b2b4c-3fa7-4785-ae65-ffb19258ec5d-openshift-service-ca\") pod \"maas-api-e2e-derive-b6596a5d-7ccb87547b-z8476\" (UID: \"cf5b2b4c-3fa7-4785-ae65-ffb19258ec5d\") " pod="opendatahub/maas-api-e2e-derive-b6596a5d-7ccb87547b-z8476" Jul 05 19:58:36.080407 ip-10-0-133-7 kubenswrapper[2572]: E0705 19:58:36.080378 2572 secret.go:189] Couldn't get secret opendatahub/maas-api-e2e-derive-b6596a5d-serving-cert: secret "maas-api-e2e-derive-b6596a5d-serving-cert" not found Jul 05 19:58:36.080565 ip-10-0-133-7 kubenswrapper[2572]: E0705 19:58:36.080443 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cf5b2b4c-3fa7-4785-ae65-ffb19258ec5d-maas-api-tls podName:cf5b2b4c-3fa7-4785-ae65-ffb19258ec5d nodeName:}" failed. No retries permitted until 2026-07-05 19:58:36.580424895 +0000 UTC m=+1569.979772346 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/cf5b2b4c-3fa7-4785-ae65-ffb19258ec5d-maas-api-tls") pod "maas-api-e2e-derive-b6596a5d-7ccb87547b-z8476" (UID: "cf5b2b4c-3fa7-4785-ae65-ffb19258ec5d") : secret "maas-api-e2e-derive-b6596a5d-serving-cert" not found Jul 05 19:58:36.080879 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:58:36.080862 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/cf5b2b4c-3fa7-4785-ae65-ffb19258ec5d-openshift-service-ca\") pod \"maas-api-e2e-derive-b6596a5d-7ccb87547b-z8476\" (UID: \"cf5b2b4c-3fa7-4785-ae65-ffb19258ec5d\") " pod="opendatahub/maas-api-e2e-derive-b6596a5d-7ccb87547b-z8476" Jul 05 19:58:36.090657 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:58:36.090636 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dkgvz\" (UniqueName: \"kubernetes.io/projected/cf5b2b4c-3fa7-4785-ae65-ffb19258ec5d-kube-api-access-dkgvz\") pod \"maas-api-e2e-derive-b6596a5d-7ccb87547b-z8476\" (UID: \"cf5b2b4c-3fa7-4785-ae65-ffb19258ec5d\") " pod="opendatahub/maas-api-e2e-derive-b6596a5d-7ccb87547b-z8476" Jul 05 19:58:36.585404 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:58:36.585362 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/cf5b2b4c-3fa7-4785-ae65-ffb19258ec5d-maas-api-tls\") pod \"maas-api-e2e-derive-b6596a5d-7ccb87547b-z8476\" (UID: \"cf5b2b4c-3fa7-4785-ae65-ffb19258ec5d\") " pod="opendatahub/maas-api-e2e-derive-b6596a5d-7ccb87547b-z8476" Jul 05 19:58:36.588050 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:58:36.588026 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/cf5b2b4c-3fa7-4785-ae65-ffb19258ec5d-maas-api-tls\") pod \"maas-api-e2e-derive-b6596a5d-7ccb87547b-z8476\" (UID: \"cf5b2b4c-3fa7-4785-ae65-ffb19258ec5d\") " pod="opendatahub/maas-api-e2e-derive-b6596a5d-7ccb87547b-z8476" Jul 05 19:58:36.716864 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:58:36.716823 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-derive-b6596a5d-7ccb87547b-z8476" Jul 05 19:58:36.857230 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:58:36.857198 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-derive-b6596a5d-7ccb87547b-z8476"] Jul 05 19:58:36.859653 ip-10-0-133-7 kubenswrapper[2572]: W0705 19:58:36.859627 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcf5b2b4c_3fa7_4785_ae65_ffb19258ec5d.slice/crio-0151d40b4074866380eb9db02f85e76eb7369bf3531f85e59ae33505fc5682ca WatchSource:0}: Error finding container 0151d40b4074866380eb9db02f85e76eb7369bf3531f85e59ae33505fc5682ca: Status 404 returned error can't find the container with id 0151d40b4074866380eb9db02f85e76eb7369bf3531f85e59ae33505fc5682ca Jul 05 19:58:37.334284 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:58:37.334243 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-derive-b6596a5d-7ccb87547b-z8476" event={"ID":"cf5b2b4c-3fa7-4785-ae65-ffb19258ec5d","Type":"ContainerStarted","Data":"8021b9c74d41a62624db9d8d589b61c2d133861d5e0832cc8f87324308c0bb82"} Jul 05 19:58:37.334470 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:58:37.334312 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-derive-b6596a5d-7ccb87547b-z8476" event={"ID":"cf5b2b4c-3fa7-4785-ae65-ffb19258ec5d","Type":"ContainerStarted","Data":"0151d40b4074866380eb9db02f85e76eb7369bf3531f85e59ae33505fc5682ca"} Jul 05 19:58:37.334541 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:58:37.334478 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-derive-b6596a5d-7ccb87547b-z8476" Jul 05 19:58:37.353691 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:58:37.353640 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-derive-b6596a5d-7ccb87547b-z8476" podStartSLOduration=2.009917499 podStartE2EDuration="2.35362462s" totalImagesPullingTime="343.707121ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-05 19:58:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 19:58:37.351629213 +0000 UTC m=+1570.750976673" watchObservedRunningTime="2026-07-05 19:58:37.35362462 +0000 UTC m=+1570.752972087" Jul 05 19:58:39.782379 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:58:39.782345 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jt8wt"] Jul 05 19:58:40.450657 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:58:40.450624 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-derive-b6596a5d-7ccb87547b-z8476"] Jul 05 19:58:40.450900 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:58:40.450846 2572 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-derive-b6596a5d-7ccb87547b-z8476" podUID="cf5b2b4c-3fa7-4785-ae65-ffb19258ec5d" containerName="maas-api" containerID="cri-o://8021b9c74d41a62624db9d8d589b61c2d133861d5e0832cc8f87324308c0bb82" gracePeriod=30 Jul 05 19:58:40.702146 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:58:40.702093 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-derive-b6596a5d-7ccb87547b-z8476" Jul 05 19:58:40.724196 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:58:40.724169 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/cf5b2b4c-3fa7-4785-ae65-ffb19258ec5d-maas-api-tls\") pod \"cf5b2b4c-3fa7-4785-ae65-ffb19258ec5d\" (UID: \"cf5b2b4c-3fa7-4785-ae65-ffb19258ec5d\") " Jul 05 19:58:40.724340 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:58:40.724240 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/cf5b2b4c-3fa7-4785-ae65-ffb19258ec5d-openshift-service-ca\") pod \"cf5b2b4c-3fa7-4785-ae65-ffb19258ec5d\" (UID: \"cf5b2b4c-3fa7-4785-ae65-ffb19258ec5d\") " Jul 05 19:58:40.724340 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:58:40.724275 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dkgvz\" (UniqueName: \"kubernetes.io/projected/cf5b2b4c-3fa7-4785-ae65-ffb19258ec5d-kube-api-access-dkgvz\") pod \"cf5b2b4c-3fa7-4785-ae65-ffb19258ec5d\" (UID: \"cf5b2b4c-3fa7-4785-ae65-ffb19258ec5d\") " Jul 05 19:58:40.724599 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:58:40.724575 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cf5b2b4c-3fa7-4785-ae65-ffb19258ec5d-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "cf5b2b4c-3fa7-4785-ae65-ffb19258ec5d" (UID: "cf5b2b4c-3fa7-4785-ae65-ffb19258ec5d"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 05 19:58:40.726377 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:58:40.726355 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cf5b2b4c-3fa7-4785-ae65-ffb19258ec5d-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "cf5b2b4c-3fa7-4785-ae65-ffb19258ec5d" (UID: "cf5b2b4c-3fa7-4785-ae65-ffb19258ec5d"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 05 19:58:40.726456 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:58:40.726398 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cf5b2b4c-3fa7-4785-ae65-ffb19258ec5d-kube-api-access-dkgvz" (OuterVolumeSpecName: "kube-api-access-dkgvz") pod "cf5b2b4c-3fa7-4785-ae65-ffb19258ec5d" (UID: "cf5b2b4c-3fa7-4785-ae65-ffb19258ec5d"). InnerVolumeSpecName "kube-api-access-dkgvz". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 05 19:58:40.825798 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:58:40.825762 2572 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/cf5b2b4c-3fa7-4785-ae65-ffb19258ec5d-openshift-service-ca\") on node \"ip-10-0-133-7.ec2.internal\" DevicePath \"\"" Jul 05 19:58:40.825798 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:58:40.825790 2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dkgvz\" (UniqueName: \"kubernetes.io/projected/cf5b2b4c-3fa7-4785-ae65-ffb19258ec5d-kube-api-access-dkgvz\") on node \"ip-10-0-133-7.ec2.internal\" DevicePath \"\"" Jul 05 19:58:40.825798 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:58:40.825802 2572 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/cf5b2b4c-3fa7-4785-ae65-ffb19258ec5d-maas-api-tls\") on node \"ip-10-0-133-7.ec2.internal\" DevicePath \"\"" Jul 05 19:58:41.358469 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:58:41.358387 2572 generic.go:356] "Generic (PLEG): container finished" podID="cf5b2b4c-3fa7-4785-ae65-ffb19258ec5d" containerID="8021b9c74d41a62624db9d8d589b61c2d133861d5e0832cc8f87324308c0bb82" exitCode=0 Jul 05 19:58:41.358469 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:58:41.358434 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-derive-b6596a5d-7ccb87547b-z8476" Jul 05 19:58:41.358649 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:58:41.358474 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-derive-b6596a5d-7ccb87547b-z8476" event={"ID":"cf5b2b4c-3fa7-4785-ae65-ffb19258ec5d","Type":"ContainerDied","Data":"8021b9c74d41a62624db9d8d589b61c2d133861d5e0832cc8f87324308c0bb82"} Jul 05 19:58:41.358649 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:58:41.358529 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-derive-b6596a5d-7ccb87547b-z8476" event={"ID":"cf5b2b4c-3fa7-4785-ae65-ffb19258ec5d","Type":"ContainerDied","Data":"0151d40b4074866380eb9db02f85e76eb7369bf3531f85e59ae33505fc5682ca"} Jul 05 19:58:41.358649 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:58:41.358550 2572 scope.go:117] "RemoveContainer" containerID="8021b9c74d41a62624db9d8d589b61c2d133861d5e0832cc8f87324308c0bb82" Jul 05 19:58:41.367019 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:58:41.367000 2572 scope.go:117] "RemoveContainer" containerID="8021b9c74d41a62624db9d8d589b61c2d133861d5e0832cc8f87324308c0bb82" Jul 05 19:58:41.367283 ip-10-0-133-7 kubenswrapper[2572]: E0705 19:58:41.367265 2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8021b9c74d41a62624db9d8d589b61c2d133861d5e0832cc8f87324308c0bb82\": container with ID starting with 8021b9c74d41a62624db9d8d589b61c2d133861d5e0832cc8f87324308c0bb82 not found: ID does not exist" containerID="8021b9c74d41a62624db9d8d589b61c2d133861d5e0832cc8f87324308c0bb82" Jul 05 19:58:41.367328 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:58:41.367295 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8021b9c74d41a62624db9d8d589b61c2d133861d5e0832cc8f87324308c0bb82"} err="failed to get container status \"8021b9c74d41a62624db9d8d589b61c2d133861d5e0832cc8f87324308c0bb82\": rpc error: code = NotFound desc = could not find container \"8021b9c74d41a62624db9d8d589b61c2d133861d5e0832cc8f87324308c0bb82\": container with ID starting with 8021b9c74d41a62624db9d8d589b61c2d133861d5e0832cc8f87324308c0bb82 not found: ID does not exist" Jul 05 19:58:41.374560 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:58:41.374536 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-derive-b6596a5d-7ccb87547b-z8476"] Jul 05 19:58:41.376185 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:58:41.376166 2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-derive-b6596a5d-7ccb87547b-z8476"] Jul 05 19:58:42.963504 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:58:42.963463 2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cf5b2b4c-3fa7-4785-ae65-ffb19258ec5d" path="/var/lib/kubelet/pods/cf5b2b4c-3fa7-4785-ae65-ffb19258ec5d/volumes" Jul 05 19:58:49.883298 ip-10-0-133-7 kubenswrapper[2572]: I0705 19:58:49.883267 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jt8wt"] Jul 05 20:00:00.138391 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:00:00.138356 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-key-cleanup-29721360-qrb5k"] Jul 05 20:00:00.138864 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:00:00.138704 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cf5b2b4c-3fa7-4785-ae65-ffb19258ec5d" containerName="maas-api" Jul 05 20:00:00.138864 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:00:00.138715 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="cf5b2b4c-3fa7-4785-ae65-ffb19258ec5d" containerName="maas-api" Jul 05 20:00:00.138864 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:00:00.138801 2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="cf5b2b4c-3fa7-4785-ae65-ffb19258ec5d" containerName="maas-api" Jul 05 20:00:00.141778 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:00:00.141762 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29721360-qrb5k" Jul 05 20:00:00.144344 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:00:00.144324 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-zrsnl\"" Jul 05 20:00:00.149781 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:00:00.149759 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29721360-qrb5k"] Jul 05 20:00:00.200615 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:00:00.200579 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xst5z\" (UniqueName: \"kubernetes.io/projected/9941b28b-5cbb-49b8-9327-ca5ae24f3670-kube-api-access-xst5z\") pod \"maas-api-key-cleanup-29721360-qrb5k\" (UID: \"9941b28b-5cbb-49b8-9327-ca5ae24f3670\") " pod="opendatahub/maas-api-key-cleanup-29721360-qrb5k" Jul 05 20:00:00.301767 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:00:00.301733 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xst5z\" (UniqueName: \"kubernetes.io/projected/9941b28b-5cbb-49b8-9327-ca5ae24f3670-kube-api-access-xst5z\") pod \"maas-api-key-cleanup-29721360-qrb5k\" (UID: \"9941b28b-5cbb-49b8-9327-ca5ae24f3670\") " pod="opendatahub/maas-api-key-cleanup-29721360-qrb5k" Jul 05 20:00:00.310002 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:00:00.309970 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xst5z\" (UniqueName: \"kubernetes.io/projected/9941b28b-5cbb-49b8-9327-ca5ae24f3670-kube-api-access-xst5z\") pod \"maas-api-key-cleanup-29721360-qrb5k\" (UID: \"9941b28b-5cbb-49b8-9327-ca5ae24f3670\") " pod="opendatahub/maas-api-key-cleanup-29721360-qrb5k" Jul 05 20:00:00.453128 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:00:00.453105 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29721360-qrb5k" Jul 05 20:00:00.579456 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:00:00.579390 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29721360-qrb5k"] Jul 05 20:00:00.581902 ip-10-0-133-7 kubenswrapper[2572]: W0705 20:00:00.581872 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9941b28b_5cbb_49b8_9327_ca5ae24f3670.slice/crio-23dc4bb120ddd5dd5fbab34148558a8e3f841ed491a00bc75365763cd8a590d9 WatchSource:0}: Error finding container 23dc4bb120ddd5dd5fbab34148558a8e3f841ed491a00bc75365763cd8a590d9: Status 404 returned error can't find the container with id 23dc4bb120ddd5dd5fbab34148558a8e3f841ed491a00bc75365763cd8a590d9 Jul 05 20:00:00.734568 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:00:00.734504 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29721360-qrb5k" event={"ID":"9941b28b-5cbb-49b8-9327-ca5ae24f3670","Type":"ContainerStarted","Data":"23dc4bb120ddd5dd5fbab34148558a8e3f841ed491a00bc75365763cd8a590d9"} Jul 05 20:00:01.741348 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:00:01.741259 2572 generic.go:356] "Generic (PLEG): container finished" podID="9941b28b-5cbb-49b8-9327-ca5ae24f3670" containerID="5bd9cdb6607e05e6ae9da78ec54b2875b09b81ccc59108ad5b678ffb0a38db61" exitCode=0 Jul 05 20:00:01.741691 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:00:01.741348 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29721360-qrb5k" event={"ID":"9941b28b-5cbb-49b8-9327-ca5ae24f3670","Type":"ContainerDied","Data":"5bd9cdb6607e05e6ae9da78ec54b2875b09b81ccc59108ad5b678ffb0a38db61"} Jul 05 20:00:02.882797 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:00:02.882772 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29721360-qrb5k" Jul 05 20:00:02.924164 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:00:02.924133 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xst5z\" (UniqueName: \"kubernetes.io/projected/9941b28b-5cbb-49b8-9327-ca5ae24f3670-kube-api-access-xst5z\") pod \"9941b28b-5cbb-49b8-9327-ca5ae24f3670\" (UID: \"9941b28b-5cbb-49b8-9327-ca5ae24f3670\") " Jul 05 20:00:02.926218 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:00:02.926185 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9941b28b-5cbb-49b8-9327-ca5ae24f3670-kube-api-access-xst5z" (OuterVolumeSpecName: "kube-api-access-xst5z") pod "9941b28b-5cbb-49b8-9327-ca5ae24f3670" (UID: "9941b28b-5cbb-49b8-9327-ca5ae24f3670"). InnerVolumeSpecName "kube-api-access-xst5z". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 05 20:00:03.025582 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:00:03.025504 2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xst5z\" (UniqueName: \"kubernetes.io/projected/9941b28b-5cbb-49b8-9327-ca5ae24f3670-kube-api-access-xst5z\") on node \"ip-10-0-133-7.ec2.internal\" DevicePath \"\"" Jul 05 20:00:03.752532 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:00:03.752502 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29721360-qrb5k" Jul 05 20:00:03.752707 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:00:03.752535 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29721360-qrb5k" event={"ID":"9941b28b-5cbb-49b8-9327-ca5ae24f3670","Type":"ContainerDied","Data":"23dc4bb120ddd5dd5fbab34148558a8e3f841ed491a00bc75365763cd8a590d9"} Jul 05 20:00:03.752707 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:00:03.752579 2572 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="23dc4bb120ddd5dd5fbab34148558a8e3f841ed491a00bc75365763cd8a590d9" Jul 05 20:00:08.079920 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:00:08.079880 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jt8wt"] Jul 05 20:00:16.978431 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:00:16.978396 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jt8wt"] Jul 05 20:00:23.075275 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:00:23.075232 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-mt-3e263149-6f8d479c89-s22gg"] Jul 05 20:00:23.075779 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:00:23.075759 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9941b28b-5cbb-49b8-9327-ca5ae24f3670" containerName="cleanup" Jul 05 20:00:23.075899 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:00:23.075782 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="9941b28b-5cbb-49b8-9327-ca5ae24f3670" containerName="cleanup" Jul 05 20:00:23.076003 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:00:23.075925 2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="9941b28b-5cbb-49b8-9327-ca5ae24f3670" containerName="cleanup" Jul 05 20:00:23.079280 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:00:23.079260 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-mt-3e263149-6f8d479c89-s22gg" Jul 05 20:00:23.081800 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:00:23.081774 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-mt-3e263149-serving-cert\"" Jul 05 20:00:23.081800 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:00:23.081797 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-zrsnl\"" Jul 05 20:00:23.089067 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:00:23.089042 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-mt-3e263149-6f8d479c89-s22gg"] Jul 05 20:00:23.207626 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:00:23.207586 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/099dad14-35a0-4e0a-bd62-7f90131f3c11-openshift-service-ca\") pod \"maas-api-e2e-mt-3e263149-6f8d479c89-s22gg\" (UID: \"099dad14-35a0-4e0a-bd62-7f90131f3c11\") " pod="opendatahub/maas-api-e2e-mt-3e263149-6f8d479c89-s22gg" Jul 05 20:00:23.207765 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:00:23.207648 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/099dad14-35a0-4e0a-bd62-7f90131f3c11-maas-api-tls\") pod \"maas-api-e2e-mt-3e263149-6f8d479c89-s22gg\" (UID: \"099dad14-35a0-4e0a-bd62-7f90131f3c11\") " pod="opendatahub/maas-api-e2e-mt-3e263149-6f8d479c89-s22gg" Jul 05 20:00:23.207765 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:00:23.207701 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pkcm8\" (UniqueName: \"kubernetes.io/projected/099dad14-35a0-4e0a-bd62-7f90131f3c11-kube-api-access-pkcm8\") pod \"maas-api-e2e-mt-3e263149-6f8d479c89-s22gg\" (UID: \"099dad14-35a0-4e0a-bd62-7f90131f3c11\") " pod="opendatahub/maas-api-e2e-mt-3e263149-6f8d479c89-s22gg" Jul 05 20:00:23.308978 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:00:23.308914 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/099dad14-35a0-4e0a-bd62-7f90131f3c11-openshift-service-ca\") pod \"maas-api-e2e-mt-3e263149-6f8d479c89-s22gg\" (UID: \"099dad14-35a0-4e0a-bd62-7f90131f3c11\") " pod="opendatahub/maas-api-e2e-mt-3e263149-6f8d479c89-s22gg" Jul 05 20:00:23.308978 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:00:23.308972 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/099dad14-35a0-4e0a-bd62-7f90131f3c11-maas-api-tls\") pod \"maas-api-e2e-mt-3e263149-6f8d479c89-s22gg\" (UID: \"099dad14-35a0-4e0a-bd62-7f90131f3c11\") " pod="opendatahub/maas-api-e2e-mt-3e263149-6f8d479c89-s22gg" Jul 05 20:00:23.309251 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:00:23.309008 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pkcm8\" (UniqueName: \"kubernetes.io/projected/099dad14-35a0-4e0a-bd62-7f90131f3c11-kube-api-access-pkcm8\") pod \"maas-api-e2e-mt-3e263149-6f8d479c89-s22gg\" (UID: \"099dad14-35a0-4e0a-bd62-7f90131f3c11\") " pod="opendatahub/maas-api-e2e-mt-3e263149-6f8d479c89-s22gg" Jul 05 20:00:23.309251 ip-10-0-133-7 kubenswrapper[2572]: E0705 20:00:23.309141 2572 secret.go:189] Couldn't get secret opendatahub/maas-api-e2e-mt-3e263149-serving-cert: secret "maas-api-e2e-mt-3e263149-serving-cert" not found Jul 05 20:00:23.309251 ip-10-0-133-7 kubenswrapper[2572]: E0705 20:00:23.309214 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/099dad14-35a0-4e0a-bd62-7f90131f3c11-maas-api-tls podName:099dad14-35a0-4e0a-bd62-7f90131f3c11 nodeName:}" failed. No retries permitted until 2026-07-05 20:00:23.809198237 +0000 UTC m=+1677.208545683 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/099dad14-35a0-4e0a-bd62-7f90131f3c11-maas-api-tls") pod "maas-api-e2e-mt-3e263149-6f8d479c89-s22gg" (UID: "099dad14-35a0-4e0a-bd62-7f90131f3c11") : secret "maas-api-e2e-mt-3e263149-serving-cert" not found Jul 05 20:00:23.309674 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:00:23.309648 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/099dad14-35a0-4e0a-bd62-7f90131f3c11-openshift-service-ca\") pod \"maas-api-e2e-mt-3e263149-6f8d479c89-s22gg\" (UID: \"099dad14-35a0-4e0a-bd62-7f90131f3c11\") " pod="opendatahub/maas-api-e2e-mt-3e263149-6f8d479c89-s22gg" Jul 05 20:00:23.326138 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:00:23.326072 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pkcm8\" (UniqueName: \"kubernetes.io/projected/099dad14-35a0-4e0a-bd62-7f90131f3c11-kube-api-access-pkcm8\") pod \"maas-api-e2e-mt-3e263149-6f8d479c89-s22gg\" (UID: \"099dad14-35a0-4e0a-bd62-7f90131f3c11\") " pod="opendatahub/maas-api-e2e-mt-3e263149-6f8d479c89-s22gg" Jul 05 20:00:23.814206 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:00:23.814175 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/099dad14-35a0-4e0a-bd62-7f90131f3c11-maas-api-tls\") pod \"maas-api-e2e-mt-3e263149-6f8d479c89-s22gg\" (UID: \"099dad14-35a0-4e0a-bd62-7f90131f3c11\") " pod="opendatahub/maas-api-e2e-mt-3e263149-6f8d479c89-s22gg" Jul 05 20:00:23.816822 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:00:23.816795 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/099dad14-35a0-4e0a-bd62-7f90131f3c11-maas-api-tls\") pod \"maas-api-e2e-mt-3e263149-6f8d479c89-s22gg\" (UID: \"099dad14-35a0-4e0a-bd62-7f90131f3c11\") " pod="opendatahub/maas-api-e2e-mt-3e263149-6f8d479c89-s22gg" Jul 05 20:00:23.990261 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:00:23.990219 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-mt-3e263149-6f8d479c89-s22gg" Jul 05 20:00:24.127915 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:00:24.127890 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-mt-3e263149-6f8d479c89-s22gg"] Jul 05 20:00:24.862440 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:00:24.862348 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-mt-3e263149-6f8d479c89-s22gg" event={"ID":"099dad14-35a0-4e0a-bd62-7f90131f3c11","Type":"ContainerStarted","Data":"5be860398b67ff482662c7812fb287483233daf1df0499cb0ef60c023d47f102"} Jul 05 20:00:24.862440 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:00:24.862404 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-mt-3e263149-6f8d479c89-s22gg" event={"ID":"099dad14-35a0-4e0a-bd62-7f90131f3c11","Type":"ContainerStarted","Data":"b1fbd874c21a4e89998393538c119a181b8d07709246ab0f26fcb2b3bcb8f4b2"} Jul 05 20:00:24.862440 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:00:24.862428 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-mt-3e263149-6f8d479c89-s22gg" Jul 05 20:00:24.883446 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:00:24.883391 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-mt-3e263149-6f8d479c89-s22gg" podStartSLOduration=1.447146144 podStartE2EDuration="1.883373302s" totalImagesPullingTime="436.227158ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-05 20:00:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 20:00:24.88153025 +0000 UTC m=+1678.280877717" watchObservedRunningTime="2026-07-05 20:00:24.883373302 +0000 UTC m=+1678.282720768" Jul 05 20:00:27.482501 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:00:27.482462 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jt8wt"] Jul 05 20:00:30.873123 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:00:30.873090 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-e2e-mt-3e263149-6f8d479c89-s22gg" Jul 05 20:00:34.708357 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:00:34.708307 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-mt-3e263149-6f8d479c89-s22gg"] Jul 05 20:00:34.708818 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:00:34.708624 2572 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-mt-3e263149-6f8d479c89-s22gg" podUID="099dad14-35a0-4e0a-bd62-7f90131f3c11" containerName="maas-api" containerID="cri-o://5be860398b67ff482662c7812fb287483233daf1df0499cb0ef60c023d47f102" gracePeriod=30 Jul 05 20:00:34.911928 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:00:34.911890 2572 generic.go:356] "Generic (PLEG): container finished" podID="099dad14-35a0-4e0a-bd62-7f90131f3c11" containerID="5be860398b67ff482662c7812fb287483233daf1df0499cb0ef60c023d47f102" exitCode=0 Jul 05 20:00:34.912085 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:00:34.911987 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-mt-3e263149-6f8d479c89-s22gg" event={"ID":"099dad14-35a0-4e0a-bd62-7f90131f3c11","Type":"ContainerDied","Data":"5be860398b67ff482662c7812fb287483233daf1df0499cb0ef60c023d47f102"} Jul 05 20:00:34.968558 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:00:34.968501 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-mt-3e263149-6f8d479c89-s22gg" Jul 05 20:00:35.000457 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:00:35.000423 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/099dad14-35a0-4e0a-bd62-7f90131f3c11-openshift-service-ca\") pod \"099dad14-35a0-4e0a-bd62-7f90131f3c11\" (UID: \"099dad14-35a0-4e0a-bd62-7f90131f3c11\") " Jul 05 20:00:35.000617 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:00:35.000467 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pkcm8\" (UniqueName: \"kubernetes.io/projected/099dad14-35a0-4e0a-bd62-7f90131f3c11-kube-api-access-pkcm8\") pod \"099dad14-35a0-4e0a-bd62-7f90131f3c11\" (UID: \"099dad14-35a0-4e0a-bd62-7f90131f3c11\") " Jul 05 20:00:35.000617 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:00:35.000594 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/099dad14-35a0-4e0a-bd62-7f90131f3c11-maas-api-tls\") pod \"099dad14-35a0-4e0a-bd62-7f90131f3c11\" (UID: \"099dad14-35a0-4e0a-bd62-7f90131f3c11\") " Jul 05 20:00:35.000823 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:00:35.000798 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/099dad14-35a0-4e0a-bd62-7f90131f3c11-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "099dad14-35a0-4e0a-bd62-7f90131f3c11" (UID: "099dad14-35a0-4e0a-bd62-7f90131f3c11"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 05 20:00:35.002808 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:00:35.002772 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/099dad14-35a0-4e0a-bd62-7f90131f3c11-kube-api-access-pkcm8" (OuterVolumeSpecName: "kube-api-access-pkcm8") pod "099dad14-35a0-4e0a-bd62-7f90131f3c11" (UID: "099dad14-35a0-4e0a-bd62-7f90131f3c11"). InnerVolumeSpecName "kube-api-access-pkcm8". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 05 20:00:35.002808 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:00:35.002784 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/099dad14-35a0-4e0a-bd62-7f90131f3c11-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "099dad14-35a0-4e0a-bd62-7f90131f3c11" (UID: "099dad14-35a0-4e0a-bd62-7f90131f3c11"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 05 20:00:35.101371 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:00:35.101340 2572 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/099dad14-35a0-4e0a-bd62-7f90131f3c11-maas-api-tls\") on node \"ip-10-0-133-7.ec2.internal\" DevicePath \"\"" Jul 05 20:00:35.101371 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:00:35.101366 2572 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/099dad14-35a0-4e0a-bd62-7f90131f3c11-openshift-service-ca\") on node \"ip-10-0-133-7.ec2.internal\" DevicePath \"\"" Jul 05 20:00:35.101371 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:00:35.101376 2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pkcm8\" (UniqueName: \"kubernetes.io/projected/099dad14-35a0-4e0a-bd62-7f90131f3c11-kube-api-access-pkcm8\") on node \"ip-10-0-133-7.ec2.internal\" DevicePath \"\"" Jul 05 20:00:35.917581 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:00:35.917551 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-mt-3e263149-6f8d479c89-s22gg" Jul 05 20:00:35.917581 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:00:35.917568 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-mt-3e263149-6f8d479c89-s22gg" event={"ID":"099dad14-35a0-4e0a-bd62-7f90131f3c11","Type":"ContainerDied","Data":"b1fbd874c21a4e89998393538c119a181b8d07709246ab0f26fcb2b3bcb8f4b2"} Jul 05 20:00:35.918119 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:00:35.917634 2572 scope.go:117] "RemoveContainer" containerID="5be860398b67ff482662c7812fb287483233daf1df0499cb0ef60c023d47f102" Jul 05 20:00:35.938460 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:00:35.938439 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-mt-3e263149-6f8d479c89-s22gg"] Jul 05 20:00:35.941844 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:00:35.941821 2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-mt-3e263149-6f8d479c89-s22gg"] Jul 05 20:00:36.962874 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:00:36.962840 2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="099dad14-35a0-4e0a-bd62-7f90131f3c11" path="/var/lib/kubelet/pods/099dad14-35a0-4e0a-bd62-7f90131f3c11/volumes" Jul 05 20:00:38.585607 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:00:38.585577 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jt8wt"] Jul 05 20:01:03.285913 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:01:03.285830 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-mt-f4b2f9ba-86b67d464b-d7khn"] Jul 05 20:01:03.286400 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:01:03.286197 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="099dad14-35a0-4e0a-bd62-7f90131f3c11" containerName="maas-api" Jul 05 20:01:03.286400 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:01:03.286209 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="099dad14-35a0-4e0a-bd62-7f90131f3c11" containerName="maas-api" Jul 05 20:01:03.286400 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:01:03.286278 2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="099dad14-35a0-4e0a-bd62-7f90131f3c11" containerName="maas-api" Jul 05 20:01:03.289336 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:01:03.289319 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-mt-f4b2f9ba-86b67d464b-d7khn" Jul 05 20:01:03.291862 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:01:03.291828 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-mt-f4b2f9ba-serving-cert\"" Jul 05 20:01:03.291994 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:01:03.291943 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-zrsnl\"" Jul 05 20:01:03.297640 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:01:03.297611 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-mt-f4b2f9ba-86b67d464b-d7khn"] Jul 05 20:01:03.446222 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:01:03.446189 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c91c3154-ff30-4bf6-8ec0-7f2676da43a0-maas-api-tls\") pod \"maas-api-e2e-mt-f4b2f9ba-86b67d464b-d7khn\" (UID: \"c91c3154-ff30-4bf6-8ec0-7f2676da43a0\") " pod="opendatahub/maas-api-e2e-mt-f4b2f9ba-86b67d464b-d7khn" Jul 05 20:01:03.446387 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:01:03.446235 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c91c3154-ff30-4bf6-8ec0-7f2676da43a0-openshift-service-ca\") pod \"maas-api-e2e-mt-f4b2f9ba-86b67d464b-d7khn\" (UID: \"c91c3154-ff30-4bf6-8ec0-7f2676da43a0\") " pod="opendatahub/maas-api-e2e-mt-f4b2f9ba-86b67d464b-d7khn" Jul 05 20:01:03.446387 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:01:03.446252 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2d9n7\" (UniqueName: \"kubernetes.io/projected/c91c3154-ff30-4bf6-8ec0-7f2676da43a0-kube-api-access-2d9n7\") pod \"maas-api-e2e-mt-f4b2f9ba-86b67d464b-d7khn\" (UID: \"c91c3154-ff30-4bf6-8ec0-7f2676da43a0\") " pod="opendatahub/maas-api-e2e-mt-f4b2f9ba-86b67d464b-d7khn" Jul 05 20:01:03.547673 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:01:03.547576 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c91c3154-ff30-4bf6-8ec0-7f2676da43a0-maas-api-tls\") pod \"maas-api-e2e-mt-f4b2f9ba-86b67d464b-d7khn\" (UID: \"c91c3154-ff30-4bf6-8ec0-7f2676da43a0\") " pod="opendatahub/maas-api-e2e-mt-f4b2f9ba-86b67d464b-d7khn" Jul 05 20:01:03.547673 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:01:03.547638 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c91c3154-ff30-4bf6-8ec0-7f2676da43a0-openshift-service-ca\") pod \"maas-api-e2e-mt-f4b2f9ba-86b67d464b-d7khn\" (UID: \"c91c3154-ff30-4bf6-8ec0-7f2676da43a0\") " pod="opendatahub/maas-api-e2e-mt-f4b2f9ba-86b67d464b-d7khn" Jul 05 20:01:03.547912 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:01:03.547661 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2d9n7\" (UniqueName: \"kubernetes.io/projected/c91c3154-ff30-4bf6-8ec0-7f2676da43a0-kube-api-access-2d9n7\") pod \"maas-api-e2e-mt-f4b2f9ba-86b67d464b-d7khn\" (UID: \"c91c3154-ff30-4bf6-8ec0-7f2676da43a0\") " pod="opendatahub/maas-api-e2e-mt-f4b2f9ba-86b67d464b-d7khn" Jul 05 20:01:03.548647 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:01:03.548622 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c91c3154-ff30-4bf6-8ec0-7f2676da43a0-openshift-service-ca\") pod \"maas-api-e2e-mt-f4b2f9ba-86b67d464b-d7khn\" (UID: \"c91c3154-ff30-4bf6-8ec0-7f2676da43a0\") " pod="opendatahub/maas-api-e2e-mt-f4b2f9ba-86b67d464b-d7khn" Jul 05 20:01:03.550314 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:01:03.550288 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c91c3154-ff30-4bf6-8ec0-7f2676da43a0-maas-api-tls\") pod \"maas-api-e2e-mt-f4b2f9ba-86b67d464b-d7khn\" (UID: \"c91c3154-ff30-4bf6-8ec0-7f2676da43a0\") " pod="opendatahub/maas-api-e2e-mt-f4b2f9ba-86b67d464b-d7khn" Jul 05 20:01:03.564571 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:01:03.564529 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2d9n7\" (UniqueName: \"kubernetes.io/projected/c91c3154-ff30-4bf6-8ec0-7f2676da43a0-kube-api-access-2d9n7\") pod \"maas-api-e2e-mt-f4b2f9ba-86b67d464b-d7khn\" (UID: \"c91c3154-ff30-4bf6-8ec0-7f2676da43a0\") " pod="opendatahub/maas-api-e2e-mt-f4b2f9ba-86b67d464b-d7khn" Jul 05 20:01:03.601353 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:01:03.601324 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-mt-f4b2f9ba-86b67d464b-d7khn" Jul 05 20:01:03.740684 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:01:03.740648 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-mt-f4b2f9ba-86b67d464b-d7khn"] Jul 05 20:01:03.744284 ip-10-0-133-7 kubenswrapper[2572]: W0705 20:01:03.744260 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc91c3154_ff30_4bf6_8ec0_7f2676da43a0.slice/crio-1748df44ad0b01ab7fd3974ecdc8dd2fe2ad3778472d3f61c0af6b5788ed1e87 WatchSource:0}: Error finding container 1748df44ad0b01ab7fd3974ecdc8dd2fe2ad3778472d3f61c0af6b5788ed1e87: Status 404 returned error can't find the container with id 1748df44ad0b01ab7fd3974ecdc8dd2fe2ad3778472d3f61c0af6b5788ed1e87 Jul 05 20:01:04.057033 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:01:04.056997 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-mt-f4b2f9ba-86b67d464b-d7khn" event={"ID":"c91c3154-ff30-4bf6-8ec0-7f2676da43a0","Type":"ContainerStarted","Data":"1748df44ad0b01ab7fd3974ecdc8dd2fe2ad3778472d3f61c0af6b5788ed1e87"} Jul 05 20:01:05.063419 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:01:05.063385 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-mt-f4b2f9ba-86b67d464b-d7khn" event={"ID":"c91c3154-ff30-4bf6-8ec0-7f2676da43a0","Type":"ContainerStarted","Data":"a65b6c94fd09632a26058a04c0b8e0cddaef534489baca71ed1645637de6f0c3"} Jul 05 20:01:05.063803 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:01:05.063514 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-mt-f4b2f9ba-86b67d464b-d7khn" Jul 05 20:01:05.081246 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:01:05.081196 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-mt-f4b2f9ba-86b67d464b-d7khn" podStartSLOduration=1.458882151 podStartE2EDuration="2.081178247s" totalImagesPullingTime="622.296096ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-05 20:01:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 20:01:05.07935913 +0000 UTC m=+1718.478706598" watchObservedRunningTime="2026-07-05 20:01:05.081178247 +0000 UTC m=+1718.480525714" Jul 05 20:01:09.478913 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:01:09.478872 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jt8wt"] Jul 05 20:01:11.073362 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:01:11.073330 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-e2e-mt-f4b2f9ba-86b67d464b-d7khn" Jul 05 20:01:20.690375 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:01:20.690343 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jt8wt"] Jul 05 20:01:32.490173 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:01:32.490140 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jt8wt"] Jul 05 20:01:35.724465 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:01:35.724416 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-mt-f4b2f9ba-86b67d464b-d7khn"] Jul 05 20:01:35.725108 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:01:35.724773 2572 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-mt-f4b2f9ba-86b67d464b-d7khn" podUID="c91c3154-ff30-4bf6-8ec0-7f2676da43a0" containerName="maas-api" containerID="cri-o://a65b6c94fd09632a26058a04c0b8e0cddaef534489baca71ed1645637de6f0c3" gracePeriod=30 Jul 05 20:01:35.996064 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:01:35.996034 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-mt-f4b2f9ba-86b67d464b-d7khn" Jul 05 20:01:36.040732 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:01:36.040694 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c91c3154-ff30-4bf6-8ec0-7f2676da43a0-maas-api-tls\") pod \"c91c3154-ff30-4bf6-8ec0-7f2676da43a0\" (UID: \"c91c3154-ff30-4bf6-8ec0-7f2676da43a0\") " Jul 05 20:01:36.040887 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:01:36.040796 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c91c3154-ff30-4bf6-8ec0-7f2676da43a0-openshift-service-ca\") pod \"c91c3154-ff30-4bf6-8ec0-7f2676da43a0\" (UID: \"c91c3154-ff30-4bf6-8ec0-7f2676da43a0\") " Jul 05 20:01:36.040887 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:01:36.040820 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2d9n7\" (UniqueName: \"kubernetes.io/projected/c91c3154-ff30-4bf6-8ec0-7f2676da43a0-kube-api-access-2d9n7\") pod \"c91c3154-ff30-4bf6-8ec0-7f2676da43a0\" (UID: \"c91c3154-ff30-4bf6-8ec0-7f2676da43a0\") " Jul 05 20:01:36.041234 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:01:36.041188 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c91c3154-ff30-4bf6-8ec0-7f2676da43a0-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "c91c3154-ff30-4bf6-8ec0-7f2676da43a0" (UID: "c91c3154-ff30-4bf6-8ec0-7f2676da43a0"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 05 20:01:36.043468 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:01:36.043435 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c91c3154-ff30-4bf6-8ec0-7f2676da43a0-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "c91c3154-ff30-4bf6-8ec0-7f2676da43a0" (UID: "c91c3154-ff30-4bf6-8ec0-7f2676da43a0"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 05 20:01:36.043600 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:01:36.043457 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c91c3154-ff30-4bf6-8ec0-7f2676da43a0-kube-api-access-2d9n7" (OuterVolumeSpecName: "kube-api-access-2d9n7") pod "c91c3154-ff30-4bf6-8ec0-7f2676da43a0" (UID: "c91c3154-ff30-4bf6-8ec0-7f2676da43a0"). InnerVolumeSpecName "kube-api-access-2d9n7". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 05 20:01:36.141934 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:01:36.141897 2572 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c91c3154-ff30-4bf6-8ec0-7f2676da43a0-maas-api-tls\") on node \"ip-10-0-133-7.ec2.internal\" DevicePath \"\"" Jul 05 20:01:36.141934 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:01:36.141934 2572 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c91c3154-ff30-4bf6-8ec0-7f2676da43a0-openshift-service-ca\") on node \"ip-10-0-133-7.ec2.internal\" DevicePath \"\"" Jul 05 20:01:36.142132 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:01:36.141966 2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2d9n7\" (UniqueName: \"kubernetes.io/projected/c91c3154-ff30-4bf6-8ec0-7f2676da43a0-kube-api-access-2d9n7\") on node \"ip-10-0-133-7.ec2.internal\" DevicePath \"\"" Jul 05 20:01:36.218279 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:01:36.218249 2572 generic.go:356] "Generic (PLEG): container finished" podID="c91c3154-ff30-4bf6-8ec0-7f2676da43a0" containerID="a65b6c94fd09632a26058a04c0b8e0cddaef534489baca71ed1645637de6f0c3" exitCode=0 Jul 05 20:01:36.218441 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:01:36.218294 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-mt-f4b2f9ba-86b67d464b-d7khn" Jul 05 20:01:36.218441 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:01:36.218322 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-mt-f4b2f9ba-86b67d464b-d7khn" event={"ID":"c91c3154-ff30-4bf6-8ec0-7f2676da43a0","Type":"ContainerDied","Data":"a65b6c94fd09632a26058a04c0b8e0cddaef534489baca71ed1645637de6f0c3"} Jul 05 20:01:36.218441 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:01:36.218374 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-mt-f4b2f9ba-86b67d464b-d7khn" event={"ID":"c91c3154-ff30-4bf6-8ec0-7f2676da43a0","Type":"ContainerDied","Data":"1748df44ad0b01ab7fd3974ecdc8dd2fe2ad3778472d3f61c0af6b5788ed1e87"} Jul 05 20:01:36.218441 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:01:36.218405 2572 scope.go:117] "RemoveContainer" containerID="a65b6c94fd09632a26058a04c0b8e0cddaef534489baca71ed1645637de6f0c3" Jul 05 20:01:36.228694 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:01:36.228673 2572 scope.go:117] "RemoveContainer" containerID="a65b6c94fd09632a26058a04c0b8e0cddaef534489baca71ed1645637de6f0c3" Jul 05 20:01:36.229078 ip-10-0-133-7 kubenswrapper[2572]: E0705 20:01:36.229052 2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a65b6c94fd09632a26058a04c0b8e0cddaef534489baca71ed1645637de6f0c3\": container with ID starting with a65b6c94fd09632a26058a04c0b8e0cddaef534489baca71ed1645637de6f0c3 not found: ID does not exist" containerID="a65b6c94fd09632a26058a04c0b8e0cddaef534489baca71ed1645637de6f0c3" Jul 05 20:01:36.229164 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:01:36.229090 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a65b6c94fd09632a26058a04c0b8e0cddaef534489baca71ed1645637de6f0c3"} err="failed to get container status \"a65b6c94fd09632a26058a04c0b8e0cddaef534489baca71ed1645637de6f0c3\": rpc error: code = NotFound desc = could not find container \"a65b6c94fd09632a26058a04c0b8e0cddaef534489baca71ed1645637de6f0c3\": container with ID starting with a65b6c94fd09632a26058a04c0b8e0cddaef534489baca71ed1645637de6f0c3 not found: ID does not exist" Jul 05 20:01:36.240741 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:01:36.240696 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-mt-f4b2f9ba-86b67d464b-d7khn"] Jul 05 20:01:36.244340 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:01:36.244314 2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-mt-f4b2f9ba-86b67d464b-d7khn"] Jul 05 20:01:36.964225 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:01:36.964189 2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c91c3154-ff30-4bf6-8ec0-7f2676da43a0" path="/var/lib/kubelet/pods/c91c3154-ff30-4bf6-8ec0-7f2676da43a0/volumes" Jul 05 20:01:46.386489 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:01:46.386455 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jt8wt"] Jul 05 20:02:25.879986 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:02:25.879934 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jt8wt"] Jul 05 20:02:27.057581 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:02:27.057554 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-plqpb_ac3142e8-817c-493b-b998-41ff8f4680f9/console-operator/1.log" Jul 05 20:02:27.058450 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:02:27.058432 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-plqpb_ac3142e8-817c-493b-b998-41ff8f4680f9/console-operator/1.log" Jul 05 20:03:04.086148 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:03:04.086117 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jt8wt"] Jul 05 20:03:17.882220 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:03:17.882186 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jt8wt"] Jul 05 20:03:58.235794 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:03:58.235711 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-inf-a-8dc0f0-5d6f8b7699-qchqx"] Jul 05 20:03:58.236436 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:03:58.236337 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c91c3154-ff30-4bf6-8ec0-7f2676da43a0" containerName="maas-api" Jul 05 20:03:58.236436 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:03:58.236359 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="c91c3154-ff30-4bf6-8ec0-7f2676da43a0" containerName="maas-api" Jul 05 20:03:58.236571 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:03:58.236470 2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="c91c3154-ff30-4bf6-8ec0-7f2676da43a0" containerName="maas-api" Jul 05 20:03:58.240153 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:03:58.239930 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-inf-a-8dc0f0-5d6f8b7699-qchqx" Jul 05 20:03:58.242744 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:03:58.242718 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-inf-a-8dc0f0-serving-cert\"" Jul 05 20:03:58.242744 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:03:58.242737 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-zrsnl\"" Jul 05 20:03:58.251445 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:03:58.251422 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-inf-a-8dc0f0-5d6f8b7699-qchqx"] Jul 05 20:03:58.343655 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:03:58.343604 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/26c09bd3-9080-4333-ad74-635537b56bb7-openshift-service-ca\") pod \"maas-api-e2e-inf-a-8dc0f0-5d6f8b7699-qchqx\" (UID: \"26c09bd3-9080-4333-ad74-635537b56bb7\") " pod="opendatahub/maas-api-e2e-inf-a-8dc0f0-5d6f8b7699-qchqx" Jul 05 20:03:58.343851 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:03:58.343663 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dnktm\" (UniqueName: \"kubernetes.io/projected/26c09bd3-9080-4333-ad74-635537b56bb7-kube-api-access-dnktm\") pod \"maas-api-e2e-inf-a-8dc0f0-5d6f8b7699-qchqx\" (UID: \"26c09bd3-9080-4333-ad74-635537b56bb7\") " pod="opendatahub/maas-api-e2e-inf-a-8dc0f0-5d6f8b7699-qchqx" Jul 05 20:03:58.343851 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:03:58.343732 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/26c09bd3-9080-4333-ad74-635537b56bb7-maas-api-tls\") pod \"maas-api-e2e-inf-a-8dc0f0-5d6f8b7699-qchqx\" (UID: \"26c09bd3-9080-4333-ad74-635537b56bb7\") " pod="opendatahub/maas-api-e2e-inf-a-8dc0f0-5d6f8b7699-qchqx" Jul 05 20:03:58.445152 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:03:58.445120 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/26c09bd3-9080-4333-ad74-635537b56bb7-openshift-service-ca\") pod \"maas-api-e2e-inf-a-8dc0f0-5d6f8b7699-qchqx\" (UID: \"26c09bd3-9080-4333-ad74-635537b56bb7\") " pod="opendatahub/maas-api-e2e-inf-a-8dc0f0-5d6f8b7699-qchqx" Jul 05 20:03:58.445324 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:03:58.445164 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dnktm\" (UniqueName: \"kubernetes.io/projected/26c09bd3-9080-4333-ad74-635537b56bb7-kube-api-access-dnktm\") pod \"maas-api-e2e-inf-a-8dc0f0-5d6f8b7699-qchqx\" (UID: \"26c09bd3-9080-4333-ad74-635537b56bb7\") " pod="opendatahub/maas-api-e2e-inf-a-8dc0f0-5d6f8b7699-qchqx" Jul 05 20:03:58.445324 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:03:58.445207 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/26c09bd3-9080-4333-ad74-635537b56bb7-maas-api-tls\") pod \"maas-api-e2e-inf-a-8dc0f0-5d6f8b7699-qchqx\" (UID: \"26c09bd3-9080-4333-ad74-635537b56bb7\") " pod="opendatahub/maas-api-e2e-inf-a-8dc0f0-5d6f8b7699-qchqx" Jul 05 20:03:58.445728 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:03:58.445709 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/26c09bd3-9080-4333-ad74-635537b56bb7-openshift-service-ca\") pod \"maas-api-e2e-inf-a-8dc0f0-5d6f8b7699-qchqx\" (UID: \"26c09bd3-9080-4333-ad74-635537b56bb7\") " pod="opendatahub/maas-api-e2e-inf-a-8dc0f0-5d6f8b7699-qchqx" Jul 05 20:03:58.447540 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:03:58.447513 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/26c09bd3-9080-4333-ad74-635537b56bb7-maas-api-tls\") pod \"maas-api-e2e-inf-a-8dc0f0-5d6f8b7699-qchqx\" (UID: \"26c09bd3-9080-4333-ad74-635537b56bb7\") " pod="opendatahub/maas-api-e2e-inf-a-8dc0f0-5d6f8b7699-qchqx" Jul 05 20:03:58.452513 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:03:58.452486 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dnktm\" (UniqueName: \"kubernetes.io/projected/26c09bd3-9080-4333-ad74-635537b56bb7-kube-api-access-dnktm\") pod \"maas-api-e2e-inf-a-8dc0f0-5d6f8b7699-qchqx\" (UID: \"26c09bd3-9080-4333-ad74-635537b56bb7\") " pod="opendatahub/maas-api-e2e-inf-a-8dc0f0-5d6f8b7699-qchqx" Jul 05 20:03:58.553932 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:03:58.553852 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-inf-a-8dc0f0-5d6f8b7699-qchqx" Jul 05 20:03:58.692289 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:03:58.692264 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-inf-a-8dc0f0-5d6f8b7699-qchqx"] Jul 05 20:03:58.694571 ip-10-0-133-7 kubenswrapper[2572]: W0705 20:03:58.694541 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod26c09bd3_9080_4333_ad74_635537b56bb7.slice/crio-5be8ece8a5e9c1e64cc812c246e05619a487a6d3bfcafe5ddb5d3a5a599ee948 WatchSource:0}: Error finding container 5be8ece8a5e9c1e64cc812c246e05619a487a6d3bfcafe5ddb5d3a5a599ee948: Status 404 returned error can't find the container with id 5be8ece8a5e9c1e64cc812c246e05619a487a6d3bfcafe5ddb5d3a5a599ee948 Jul 05 20:03:58.696015 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:03:58.695994 2572 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 05 20:03:58.920538 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:03:58.920455 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-inf-a-8dc0f0-5d6f8b7699-qchqx" event={"ID":"26c09bd3-9080-4333-ad74-635537b56bb7","Type":"ContainerStarted","Data":"5be8ece8a5e9c1e64cc812c246e05619a487a6d3bfcafe5ddb5d3a5a599ee948"} Jul 05 20:03:59.927183 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:03:59.927146 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-inf-a-8dc0f0-5d6f8b7699-qchqx" event={"ID":"26c09bd3-9080-4333-ad74-635537b56bb7","Type":"ContainerStarted","Data":"d2a0d73cc3f4d00edbe054a9009d89f0dec6f78575fc4f50687af558b7c3936a"} Jul 05 20:03:59.927554 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:03:59.927264 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-inf-a-8dc0f0-5d6f8b7699-qchqx" Jul 05 20:03:59.943589 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:03:59.943541 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-inf-a-8dc0f0-5d6f8b7699-qchqx" podStartSLOduration=1.50592829 podStartE2EDuration="1.943527598s" totalImagesPullingTime="437.599308ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-05 20:03:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 20:03:59.943252068 +0000 UTC m=+1893.342599558" watchObservedRunningTime="2026-07-05 20:03:59.943527598 +0000 UTC m=+1893.342875066" Jul 05 20:04:05.684605 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:04:05.684574 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jt8wt"] Jul 05 20:04:05.939280 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:04:05.939199 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-e2e-inf-a-8dc0f0-5d6f8b7699-qchqx" Jul 05 20:04:06.238371 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:04:06.238338 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-inf-b-b14b17-77f7d785c6-524vx"] Jul 05 20:04:06.242458 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:04:06.242430 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-inf-b-b14b17-77f7d785c6-524vx" Jul 05 20:04:06.244892 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:04:06.244862 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-inf-b-b14b17-serving-cert\"" Jul 05 20:04:06.257342 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:04:06.257321 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-inf-b-b14b17-77f7d785c6-524vx"] Jul 05 20:04:06.412523 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:04:06.412487 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f6574912-1560-4503-9a1f-98afaf3720d0-openshift-service-ca\") pod \"maas-api-e2e-inf-b-b14b17-77f7d785c6-524vx\" (UID: \"f6574912-1560-4503-9a1f-98afaf3720d0\") " pod="opendatahub/maas-api-e2e-inf-b-b14b17-77f7d785c6-524vx" Jul 05 20:04:06.412523 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:04:06.412523 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f6574912-1560-4503-9a1f-98afaf3720d0-maas-api-tls\") pod \"maas-api-e2e-inf-b-b14b17-77f7d785c6-524vx\" (UID: \"f6574912-1560-4503-9a1f-98afaf3720d0\") " pod="opendatahub/maas-api-e2e-inf-b-b14b17-77f7d785c6-524vx" Jul 05 20:04:06.412731 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:04:06.412589 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7cgwb\" (UniqueName: \"kubernetes.io/projected/f6574912-1560-4503-9a1f-98afaf3720d0-kube-api-access-7cgwb\") pod \"maas-api-e2e-inf-b-b14b17-77f7d785c6-524vx\" (UID: \"f6574912-1560-4503-9a1f-98afaf3720d0\") " pod="opendatahub/maas-api-e2e-inf-b-b14b17-77f7d785c6-524vx" Jul 05 20:04:06.513725 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:04:06.513631 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f6574912-1560-4503-9a1f-98afaf3720d0-openshift-service-ca\") pod \"maas-api-e2e-inf-b-b14b17-77f7d785c6-524vx\" (UID: \"f6574912-1560-4503-9a1f-98afaf3720d0\") " pod="opendatahub/maas-api-e2e-inf-b-b14b17-77f7d785c6-524vx" Jul 05 20:04:06.513725 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:04:06.513670 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f6574912-1560-4503-9a1f-98afaf3720d0-maas-api-tls\") pod \"maas-api-e2e-inf-b-b14b17-77f7d785c6-524vx\" (UID: \"f6574912-1560-4503-9a1f-98afaf3720d0\") " pod="opendatahub/maas-api-e2e-inf-b-b14b17-77f7d785c6-524vx" Jul 05 20:04:06.513991 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:04:06.513731 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7cgwb\" (UniqueName: \"kubernetes.io/projected/f6574912-1560-4503-9a1f-98afaf3720d0-kube-api-access-7cgwb\") pod \"maas-api-e2e-inf-b-b14b17-77f7d785c6-524vx\" (UID: \"f6574912-1560-4503-9a1f-98afaf3720d0\") " pod="opendatahub/maas-api-e2e-inf-b-b14b17-77f7d785c6-524vx" Jul 05 20:04:06.513991 ip-10-0-133-7 kubenswrapper[2572]: E0705 20:04:06.513906 2572 secret.go:189] Couldn't get secret opendatahub/maas-api-e2e-inf-b-b14b17-serving-cert: secret "maas-api-e2e-inf-b-b14b17-serving-cert" not found Jul 05 20:04:06.514114 ip-10-0-133-7 kubenswrapper[2572]: E0705 20:04:06.514023 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f6574912-1560-4503-9a1f-98afaf3720d0-maas-api-tls podName:f6574912-1560-4503-9a1f-98afaf3720d0 nodeName:}" failed. No retries permitted until 2026-07-05 20:04:07.013998567 +0000 UTC m=+1900.413346014 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/f6574912-1560-4503-9a1f-98afaf3720d0-maas-api-tls") pod "maas-api-e2e-inf-b-b14b17-77f7d785c6-524vx" (UID: "f6574912-1560-4503-9a1f-98afaf3720d0") : secret "maas-api-e2e-inf-b-b14b17-serving-cert" not found Jul 05 20:04:06.514388 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:04:06.514366 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f6574912-1560-4503-9a1f-98afaf3720d0-openshift-service-ca\") pod \"maas-api-e2e-inf-b-b14b17-77f7d785c6-524vx\" (UID: \"f6574912-1560-4503-9a1f-98afaf3720d0\") " pod="opendatahub/maas-api-e2e-inf-b-b14b17-77f7d785c6-524vx" Jul 05 20:04:06.522887 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:04:06.522856 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7cgwb\" (UniqueName: \"kubernetes.io/projected/f6574912-1560-4503-9a1f-98afaf3720d0-kube-api-access-7cgwb\") pod \"maas-api-e2e-inf-b-b14b17-77f7d785c6-524vx\" (UID: \"f6574912-1560-4503-9a1f-98afaf3720d0\") " pod="opendatahub/maas-api-e2e-inf-b-b14b17-77f7d785c6-524vx" Jul 05 20:04:07.018376 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:04:07.018335 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f6574912-1560-4503-9a1f-98afaf3720d0-maas-api-tls\") pod \"maas-api-e2e-inf-b-b14b17-77f7d785c6-524vx\" (UID: \"f6574912-1560-4503-9a1f-98afaf3720d0\") " pod="opendatahub/maas-api-e2e-inf-b-b14b17-77f7d785c6-524vx" Jul 05 20:04:07.020748 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:04:07.020717 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f6574912-1560-4503-9a1f-98afaf3720d0-maas-api-tls\") pod \"maas-api-e2e-inf-b-b14b17-77f7d785c6-524vx\" (UID: \"f6574912-1560-4503-9a1f-98afaf3720d0\") " pod="opendatahub/maas-api-e2e-inf-b-b14b17-77f7d785c6-524vx" Jul 05 20:04:07.155861 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:04:07.155832 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-inf-b-b14b17-77f7d785c6-524vx" Jul 05 20:04:07.289895 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:04:07.289869 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-inf-b-b14b17-77f7d785c6-524vx"] Jul 05 20:04:07.291770 ip-10-0-133-7 kubenswrapper[2572]: W0705 20:04:07.291735 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf6574912_1560_4503_9a1f_98afaf3720d0.slice/crio-f4f4213e0332b391716a39e057036796aec4d0f00f3059fd76df6a8c60106ce8 WatchSource:0}: Error finding container f4f4213e0332b391716a39e057036796aec4d0f00f3059fd76df6a8c60106ce8: Status 404 returned error can't find the container with id f4f4213e0332b391716a39e057036796aec4d0f00f3059fd76df6a8c60106ce8 Jul 05 20:04:07.977766 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:04:07.977671 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-inf-b-b14b17-77f7d785c6-524vx" event={"ID":"f6574912-1560-4503-9a1f-98afaf3720d0","Type":"ContainerStarted","Data":"8b1aa808510d347f40796e22c0f98439acd5ef0b7563b7e94456109d3691e22a"} Jul 05 20:04:07.977766 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:04:07.977749 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-inf-b-b14b17-77f7d785c6-524vx" event={"ID":"f6574912-1560-4503-9a1f-98afaf3720d0","Type":"ContainerStarted","Data":"f4f4213e0332b391716a39e057036796aec4d0f00f3059fd76df6a8c60106ce8"} Jul 05 20:04:07.977987 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:04:07.977798 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-inf-b-b14b17-77f7d785c6-524vx" Jul 05 20:04:07.994750 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:04:07.994703 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-inf-b-b14b17-77f7d785c6-524vx" podStartSLOduration=1.581233912 podStartE2EDuration="1.994685048s" totalImagesPullingTime="413.451136ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-05 20:04:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 20:04:07.992763371 +0000 UTC m=+1901.392110848" watchObservedRunningTime="2026-07-05 20:04:07.994685048 +0000 UTC m=+1901.394032514" Jul 05 20:04:13.987424 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:04:13.987396 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-e2e-inf-b-b14b17-77f7d785c6-524vx" Jul 05 20:04:16.604458 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:04:16.604423 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jt8wt"] Jul 05 20:04:26.891014 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:04:26.890978 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jt8wt"] Jul 05 20:04:37.180724 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:04:37.180687 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jt8wt"] Jul 05 20:05:01.183795 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:05:01.183758 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jt8wt"] Jul 05 20:05:21.191190 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:05:21.190655 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-inf-a-8dc0f0-5d6f8b7699-qchqx"] Jul 05 20:05:21.191190 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:05:21.190936 2572 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-inf-a-8dc0f0-5d6f8b7699-qchqx" podUID="26c09bd3-9080-4333-ad74-635537b56bb7" containerName="maas-api" containerID="cri-o://d2a0d73cc3f4d00edbe054a9009d89f0dec6f78575fc4f50687af558b7c3936a" gracePeriod=30 Jul 05 20:05:21.644078 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:05:21.644047 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-inf-a-8dc0f0-5d6f8b7699-qchqx" Jul 05 20:05:21.759069 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:05:21.758974 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dnktm\" (UniqueName: \"kubernetes.io/projected/26c09bd3-9080-4333-ad74-635537b56bb7-kube-api-access-dnktm\") pod \"26c09bd3-9080-4333-ad74-635537b56bb7\" (UID: \"26c09bd3-9080-4333-ad74-635537b56bb7\") " Jul 05 20:05:21.759069 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:05:21.759026 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/26c09bd3-9080-4333-ad74-635537b56bb7-maas-api-tls\") pod \"26c09bd3-9080-4333-ad74-635537b56bb7\" (UID: \"26c09bd3-9080-4333-ad74-635537b56bb7\") " Jul 05 20:05:21.759310 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:05:21.759075 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/26c09bd3-9080-4333-ad74-635537b56bb7-openshift-service-ca\") pod \"26c09bd3-9080-4333-ad74-635537b56bb7\" (UID: \"26c09bd3-9080-4333-ad74-635537b56bb7\") " Jul 05 20:05:21.759460 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:05:21.759434 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/26c09bd3-9080-4333-ad74-635537b56bb7-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "26c09bd3-9080-4333-ad74-635537b56bb7" (UID: "26c09bd3-9080-4333-ad74-635537b56bb7"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 05 20:05:21.761158 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:05:21.761121 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/26c09bd3-9080-4333-ad74-635537b56bb7-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "26c09bd3-9080-4333-ad74-635537b56bb7" (UID: "26c09bd3-9080-4333-ad74-635537b56bb7"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 05 20:05:21.761254 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:05:21.761203 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/26c09bd3-9080-4333-ad74-635537b56bb7-kube-api-access-dnktm" (OuterVolumeSpecName: "kube-api-access-dnktm") pod "26c09bd3-9080-4333-ad74-635537b56bb7" (UID: "26c09bd3-9080-4333-ad74-635537b56bb7"). InnerVolumeSpecName "kube-api-access-dnktm". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 05 20:05:21.860458 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:05:21.860419 2572 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/26c09bd3-9080-4333-ad74-635537b56bb7-maas-api-tls\") on node \"ip-10-0-133-7.ec2.internal\" DevicePath \"\"" Jul 05 20:05:21.860458 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:05:21.860456 2572 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/26c09bd3-9080-4333-ad74-635537b56bb7-openshift-service-ca\") on node \"ip-10-0-133-7.ec2.internal\" DevicePath \"\"" Jul 05 20:05:21.860639 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:05:21.860468 2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dnktm\" (UniqueName: \"kubernetes.io/projected/26c09bd3-9080-4333-ad74-635537b56bb7-kube-api-access-dnktm\") on node \"ip-10-0-133-7.ec2.internal\" DevicePath \"\"" Jul 05 20:05:22.348639 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:05:22.348601 2572 generic.go:356] "Generic (PLEG): container finished" podID="26c09bd3-9080-4333-ad74-635537b56bb7" containerID="d2a0d73cc3f4d00edbe054a9009d89f0dec6f78575fc4f50687af558b7c3936a" exitCode=0 Jul 05 20:05:22.349129 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:05:22.348657 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-inf-a-8dc0f0-5d6f8b7699-qchqx" Jul 05 20:05:22.349129 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:05:22.348663 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-inf-a-8dc0f0-5d6f8b7699-qchqx" event={"ID":"26c09bd3-9080-4333-ad74-635537b56bb7","Type":"ContainerDied","Data":"d2a0d73cc3f4d00edbe054a9009d89f0dec6f78575fc4f50687af558b7c3936a"} Jul 05 20:05:22.349129 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:05:22.348719 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-inf-a-8dc0f0-5d6f8b7699-qchqx" event={"ID":"26c09bd3-9080-4333-ad74-635537b56bb7","Type":"ContainerDied","Data":"5be8ece8a5e9c1e64cc812c246e05619a487a6d3bfcafe5ddb5d3a5a599ee948"} Jul 05 20:05:22.349129 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:05:22.348761 2572 scope.go:117] "RemoveContainer" containerID="d2a0d73cc3f4d00edbe054a9009d89f0dec6f78575fc4f50687af558b7c3936a" Jul 05 20:05:22.358182 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:05:22.358166 2572 scope.go:117] "RemoveContainer" containerID="d2a0d73cc3f4d00edbe054a9009d89f0dec6f78575fc4f50687af558b7c3936a" Jul 05 20:05:22.358448 ip-10-0-133-7 kubenswrapper[2572]: E0705 20:05:22.358423 2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d2a0d73cc3f4d00edbe054a9009d89f0dec6f78575fc4f50687af558b7c3936a\": container with ID starting with d2a0d73cc3f4d00edbe054a9009d89f0dec6f78575fc4f50687af558b7c3936a not found: ID does not exist" containerID="d2a0d73cc3f4d00edbe054a9009d89f0dec6f78575fc4f50687af558b7c3936a" Jul 05 20:05:22.358513 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:05:22.358456 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d2a0d73cc3f4d00edbe054a9009d89f0dec6f78575fc4f50687af558b7c3936a"} err="failed to get container status \"d2a0d73cc3f4d00edbe054a9009d89f0dec6f78575fc4f50687af558b7c3936a\": rpc error: code = NotFound desc = could not find container \"d2a0d73cc3f4d00edbe054a9009d89f0dec6f78575fc4f50687af558b7c3936a\": container with ID starting with d2a0d73cc3f4d00edbe054a9009d89f0dec6f78575fc4f50687af558b7c3936a not found: ID does not exist" Jul 05 20:05:22.370213 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:05:22.370190 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-inf-a-8dc0f0-5d6f8b7699-qchqx"] Jul 05 20:05:22.374208 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:05:22.374188 2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-inf-a-8dc0f0-5d6f8b7699-qchqx"] Jul 05 20:05:22.963215 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:05:22.963182 2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="26c09bd3-9080-4333-ad74-635537b56bb7" path="/var/lib/kubelet/pods/26c09bd3-9080-4333-ad74-635537b56bb7/volumes" Jul 05 20:05:24.187243 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:05:24.187207 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jt8wt"] Jul 05 20:06:04.087530 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:06:04.087494 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-inf-b-b14b17-77f7d785c6-524vx"] Jul 05 20:06:04.088523 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:06:04.088461 2572 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-inf-b-b14b17-77f7d785c6-524vx" podUID="f6574912-1560-4503-9a1f-98afaf3720d0" containerName="maas-api" containerID="cri-o://8b1aa808510d347f40796e22c0f98439acd5ef0b7563b7e94456109d3691e22a" gracePeriod=30 Jul 05 20:06:04.351534 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:06:04.351511 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-inf-b-b14b17-77f7d785c6-524vx" Jul 05 20:06:04.410896 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:06:04.410866 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7cgwb\" (UniqueName: \"kubernetes.io/projected/f6574912-1560-4503-9a1f-98afaf3720d0-kube-api-access-7cgwb\") pod \"f6574912-1560-4503-9a1f-98afaf3720d0\" (UID: \"f6574912-1560-4503-9a1f-98afaf3720d0\") " Jul 05 20:06:04.411102 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:06:04.410934 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f6574912-1560-4503-9a1f-98afaf3720d0-openshift-service-ca\") pod \"f6574912-1560-4503-9a1f-98afaf3720d0\" (UID: \"f6574912-1560-4503-9a1f-98afaf3720d0\") " Jul 05 20:06:04.411102 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:06:04.410987 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f6574912-1560-4503-9a1f-98afaf3720d0-maas-api-tls\") pod \"f6574912-1560-4503-9a1f-98afaf3720d0\" (UID: \"f6574912-1560-4503-9a1f-98afaf3720d0\") " Jul 05 20:06:04.411309 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:06:04.411283 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f6574912-1560-4503-9a1f-98afaf3720d0-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "f6574912-1560-4503-9a1f-98afaf3720d0" (UID: "f6574912-1560-4503-9a1f-98afaf3720d0"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 05 20:06:04.413052 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:06:04.413026 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f6574912-1560-4503-9a1f-98afaf3720d0-kube-api-access-7cgwb" (OuterVolumeSpecName: "kube-api-access-7cgwb") pod "f6574912-1560-4503-9a1f-98afaf3720d0" (UID: "f6574912-1560-4503-9a1f-98afaf3720d0"). InnerVolumeSpecName "kube-api-access-7cgwb". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 05 20:06:04.413131 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:06:04.413083 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f6574912-1560-4503-9a1f-98afaf3720d0-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "f6574912-1560-4503-9a1f-98afaf3720d0" (UID: "f6574912-1560-4503-9a1f-98afaf3720d0"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 05 20:06:04.511927 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:06:04.511896 2572 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f6574912-1560-4503-9a1f-98afaf3720d0-openshift-service-ca\") on node \"ip-10-0-133-7.ec2.internal\" DevicePath \"\"" Jul 05 20:06:04.511927 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:06:04.511923 2572 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f6574912-1560-4503-9a1f-98afaf3720d0-maas-api-tls\") on node \"ip-10-0-133-7.ec2.internal\" DevicePath \"\"" Jul 05 20:06:04.511927 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:06:04.511933 2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7cgwb\" (UniqueName: \"kubernetes.io/projected/f6574912-1560-4503-9a1f-98afaf3720d0-kube-api-access-7cgwb\") on node \"ip-10-0-133-7.ec2.internal\" DevicePath \"\"" Jul 05 20:06:04.556028 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:06:04.555994 2572 generic.go:356] "Generic (PLEG): container finished" podID="f6574912-1560-4503-9a1f-98afaf3720d0" containerID="8b1aa808510d347f40796e22c0f98439acd5ef0b7563b7e94456109d3691e22a" exitCode=0 Jul 05 20:06:04.556186 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:06:04.556040 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-inf-b-b14b17-77f7d785c6-524vx" Jul 05 20:06:04.556186 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:06:04.556085 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-inf-b-b14b17-77f7d785c6-524vx" event={"ID":"f6574912-1560-4503-9a1f-98afaf3720d0","Type":"ContainerDied","Data":"8b1aa808510d347f40796e22c0f98439acd5ef0b7563b7e94456109d3691e22a"} Jul 05 20:06:04.556186 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:06:04.556139 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-inf-b-b14b17-77f7d785c6-524vx" event={"ID":"f6574912-1560-4503-9a1f-98afaf3720d0","Type":"ContainerDied","Data":"f4f4213e0332b391716a39e057036796aec4d0f00f3059fd76df6a8c60106ce8"} Jul 05 20:06:04.556186 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:06:04.556161 2572 scope.go:117] "RemoveContainer" containerID="8b1aa808510d347f40796e22c0f98439acd5ef0b7563b7e94456109d3691e22a" Jul 05 20:06:04.565014 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:06:04.564997 2572 scope.go:117] "RemoveContainer" containerID="8b1aa808510d347f40796e22c0f98439acd5ef0b7563b7e94456109d3691e22a" Jul 05 20:06:04.565288 ip-10-0-133-7 kubenswrapper[2572]: E0705 20:06:04.565272 2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8b1aa808510d347f40796e22c0f98439acd5ef0b7563b7e94456109d3691e22a\": container with ID starting with 8b1aa808510d347f40796e22c0f98439acd5ef0b7563b7e94456109d3691e22a not found: ID does not exist" containerID="8b1aa808510d347f40796e22c0f98439acd5ef0b7563b7e94456109d3691e22a" Jul 05 20:06:04.565328 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:06:04.565299 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8b1aa808510d347f40796e22c0f98439acd5ef0b7563b7e94456109d3691e22a"} err="failed to get container status \"8b1aa808510d347f40796e22c0f98439acd5ef0b7563b7e94456109d3691e22a\": rpc error: code = NotFound desc = could not find container \"8b1aa808510d347f40796e22c0f98439acd5ef0b7563b7e94456109d3691e22a\": container with ID starting with 8b1aa808510d347f40796e22c0f98439acd5ef0b7563b7e94456109d3691e22a not found: ID does not exist" Jul 05 20:06:04.576198 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:06:04.576175 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-inf-b-b14b17-77f7d785c6-524vx"] Jul 05 20:06:04.582222 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:06:04.582201 2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-inf-b-b14b17-77f7d785c6-524vx"] Jul 05 20:06:04.962722 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:06:04.962692 2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f6574912-1560-4503-9a1f-98afaf3720d0" path="/var/lib/kubelet/pods/f6574912-1560-4503-9a1f-98afaf3720d0/volumes" Jul 05 20:06:05.885609 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:06:05.885567 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jt8wt"] Jul 05 20:06:10.649917 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:06:10.649879 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-a-237c8b-openshift-default-56b9c7f45c-p9nvr"] Jul 05 20:06:10.650381 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:06:10.650273 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="26c09bd3-9080-4333-ad74-635537b56bb7" containerName="maas-api" Jul 05 20:06:10.650381 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:06:10.650286 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="26c09bd3-9080-4333-ad74-635537b56bb7" containerName="maas-api" Jul 05 20:06:10.650381 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:06:10.650304 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f6574912-1560-4503-9a1f-98afaf3720d0" containerName="maas-api" Jul 05 20:06:10.650381 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:06:10.650310 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="f6574912-1560-4503-9a1f-98afaf3720d0" containerName="maas-api" Jul 05 20:06:10.650381 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:06:10.650371 2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="f6574912-1560-4503-9a1f-98afaf3720d0" containerName="maas-api" Jul 05 20:06:10.650381 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:06:10.650381 2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="26c09bd3-9080-4333-ad74-635537b56bb7" containerName="maas-api" Jul 05 20:06:10.655126 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:06:10.655104 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-237c8b-openshift-default-56b9c7f45c-p9nvr" Jul 05 20:06:10.657512 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:06:10.657490 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-a-237c8b-openshift-default-dockercfg-pqv8g\"" Jul 05 20:06:10.659684 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:06:10.659659 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bde69bcc-a602-4558-b3be-d7ee365adfe7-istio-podinfo\") pod \"e2e-api-a-237c8b-openshift-default-56b9c7f45c-p9nvr\" (UID: \"bde69bcc-a602-4558-b3be-d7ee365adfe7\") " pod="openshift-ingress/e2e-api-a-237c8b-openshift-default-56b9c7f45c-p9nvr" Jul 05 20:06:10.659778 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:06:10.659714 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bde69bcc-a602-4558-b3be-d7ee365adfe7-istiod-ca-cert\") pod \"e2e-api-a-237c8b-openshift-default-56b9c7f45c-p9nvr\" (UID: \"bde69bcc-a602-4558-b3be-d7ee365adfe7\") " pod="openshift-ingress/e2e-api-a-237c8b-openshift-default-56b9c7f45c-p9nvr" Jul 05 20:06:10.659849 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:06:10.659829 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bde69bcc-a602-4558-b3be-d7ee365adfe7-credential-socket\") pod \"e2e-api-a-237c8b-openshift-default-56b9c7f45c-p9nvr\" (UID: \"bde69bcc-a602-4558-b3be-d7ee365adfe7\") " pod="openshift-ingress/e2e-api-a-237c8b-openshift-default-56b9c7f45c-p9nvr" Jul 05 20:06:10.659888 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:06:10.659858 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bde69bcc-a602-4558-b3be-d7ee365adfe7-istio-data\") pod \"e2e-api-a-237c8b-openshift-default-56b9c7f45c-p9nvr\" (UID: \"bde69bcc-a602-4558-b3be-d7ee365adfe7\") " pod="openshift-ingress/e2e-api-a-237c8b-openshift-default-56b9c7f45c-p9nvr" Jul 05 20:06:10.659888 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:06:10.659880 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l6bpq\" (UniqueName: \"kubernetes.io/projected/bde69bcc-a602-4558-b3be-d7ee365adfe7-kube-api-access-l6bpq\") pod \"e2e-api-a-237c8b-openshift-default-56b9c7f45c-p9nvr\" (UID: \"bde69bcc-a602-4558-b3be-d7ee365adfe7\") " pod="openshift-ingress/e2e-api-a-237c8b-openshift-default-56b9c7f45c-p9nvr" Jul 05 20:06:10.659977 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:06:10.659938 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bde69bcc-a602-4558-b3be-d7ee365adfe7-workload-certs\") pod \"e2e-api-a-237c8b-openshift-default-56b9c7f45c-p9nvr\" (UID: \"bde69bcc-a602-4558-b3be-d7ee365adfe7\") " pod="openshift-ingress/e2e-api-a-237c8b-openshift-default-56b9c7f45c-p9nvr" Jul 05 20:06:10.660020 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:06:10.659999 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bde69bcc-a602-4558-b3be-d7ee365adfe7-istio-envoy\") pod \"e2e-api-a-237c8b-openshift-default-56b9c7f45c-p9nvr\" (UID: \"bde69bcc-a602-4558-b3be-d7ee365adfe7\") " pod="openshift-ingress/e2e-api-a-237c8b-openshift-default-56b9c7f45c-p9nvr" Jul 05 20:06:10.660020 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:06:10.660016 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bde69bcc-a602-4558-b3be-d7ee365adfe7-istio-token\") pod \"e2e-api-a-237c8b-openshift-default-56b9c7f45c-p9nvr\" (UID: \"bde69bcc-a602-4558-b3be-d7ee365adfe7\") " pod="openshift-ingress/e2e-api-a-237c8b-openshift-default-56b9c7f45c-p9nvr" Jul 05 20:06:10.660090 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:06:10.660043 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bde69bcc-a602-4558-b3be-d7ee365adfe7-workload-socket\") pod \"e2e-api-a-237c8b-openshift-default-56b9c7f45c-p9nvr\" (UID: \"bde69bcc-a602-4558-b3be-d7ee365adfe7\") " pod="openshift-ingress/e2e-api-a-237c8b-openshift-default-56b9c7f45c-p9nvr" Jul 05 20:06:10.665557 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:06:10.665529 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-237c8b-openshift-default-56b9c7f45c-p9nvr"] Jul 05 20:06:10.760557 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:06:10.760508 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bde69bcc-a602-4558-b3be-d7ee365adfe7-workload-certs\") pod \"e2e-api-a-237c8b-openshift-default-56b9c7f45c-p9nvr\" (UID: \"bde69bcc-a602-4558-b3be-d7ee365adfe7\") " pod="openshift-ingress/e2e-api-a-237c8b-openshift-default-56b9c7f45c-p9nvr" Jul 05 20:06:10.760557 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:06:10.760562 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bde69bcc-a602-4558-b3be-d7ee365adfe7-istio-envoy\") pod \"e2e-api-a-237c8b-openshift-default-56b9c7f45c-p9nvr\" (UID: \"bde69bcc-a602-4558-b3be-d7ee365adfe7\") " pod="openshift-ingress/e2e-api-a-237c8b-openshift-default-56b9c7f45c-p9nvr" Jul 05 20:06:10.760819 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:06:10.760708 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bde69bcc-a602-4558-b3be-d7ee365adfe7-istio-token\") pod \"e2e-api-a-237c8b-openshift-default-56b9c7f45c-p9nvr\" (UID: \"bde69bcc-a602-4558-b3be-d7ee365adfe7\") " pod="openshift-ingress/e2e-api-a-237c8b-openshift-default-56b9c7f45c-p9nvr" Jul 05 20:06:10.760819 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:06:10.760767 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bde69bcc-a602-4558-b3be-d7ee365adfe7-workload-socket\") pod \"e2e-api-a-237c8b-openshift-default-56b9c7f45c-p9nvr\" (UID: \"bde69bcc-a602-4558-b3be-d7ee365adfe7\") " pod="openshift-ingress/e2e-api-a-237c8b-openshift-default-56b9c7f45c-p9nvr" Jul 05 20:06:10.760819 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:06:10.760794 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bde69bcc-a602-4558-b3be-d7ee365adfe7-istio-podinfo\") pod \"e2e-api-a-237c8b-openshift-default-56b9c7f45c-p9nvr\" (UID: \"bde69bcc-a602-4558-b3be-d7ee365adfe7\") " pod="openshift-ingress/e2e-api-a-237c8b-openshift-default-56b9c7f45c-p9nvr" Jul 05 20:06:10.761020 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:06:10.760856 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bde69bcc-a602-4558-b3be-d7ee365adfe7-istiod-ca-cert\") pod \"e2e-api-a-237c8b-openshift-default-56b9c7f45c-p9nvr\" (UID: \"bde69bcc-a602-4558-b3be-d7ee365adfe7\") " pod="openshift-ingress/e2e-api-a-237c8b-openshift-default-56b9c7f45c-p9nvr" Jul 05 20:06:10.761020 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:06:10.760943 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bde69bcc-a602-4558-b3be-d7ee365adfe7-credential-socket\") pod \"e2e-api-a-237c8b-openshift-default-56b9c7f45c-p9nvr\" (UID: \"bde69bcc-a602-4558-b3be-d7ee365adfe7\") " pod="openshift-ingress/e2e-api-a-237c8b-openshift-default-56b9c7f45c-p9nvr" Jul 05 20:06:10.761020 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:06:10.760994 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bde69bcc-a602-4558-b3be-d7ee365adfe7-istio-data\") pod \"e2e-api-a-237c8b-openshift-default-56b9c7f45c-p9nvr\" (UID: \"bde69bcc-a602-4558-b3be-d7ee365adfe7\") " pod="openshift-ingress/e2e-api-a-237c8b-openshift-default-56b9c7f45c-p9nvr" Jul 05 20:06:10.761171 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:06:10.761022 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l6bpq\" (UniqueName: \"kubernetes.io/projected/bde69bcc-a602-4558-b3be-d7ee365adfe7-kube-api-access-l6bpq\") pod \"e2e-api-a-237c8b-openshift-default-56b9c7f45c-p9nvr\" (UID: \"bde69bcc-a602-4558-b3be-d7ee365adfe7\") " pod="openshift-ingress/e2e-api-a-237c8b-openshift-default-56b9c7f45c-p9nvr" Jul 05 20:06:10.761171 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:06:10.760996 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bde69bcc-a602-4558-b3be-d7ee365adfe7-workload-certs\") pod \"e2e-api-a-237c8b-openshift-default-56b9c7f45c-p9nvr\" (UID: \"bde69bcc-a602-4558-b3be-d7ee365adfe7\") " pod="openshift-ingress/e2e-api-a-237c8b-openshift-default-56b9c7f45c-p9nvr" Jul 05 20:06:10.761407 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:06:10.761381 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bde69bcc-a602-4558-b3be-d7ee365adfe7-credential-socket\") pod \"e2e-api-a-237c8b-openshift-default-56b9c7f45c-p9nvr\" (UID: \"bde69bcc-a602-4558-b3be-d7ee365adfe7\") " pod="openshift-ingress/e2e-api-a-237c8b-openshift-default-56b9c7f45c-p9nvr" Jul 05 20:06:10.761663 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:06:10.761632 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bde69bcc-a602-4558-b3be-d7ee365adfe7-workload-socket\") pod \"e2e-api-a-237c8b-openshift-default-56b9c7f45c-p9nvr\" (UID: \"bde69bcc-a602-4558-b3be-d7ee365adfe7\") " pod="openshift-ingress/e2e-api-a-237c8b-openshift-default-56b9c7f45c-p9nvr" Jul 05 20:06:10.762005 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:06:10.761778 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bde69bcc-a602-4558-b3be-d7ee365adfe7-istio-data\") pod \"e2e-api-a-237c8b-openshift-default-56b9c7f45c-p9nvr\" (UID: \"bde69bcc-a602-4558-b3be-d7ee365adfe7\") " pod="openshift-ingress/e2e-api-a-237c8b-openshift-default-56b9c7f45c-p9nvr" Jul 05 20:06:10.762140 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:06:10.762116 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bde69bcc-a602-4558-b3be-d7ee365adfe7-istiod-ca-cert\") pod \"e2e-api-a-237c8b-openshift-default-56b9c7f45c-p9nvr\" (UID: \"bde69bcc-a602-4558-b3be-d7ee365adfe7\") " pod="openshift-ingress/e2e-api-a-237c8b-openshift-default-56b9c7f45c-p9nvr" Jul 05 20:06:10.763217 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:06:10.763189 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bde69bcc-a602-4558-b3be-d7ee365adfe7-istio-envoy\") pod \"e2e-api-a-237c8b-openshift-default-56b9c7f45c-p9nvr\" (UID: \"bde69bcc-a602-4558-b3be-d7ee365adfe7\") " pod="openshift-ingress/e2e-api-a-237c8b-openshift-default-56b9c7f45c-p9nvr" Jul 05 20:06:10.763795 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:06:10.763778 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bde69bcc-a602-4558-b3be-d7ee365adfe7-istio-podinfo\") pod \"e2e-api-a-237c8b-openshift-default-56b9c7f45c-p9nvr\" (UID: \"bde69bcc-a602-4558-b3be-d7ee365adfe7\") " pod="openshift-ingress/e2e-api-a-237c8b-openshift-default-56b9c7f45c-p9nvr" Jul 05 20:06:10.768115 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:06:10.768091 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bde69bcc-a602-4558-b3be-d7ee365adfe7-istio-token\") pod \"e2e-api-a-237c8b-openshift-default-56b9c7f45c-p9nvr\" (UID: \"bde69bcc-a602-4558-b3be-d7ee365adfe7\") " pod="openshift-ingress/e2e-api-a-237c8b-openshift-default-56b9c7f45c-p9nvr" Jul 05 20:06:10.768201 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:06:10.768128 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-l6bpq\" (UniqueName: \"kubernetes.io/projected/bde69bcc-a602-4558-b3be-d7ee365adfe7-kube-api-access-l6bpq\") pod \"e2e-api-a-237c8b-openshift-default-56b9c7f45c-p9nvr\" (UID: \"bde69bcc-a602-4558-b3be-d7ee365adfe7\") " pod="openshift-ingress/e2e-api-a-237c8b-openshift-default-56b9c7f45c-p9nvr" Jul 05 20:06:10.967177 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:06:10.967143 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-237c8b-openshift-default-56b9c7f45c-p9nvr" Jul 05 20:06:11.107824 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:06:11.107799 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-237c8b-openshift-default-56b9c7f45c-p9nvr"] Jul 05 20:06:11.110014 ip-10-0-133-7 kubenswrapper[2572]: W0705 20:06:11.109987 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbde69bcc_a602_4558_b3be_d7ee365adfe7.slice/crio-a6b31a0903a4d3aec703f9429889e1e3e5d233a4ac7ce6a0ec49dcdbb7f3b2b7 WatchSource:0}: Error finding container a6b31a0903a4d3aec703f9429889e1e3e5d233a4ac7ce6a0ec49dcdbb7f3b2b7: Status 404 returned error can't find the container with id a6b31a0903a4d3aec703f9429889e1e3e5d233a4ac7ce6a0ec49dcdbb7f3b2b7 Jul 05 20:06:11.594332 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:06:11.594296 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-237c8b-openshift-default-56b9c7f45c-p9nvr" event={"ID":"bde69bcc-a602-4558-b3be-d7ee365adfe7","Type":"ContainerStarted","Data":"a6b31a0903a4d3aec703f9429889e1e3e5d233a4ac7ce6a0ec49dcdbb7f3b2b7"} Jul 05 20:06:13.658698 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:06:13.658657 2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 05 20:06:13.659124 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:06:13.658748 2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 05 20:06:13.659124 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:06:13.658793 2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 05 20:06:14.611493 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:06:14.611454 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-237c8b-openshift-default-56b9c7f45c-p9nvr" event={"ID":"bde69bcc-a602-4558-b3be-d7ee365adfe7","Type":"ContainerStarted","Data":"094c447cd259e1ec86b0e07f843af5228efad52cd9eb2b6f9fef4735f120ca75"} Jul 05 20:06:14.633541 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:06:14.633489 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-a-237c8b-openshift-default-56b9c7f45c-p9nvr" podStartSLOduration=2.087633349 podStartE2EDuration="4.633460981s" totalImagesPullingTime="2.545827632s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-05 20:06:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 20:06:14.630626177 +0000 UTC m=+2028.029973668" watchObservedRunningTime="2026-07-05 20:06:14.633460981 +0000 UTC m=+2028.032808483" Jul 05 20:06:14.968985 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:06:14.968929 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-237c8b-openshift-default-56b9c7f45c-p9nvr" Jul 05 20:06:14.972739 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:06:14.972711 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-237c8b-openshift-default-56b9c7f45c-p9nvr" Jul 05 20:06:15.616701 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:06:15.616671 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-237c8b-openshift-default-56b9c7f45c-p9nvr" Jul 05 20:06:15.617789 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:06:15.617770 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-237c8b-openshift-default-56b9c7f45c-p9nvr" Jul 05 20:06:20.085692 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:06:20.085658 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jt8wt"] Jul 05 20:06:28.691987 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:06:28.691931 2572 generic.go:356] "Generic (PLEG): container finished" podID="bde69bcc-a602-4558-b3be-d7ee365adfe7" containerID="094c447cd259e1ec86b0e07f843af5228efad52cd9eb2b6f9fef4735f120ca75" exitCode=0 Jul 05 20:06:28.692411 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:06:28.692008 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-237c8b-openshift-default-56b9c7f45c-p9nvr" event={"ID":"bde69bcc-a602-4558-b3be-d7ee365adfe7","Type":"ContainerDied","Data":"094c447cd259e1ec86b0e07f843af5228efad52cd9eb2b6f9fef4735f120ca75"} Jul 05 20:06:28.692411 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:06:28.692396 2572 scope.go:117] "RemoveContainer" containerID="094c447cd259e1ec86b0e07f843af5228efad52cd9eb2b6f9fef4735f120ca75" Jul 05 20:06:28.693415 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:06:28.693385 2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 05 20:06:28.693483 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:06:28.693454 2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 05 20:06:28.693520 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:06:28.693486 2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 05 20:06:29.699483 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:06:29.699448 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-237c8b-openshift-default-56b9c7f45c-p9nvr" event={"ID":"bde69bcc-a602-4558-b3be-d7ee365adfe7","Type":"ContainerStarted","Data":"5343fe40994711bc05a77e42380760611a061ff41f17e111bdb4339ac77996e9"} Jul 05 20:06:29.968011 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:06:29.967884 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-237c8b-openshift-default-56b9c7f45c-p9nvr" Jul 05 20:06:29.969185 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:06:29.969158 2572 patch_prober.go:28] interesting pod/e2e-api-a-237c8b-openshift-default-56b9c7f45c-p9nvr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.45:15021/healthz/ready\": dial tcp 10.132.0.45:15021: connect: connection refused" start-of-body= Jul 05 20:06:29.969271 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:06:29.969210 2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-237c8b-openshift-default-56b9c7f45c-p9nvr" podUID="bde69bcc-a602-4558-b3be-d7ee365adfe7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.45:15021/healthz/ready\": dial tcp 10.132.0.45:15021: connect: connection refused" Jul 05 20:06:30.617265 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:06:30.617229 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-237c8b-openshift-default-56b9c7f45c-p9nvr" Jul 05 20:06:30.968183 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:06:30.968148 2572 patch_prober.go:28] interesting pod/e2e-api-a-237c8b-openshift-default-56b9c7f45c-p9nvr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.45:15021/healthz/ready\": dial tcp 10.132.0.45:15021: connect: connection refused" start-of-body= Jul 05 20:06:30.968570 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:06:30.968201 2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-237c8b-openshift-default-56b9c7f45c-p9nvr" podUID="bde69bcc-a602-4558-b3be-d7ee365adfe7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.45:15021/healthz/ready\": dial tcp 10.132.0.45:15021: connect: connection refused" Jul 05 20:06:31.968073 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:06:31.968033 2572 patch_prober.go:28] interesting pod/e2e-api-a-237c8b-openshift-default-56b9c7f45c-p9nvr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.45:15021/healthz/ready\": dial tcp 10.132.0.45:15021: connect: connection refused" start-of-body= Jul 05 20:06:31.968256 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:06:31.968088 2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-237c8b-openshift-default-56b9c7f45c-p9nvr" podUID="bde69bcc-a602-4558-b3be-d7ee365adfe7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.45:15021/healthz/ready\": dial tcp 10.132.0.45:15021: connect: connection refused" Jul 05 20:06:32.968400 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:06:32.968355 2572 patch_prober.go:28] interesting pod/e2e-api-a-237c8b-openshift-default-56b9c7f45c-p9nvr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.45:15021/healthz/ready\": dial tcp 10.132.0.45:15021: connect: connection refused" start-of-body= Jul 05 20:06:32.968862 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:06:32.968420 2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-237c8b-openshift-default-56b9c7f45c-p9nvr" podUID="bde69bcc-a602-4558-b3be-d7ee365adfe7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.45:15021/healthz/ready\": dial tcp 10.132.0.45:15021: connect: connection refused" Jul 05 20:06:33.971569 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:06:33.971535 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-237c8b-openshift-default-56b9c7f45c-p9nvr" Jul 05 20:06:33.972606 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:06:33.972586 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-237c8b-openshift-default-56b9c7f45c-p9nvr" Jul 05 20:06:37.490590 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:06:37.490551 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jt8wt"] Jul 05 20:06:43.860123 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:06:43.860088 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-237c8b-openshift-default-56b9c7f45c-p9nvr"] Jul 05 20:06:43.860689 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:06:43.860359 2572 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-api-a-237c8b-openshift-default-56b9c7f45c-p9nvr" podUID="bde69bcc-a602-4558-b3be-d7ee365adfe7" containerName="istio-proxy" containerID="cri-o://5343fe40994711bc05a77e42380760611a061ff41f17e111bdb4339ac77996e9" gracePeriod=30 Jul 05 20:06:47.182336 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:06:47.182301 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jt8wt"] Jul 05 20:06:48.973742 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:06:48.973710 2572 patch_prober.go:28] interesting pod/e2e-api-a-237c8b-openshift-default-56b9c7f45c-p9nvr container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.45:15021/healthz/ready\": dial tcp 10.132.0.45:15021: connect: connection refused" start-of-body= Jul 05 20:06:48.974114 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:06:48.973781 2572 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-a-237c8b-openshift-default-56b9c7f45c-p9nvr" podUID="bde69bcc-a602-4558-b3be-d7ee365adfe7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.45:15021/healthz/ready\": dial tcp 10.132.0.45:15021: connect: connection refused" Jul 05 20:06:49.116383 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:06:49.116359 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-237c8b-openshift-default-56b9c7f45c-p9nvr" Jul 05 20:06:49.197059 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:06:49.197021 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bde69bcc-a602-4558-b3be-d7ee365adfe7-istio-podinfo\") pod \"bde69bcc-a602-4558-b3be-d7ee365adfe7\" (UID: \"bde69bcc-a602-4558-b3be-d7ee365adfe7\") " Jul 05 20:06:49.197059 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:06:49.197053 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bde69bcc-a602-4558-b3be-d7ee365adfe7-istiod-ca-cert\") pod \"bde69bcc-a602-4558-b3be-d7ee365adfe7\" (UID: \"bde69bcc-a602-4558-b3be-d7ee365adfe7\") " Jul 05 20:06:49.197287 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:06:49.197072 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-l6bpq\" (UniqueName: \"kubernetes.io/projected/bde69bcc-a602-4558-b3be-d7ee365adfe7-kube-api-access-l6bpq\") pod \"bde69bcc-a602-4558-b3be-d7ee365adfe7\" (UID: \"bde69bcc-a602-4558-b3be-d7ee365adfe7\") " Jul 05 20:06:49.197287 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:06:49.197092 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bde69bcc-a602-4558-b3be-d7ee365adfe7-istio-data\") pod \"bde69bcc-a602-4558-b3be-d7ee365adfe7\" (UID: \"bde69bcc-a602-4558-b3be-d7ee365adfe7\") " Jul 05 20:06:49.197287 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:06:49.197126 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bde69bcc-a602-4558-b3be-d7ee365adfe7-workload-socket\") pod \"bde69bcc-a602-4558-b3be-d7ee365adfe7\" (UID: \"bde69bcc-a602-4558-b3be-d7ee365adfe7\") " Jul 05 20:06:49.197287 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:06:49.197153 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bde69bcc-a602-4558-b3be-d7ee365adfe7-istio-envoy\") pod \"bde69bcc-a602-4558-b3be-d7ee365adfe7\" (UID: \"bde69bcc-a602-4558-b3be-d7ee365adfe7\") " Jul 05 20:06:49.197287 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:06:49.197173 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bde69bcc-a602-4558-b3be-d7ee365adfe7-workload-certs\") pod \"bde69bcc-a602-4558-b3be-d7ee365adfe7\" (UID: \"bde69bcc-a602-4558-b3be-d7ee365adfe7\") " Jul 05 20:06:49.197287 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:06:49.197234 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bde69bcc-a602-4558-b3be-d7ee365adfe7-credential-socket\") pod \"bde69bcc-a602-4558-b3be-d7ee365adfe7\" (UID: \"bde69bcc-a602-4558-b3be-d7ee365adfe7\") " Jul 05 20:06:49.197287 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:06:49.197278 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bde69bcc-a602-4558-b3be-d7ee365adfe7-istio-token\") pod \"bde69bcc-a602-4558-b3be-d7ee365adfe7\" (UID: \"bde69bcc-a602-4558-b3be-d7ee365adfe7\") " Jul 05 20:06:49.197634 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:06:49.197434 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bde69bcc-a602-4558-b3be-d7ee365adfe7-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "bde69bcc-a602-4558-b3be-d7ee365adfe7" (UID: "bde69bcc-a602-4558-b3be-d7ee365adfe7"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 05 20:06:49.197634 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:06:49.197611 2572 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bde69bcc-a602-4558-b3be-d7ee365adfe7-workload-socket\") on node \"ip-10-0-133-7.ec2.internal\" DevicePath \"\"" Jul 05 20:06:49.197747 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:06:49.197628 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bde69bcc-a602-4558-b3be-d7ee365adfe7-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "bde69bcc-a602-4558-b3be-d7ee365adfe7" (UID: "bde69bcc-a602-4558-b3be-d7ee365adfe7"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 05 20:06:49.197802 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:06:49.197790 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bde69bcc-a602-4558-b3be-d7ee365adfe7-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "bde69bcc-a602-4558-b3be-d7ee365adfe7" (UID: "bde69bcc-a602-4558-b3be-d7ee365adfe7"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 05 20:06:49.197854 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:06:49.197808 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bde69bcc-a602-4558-b3be-d7ee365adfe7-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "bde69bcc-a602-4558-b3be-d7ee365adfe7" (UID: "bde69bcc-a602-4558-b3be-d7ee365adfe7"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 05 20:06:49.198037 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:06:49.198017 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bde69bcc-a602-4558-b3be-d7ee365adfe7-istio-data" (OuterVolumeSpecName: "istio-data") pod "bde69bcc-a602-4558-b3be-d7ee365adfe7" (UID: "bde69bcc-a602-4558-b3be-d7ee365adfe7"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 05 20:06:49.199460 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:06:49.199436 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/bde69bcc-a602-4558-b3be-d7ee365adfe7-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "bde69bcc-a602-4558-b3be-d7ee365adfe7" (UID: "bde69bcc-a602-4558-b3be-d7ee365adfe7"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 05 20:06:49.199460 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:06:49.199447 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bde69bcc-a602-4558-b3be-d7ee365adfe7-kube-api-access-l6bpq" (OuterVolumeSpecName: "kube-api-access-l6bpq") pod "bde69bcc-a602-4558-b3be-d7ee365adfe7" (UID: "bde69bcc-a602-4558-b3be-d7ee365adfe7"). InnerVolumeSpecName "kube-api-access-l6bpq". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 05 20:06:49.199734 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:06:49.199717 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bde69bcc-a602-4558-b3be-d7ee365adfe7-istio-token" (OuterVolumeSpecName: "istio-token") pod "bde69bcc-a602-4558-b3be-d7ee365adfe7" (UID: "bde69bcc-a602-4558-b3be-d7ee365adfe7"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 05 20:06:49.199774 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:06:49.199716 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bde69bcc-a602-4558-b3be-d7ee365adfe7-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "bde69bcc-a602-4558-b3be-d7ee365adfe7" (UID: "bde69bcc-a602-4558-b3be-d7ee365adfe7"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 05 20:06:49.298478 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:06:49.298435 2572 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bde69bcc-a602-4558-b3be-d7ee365adfe7-istio-podinfo\") on node \"ip-10-0-133-7.ec2.internal\" DevicePath \"\"" Jul 05 20:06:49.298478 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:06:49.298470 2572 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bde69bcc-a602-4558-b3be-d7ee365adfe7-istiod-ca-cert\") on node \"ip-10-0-133-7.ec2.internal\" DevicePath \"\"" Jul 05 20:06:49.298687 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:06:49.298484 2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-l6bpq\" (UniqueName: \"kubernetes.io/projected/bde69bcc-a602-4558-b3be-d7ee365adfe7-kube-api-access-l6bpq\") on node \"ip-10-0-133-7.ec2.internal\" DevicePath \"\"" Jul 05 20:06:49.298687 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:06:49.298498 2572 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bde69bcc-a602-4558-b3be-d7ee365adfe7-istio-data\") on node \"ip-10-0-133-7.ec2.internal\" DevicePath \"\"" Jul 05 20:06:49.298687 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:06:49.298509 2572 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bde69bcc-a602-4558-b3be-d7ee365adfe7-istio-envoy\") on node \"ip-10-0-133-7.ec2.internal\" DevicePath \"\"" Jul 05 20:06:49.298687 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:06:49.298520 2572 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bde69bcc-a602-4558-b3be-d7ee365adfe7-workload-certs\") on node \"ip-10-0-133-7.ec2.internal\" DevicePath \"\"" Jul 05 20:06:49.298687 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:06:49.298530 2572 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bde69bcc-a602-4558-b3be-d7ee365adfe7-credential-socket\") on node \"ip-10-0-133-7.ec2.internal\" DevicePath \"\"" Jul 05 20:06:49.298687 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:06:49.298540 2572 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bde69bcc-a602-4558-b3be-d7ee365adfe7-istio-token\") on node \"ip-10-0-133-7.ec2.internal\" DevicePath \"\"" Jul 05 20:06:49.812267 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:06:49.812227 2572 generic.go:356] "Generic (PLEG): container finished" podID="bde69bcc-a602-4558-b3be-d7ee365adfe7" containerID="5343fe40994711bc05a77e42380760611a061ff41f17e111bdb4339ac77996e9" exitCode=0 Jul 05 20:06:49.812446 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:06:49.812285 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-237c8b-openshift-default-56b9c7f45c-p9nvr" Jul 05 20:06:49.812446 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:06:49.812287 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-237c8b-openshift-default-56b9c7f45c-p9nvr" event={"ID":"bde69bcc-a602-4558-b3be-d7ee365adfe7","Type":"ContainerDied","Data":"5343fe40994711bc05a77e42380760611a061ff41f17e111bdb4339ac77996e9"} Jul 05 20:06:49.812446 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:06:49.812381 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-237c8b-openshift-default-56b9c7f45c-p9nvr" event={"ID":"bde69bcc-a602-4558-b3be-d7ee365adfe7","Type":"ContainerDied","Data":"a6b31a0903a4d3aec703f9429889e1e3e5d233a4ac7ce6a0ec49dcdbb7f3b2b7"} Jul 05 20:06:49.812446 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:06:49.812406 2572 scope.go:117] "RemoveContainer" containerID="5343fe40994711bc05a77e42380760611a061ff41f17e111bdb4339ac77996e9" Jul 05 20:06:49.829894 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:06:49.829872 2572 scope.go:117] "RemoveContainer" containerID="094c447cd259e1ec86b0e07f843af5228efad52cd9eb2b6f9fef4735f120ca75" Jul 05 20:06:49.838928 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:06:49.838901 2572 scope.go:117] "RemoveContainer" containerID="5343fe40994711bc05a77e42380760611a061ff41f17e111bdb4339ac77996e9" Jul 05 20:06:49.839236 ip-10-0-133-7 kubenswrapper[2572]: E0705 20:06:49.839215 2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5343fe40994711bc05a77e42380760611a061ff41f17e111bdb4339ac77996e9\": container with ID starting with 5343fe40994711bc05a77e42380760611a061ff41f17e111bdb4339ac77996e9 not found: ID does not exist" containerID="5343fe40994711bc05a77e42380760611a061ff41f17e111bdb4339ac77996e9" Jul 05 20:06:49.839333 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:06:49.839249 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5343fe40994711bc05a77e42380760611a061ff41f17e111bdb4339ac77996e9"} err="failed to get container status \"5343fe40994711bc05a77e42380760611a061ff41f17e111bdb4339ac77996e9\": rpc error: code = NotFound desc = could not find container \"5343fe40994711bc05a77e42380760611a061ff41f17e111bdb4339ac77996e9\": container with ID starting with 5343fe40994711bc05a77e42380760611a061ff41f17e111bdb4339ac77996e9 not found: ID does not exist" Jul 05 20:06:49.839333 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:06:49.839272 2572 scope.go:117] "RemoveContainer" containerID="094c447cd259e1ec86b0e07f843af5228efad52cd9eb2b6f9fef4735f120ca75" Jul 05 20:06:49.839595 ip-10-0-133-7 kubenswrapper[2572]: E0705 20:06:49.839574 2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"094c447cd259e1ec86b0e07f843af5228efad52cd9eb2b6f9fef4735f120ca75\": container with ID starting with 094c447cd259e1ec86b0e07f843af5228efad52cd9eb2b6f9fef4735f120ca75 not found: ID does not exist" containerID="094c447cd259e1ec86b0e07f843af5228efad52cd9eb2b6f9fef4735f120ca75" Jul 05 20:06:49.839672 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:06:49.839612 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"094c447cd259e1ec86b0e07f843af5228efad52cd9eb2b6f9fef4735f120ca75"} err="failed to get container status \"094c447cd259e1ec86b0e07f843af5228efad52cd9eb2b6f9fef4735f120ca75\": rpc error: code = NotFound desc = could not find container \"094c447cd259e1ec86b0e07f843af5228efad52cd9eb2b6f9fef4735f120ca75\": container with ID starting with 094c447cd259e1ec86b0e07f843af5228efad52cd9eb2b6f9fef4735f120ca75 not found: ID does not exist" Jul 05 20:06:49.840581 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:06:49.840561 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-237c8b-openshift-default-56b9c7f45c-p9nvr"] Jul 05 20:06:49.845591 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:06:49.845564 2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-a-237c8b-openshift-default-56b9c7f45c-p9nvr"] Jul 05 20:06:50.962842 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:06:50.962810 2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bde69bcc-a602-4558-b3be-d7ee365adfe7" path="/var/lib/kubelet/pods/bde69bcc-a602-4558-b3be-d7ee365adfe7/volumes" Jul 05 20:06:51.479072 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:06:51.479038 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-a-d9296f-openshift-default-749b575699-d96pz"] Jul 05 20:06:51.479431 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:06:51.479416 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bde69bcc-a602-4558-b3be-d7ee365adfe7" containerName="istio-proxy" Jul 05 20:06:51.479489 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:06:51.479435 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="bde69bcc-a602-4558-b3be-d7ee365adfe7" containerName="istio-proxy" Jul 05 20:06:51.479489 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:06:51.479452 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bde69bcc-a602-4558-b3be-d7ee365adfe7" containerName="istio-proxy" Jul 05 20:06:51.479489 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:06:51.479457 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="bde69bcc-a602-4558-b3be-d7ee365adfe7" containerName="istio-proxy" Jul 05 20:06:51.479596 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:06:51.479528 2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="bde69bcc-a602-4558-b3be-d7ee365adfe7" containerName="istio-proxy" Jul 05 20:06:51.479596 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:06:51.479539 2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="bde69bcc-a602-4558-b3be-d7ee365adfe7" containerName="istio-proxy" Jul 05 20:06:51.484739 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:06:51.484713 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-d9296f-openshift-default-749b575699-d96pz" Jul 05 20:06:51.487206 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:06:51.487179 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-a-d9296f-openshift-default-dockercfg-5tdrj\"" Jul 05 20:06:51.495037 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:06:51.495015 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-d9296f-openshift-default-749b575699-d96pz"] Jul 05 20:06:51.617593 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:06:51.617551 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b5110f18-3583-404a-876c-c7042a540e81-istio-envoy\") pod \"e2e-shared-a-d9296f-openshift-default-749b575699-d96pz\" (UID: \"b5110f18-3583-404a-876c-c7042a540e81\") " pod="openshift-ingress/e2e-shared-a-d9296f-openshift-default-749b575699-d96pz" Jul 05 20:06:51.617593 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:06:51.617591 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b5110f18-3583-404a-876c-c7042a540e81-istio-token\") pod \"e2e-shared-a-d9296f-openshift-default-749b575699-d96pz\" (UID: \"b5110f18-3583-404a-876c-c7042a540e81\") " pod="openshift-ingress/e2e-shared-a-d9296f-openshift-default-749b575699-d96pz" Jul 05 20:06:51.617808 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:06:51.617626 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b5110f18-3583-404a-876c-c7042a540e81-workload-certs\") pod \"e2e-shared-a-d9296f-openshift-default-749b575699-d96pz\" (UID: \"b5110f18-3583-404a-876c-c7042a540e81\") " pod="openshift-ingress/e2e-shared-a-d9296f-openshift-default-749b575699-d96pz" Jul 05 20:06:51.617808 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:06:51.617666 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b5110f18-3583-404a-876c-c7042a540e81-workload-socket\") pod \"e2e-shared-a-d9296f-openshift-default-749b575699-d96pz\" (UID: \"b5110f18-3583-404a-876c-c7042a540e81\") " pod="openshift-ingress/e2e-shared-a-d9296f-openshift-default-749b575699-d96pz" Jul 05 20:06:51.617808 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:06:51.617704 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c7rdp\" (UniqueName: \"kubernetes.io/projected/b5110f18-3583-404a-876c-c7042a540e81-kube-api-access-c7rdp\") pod \"e2e-shared-a-d9296f-openshift-default-749b575699-d96pz\" (UID: \"b5110f18-3583-404a-876c-c7042a540e81\") " pod="openshift-ingress/e2e-shared-a-d9296f-openshift-default-749b575699-d96pz" Jul 05 20:06:51.617808 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:06:51.617742 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b5110f18-3583-404a-876c-c7042a540e81-credential-socket\") pod \"e2e-shared-a-d9296f-openshift-default-749b575699-d96pz\" (UID: \"b5110f18-3583-404a-876c-c7042a540e81\") " pod="openshift-ingress/e2e-shared-a-d9296f-openshift-default-749b575699-d96pz" Jul 05 20:06:51.617808 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:06:51.617786 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b5110f18-3583-404a-876c-c7042a540e81-istio-podinfo\") pod \"e2e-shared-a-d9296f-openshift-default-749b575699-d96pz\" (UID: \"b5110f18-3583-404a-876c-c7042a540e81\") " pod="openshift-ingress/e2e-shared-a-d9296f-openshift-default-749b575699-d96pz" Jul 05 20:06:51.618002 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:06:51.617814 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b5110f18-3583-404a-876c-c7042a540e81-istio-data\") pod \"e2e-shared-a-d9296f-openshift-default-749b575699-d96pz\" (UID: \"b5110f18-3583-404a-876c-c7042a540e81\") " pod="openshift-ingress/e2e-shared-a-d9296f-openshift-default-749b575699-d96pz" Jul 05 20:06:51.618002 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:06:51.617829 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b5110f18-3583-404a-876c-c7042a540e81-istiod-ca-cert\") pod \"e2e-shared-a-d9296f-openshift-default-749b575699-d96pz\" (UID: \"b5110f18-3583-404a-876c-c7042a540e81\") " pod="openshift-ingress/e2e-shared-a-d9296f-openshift-default-749b575699-d96pz" Jul 05 20:06:51.719236 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:06:51.719200 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b5110f18-3583-404a-876c-c7042a540e81-workload-socket\") pod \"e2e-shared-a-d9296f-openshift-default-749b575699-d96pz\" (UID: \"b5110f18-3583-404a-876c-c7042a540e81\") " pod="openshift-ingress/e2e-shared-a-d9296f-openshift-default-749b575699-d96pz" Jul 05 20:06:51.719236 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:06:51.719243 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c7rdp\" (UniqueName: \"kubernetes.io/projected/b5110f18-3583-404a-876c-c7042a540e81-kube-api-access-c7rdp\") pod \"e2e-shared-a-d9296f-openshift-default-749b575699-d96pz\" (UID: \"b5110f18-3583-404a-876c-c7042a540e81\") " pod="openshift-ingress/e2e-shared-a-d9296f-openshift-default-749b575699-d96pz" Jul 05 20:06:51.719473 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:06:51.719261 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b5110f18-3583-404a-876c-c7042a540e81-credential-socket\") pod \"e2e-shared-a-d9296f-openshift-default-749b575699-d96pz\" (UID: \"b5110f18-3583-404a-876c-c7042a540e81\") " pod="openshift-ingress/e2e-shared-a-d9296f-openshift-default-749b575699-d96pz" Jul 05 20:06:51.719473 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:06:51.719284 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b5110f18-3583-404a-876c-c7042a540e81-istio-podinfo\") pod \"e2e-shared-a-d9296f-openshift-default-749b575699-d96pz\" (UID: \"b5110f18-3583-404a-876c-c7042a540e81\") " pod="openshift-ingress/e2e-shared-a-d9296f-openshift-default-749b575699-d96pz" Jul 05 20:06:51.719473 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:06:51.719311 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b5110f18-3583-404a-876c-c7042a540e81-istio-data\") pod \"e2e-shared-a-d9296f-openshift-default-749b575699-d96pz\" (UID: \"b5110f18-3583-404a-876c-c7042a540e81\") " pod="openshift-ingress/e2e-shared-a-d9296f-openshift-default-749b575699-d96pz" Jul 05 20:06:51.719473 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:06:51.719327 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b5110f18-3583-404a-876c-c7042a540e81-istiod-ca-cert\") pod \"e2e-shared-a-d9296f-openshift-default-749b575699-d96pz\" (UID: \"b5110f18-3583-404a-876c-c7042a540e81\") " pod="openshift-ingress/e2e-shared-a-d9296f-openshift-default-749b575699-d96pz" Jul 05 20:06:51.719473 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:06:51.719363 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b5110f18-3583-404a-876c-c7042a540e81-istio-envoy\") pod \"e2e-shared-a-d9296f-openshift-default-749b575699-d96pz\" (UID: \"b5110f18-3583-404a-876c-c7042a540e81\") " pod="openshift-ingress/e2e-shared-a-d9296f-openshift-default-749b575699-d96pz" Jul 05 20:06:51.719473 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:06:51.719385 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b5110f18-3583-404a-876c-c7042a540e81-istio-token\") pod \"e2e-shared-a-d9296f-openshift-default-749b575699-d96pz\" (UID: \"b5110f18-3583-404a-876c-c7042a540e81\") " pod="openshift-ingress/e2e-shared-a-d9296f-openshift-default-749b575699-d96pz" Jul 05 20:06:51.719473 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:06:51.719425 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b5110f18-3583-404a-876c-c7042a540e81-workload-certs\") pod \"e2e-shared-a-d9296f-openshift-default-749b575699-d96pz\" (UID: \"b5110f18-3583-404a-876c-c7042a540e81\") " pod="openshift-ingress/e2e-shared-a-d9296f-openshift-default-749b575699-d96pz" Jul 05 20:06:51.719851 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:06:51.719652 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b5110f18-3583-404a-876c-c7042a540e81-workload-socket\") pod \"e2e-shared-a-d9296f-openshift-default-749b575699-d96pz\" (UID: \"b5110f18-3583-404a-876c-c7042a540e81\") " pod="openshift-ingress/e2e-shared-a-d9296f-openshift-default-749b575699-d96pz" Jul 05 20:06:51.719851 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:06:51.719697 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b5110f18-3583-404a-876c-c7042a540e81-credential-socket\") pod \"e2e-shared-a-d9296f-openshift-default-749b575699-d96pz\" (UID: \"b5110f18-3583-404a-876c-c7042a540e81\") " pod="openshift-ingress/e2e-shared-a-d9296f-openshift-default-749b575699-d96pz" Jul 05 20:06:51.719851 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:06:51.719746 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b5110f18-3583-404a-876c-c7042a540e81-workload-certs\") pod \"e2e-shared-a-d9296f-openshift-default-749b575699-d96pz\" (UID: \"b5110f18-3583-404a-876c-c7042a540e81\") " pod="openshift-ingress/e2e-shared-a-d9296f-openshift-default-749b575699-d96pz" Jul 05 20:06:51.720071 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:06:51.720049 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b5110f18-3583-404a-876c-c7042a540e81-istio-data\") pod \"e2e-shared-a-d9296f-openshift-default-749b575699-d96pz\" (UID: \"b5110f18-3583-404a-876c-c7042a540e81\") " pod="openshift-ingress/e2e-shared-a-d9296f-openshift-default-749b575699-d96pz" Jul 05 20:06:51.720160 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:06:51.720143 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b5110f18-3583-404a-876c-c7042a540e81-istiod-ca-cert\") pod \"e2e-shared-a-d9296f-openshift-default-749b575699-d96pz\" (UID: \"b5110f18-3583-404a-876c-c7042a540e81\") " pod="openshift-ingress/e2e-shared-a-d9296f-openshift-default-749b575699-d96pz" Jul 05 20:06:51.721721 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:06:51.721698 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b5110f18-3583-404a-876c-c7042a540e81-istio-envoy\") pod \"e2e-shared-a-d9296f-openshift-default-749b575699-d96pz\" (UID: \"b5110f18-3583-404a-876c-c7042a540e81\") " pod="openshift-ingress/e2e-shared-a-d9296f-openshift-default-749b575699-d96pz" Jul 05 20:06:51.721882 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:06:51.721866 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b5110f18-3583-404a-876c-c7042a540e81-istio-podinfo\") pod \"e2e-shared-a-d9296f-openshift-default-749b575699-d96pz\" (UID: \"b5110f18-3583-404a-876c-c7042a540e81\") " pod="openshift-ingress/e2e-shared-a-d9296f-openshift-default-749b575699-d96pz" Jul 05 20:06:51.726643 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:06:51.726611 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b5110f18-3583-404a-876c-c7042a540e81-istio-token\") pod \"e2e-shared-a-d9296f-openshift-default-749b575699-d96pz\" (UID: \"b5110f18-3583-404a-876c-c7042a540e81\") " pod="openshift-ingress/e2e-shared-a-d9296f-openshift-default-749b575699-d96pz" Jul 05 20:06:51.726757 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:06:51.726739 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c7rdp\" (UniqueName: \"kubernetes.io/projected/b5110f18-3583-404a-876c-c7042a540e81-kube-api-access-c7rdp\") pod \"e2e-shared-a-d9296f-openshift-default-749b575699-d96pz\" (UID: \"b5110f18-3583-404a-876c-c7042a540e81\") " pod="openshift-ingress/e2e-shared-a-d9296f-openshift-default-749b575699-d96pz" Jul 05 20:06:51.796723 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:06:51.796644 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-d9296f-openshift-default-749b575699-d96pz" Jul 05 20:06:51.943259 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:06:51.943235 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-d9296f-openshift-default-749b575699-d96pz"] Jul 05 20:06:51.946097 ip-10-0-133-7 kubenswrapper[2572]: W0705 20:06:51.946066 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb5110f18_3583_404a_876c_c7042a540e81.slice/crio-cd026cf3e6f2931e13ea0418dda942ccc5d0a36dfb92505d8b4cb945db18c223 WatchSource:0}: Error finding container cd026cf3e6f2931e13ea0418dda942ccc5d0a36dfb92505d8b4cb945db18c223: Status 404 returned error can't find the container with id cd026cf3e6f2931e13ea0418dda942ccc5d0a36dfb92505d8b4cb945db18c223 Jul 05 20:06:51.948376 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:06:51.948328 2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 05 20:06:51.948481 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:06:51.948408 2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 05 20:06:51.948481 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:06:51.948442 2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 05 20:06:52.829836 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:06:52.829800 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-d9296f-openshift-default-749b575699-d96pz" event={"ID":"b5110f18-3583-404a-876c-c7042a540e81","Type":"ContainerStarted","Data":"3b25e5b16ccac8cca9323d41304fe2041d88146c104ba5385c7ea0904334706a"} Jul 05 20:06:52.830286 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:06:52.829851 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-d9296f-openshift-default-749b575699-d96pz" event={"ID":"b5110f18-3583-404a-876c-c7042a540e81","Type":"ContainerStarted","Data":"cd026cf3e6f2931e13ea0418dda942ccc5d0a36dfb92505d8b4cb945db18c223"} Jul 05 20:06:52.848969 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:06:52.848900 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-a-d9296f-openshift-default-749b575699-d96pz" podStartSLOduration=1.8488805240000001 podStartE2EDuration="1.848880524s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-05 20:06:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 20:06:52.847911098 +0000 UTC m=+2066.247258565" watchObservedRunningTime="2026-07-05 20:06:52.848880524 +0000 UTC m=+2066.248227969" Jul 05 20:06:53.797394 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:06:53.797359 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-d9296f-openshift-default-749b575699-d96pz" Jul 05 20:06:53.802197 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:06:53.802173 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-d9296f-openshift-default-749b575699-d96pz" Jul 05 20:06:53.836001 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:06:53.835970 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-d9296f-openshift-default-749b575699-d96pz" Jul 05 20:06:53.836926 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:06:53.836909 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-d9296f-openshift-default-749b575699-d96pz" Jul 05 20:07:00.034827 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:07:00.034787 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-b-65fb4d-openshift-default-664c757fc5-x2cwh"] Jul 05 20:07:00.039155 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:07:00.039124 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-65fb4d-openshift-default-664c757fc5-x2cwh" Jul 05 20:07:00.041699 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:07:00.041671 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-b-65fb4d-openshift-default-dockercfg-m5w54\"" Jul 05 20:07:00.049531 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:07:00.049502 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-65fb4d-openshift-default-664c757fc5-x2cwh"] Jul 05 20:07:00.195284 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:07:00.195247 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/977737f0-61d5-4b17-915f-c45313cbaeac-istio-envoy\") pod \"e2e-shared-b-65fb4d-openshift-default-664c757fc5-x2cwh\" (UID: \"977737f0-61d5-4b17-915f-c45313cbaeac\") " pod="openshift-ingress/e2e-shared-b-65fb4d-openshift-default-664c757fc5-x2cwh" Jul 05 20:07:00.195284 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:07:00.195284 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/977737f0-61d5-4b17-915f-c45313cbaeac-istio-token\") pod \"e2e-shared-b-65fb4d-openshift-default-664c757fc5-x2cwh\" (UID: \"977737f0-61d5-4b17-915f-c45313cbaeac\") " pod="openshift-ingress/e2e-shared-b-65fb4d-openshift-default-664c757fc5-x2cwh" Jul 05 20:07:00.195522 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:07:00.195308 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/977737f0-61d5-4b17-915f-c45313cbaeac-credential-socket\") pod \"e2e-shared-b-65fb4d-openshift-default-664c757fc5-x2cwh\" (UID: \"977737f0-61d5-4b17-915f-c45313cbaeac\") " pod="openshift-ingress/e2e-shared-b-65fb4d-openshift-default-664c757fc5-x2cwh" Jul 05 20:07:00.195522 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:07:00.195366 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/977737f0-61d5-4b17-915f-c45313cbaeac-istiod-ca-cert\") pod \"e2e-shared-b-65fb4d-openshift-default-664c757fc5-x2cwh\" (UID: \"977737f0-61d5-4b17-915f-c45313cbaeac\") " pod="openshift-ingress/e2e-shared-b-65fb4d-openshift-default-664c757fc5-x2cwh" Jul 05 20:07:00.195522 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:07:00.195397 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/977737f0-61d5-4b17-915f-c45313cbaeac-workload-certs\") pod \"e2e-shared-b-65fb4d-openshift-default-664c757fc5-x2cwh\" (UID: \"977737f0-61d5-4b17-915f-c45313cbaeac\") " pod="openshift-ingress/e2e-shared-b-65fb4d-openshift-default-664c757fc5-x2cwh" Jul 05 20:07:00.195522 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:07:00.195440 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/977737f0-61d5-4b17-915f-c45313cbaeac-workload-socket\") pod \"e2e-shared-b-65fb4d-openshift-default-664c757fc5-x2cwh\" (UID: \"977737f0-61d5-4b17-915f-c45313cbaeac\") " pod="openshift-ingress/e2e-shared-b-65fb4d-openshift-default-664c757fc5-x2cwh" Jul 05 20:07:00.195522 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:07:00.195460 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/977737f0-61d5-4b17-915f-c45313cbaeac-istio-podinfo\") pod \"e2e-shared-b-65fb4d-openshift-default-664c757fc5-x2cwh\" (UID: \"977737f0-61d5-4b17-915f-c45313cbaeac\") " pod="openshift-ingress/e2e-shared-b-65fb4d-openshift-default-664c757fc5-x2cwh" Jul 05 20:07:00.195754 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:07:00.195514 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/977737f0-61d5-4b17-915f-c45313cbaeac-istio-data\") pod \"e2e-shared-b-65fb4d-openshift-default-664c757fc5-x2cwh\" (UID: \"977737f0-61d5-4b17-915f-c45313cbaeac\") " pod="openshift-ingress/e2e-shared-b-65fb4d-openshift-default-664c757fc5-x2cwh" Jul 05 20:07:00.195754 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:07:00.195602 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z898j\" (UniqueName: \"kubernetes.io/projected/977737f0-61d5-4b17-915f-c45313cbaeac-kube-api-access-z898j\") pod \"e2e-shared-b-65fb4d-openshift-default-664c757fc5-x2cwh\" (UID: \"977737f0-61d5-4b17-915f-c45313cbaeac\") " pod="openshift-ingress/e2e-shared-b-65fb4d-openshift-default-664c757fc5-x2cwh" Jul 05 20:07:00.296321 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:07:00.296215 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/977737f0-61d5-4b17-915f-c45313cbaeac-workload-certs\") pod \"e2e-shared-b-65fb4d-openshift-default-664c757fc5-x2cwh\" (UID: \"977737f0-61d5-4b17-915f-c45313cbaeac\") " pod="openshift-ingress/e2e-shared-b-65fb4d-openshift-default-664c757fc5-x2cwh" Jul 05 20:07:00.296321 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:07:00.296284 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/977737f0-61d5-4b17-915f-c45313cbaeac-workload-socket\") pod \"e2e-shared-b-65fb4d-openshift-default-664c757fc5-x2cwh\" (UID: \"977737f0-61d5-4b17-915f-c45313cbaeac\") " pod="openshift-ingress/e2e-shared-b-65fb4d-openshift-default-664c757fc5-x2cwh" Jul 05 20:07:00.296321 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:07:00.296304 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/977737f0-61d5-4b17-915f-c45313cbaeac-istio-podinfo\") pod \"e2e-shared-b-65fb4d-openshift-default-664c757fc5-x2cwh\" (UID: \"977737f0-61d5-4b17-915f-c45313cbaeac\") " pod="openshift-ingress/e2e-shared-b-65fb4d-openshift-default-664c757fc5-x2cwh" Jul 05 20:07:00.296321 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:07:00.296321 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/977737f0-61d5-4b17-915f-c45313cbaeac-istio-data\") pod \"e2e-shared-b-65fb4d-openshift-default-664c757fc5-x2cwh\" (UID: \"977737f0-61d5-4b17-915f-c45313cbaeac\") " pod="openshift-ingress/e2e-shared-b-65fb4d-openshift-default-664c757fc5-x2cwh" Jul 05 20:07:00.296680 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:07:00.296347 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z898j\" (UniqueName: \"kubernetes.io/projected/977737f0-61d5-4b17-915f-c45313cbaeac-kube-api-access-z898j\") pod \"e2e-shared-b-65fb4d-openshift-default-664c757fc5-x2cwh\" (UID: \"977737f0-61d5-4b17-915f-c45313cbaeac\") " pod="openshift-ingress/e2e-shared-b-65fb4d-openshift-default-664c757fc5-x2cwh" Jul 05 20:07:00.296680 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:07:00.296378 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/977737f0-61d5-4b17-915f-c45313cbaeac-istio-envoy\") pod \"e2e-shared-b-65fb4d-openshift-default-664c757fc5-x2cwh\" (UID: \"977737f0-61d5-4b17-915f-c45313cbaeac\") " pod="openshift-ingress/e2e-shared-b-65fb4d-openshift-default-664c757fc5-x2cwh" Jul 05 20:07:00.296680 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:07:00.296404 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/977737f0-61d5-4b17-915f-c45313cbaeac-istio-token\") pod \"e2e-shared-b-65fb4d-openshift-default-664c757fc5-x2cwh\" (UID: \"977737f0-61d5-4b17-915f-c45313cbaeac\") " pod="openshift-ingress/e2e-shared-b-65fb4d-openshift-default-664c757fc5-x2cwh" Jul 05 20:07:00.296680 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:07:00.296437 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/977737f0-61d5-4b17-915f-c45313cbaeac-credential-socket\") pod \"e2e-shared-b-65fb4d-openshift-default-664c757fc5-x2cwh\" (UID: \"977737f0-61d5-4b17-915f-c45313cbaeac\") " pod="openshift-ingress/e2e-shared-b-65fb4d-openshift-default-664c757fc5-x2cwh" Jul 05 20:07:00.296680 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:07:00.296478 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/977737f0-61d5-4b17-915f-c45313cbaeac-istiod-ca-cert\") pod \"e2e-shared-b-65fb4d-openshift-default-664c757fc5-x2cwh\" (UID: \"977737f0-61d5-4b17-915f-c45313cbaeac\") " pod="openshift-ingress/e2e-shared-b-65fb4d-openshift-default-664c757fc5-x2cwh" Jul 05 20:07:00.296905 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:07:00.296704 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/977737f0-61d5-4b17-915f-c45313cbaeac-workload-socket\") pod \"e2e-shared-b-65fb4d-openshift-default-664c757fc5-x2cwh\" (UID: \"977737f0-61d5-4b17-915f-c45313cbaeac\") " pod="openshift-ingress/e2e-shared-b-65fb4d-openshift-default-664c757fc5-x2cwh" Jul 05 20:07:00.296905 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:07:00.296812 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/977737f0-61d5-4b17-915f-c45313cbaeac-workload-certs\") pod \"e2e-shared-b-65fb4d-openshift-default-664c757fc5-x2cwh\" (UID: \"977737f0-61d5-4b17-915f-c45313cbaeac\") " pod="openshift-ingress/e2e-shared-b-65fb4d-openshift-default-664c757fc5-x2cwh" Jul 05 20:07:00.297055 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:07:00.297009 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/977737f0-61d5-4b17-915f-c45313cbaeac-istio-data\") pod \"e2e-shared-b-65fb4d-openshift-default-664c757fc5-x2cwh\" (UID: \"977737f0-61d5-4b17-915f-c45313cbaeac\") " pod="openshift-ingress/e2e-shared-b-65fb4d-openshift-default-664c757fc5-x2cwh" Jul 05 20:07:00.297104 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:07:00.297049 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/977737f0-61d5-4b17-915f-c45313cbaeac-credential-socket\") pod \"e2e-shared-b-65fb4d-openshift-default-664c757fc5-x2cwh\" (UID: \"977737f0-61d5-4b17-915f-c45313cbaeac\") " pod="openshift-ingress/e2e-shared-b-65fb4d-openshift-default-664c757fc5-x2cwh" Jul 05 20:07:00.297229 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:07:00.297206 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/977737f0-61d5-4b17-915f-c45313cbaeac-istiod-ca-cert\") pod \"e2e-shared-b-65fb4d-openshift-default-664c757fc5-x2cwh\" (UID: \"977737f0-61d5-4b17-915f-c45313cbaeac\") " pod="openshift-ingress/e2e-shared-b-65fb4d-openshift-default-664c757fc5-x2cwh" Jul 05 20:07:00.298725 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:07:00.298701 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/977737f0-61d5-4b17-915f-c45313cbaeac-istio-envoy\") pod \"e2e-shared-b-65fb4d-openshift-default-664c757fc5-x2cwh\" (UID: \"977737f0-61d5-4b17-915f-c45313cbaeac\") " pod="openshift-ingress/e2e-shared-b-65fb4d-openshift-default-664c757fc5-x2cwh" Jul 05 20:07:00.298897 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:07:00.298878 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/977737f0-61d5-4b17-915f-c45313cbaeac-istio-podinfo\") pod \"e2e-shared-b-65fb4d-openshift-default-664c757fc5-x2cwh\" (UID: \"977737f0-61d5-4b17-915f-c45313cbaeac\") " pod="openshift-ingress/e2e-shared-b-65fb4d-openshift-default-664c757fc5-x2cwh" Jul 05 20:07:00.307688 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:07:00.307661 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/977737f0-61d5-4b17-915f-c45313cbaeac-istio-token\") pod \"e2e-shared-b-65fb4d-openshift-default-664c757fc5-x2cwh\" (UID: \"977737f0-61d5-4b17-915f-c45313cbaeac\") " pod="openshift-ingress/e2e-shared-b-65fb4d-openshift-default-664c757fc5-x2cwh" Jul 05 20:07:00.308054 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:07:00.308030 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z898j\" (UniqueName: \"kubernetes.io/projected/977737f0-61d5-4b17-915f-c45313cbaeac-kube-api-access-z898j\") pod \"e2e-shared-b-65fb4d-openshift-default-664c757fc5-x2cwh\" (UID: \"977737f0-61d5-4b17-915f-c45313cbaeac\") " pod="openshift-ingress/e2e-shared-b-65fb4d-openshift-default-664c757fc5-x2cwh" Jul 05 20:07:00.351235 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:07:00.351192 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-65fb4d-openshift-default-664c757fc5-x2cwh" Jul 05 20:07:00.484265 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:07:00.484222 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jt8wt"] Jul 05 20:07:00.496434 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:07:00.496411 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-65fb4d-openshift-default-664c757fc5-x2cwh"] Jul 05 20:07:00.498778 ip-10-0-133-7 kubenswrapper[2572]: W0705 20:07:00.498720 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod977737f0_61d5_4b17_915f_c45313cbaeac.slice/crio-9ea776a246ece7fc1fea165be6bfb23e32e98ad143096fadc8b1c1aebafb5407 WatchSource:0}: Error finding container 9ea776a246ece7fc1fea165be6bfb23e32e98ad143096fadc8b1c1aebafb5407: Status 404 returned error can't find the container with id 9ea776a246ece7fc1fea165be6bfb23e32e98ad143096fadc8b1c1aebafb5407 Jul 05 20:07:00.501310 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:07:00.501278 2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 05 20:07:00.501399 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:07:00.501343 2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 05 20:07:00.501399 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:07:00.501369 2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 05 20:07:00.879245 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:07:00.879128 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-65fb4d-openshift-default-664c757fc5-x2cwh" event={"ID":"977737f0-61d5-4b17-915f-c45313cbaeac","Type":"ContainerStarted","Data":"9b38bca1fcc2fd4008c2e0116f3c64b942e4a67ad26bf177741fbc39616e3413"} Jul 05 20:07:00.879245 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:07:00.879228 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-65fb4d-openshift-default-664c757fc5-x2cwh" event={"ID":"977737f0-61d5-4b17-915f-c45313cbaeac","Type":"ContainerStarted","Data":"9ea776a246ece7fc1fea165be6bfb23e32e98ad143096fadc8b1c1aebafb5407"} Jul 05 20:07:00.900431 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:07:00.900380 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-b-65fb4d-openshift-default-664c757fc5-x2cwh" podStartSLOduration=0.900364095 podStartE2EDuration="900.364095ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-05 20:07:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 20:07:00.898701067 +0000 UTC m=+2074.298048534" watchObservedRunningTime="2026-07-05 20:07:00.900364095 +0000 UTC m=+2074.299711561" Jul 05 20:07:01.352194 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:07:01.352152 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-65fb4d-openshift-default-664c757fc5-x2cwh" Jul 05 20:07:01.359342 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:07:01.359312 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-65fb4d-openshift-default-664c757fc5-x2cwh" Jul 05 20:07:01.884378 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:07:01.884341 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-65fb4d-openshift-default-664c757fc5-x2cwh" Jul 05 20:07:01.885271 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:07:01.885253 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-65fb4d-openshift-default-664c757fc5-x2cwh" Jul 05 20:07:08.837634 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:07:08.837597 2572 patch_prober.go:28] interesting pod/e2e-shared-a-d9296f-openshift-default-749b575699-d96pz container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.46:15021/healthz/ready\": dial tcp 10.132.0.46:15021: connect: connection refused" start-of-body= Jul 05 20:07:08.838597 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:07:08.838284 2572 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-a-d9296f-openshift-default-749b575699-d96pz" podUID="b5110f18-3583-404a-876c-c7042a540e81" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.46:15021/healthz/ready\": dial tcp 10.132.0.46:15021: connect: connection refused" Jul 05 20:07:08.925894 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:07:08.925858 2572 generic.go:356] "Generic (PLEG): container finished" podID="b5110f18-3583-404a-876c-c7042a540e81" containerID="3b25e5b16ccac8cca9323d41304fe2041d88146c104ba5385c7ea0904334706a" exitCode=0 Jul 05 20:07:08.926053 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:07:08.925935 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-d9296f-openshift-default-749b575699-d96pz" event={"ID":"b5110f18-3583-404a-876c-c7042a540e81","Type":"ContainerDied","Data":"3b25e5b16ccac8cca9323d41304fe2041d88146c104ba5385c7ea0904334706a"} Jul 05 20:07:08.926442 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:07:08.926424 2572 scope.go:117] "RemoveContainer" containerID="3b25e5b16ccac8cca9323d41304fe2041d88146c104ba5385c7ea0904334706a" Jul 05 20:07:08.927443 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:07:08.927413 2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 05 20:07:08.927493 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:07:08.927483 2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 05 20:07:08.927537 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:07:08.927526 2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 05 20:07:09.935448 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:07:09.935403 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-d9296f-openshift-default-749b575699-d96pz" event={"ID":"b5110f18-3583-404a-876c-c7042a540e81","Type":"ContainerStarted","Data":"5c348948167f1da85367014c1bc77538938f1fabf42934902c17b5a97930ba4b"} Jul 05 20:07:10.797085 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:07:10.797041 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-d9296f-openshift-default-749b575699-d96pz" Jul 05 20:07:10.797281 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:07:10.797210 2572 patch_prober.go:28] interesting pod/e2e-shared-a-d9296f-openshift-default-749b575699-d96pz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.46:15021/healthz/ready\": dial tcp 10.132.0.46:15021: connect: connection refused" start-of-body= Jul 05 20:07:10.797281 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:07:10.797268 2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-d9296f-openshift-default-749b575699-d96pz" podUID="b5110f18-3583-404a-876c-c7042a540e81" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.46:15021/healthz/ready\": dial tcp 10.132.0.46:15021: connect: connection refused" Jul 05 20:07:11.797277 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:07:11.797237 2572 patch_prober.go:28] interesting pod/e2e-shared-a-d9296f-openshift-default-749b575699-d96pz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.46:15021/healthz/ready\": dial tcp 10.132.0.46:15021: connect: connection refused" start-of-body= Jul 05 20:07:11.797770 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:07:11.797304 2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-d9296f-openshift-default-749b575699-d96pz" podUID="b5110f18-3583-404a-876c-c7042a540e81" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.46:15021/healthz/ready\": dial tcp 10.132.0.46:15021: connect: connection refused" Jul 05 20:07:12.797106 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:07:12.797069 2572 patch_prober.go:28] interesting pod/e2e-shared-a-d9296f-openshift-default-749b575699-d96pz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.46:15021/healthz/ready\": dial tcp 10.132.0.46:15021: connect: connection refused" start-of-body= Jul 05 20:07:12.797268 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:07:12.797133 2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-d9296f-openshift-default-749b575699-d96pz" podUID="b5110f18-3583-404a-876c-c7042a540e81" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.46:15021/healthz/ready\": dial tcp 10.132.0.46:15021: connect: connection refused" Jul 05 20:07:13.797580 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:07:13.797491 2572 patch_prober.go:28] interesting pod/e2e-shared-a-d9296f-openshift-default-749b575699-d96pz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.46:15021/healthz/ready\": dial tcp 10.132.0.46:15021: connect: connection refused" start-of-body= Jul 05 20:07:13.798103 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:07:13.798064 2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-d9296f-openshift-default-749b575699-d96pz" podUID="b5110f18-3583-404a-876c-c7042a540e81" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.46:15021/healthz/ready\": dial tcp 10.132.0.46:15021: connect: connection refused" Jul 05 20:07:14.802173 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:07:14.802145 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-d9296f-openshift-default-749b575699-d96pz" Jul 05 20:07:14.802578 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:07:14.802440 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-d9296f-openshift-default-749b575699-d96pz" Jul 05 20:07:14.803246 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:07:14.803223 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-d9296f-openshift-default-749b575699-d96pz" Jul 05 20:07:15.977714 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:07:15.977682 2572 generic.go:356] "Generic (PLEG): container finished" podID="977737f0-61d5-4b17-915f-c45313cbaeac" containerID="9b38bca1fcc2fd4008c2e0116f3c64b942e4a67ad26bf177741fbc39616e3413" exitCode=0 Jul 05 20:07:15.978213 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:07:15.977755 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-65fb4d-openshift-default-664c757fc5-x2cwh" event={"ID":"977737f0-61d5-4b17-915f-c45313cbaeac","Type":"ContainerDied","Data":"9b38bca1fcc2fd4008c2e0116f3c64b942e4a67ad26bf177741fbc39616e3413"} Jul 05 20:07:15.978284 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:07:15.978218 2572 scope.go:117] "RemoveContainer" containerID="9b38bca1fcc2fd4008c2e0116f3c64b942e4a67ad26bf177741fbc39616e3413" Jul 05 20:07:15.979251 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:07:15.979222 2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 05 20:07:15.979351 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:07:15.979287 2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 05 20:07:15.979351 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:07:15.979321 2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 05 20:07:16.091593 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:07:16.091554 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jt8wt"] Jul 05 20:07:16.885110 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:07:16.885065 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-65fb4d-openshift-default-664c757fc5-x2cwh" Jul 05 20:07:16.985606 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:07:16.985570 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-65fb4d-openshift-default-664c757fc5-x2cwh" event={"ID":"977737f0-61d5-4b17-915f-c45313cbaeac","Type":"ContainerStarted","Data":"2291fe64812e4f97240a4b77ede34f4f673abb2037bbdecef6ff905442d847f7"} Jul 05 20:07:17.352406 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:07:17.352369 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-65fb4d-openshift-default-664c757fc5-x2cwh" Jul 05 20:07:17.353195 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:07:17.353173 2572 patch_prober.go:28] interesting pod/e2e-shared-b-65fb4d-openshift-default-664c757fc5-x2cwh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.47:15021/healthz/ready\": dial tcp 10.132.0.47:15021: connect: connection refused" start-of-body= Jul 05 20:07:17.353252 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:07:17.353233 2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-65fb4d-openshift-default-664c757fc5-x2cwh" podUID="977737f0-61d5-4b17-915f-c45313cbaeac" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.47:15021/healthz/ready\": dial tcp 10.132.0.47:15021: connect: connection refused" Jul 05 20:07:18.351770 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:07:18.351723 2572 patch_prober.go:28] interesting pod/e2e-shared-b-65fb4d-openshift-default-664c757fc5-x2cwh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.47:15021/healthz/ready\": dial tcp 10.132.0.47:15021: connect: connection refused" start-of-body= Jul 05 20:07:18.352334 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:07:18.351813 2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-65fb4d-openshift-default-664c757fc5-x2cwh" podUID="977737f0-61d5-4b17-915f-c45313cbaeac" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.47:15021/healthz/ready\": dial tcp 10.132.0.47:15021: connect: connection refused" Jul 05 20:07:19.352665 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:07:19.352623 2572 patch_prober.go:28] interesting pod/e2e-shared-b-65fb4d-openshift-default-664c757fc5-x2cwh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.47:15021/healthz/ready\": dial tcp 10.132.0.47:15021: connect: connection refused" start-of-body= Jul 05 20:07:19.353316 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:07:19.353283 2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-65fb4d-openshift-default-664c757fc5-x2cwh" podUID="977737f0-61d5-4b17-915f-c45313cbaeac" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.47:15021/healthz/ready\": dial tcp 10.132.0.47:15021: connect: connection refused" Jul 05 20:07:20.352224 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:07:20.352187 2572 patch_prober.go:28] interesting pod/e2e-shared-b-65fb4d-openshift-default-664c757fc5-x2cwh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.47:15021/healthz/ready\": dial tcp 10.132.0.47:15021: connect: connection refused" start-of-body= Jul 05 20:07:20.352537 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:07:20.352507 2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-65fb4d-openshift-default-664c757fc5-x2cwh" podUID="977737f0-61d5-4b17-915f-c45313cbaeac" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.47:15021/healthz/ready\": dial tcp 10.132.0.47:15021: connect: connection refused" Jul 05 20:07:21.352706 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:07:21.352667 2572 patch_prober.go:28] interesting pod/e2e-shared-b-65fb4d-openshift-default-664c757fc5-x2cwh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.47:15021/healthz/ready\": dial tcp 10.132.0.47:15021: connect: connection refused" start-of-body= Jul 05 20:07:21.353348 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:07:21.353313 2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-65fb4d-openshift-default-664c757fc5-x2cwh" podUID="977737f0-61d5-4b17-915f-c45313cbaeac" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.47:15021/healthz/ready\": dial tcp 10.132.0.47:15021: connect: connection refused" Jul 05 20:07:22.356090 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:07:22.356055 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-65fb4d-openshift-default-664c757fc5-x2cwh" Jul 05 20:07:22.356589 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:07:22.356467 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-65fb4d-openshift-default-664c757fc5-x2cwh" Jul 05 20:07:22.357067 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:07:22.357040 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-65fb4d-openshift-default-664c757fc5-x2cwh" Jul 05 20:07:26.784697 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:07:26.784661 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jt8wt"] Jul 05 20:07:27.086936 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:07:27.086846 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-plqpb_ac3142e8-817c-493b-b998-41ff8f4680f9/console-operator/1.log" Jul 05 20:07:27.089422 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:07:27.089399 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-plqpb_ac3142e8-817c-493b-b998-41ff8f4680f9/console-operator/1.log" Jul 05 20:07:55.179924 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:07:55.179891 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jt8wt"] Jul 05 20:08:08.392553 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:08:08.392510 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jt8wt"] Jul 05 20:08:26.083812 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:08:26.083723 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jt8wt"] Jul 05 20:08:39.589696 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:08:39.589652 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jt8wt"] Jul 05 20:08:52.489024 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:08:52.488985 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jt8wt"] Jul 05 20:09:07.581003 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:09:07.580967 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jt8wt"] Jul 05 20:09:25.182447 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:09:25.182408 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jt8wt"] Jul 05 20:09:42.882390 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:09:42.882360 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jt8wt"] Jul 05 20:09:56.282666 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:09:56.282627 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jt8wt"] Jul 05 20:10:33.289286 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:10:33.289248 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jt8wt"] Jul 05 20:10:47.085761 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:10:47.085725 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jt8wt"] Jul 05 20:11:06.379218 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:11:06.379183 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jt8wt"] Jul 05 20:11:24.985679 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:11:24.985600 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jt8wt"] Jul 05 20:11:52.786039 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:11:52.786000 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jt8wt"] Jul 05 20:12:06.991765 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:12:06.991723 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jt8wt"] Jul 05 20:12:25.791361 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:12:25.791327 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jt8wt"] Jul 05 20:12:27.115602 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:12:27.115576 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-plqpb_ac3142e8-817c-493b-b998-41ff8f4680f9/console-operator/1.log" Jul 05 20:12:27.119868 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:12:27.119840 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-plqpb_ac3142e8-817c-493b-b998-41ff8f4680f9/console-operator/1.log" Jul 05 20:12:35.777394 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:12:35.777358 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jt8wt"] Jul 05 20:13:14.792537 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:13:14.792490 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-d9296f-openshift-default-749b575699-d96pz"] Jul 05 20:13:14.793564 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:13:14.793502 2572 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-a-d9296f-openshift-default-749b575699-d96pz" podUID="b5110f18-3583-404a-876c-c7042a540e81" containerName="istio-proxy" containerID="cri-o://5c348948167f1da85367014c1bc77538938f1fabf42934902c17b5a97930ba4b" gracePeriod=30 Jul 05 20:13:14.804373 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:13:14.804339 2572 patch_prober.go:28] interesting pod/e2e-shared-a-d9296f-openshift-default-749b575699-d96pz container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Jul 05 20:13:14.804492 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:13:14.804414 2572 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-a-d9296f-openshift-default-749b575699-d96pz" podUID="b5110f18-3583-404a-876c-c7042a540e81" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 05 20:13:18.895837 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:13:18.895797 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jt8wt"] Jul 05 20:13:20.052055 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:13:20.052017 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-d9296f-openshift-default-749b575699-d96pz" Jul 05 20:13:20.123898 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:13:20.123814 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b5110f18-3583-404a-876c-c7042a540e81-istio-podinfo\") pod \"b5110f18-3583-404a-876c-c7042a540e81\" (UID: \"b5110f18-3583-404a-876c-c7042a540e81\") " Jul 05 20:13:20.123898 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:13:20.123854 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b5110f18-3583-404a-876c-c7042a540e81-istio-data\") pod \"b5110f18-3583-404a-876c-c7042a540e81\" (UID: \"b5110f18-3583-404a-876c-c7042a540e81\") " Jul 05 20:13:20.123898 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:13:20.123896 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b5110f18-3583-404a-876c-c7042a540e81-istio-envoy\") pod \"b5110f18-3583-404a-876c-c7042a540e81\" (UID: \"b5110f18-3583-404a-876c-c7042a540e81\") " Jul 05 20:13:20.124209 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:13:20.123920 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b5110f18-3583-404a-876c-c7042a540e81-istio-token\") pod \"b5110f18-3583-404a-876c-c7042a540e81\" (UID: \"b5110f18-3583-404a-876c-c7042a540e81\") " Jul 05 20:13:20.124209 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:13:20.123942 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b5110f18-3583-404a-876c-c7042a540e81-credential-socket\") pod \"b5110f18-3583-404a-876c-c7042a540e81\" (UID: \"b5110f18-3583-404a-876c-c7042a540e81\") " Jul 05 20:13:20.124209 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:13:20.124017 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b5110f18-3583-404a-876c-c7042a540e81-workload-socket\") pod \"b5110f18-3583-404a-876c-c7042a540e81\" (UID: \"b5110f18-3583-404a-876c-c7042a540e81\") " Jul 05 20:13:20.124209 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:13:20.124070 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-c7rdp\" (UniqueName: \"kubernetes.io/projected/b5110f18-3583-404a-876c-c7042a540e81-kube-api-access-c7rdp\") pod \"b5110f18-3583-404a-876c-c7042a540e81\" (UID: \"b5110f18-3583-404a-876c-c7042a540e81\") " Jul 05 20:13:20.124209 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:13:20.124117 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b5110f18-3583-404a-876c-c7042a540e81-workload-certs\") pod \"b5110f18-3583-404a-876c-c7042a540e81\" (UID: \"b5110f18-3583-404a-876c-c7042a540e81\") " Jul 05 20:13:20.124209 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:13:20.124142 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b5110f18-3583-404a-876c-c7042a540e81-istiod-ca-cert\") pod \"b5110f18-3583-404a-876c-c7042a540e81\" (UID: \"b5110f18-3583-404a-876c-c7042a540e81\") " Jul 05 20:13:20.124529 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:13:20.124413 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b5110f18-3583-404a-876c-c7042a540e81-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "b5110f18-3583-404a-876c-c7042a540e81" (UID: "b5110f18-3583-404a-876c-c7042a540e81"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 05 20:13:20.124600 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:13:20.124546 2572 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b5110f18-3583-404a-876c-c7042a540e81-credential-socket\") on node \"ip-10-0-133-7.ec2.internal\" DevicePath \"\"" Jul 05 20:13:20.124798 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:13:20.124773 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b5110f18-3583-404a-876c-c7042a540e81-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "b5110f18-3583-404a-876c-c7042a540e81" (UID: "b5110f18-3583-404a-876c-c7042a540e81"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 05 20:13:20.124901 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:13:20.124814 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b5110f18-3583-404a-876c-c7042a540e81-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "b5110f18-3583-404a-876c-c7042a540e81" (UID: "b5110f18-3583-404a-876c-c7042a540e81"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 05 20:13:20.124901 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:13:20.124855 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b5110f18-3583-404a-876c-c7042a540e81-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "b5110f18-3583-404a-876c-c7042a540e81" (UID: "b5110f18-3583-404a-876c-c7042a540e81"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 05 20:13:20.125057 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:13:20.125032 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b5110f18-3583-404a-876c-c7042a540e81-istio-data" (OuterVolumeSpecName: "istio-data") pod "b5110f18-3583-404a-876c-c7042a540e81" (UID: "b5110f18-3583-404a-876c-c7042a540e81"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 05 20:13:20.126201 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:13:20.126177 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/b5110f18-3583-404a-876c-c7042a540e81-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "b5110f18-3583-404a-876c-c7042a540e81" (UID: "b5110f18-3583-404a-876c-c7042a540e81"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 05 20:13:20.126306 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:13:20.126218 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b5110f18-3583-404a-876c-c7042a540e81-istio-token" (OuterVolumeSpecName: "istio-token") pod "b5110f18-3583-404a-876c-c7042a540e81" (UID: "b5110f18-3583-404a-876c-c7042a540e81"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 05 20:13:20.126306 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:13:20.126262 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b5110f18-3583-404a-876c-c7042a540e81-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "b5110f18-3583-404a-876c-c7042a540e81" (UID: "b5110f18-3583-404a-876c-c7042a540e81"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 05 20:13:20.126381 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:13:20.126318 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b5110f18-3583-404a-876c-c7042a540e81-kube-api-access-c7rdp" (OuterVolumeSpecName: "kube-api-access-c7rdp") pod "b5110f18-3583-404a-876c-c7042a540e81" (UID: "b5110f18-3583-404a-876c-c7042a540e81"). InnerVolumeSpecName "kube-api-access-c7rdp". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 05 20:13:20.224977 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:13:20.224918 2572 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b5110f18-3583-404a-876c-c7042a540e81-workload-certs\") on node \"ip-10-0-133-7.ec2.internal\" DevicePath \"\"" Jul 05 20:13:20.224977 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:13:20.224976 2572 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b5110f18-3583-404a-876c-c7042a540e81-istiod-ca-cert\") on node \"ip-10-0-133-7.ec2.internal\" DevicePath \"\"" Jul 05 20:13:20.225199 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:13:20.224990 2572 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b5110f18-3583-404a-876c-c7042a540e81-istio-podinfo\") on node \"ip-10-0-133-7.ec2.internal\" DevicePath \"\"" Jul 05 20:13:20.225199 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:13:20.225001 2572 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b5110f18-3583-404a-876c-c7042a540e81-istio-data\") on node \"ip-10-0-133-7.ec2.internal\" DevicePath \"\"" Jul 05 20:13:20.225199 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:13:20.225011 2572 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b5110f18-3583-404a-876c-c7042a540e81-istio-envoy\") on node \"ip-10-0-133-7.ec2.internal\" DevicePath \"\"" Jul 05 20:13:20.225199 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:13:20.225021 2572 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b5110f18-3583-404a-876c-c7042a540e81-istio-token\") on node \"ip-10-0-133-7.ec2.internal\" DevicePath \"\"" Jul 05 20:13:20.225199 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:13:20.225031 2572 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b5110f18-3583-404a-876c-c7042a540e81-workload-socket\") on node \"ip-10-0-133-7.ec2.internal\" DevicePath \"\"" Jul 05 20:13:20.225199 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:13:20.225043 2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-c7rdp\" (UniqueName: \"kubernetes.io/projected/b5110f18-3583-404a-876c-c7042a540e81-kube-api-access-c7rdp\") on node \"ip-10-0-133-7.ec2.internal\" DevicePath \"\"" Jul 05 20:13:20.811696 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:13:20.811660 2572 generic.go:356] "Generic (PLEG): container finished" podID="b5110f18-3583-404a-876c-c7042a540e81" containerID="5c348948167f1da85367014c1bc77538938f1fabf42934902c17b5a97930ba4b" exitCode=0 Jul 05 20:13:20.811864 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:13:20.811721 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-d9296f-openshift-default-749b575699-d96pz" Jul 05 20:13:20.811864 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:13:20.811721 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-d9296f-openshift-default-749b575699-d96pz" event={"ID":"b5110f18-3583-404a-876c-c7042a540e81","Type":"ContainerDied","Data":"5c348948167f1da85367014c1bc77538938f1fabf42934902c17b5a97930ba4b"} Jul 05 20:13:20.811938 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:13:20.811868 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-d9296f-openshift-default-749b575699-d96pz" event={"ID":"b5110f18-3583-404a-876c-c7042a540e81","Type":"ContainerDied","Data":"cd026cf3e6f2931e13ea0418dda942ccc5d0a36dfb92505d8b4cb945db18c223"} Jul 05 20:13:20.811938 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:13:20.811893 2572 scope.go:117] "RemoveContainer" containerID="5c348948167f1da85367014c1bc77538938f1fabf42934902c17b5a97930ba4b" Jul 05 20:13:20.821647 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:13:20.821628 2572 scope.go:117] "RemoveContainer" containerID="3b25e5b16ccac8cca9323d41304fe2041d88146c104ba5385c7ea0904334706a" Jul 05 20:13:20.829862 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:13:20.829830 2572 scope.go:117] "RemoveContainer" containerID="5c348948167f1da85367014c1bc77538938f1fabf42934902c17b5a97930ba4b" Jul 05 20:13:20.830181 ip-10-0-133-7 kubenswrapper[2572]: E0705 20:13:20.830160 2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5c348948167f1da85367014c1bc77538938f1fabf42934902c17b5a97930ba4b\": container with ID starting with 5c348948167f1da85367014c1bc77538938f1fabf42934902c17b5a97930ba4b not found: ID does not exist" containerID="5c348948167f1da85367014c1bc77538938f1fabf42934902c17b5a97930ba4b" Jul 05 20:13:20.830245 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:13:20.830197 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5c348948167f1da85367014c1bc77538938f1fabf42934902c17b5a97930ba4b"} err="failed to get container status \"5c348948167f1da85367014c1bc77538938f1fabf42934902c17b5a97930ba4b\": rpc error: code = NotFound desc = could not find container \"5c348948167f1da85367014c1bc77538938f1fabf42934902c17b5a97930ba4b\": container with ID starting with 5c348948167f1da85367014c1bc77538938f1fabf42934902c17b5a97930ba4b not found: ID does not exist" Jul 05 20:13:20.830245 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:13:20.830219 2572 scope.go:117] "RemoveContainer" containerID="3b25e5b16ccac8cca9323d41304fe2041d88146c104ba5385c7ea0904334706a" Jul 05 20:13:20.830508 ip-10-0-133-7 kubenswrapper[2572]: E0705 20:13:20.830482 2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3b25e5b16ccac8cca9323d41304fe2041d88146c104ba5385c7ea0904334706a\": container with ID starting with 3b25e5b16ccac8cca9323d41304fe2041d88146c104ba5385c7ea0904334706a not found: ID does not exist" containerID="3b25e5b16ccac8cca9323d41304fe2041d88146c104ba5385c7ea0904334706a" Jul 05 20:13:20.830577 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:13:20.830518 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3b25e5b16ccac8cca9323d41304fe2041d88146c104ba5385c7ea0904334706a"} err="failed to get container status \"3b25e5b16ccac8cca9323d41304fe2041d88146c104ba5385c7ea0904334706a\": rpc error: code = NotFound desc = could not find container \"3b25e5b16ccac8cca9323d41304fe2041d88146c104ba5385c7ea0904334706a\": container with ID starting with 3b25e5b16ccac8cca9323d41304fe2041d88146c104ba5385c7ea0904334706a not found: ID does not exist" Jul 05 20:13:20.833163 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:13:20.833141 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-d9296f-openshift-default-749b575699-d96pz"] Jul 05 20:13:20.837021 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:13:20.837000 2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-a-d9296f-openshift-default-749b575699-d96pz"] Jul 05 20:13:20.963525 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:13:20.963493 2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b5110f18-3583-404a-876c-c7042a540e81" path="/var/lib/kubelet/pods/b5110f18-3583-404a-876c-c7042a540e81/volumes" Jul 05 20:13:21.825666 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:13:21.825635 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-65fb4d-openshift-default-664c757fc5-x2cwh"] Jul 05 20:13:21.826157 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:13:21.825841 2572 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-b-65fb4d-openshift-default-664c757fc5-x2cwh" podUID="977737f0-61d5-4b17-915f-c45313cbaeac" containerName="istio-proxy" containerID="cri-o://2291fe64812e4f97240a4b77ede34f4f673abb2037bbdecef6ff905442d847f7" gracePeriod=30 Jul 05 20:13:22.358562 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:13:22.358523 2572 patch_prober.go:28] interesting pod/e2e-shared-b-65fb4d-openshift-default-664c757fc5-x2cwh container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Jul 05 20:13:22.358710 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:13:22.358586 2572 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-b-65fb4d-openshift-default-664c757fc5-x2cwh" podUID="977737f0-61d5-4b17-915f-c45313cbaeac" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 05 20:13:27.091909 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:13:27.091851 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-65fb4d-openshift-default-664c757fc5-x2cwh" Jul 05 20:13:27.101361 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:13:27.101341 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-gb5pg_97d61b1e-b753-4325-9c0c-567526952ea3/manager/0.log" Jul 05 20:13:27.193730 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:13:27.193701 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/977737f0-61d5-4b17-915f-c45313cbaeac-istio-data\") pod \"977737f0-61d5-4b17-915f-c45313cbaeac\" (UID: \"977737f0-61d5-4b17-915f-c45313cbaeac\") " Jul 05 20:13:27.193933 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:13:27.193747 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/977737f0-61d5-4b17-915f-c45313cbaeac-istiod-ca-cert\") pod \"977737f0-61d5-4b17-915f-c45313cbaeac\" (UID: \"977737f0-61d5-4b17-915f-c45313cbaeac\") " Jul 05 20:13:27.193933 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:13:27.193818 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/977737f0-61d5-4b17-915f-c45313cbaeac-istio-envoy\") pod \"977737f0-61d5-4b17-915f-c45313cbaeac\" (UID: \"977737f0-61d5-4b17-915f-c45313cbaeac\") " Jul 05 20:13:27.193933 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:13:27.193840 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/977737f0-61d5-4b17-915f-c45313cbaeac-workload-certs\") pod \"977737f0-61d5-4b17-915f-c45313cbaeac\" (UID: \"977737f0-61d5-4b17-915f-c45313cbaeac\") " Jul 05 20:13:27.193933 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:13:27.193865 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-z898j\" (UniqueName: \"kubernetes.io/projected/977737f0-61d5-4b17-915f-c45313cbaeac-kube-api-access-z898j\") pod \"977737f0-61d5-4b17-915f-c45313cbaeac\" (UID: \"977737f0-61d5-4b17-915f-c45313cbaeac\") " Jul 05 20:13:27.193933 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:13:27.193910 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/977737f0-61d5-4b17-915f-c45313cbaeac-istio-podinfo\") pod \"977737f0-61d5-4b17-915f-c45313cbaeac\" (UID: \"977737f0-61d5-4b17-915f-c45313cbaeac\") " Jul 05 20:13:27.194212 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:13:27.193934 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/977737f0-61d5-4b17-915f-c45313cbaeac-istio-token\") pod \"977737f0-61d5-4b17-915f-c45313cbaeac\" (UID: \"977737f0-61d5-4b17-915f-c45313cbaeac\") " Jul 05 20:13:27.194212 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:13:27.193972 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/977737f0-61d5-4b17-915f-c45313cbaeac-credential-socket\") pod \"977737f0-61d5-4b17-915f-c45313cbaeac\" (UID: \"977737f0-61d5-4b17-915f-c45313cbaeac\") " Jul 05 20:13:27.194212 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:13:27.194001 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/977737f0-61d5-4b17-915f-c45313cbaeac-workload-socket\") pod \"977737f0-61d5-4b17-915f-c45313cbaeac\" (UID: \"977737f0-61d5-4b17-915f-c45313cbaeac\") " Jul 05 20:13:27.194212 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:13:27.194110 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/977737f0-61d5-4b17-915f-c45313cbaeac-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "977737f0-61d5-4b17-915f-c45313cbaeac" (UID: "977737f0-61d5-4b17-915f-c45313cbaeac"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 05 20:13:27.194212 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:13:27.194153 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/977737f0-61d5-4b17-915f-c45313cbaeac-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "977737f0-61d5-4b17-915f-c45313cbaeac" (UID: "977737f0-61d5-4b17-915f-c45313cbaeac"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 05 20:13:27.194478 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:13:27.194308 2572 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/977737f0-61d5-4b17-915f-c45313cbaeac-workload-certs\") on node \"ip-10-0-133-7.ec2.internal\" DevicePath \"\"" Jul 05 20:13:27.194478 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:13:27.194326 2572 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/977737f0-61d5-4b17-915f-c45313cbaeac-istiod-ca-cert\") on node \"ip-10-0-133-7.ec2.internal\" DevicePath \"\"" Jul 05 20:13:27.194478 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:13:27.194332 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/977737f0-61d5-4b17-915f-c45313cbaeac-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "977737f0-61d5-4b17-915f-c45313cbaeac" (UID: "977737f0-61d5-4b17-915f-c45313cbaeac"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 05 20:13:27.194478 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:13:27.194451 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/977737f0-61d5-4b17-915f-c45313cbaeac-istio-data" (OuterVolumeSpecName: "istio-data") pod "977737f0-61d5-4b17-915f-c45313cbaeac" (UID: "977737f0-61d5-4b17-915f-c45313cbaeac"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 05 20:13:27.195207 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:13:27.194690 2572 scope.go:117] "RemoveContainer" containerID="9b38bca1fcc2fd4008c2e0116f3c64b942e4a67ad26bf177741fbc39616e3413" Jul 05 20:13:27.195207 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:13:27.194716 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/977737f0-61d5-4b17-915f-c45313cbaeac-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "977737f0-61d5-4b17-915f-c45313cbaeac" (UID: "977737f0-61d5-4b17-915f-c45313cbaeac"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 05 20:13:27.196637 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:13:27.196610 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/977737f0-61d5-4b17-915f-c45313cbaeac-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "977737f0-61d5-4b17-915f-c45313cbaeac" (UID: "977737f0-61d5-4b17-915f-c45313cbaeac"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 05 20:13:27.196751 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:13:27.196652 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/977737f0-61d5-4b17-915f-c45313cbaeac-istio-token" (OuterVolumeSpecName: "istio-token") pod "977737f0-61d5-4b17-915f-c45313cbaeac" (UID: "977737f0-61d5-4b17-915f-c45313cbaeac"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 05 20:13:27.196877 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:13:27.196845 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/977737f0-61d5-4b17-915f-c45313cbaeac-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "977737f0-61d5-4b17-915f-c45313cbaeac" (UID: "977737f0-61d5-4b17-915f-c45313cbaeac"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 05 20:13:27.197121 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:13:27.197084 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/977737f0-61d5-4b17-915f-c45313cbaeac-kube-api-access-z898j" (OuterVolumeSpecName: "kube-api-access-z898j") pod "977737f0-61d5-4b17-915f-c45313cbaeac" (UID: "977737f0-61d5-4b17-915f-c45313cbaeac"). InnerVolumeSpecName "kube-api-access-z898j". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 05 20:13:27.215642 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:13:27.215617 2572 scope.go:117] "RemoveContainer" containerID="2291fe64812e4f97240a4b77ede34f4f673abb2037bbdecef6ff905442d847f7" Jul 05 20:13:27.235414 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:13:27.235391 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-mrwpx_8c58f1f3-6c72-44cb-8014-6d39e075fb5f/manager/0.log" Jul 05 20:13:27.295529 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:13:27.295502 2572 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/977737f0-61d5-4b17-915f-c45313cbaeac-istio-envoy\") on node \"ip-10-0-133-7.ec2.internal\" DevicePath \"\"" Jul 05 20:13:27.295529 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:13:27.295525 2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-z898j\" (UniqueName: \"kubernetes.io/projected/977737f0-61d5-4b17-915f-c45313cbaeac-kube-api-access-z898j\") on node \"ip-10-0-133-7.ec2.internal\" DevicePath \"\"" Jul 05 20:13:27.295689 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:13:27.295535 2572 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/977737f0-61d5-4b17-915f-c45313cbaeac-istio-podinfo\") on node \"ip-10-0-133-7.ec2.internal\" DevicePath \"\"" Jul 05 20:13:27.295689 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:13:27.295546 2572 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/977737f0-61d5-4b17-915f-c45313cbaeac-istio-token\") on node \"ip-10-0-133-7.ec2.internal\" DevicePath \"\"" Jul 05 20:13:27.295689 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:13:27.295555 2572 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/977737f0-61d5-4b17-915f-c45313cbaeac-credential-socket\") on node \"ip-10-0-133-7.ec2.internal\" DevicePath \"\"" Jul 05 20:13:27.295689 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:13:27.295566 2572 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/977737f0-61d5-4b17-915f-c45313cbaeac-workload-socket\") on node \"ip-10-0-133-7.ec2.internal\" DevicePath \"\"" Jul 05 20:13:27.295689 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:13:27.295577 2572 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/977737f0-61d5-4b17-915f-c45313cbaeac-istio-data\") on node \"ip-10-0-133-7.ec2.internal\" DevicePath \"\"" Jul 05 20:13:27.460415 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:13:27.460390 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29721345-qfbts_66dea222-81f4-4740-b61e-ba09e57bc967/cleanup/0.log" Jul 05 20:13:27.572076 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:13:27.572047 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29721360-qrb5k_9941b28b-5cbb-49b8-9327-ca5ae24f3670/cleanup/0.log" Jul 05 20:13:27.800407 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:13:27.800331 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-5m84h_4c4a0c1f-060b-41aa-b052-f481f09b194e/server/0.log" Jul 05 20:13:27.851990 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:13:27.851931 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-65fb4d-openshift-default-664c757fc5-x2cwh" event={"ID":"977737f0-61d5-4b17-915f-c45313cbaeac","Type":"ContainerDied","Data":"2291fe64812e4f97240a4b77ede34f4f673abb2037bbdecef6ff905442d847f7"} Jul 05 20:13:27.851990 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:13:27.851980 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-65fb4d-openshift-default-664c757fc5-x2cwh" Jul 05 20:13:27.852176 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:13:27.852020 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-65fb4d-openshift-default-664c757fc5-x2cwh" event={"ID":"977737f0-61d5-4b17-915f-c45313cbaeac","Type":"ContainerDied","Data":"9ea776a246ece7fc1fea165be6bfb23e32e98ad143096fadc8b1c1aebafb5407"} Jul 05 20:13:27.883501 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:13:27.883469 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-65fb4d-openshift-default-664c757fc5-x2cwh"] Jul 05 20:13:27.887071 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:13:27.887048 2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-b-65fb4d-openshift-default-664c757fc5-x2cwh"] Jul 05 20:13:27.914338 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:13:27.914314 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-nhlrw_4dc8b8e5-af24-4fc1-a9e0-52c9da79adc2/manager/0.log" Jul 05 20:13:28.273941 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:13:28.273916 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-547755b757-npd7k_034248b4-3532-46d6-a19e-626b86062099/copy-manifests/0.log" Jul 05 20:13:28.285667 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:13:28.285642 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-547755b757-npd7k_034248b4-3532-46d6-a19e-626b86062099/manager/0.log" Jul 05 20:13:28.963053 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:13:28.963020 2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="977737f0-61d5-4b17-915f-c45313cbaeac" path="/var/lib/kubelet/pods/977737f0-61d5-4b17-915f-c45313cbaeac/volumes" Jul 05 20:13:30.262021 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:13:30.261987 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-fhmg2_3ec936c6-db14-4a04-90b5-765f91bda5db/manager/0.log" Jul 05 20:13:30.381726 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:13:30.381684 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-jt8wt_2c3766b2-ffe9-42a7-be58-19a998af727f/limitador/0.log" Jul 05 20:13:30.948413 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:13:30.948385 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-n5c2b_2636f449-30fe-4448-b3e6-b80e5a9e9449/discovery/0.log" Jul 05 20:13:31.056273 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:13:31.056240 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-f6b494dcc-5jq2d_09de75a4-dddd-468f-ab55-0e1a429d0034/kube-auth-proxy/0.log" Jul 05 20:13:31.640142 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:13:31.640116 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-647c6ccd69-6rdf2_d92912ee-635b-42af-8e2a-0bd5fc31ffc2/router/0.log" Jul 05 20:13:39.466312 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:13:39.466266 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-k2b5v_b256bcc8-4bdd-48db-b050-c02c368ef29d/global-pull-secret-syncer/0.log" Jul 05 20:13:39.583110 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:13:39.583075 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-6ldkn_e9938fdb-3276-474c-87c7-0386eacd806a/konnectivity-agent/0.log" Jul 05 20:13:39.640831 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:13:39.640802 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-133-7.ec2.internal_e2bff7cbf82451b4333adfc3db2c0112/haproxy/0.log" Jul 05 20:13:45.174197 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:13:45.174162 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-fhmg2_3ec936c6-db14-4a04-90b5-765f91bda5db/manager/0.log" Jul 05 20:13:45.219527 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:13:45.219494 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-jt8wt_2c3766b2-ffe9-42a7-be58-19a998af727f/limitador/0.log" Jul 05 20:13:47.196019 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:13:47.195987 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-64786d9cbb-zkn8b_1fd5a296-7d6e-475a-8e56-c50ac3e09085/cluster-monitoring-operator/0.log" Jul 05 20:13:47.341084 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:13:47.341061 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-c5c6p_57fe8b95-63f8-4735-ac57-f21153500b04/node-exporter/0.log" Jul 05 20:13:47.360677 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:13:47.360657 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-c5c6p_57fe8b95-63f8-4735-ac57-f21153500b04/kube-rbac-proxy/0.log" Jul 05 20:13:47.380623 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:13:47.380606 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-c5c6p_57fe8b95-63f8-4735-ac57-f21153500b04/init-textfile/0.log" Jul 05 20:13:47.947768 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:13:47.947742 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-78cf6ddc84-cxd6m_22cae53d-beb4-40fb-871a-d8444dd2c5cd/telemeter-client/0.log" Jul 05 20:13:48.004280 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:13:48.004238 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-78cf6ddc84-cxd6m_22cae53d-beb4-40fb-871a-d8444dd2c5cd/reload/0.log" Jul 05 20:13:48.060358 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:13:48.060324 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-78cf6ddc84-cxd6m_22cae53d-beb4-40fb-871a-d8444dd2c5cd/kube-rbac-proxy/0.log" Jul 05 20:13:49.024978 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:13:49.024920 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-hb8xk/perf-node-gather-daemonset-rz2n7"] Jul 05 20:13:49.025452 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:13:49.025274 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="977737f0-61d5-4b17-915f-c45313cbaeac" containerName="istio-proxy" Jul 05 20:13:49.025452 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:13:49.025286 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="977737f0-61d5-4b17-915f-c45313cbaeac" containerName="istio-proxy" Jul 05 20:13:49.025452 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:13:49.025295 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="977737f0-61d5-4b17-915f-c45313cbaeac" containerName="istio-proxy" Jul 05 20:13:49.025452 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:13:49.025300 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="977737f0-61d5-4b17-915f-c45313cbaeac" containerName="istio-proxy" Jul 05 20:13:49.025452 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:13:49.025309 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b5110f18-3583-404a-876c-c7042a540e81" containerName="istio-proxy" Jul 05 20:13:49.025452 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:13:49.025314 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="b5110f18-3583-404a-876c-c7042a540e81" containerName="istio-proxy" Jul 05 20:13:49.025452 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:13:49.025385 2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="b5110f18-3583-404a-876c-c7042a540e81" containerName="istio-proxy" Jul 05 20:13:49.025452 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:13:49.025395 2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="977737f0-61d5-4b17-915f-c45313cbaeac" containerName="istio-proxy" Jul 05 20:13:49.025452 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:13:49.025401 2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="b5110f18-3583-404a-876c-c7042a540e81" containerName="istio-proxy" Jul 05 20:13:49.025452 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:13:49.025408 2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="977737f0-61d5-4b17-915f-c45313cbaeac" containerName="istio-proxy" Jul 05 20:13:49.028472 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:13:49.028454 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-hb8xk/perf-node-gather-daemonset-rz2n7" Jul 05 20:13:49.030890 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:13:49.030872 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-hb8xk\"/\"openshift-service-ca.crt\"" Jul 05 20:13:49.031014 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:13:49.030933 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-hb8xk\"/\"kube-root-ca.crt\"" Jul 05 20:13:49.031076 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:13:49.031031 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-hb8xk\"/\"default-dockercfg-9prf5\"" Jul 05 20:13:49.037056 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:13:49.037033 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-hb8xk/perf-node-gather-daemonset-rz2n7"] Jul 05 20:13:49.078268 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:13:49.078232 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/632ec64e-e426-4211-8f90-985ff2adfc53-proc\") pod \"perf-node-gather-daemonset-rz2n7\" (UID: \"632ec64e-e426-4211-8f90-985ff2adfc53\") " pod="openshift-must-gather-hb8xk/perf-node-gather-daemonset-rz2n7" Jul 05 20:13:49.078443 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:13:49.078274 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/632ec64e-e426-4211-8f90-985ff2adfc53-lib-modules\") pod \"perf-node-gather-daemonset-rz2n7\" (UID: \"632ec64e-e426-4211-8f90-985ff2adfc53\") " pod="openshift-must-gather-hb8xk/perf-node-gather-daemonset-rz2n7" Jul 05 20:13:49.078443 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:13:49.078387 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/632ec64e-e426-4211-8f90-985ff2adfc53-sys\") pod \"perf-node-gather-daemonset-rz2n7\" (UID: \"632ec64e-e426-4211-8f90-985ff2adfc53\") " pod="openshift-must-gather-hb8xk/perf-node-gather-daemonset-rz2n7" Jul 05 20:13:49.078443 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:13:49.078414 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zk8qd\" (UniqueName: \"kubernetes.io/projected/632ec64e-e426-4211-8f90-985ff2adfc53-kube-api-access-zk8qd\") pod \"perf-node-gather-daemonset-rz2n7\" (UID: \"632ec64e-e426-4211-8f90-985ff2adfc53\") " pod="openshift-must-gather-hb8xk/perf-node-gather-daemonset-rz2n7" Jul 05 20:13:49.078565 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:13:49.078447 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/632ec64e-e426-4211-8f90-985ff2adfc53-podres\") pod \"perf-node-gather-daemonset-rz2n7\" (UID: \"632ec64e-e426-4211-8f90-985ff2adfc53\") " pod="openshift-must-gather-hb8xk/perf-node-gather-daemonset-rz2n7" Jul 05 20:13:49.178869 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:13:49.178835 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/632ec64e-e426-4211-8f90-985ff2adfc53-sys\") pod \"perf-node-gather-daemonset-rz2n7\" (UID: \"632ec64e-e426-4211-8f90-985ff2adfc53\") " pod="openshift-must-gather-hb8xk/perf-node-gather-daemonset-rz2n7" Jul 05 20:13:49.178869 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:13:49.178871 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zk8qd\" (UniqueName: \"kubernetes.io/projected/632ec64e-e426-4211-8f90-985ff2adfc53-kube-api-access-zk8qd\") pod \"perf-node-gather-daemonset-rz2n7\" (UID: \"632ec64e-e426-4211-8f90-985ff2adfc53\") " pod="openshift-must-gather-hb8xk/perf-node-gather-daemonset-rz2n7" Jul 05 20:13:49.179107 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:13:49.178979 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/632ec64e-e426-4211-8f90-985ff2adfc53-sys\") pod \"perf-node-gather-daemonset-rz2n7\" (UID: \"632ec64e-e426-4211-8f90-985ff2adfc53\") " pod="openshift-must-gather-hb8xk/perf-node-gather-daemonset-rz2n7" Jul 05 20:13:49.179107 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:13:49.178993 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/632ec64e-e426-4211-8f90-985ff2adfc53-podres\") pod \"perf-node-gather-daemonset-rz2n7\" (UID: \"632ec64e-e426-4211-8f90-985ff2adfc53\") " pod="openshift-must-gather-hb8xk/perf-node-gather-daemonset-rz2n7" Jul 05 20:13:49.179107 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:13:49.179030 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/632ec64e-e426-4211-8f90-985ff2adfc53-proc\") pod \"perf-node-gather-daemonset-rz2n7\" (UID: \"632ec64e-e426-4211-8f90-985ff2adfc53\") " pod="openshift-must-gather-hb8xk/perf-node-gather-daemonset-rz2n7" Jul 05 20:13:49.179107 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:13:49.179050 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/632ec64e-e426-4211-8f90-985ff2adfc53-lib-modules\") pod \"perf-node-gather-daemonset-rz2n7\" (UID: \"632ec64e-e426-4211-8f90-985ff2adfc53\") " pod="openshift-must-gather-hb8xk/perf-node-gather-daemonset-rz2n7" Jul 05 20:13:49.179107 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:13:49.179102 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/632ec64e-e426-4211-8f90-985ff2adfc53-proc\") pod \"perf-node-gather-daemonset-rz2n7\" (UID: \"632ec64e-e426-4211-8f90-985ff2adfc53\") " pod="openshift-must-gather-hb8xk/perf-node-gather-daemonset-rz2n7" Jul 05 20:13:49.179287 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:13:49.179162 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/632ec64e-e426-4211-8f90-985ff2adfc53-podres\") pod \"perf-node-gather-daemonset-rz2n7\" (UID: \"632ec64e-e426-4211-8f90-985ff2adfc53\") " pod="openshift-must-gather-hb8xk/perf-node-gather-daemonset-rz2n7" Jul 05 20:13:49.179287 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:13:49.179171 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/632ec64e-e426-4211-8f90-985ff2adfc53-lib-modules\") pod \"perf-node-gather-daemonset-rz2n7\" (UID: \"632ec64e-e426-4211-8f90-985ff2adfc53\") " pod="openshift-must-gather-hb8xk/perf-node-gather-daemonset-rz2n7" Jul 05 20:13:49.186586 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:13:49.186564 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zk8qd\" (UniqueName: \"kubernetes.io/projected/632ec64e-e426-4211-8f90-985ff2adfc53-kube-api-access-zk8qd\") pod \"perf-node-gather-daemonset-rz2n7\" (UID: \"632ec64e-e426-4211-8f90-985ff2adfc53\") " pod="openshift-must-gather-hb8xk/perf-node-gather-daemonset-rz2n7" Jul 05 20:13:49.340151 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:13:49.340066 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-hb8xk/perf-node-gather-daemonset-rz2n7" Jul 05 20:13:49.466899 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:13:49.466876 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-hb8xk/perf-node-gather-daemonset-rz2n7"] Jul 05 20:13:49.469306 ip-10-0-133-7 kubenswrapper[2572]: W0705 20:13:49.469268 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod632ec64e_e426_4211_8f90_985ff2adfc53.slice/crio-c71152d518493e683bca196dadf2ba6bbe2e237935a6dfe0741463632b7e4d9d WatchSource:0}: Error finding container c71152d518493e683bca196dadf2ba6bbe2e237935a6dfe0741463632b7e4d9d: Status 404 returned error can't find the container with id c71152d518493e683bca196dadf2ba6bbe2e237935a6dfe0741463632b7e4d9d Jul 05 20:13:49.469498 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:13:49.469480 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-6bffdf9778-r7bj5_7d69272b-dacb-48d0-bc9d-ab7f93673154/networking-console-plugin/0.log" Jul 05 20:13:49.965197 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:13:49.965160 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-hb8xk/perf-node-gather-daemonset-rz2n7" event={"ID":"632ec64e-e426-4211-8f90-985ff2adfc53","Type":"ContainerStarted","Data":"7f38d5f7eb8cef00c8bd1fb10b58f01e4706a4b3c30bf4d095a358b78b3ea15f"} Jul 05 20:13:49.965368 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:13:49.965209 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-hb8xk/perf-node-gather-daemonset-rz2n7" event={"ID":"632ec64e-e426-4211-8f90-985ff2adfc53","Type":"ContainerStarted","Data":"c71152d518493e683bca196dadf2ba6bbe2e237935a6dfe0741463632b7e4d9d"} Jul 05 20:13:49.965368 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:13:49.965286 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-hb8xk/perf-node-gather-daemonset-rz2n7" Jul 05 20:13:49.981495 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:13:49.981447 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-hb8xk/perf-node-gather-daemonset-rz2n7" podStartSLOduration=0.981432282 podStartE2EDuration="981.432282ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-05 20:13:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 20:13:49.979889812 +0000 UTC m=+2483.379237279" watchObservedRunningTime="2026-07-05 20:13:49.981432282 +0000 UTC m=+2483.380779747" Jul 05 20:13:50.023718 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:13:50.023692 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-plqpb_ac3142e8-817c-493b-b998-41ff8f4680f9/console-operator/1.log" Jul 05 20:13:50.029576 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:13:50.029549 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-plqpb_ac3142e8-817c-493b-b998-41ff8f4680f9/console-operator/2.log" Jul 05 20:13:51.007385 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:13:51.007355 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-5d456fdbcd-7x47r_8f389010-efaa-4a2a-a136-a206e6ad0cd5/volume-data-source-validator/0.log" Jul 05 20:13:52.010574 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:13:52.010546 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-kspjb_be57b515-f505-458c-8585-52cecfc83ee6/dns/0.log" Jul 05 20:13:52.030260 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:13:52.030237 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-kspjb_be57b515-f505-458c-8585-52cecfc83ee6/kube-rbac-proxy/0.log" Jul 05 20:13:52.113526 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:13:52.113502 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-d52jr_bfb32e10-9908-43c0-90f2-629b8c81ebc8/dns-node-resolver/0.log" Jul 05 20:13:52.699619 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:13:52.699588 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-pp8zt_b8af52e1-a74e-4004-8fef-45f3c97c0706/node-ca/0.log" Jul 05 20:13:53.663026 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:13:53.663000 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-n5c2b_2636f449-30fe-4448-b3e6-b80e5a9e9449/discovery/0.log" Jul 05 20:13:53.681514 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:13:53.681491 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-f6b494dcc-5jq2d_09de75a4-dddd-468f-ab55-0e1a429d0034/kube-auth-proxy/0.log" Jul 05 20:13:53.885813 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:13:53.885778 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-647c6ccd69-6rdf2_d92912ee-635b-42af-8e2a-0bd5fc31ffc2/router/0.log" Jul 05 20:13:54.505509 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:13:54.505478 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-5dxlq_ac01962e-2f62-482e-92ea-3c484803817d/serve-healthcheck-canary/0.log" Jul 05 20:13:54.989237 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:13:54.989203 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5c847dcfc4-wpgzd_f00bb4f2-e3e7-48e5-82b4-ada41ed8cd2f/insights-operator/0.log" Jul 05 20:13:54.989835 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:13:54.989818 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5c847dcfc4-wpgzd_f00bb4f2-e3e7-48e5-82b4-ada41ed8cd2f/insights-operator/1.log" Jul 05 20:13:55.009274 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:13:55.009250 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-8wfc2_6a22c6f6-ecb4-4ff6-8525-3639d132fe72/kube-rbac-proxy/0.log" Jul 05 20:13:55.028778 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:13:55.028754 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-8wfc2_6a22c6f6-ecb4-4ff6-8525-3639d132fe72/exporter/0.log" Jul 05 20:13:55.047641 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:13:55.047619 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-8wfc2_6a22c6f6-ecb4-4ff6-8525-3639d132fe72/extractor/0.log" Jul 05 20:13:55.979448 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:13:55.979419 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-hb8xk/perf-node-gather-daemonset-rz2n7" Jul 05 20:13:57.169713 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:13:57.169682 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-gb5pg_97d61b1e-b753-4325-9c0c-567526952ea3/manager/0.log" Jul 05 20:13:57.300846 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:13:57.300818 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-mrwpx_8c58f1f3-6c72-44cb-8014-6d39e075fb5f/manager/0.log" Jul 05 20:13:57.365221 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:13:57.365196 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29721345-qfbts_66dea222-81f4-4740-b61e-ba09e57bc967/cleanup/0.log" Jul 05 20:13:57.386785 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:13:57.386767 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29721360-qrb5k_9941b28b-5cbb-49b8-9327-ca5ae24f3670/cleanup/0.log" Jul 05 20:13:57.545988 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:13:57.545963 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-5m84h_4c4a0c1f-060b-41aa-b052-f481f09b194e/server/0.log" Jul 05 20:13:57.610571 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:13:57.610547 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-nhlrw_4dc8b8e5-af24-4fc1-a9e0-52c9da79adc2/manager/0.log" Jul 05 20:13:57.766305 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:13:57.766275 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-547755b757-npd7k_034248b4-3532-46d6-a19e-626b86062099/manager/0.log" Jul 05 20:13:57.782843 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:13:57.782818 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-547755b757-npd7k_034248b4-3532-46d6-a19e-626b86062099/copy-manifests/0.log" Jul 05 20:13:59.319835 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:13:59.319797 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-fd8ccff4c-lkbz9_db85611d-d3f4-4c8a-b55b-69641448cf98/openshift-lws-operator/0.log" Jul 05 20:13:59.551673 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:13:59.551644 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-n5c2b_2636f449-30fe-4448-b3e6-b80e5a9e9449/discovery/0.log" Jul 05 20:13:59.561342 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:13:59.561319 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-f6b494dcc-5jq2d_09de75a4-dddd-468f-ab55-0e1a429d0034/kube-auth-proxy/0.log" Jul 05 20:13:59.724309 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:13:59.724286 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-647c6ccd69-6rdf2_d92912ee-635b-42af-8e2a-0bd5fc31ffc2/router/0.log" Jul 05 20:14:00.968352 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:14:00.968325 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-n5c2b_2636f449-30fe-4448-b3e6-b80e5a9e9449/discovery/0.log" Jul 05 20:14:00.979524 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:14:00.979496 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-f6b494dcc-5jq2d_09de75a4-dddd-468f-ab55-0e1a429d0034/kube-auth-proxy/0.log" Jul 05 20:14:01.135852 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:14:01.135821 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-647c6ccd69-6rdf2_d92912ee-635b-42af-8e2a-0bd5fc31ffc2/router/0.log" Jul 05 20:14:04.451521 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:14:04.451478 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-846bf668f7-28jcd_f568b2ea-4b26-4337-8500-6a5daf5c7579/kube-storage-version-migrator-operator/1.log" Jul 05 20:14:04.452647 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:14:04.452628 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-846bf668f7-28jcd_f568b2ea-4b26-4337-8500-6a5daf5c7579/kube-storage-version-migrator-operator/0.log" Jul 05 20:14:05.374886 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:14:05.374855 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-49z2k_8f5a9b06-1cac-44c1-a0fd-188c005a6199/kube-multus/0.log" Jul 05 20:14:05.538634 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:14:05.538608 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-dlr8v_3567b575-3458-4a8c-9cac-04d8c9f7d1a6/kube-multus-additional-cni-plugins/0.log" Jul 05 20:14:05.557048 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:14:05.557022 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-dlr8v_3567b575-3458-4a8c-9cac-04d8c9f7d1a6/egress-router-binary-copy/0.log" Jul 05 20:14:05.577023 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:14:05.576997 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-dlr8v_3567b575-3458-4a8c-9cac-04d8c9f7d1a6/cni-plugins/0.log" Jul 05 20:14:05.596444 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:14:05.596425 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-dlr8v_3567b575-3458-4a8c-9cac-04d8c9f7d1a6/bond-cni-plugin/0.log" Jul 05 20:14:05.615522 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:14:05.615502 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-dlr8v_3567b575-3458-4a8c-9cac-04d8c9f7d1a6/routeoverride-cni/0.log" Jul 05 20:14:05.639037 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:14:05.638985 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-dlr8v_3567b575-3458-4a8c-9cac-04d8c9f7d1a6/whereabouts-cni-bincopy/0.log" Jul 05 20:14:05.658693 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:14:05.658668 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-dlr8v_3567b575-3458-4a8c-9cac-04d8c9f7d1a6/whereabouts-cni/0.log" Jul 05 20:14:05.921878 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:14:05.921809 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-brllj_05684556-d2e2-4157-9f17-097dee8230a0/network-metrics-daemon/0.log" Jul 05 20:14:05.939998 ip-10-0-133-7 kubenswrapper[2572]: I0705 20:14:05.939971 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-brllj_05684556-d2e2-4157-9f17-097dee8230a0/kube-rbac-proxy/0.log"