Jul 14 17:23:48.219189 ip-10-0-139-16 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Jul 14 17:23:48.219201 ip-10-0-139-16 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Jul 14 17:23:48.219211 ip-10-0-139-16 systemd[1]: kubelet.service: Failed with result 'resources'. Jul 14 17:23:48.219520 ip-10-0-139-16 systemd[1]: Failed to start Kubernetes Kubelet. Jul 14 17:23:58.361913 ip-10-0-139-16 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. Jul 14 17:23:58.361935 ip-10-0-139-16 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot 4cdb4f6d1ea744138c04c94834240923 -- Jul 14 17:25:37.500621 ip-10-0-139-16 systemd[1]: Starting Kubernetes Kubelet... Jul 14 17:25:37.928797 ip-10-0-139-16 kubenswrapper[2552]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 14 17:25:37.928797 ip-10-0-139-16 kubenswrapper[2552]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 14 17:25:37.928797 ip-10-0-139-16 kubenswrapper[2552]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 14 17:25:37.928797 ip-10-0-139-16 kubenswrapper[2552]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 14 17:25:37.928797 ip-10-0-139-16 kubenswrapper[2552]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 14 17:25:37.928797 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:37.923766 2552 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 14 17:25:37.928797 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:25:37.928355 2552 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 14 17:25:37.928797 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:25:37.928367 2552 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 14 17:25:37.928797 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:25:37.928371 2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 14 17:25:37.928797 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:25:37.928375 2552 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 14 17:25:37.928797 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:25:37.928378 2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 14 17:25:37.928797 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:25:37.928381 2552 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 14 17:25:37.928797 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:25:37.928384 2552 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 14 17:25:37.928797 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:25:37.928387 2552 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 14 17:25:37.932946 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:25:37.928389 2552 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 14 17:25:37.932946 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:25:37.928392 2552 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 14 17:25:37.932946 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:25:37.928396 2552 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 14 17:25:37.932946 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:25:37.928399 2552 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 14 17:25:37.932946 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:25:37.928401 2552 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 14 17:25:37.932946 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:25:37.928404 2552 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 14 17:25:37.932946 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:25:37.928406 2552 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 14 17:25:37.932946 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:25:37.928409 2552 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 14 17:25:37.932946 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:25:37.928412 2552 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 14 17:25:37.932946 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:25:37.928414 2552 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 14 17:25:37.932946 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:25:37.928417 2552 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 14 17:25:37.932946 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:25:37.928419 2552 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 14 17:25:37.932946 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:25:37.928423 2552 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 14 17:25:37.932946 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:25:37.928425 2552 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 14 17:25:37.932946 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:25:37.928428 2552 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 14 17:25:37.932946 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:25:37.928431 2552 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 14 17:25:37.932946 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:25:37.928434 2552 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 14 17:25:37.932946 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:25:37.928445 2552 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 14 17:25:37.932946 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:25:37.928452 2552 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 14 17:25:37.940903 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:25:37.928456 2552 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 14 17:25:37.940903 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:25:37.928459 2552 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 14 17:25:37.940903 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:25:37.928462 2552 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 14 17:25:37.940903 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:25:37.928465 2552 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 14 17:25:37.940903 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:25:37.928467 2552 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 14 17:25:37.940903 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:25:37.928470 2552 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 14 17:25:37.940903 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:25:37.928474 2552 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 14 17:25:37.940903 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:25:37.928476 2552 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 14 17:25:37.940903 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:25:37.928479 2552 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 14 17:25:37.940903 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:25:37.928482 2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 14 17:25:37.940903 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:25:37.928486 2552 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 14 17:25:37.940903 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:25:37.928489 2552 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 14 17:25:37.940903 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:25:37.928493 2552 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 14 17:25:37.940903 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:25:37.928496 2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 14 17:25:37.940903 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:25:37.928498 2552 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 14 17:25:37.940903 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:25:37.928501 2552 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 14 17:25:37.940903 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:25:37.928504 2552 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 14 17:25:37.940903 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:25:37.928507 2552 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 14 17:25:37.940903 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:25:37.928510 2552 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 14 17:25:37.944690 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:25:37.928513 2552 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 14 17:25:37.944690 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:25:37.928516 2552 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 14 17:25:37.944690 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:25:37.928520 2552 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 14 17:25:37.944690 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:25:37.928523 2552 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 14 17:25:37.944690 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:25:37.928525 2552 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 14 17:25:37.944690 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:25:37.928528 2552 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 14 17:25:37.944690 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:25:37.928531 2552 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 14 17:25:37.944690 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:25:37.928534 2552 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 14 17:25:37.944690 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:25:37.928536 2552 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 14 17:25:37.944690 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:25:37.928539 2552 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 14 17:25:37.944690 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:25:37.928541 2552 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 14 17:25:37.944690 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:25:37.928544 2552 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 14 17:25:37.944690 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:25:37.928547 2552 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 14 17:25:37.944690 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:25:37.928549 2552 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 14 17:25:37.944690 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:25:37.928552 2552 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 14 17:25:37.944690 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:25:37.928554 2552 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 14 17:25:37.944690 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:25:37.928557 2552 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 14 17:25:37.944690 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:25:37.928561 2552 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 14 17:25:37.944690 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:25:37.928563 2552 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 14 17:25:37.944690 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:25:37.928565 2552 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 14 17:25:38.103000 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:25:37.928568 2552 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 14 17:25:38.103000 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:25:37.928571 2552 feature_gate.go:328] unrecognized feature gate: Example Jul 14 17:25:38.103000 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:25:37.928573 2552 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 14 17:25:38.103000 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:25:37.928576 2552 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 14 17:25:38.103000 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:25:37.928578 2552 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 14 17:25:38.103000 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:25:37.928581 2552 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 14 17:25:38.103000 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:25:37.928585 2552 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 14 17:25:38.103000 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:25:37.928588 2552 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 14 17:25:38.103000 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:25:37.928591 2552 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 14 17:25:38.103000 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:25:37.928594 2552 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 14 17:25:38.103000 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:25:37.928597 2552 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 14 17:25:38.103000 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:25:37.928599 2552 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 14 17:25:38.103000 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:25:37.928601 2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 14 17:25:38.103000 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:25:37.928604 2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 14 17:25:38.103000 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:25:37.928607 2552 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 14 17:25:38.103000 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:25:37.928609 2552 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 14 17:25:38.103000 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:25:37.928612 2552 feature_gate.go:328] unrecognized feature gate: Example2 Jul 14 17:25:38.103000 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:25:37.928614 2552 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 14 17:25:38.103000 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:25:37.928617 2552 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 14 17:25:38.103000 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:25:37.928619 2552 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 14 17:25:38.119480 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:25:37.928622 2552 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 14 17:25:38.119480 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:25:37.928625 2552 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 14 17:25:38.119480 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:25:37.928627 2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 14 17:25:38.119480 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:25:37.928630 2552 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 14 17:25:38.119480 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:25:37.928632 2552 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 14 17:25:38.119480 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:25:37.928636 2552 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 14 17:25:38.119480 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:25:37.928639 2552 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 14 17:25:38.119480 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:25:37.928642 2552 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 14 17:25:38.119480 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:25:37.928645 2552 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 14 17:25:38.119480 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:25:37.928648 2552 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 14 17:25:38.119480 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:25:37.928650 2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 14 17:25:38.119480 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:25:37.928653 2552 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 14 17:25:38.119480 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:25:37.928655 2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 14 17:25:38.119480 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:25:37.930564 2552 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 14 17:25:38.119480 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:25:37.930574 2552 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 14 17:25:38.119480 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:25:37.930577 2552 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 14 17:25:38.119480 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:25:37.930580 2552 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 14 17:25:38.119480 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:25:37.930583 2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 14 17:25:38.119480 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:25:37.930587 2552 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 14 17:25:38.119480 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:25:37.930590 2552 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 14 17:25:38.002479 ip-10-0-139-16 systemd[1]: Started Kubernetes Kubelet. Jul 14 17:25:38.123892 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:25:37.930593 2552 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 14 17:25:38.123892 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:25:37.930596 2552 feature_gate.go:328] unrecognized feature gate: Example Jul 14 17:25:38.123892 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:25:37.930599 2552 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 14 17:25:38.123892 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:25:37.930602 2552 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 14 17:25:38.123892 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:25:37.930605 2552 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 14 17:25:38.123892 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:25:37.930607 2552 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 14 17:25:38.123892 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:25:37.930610 2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 14 17:25:38.123892 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:25:37.930612 2552 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 14 17:25:38.123892 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:25:37.930615 2552 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 14 17:25:38.123892 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:25:37.930617 2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 14 17:25:38.123892 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:25:37.930620 2552 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 14 17:25:38.123892 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:25:37.930622 2552 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 14 17:25:38.123892 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:25:37.930625 2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 14 17:25:38.123892 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:25:37.930628 2552 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 14 17:25:38.123892 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:25:37.930634 2552 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 14 17:25:38.123892 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:25:37.930640 2552 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 14 17:25:38.123892 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:25:37.930643 2552 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 14 17:25:38.123892 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:25:37.930646 2552 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 14 17:25:38.123892 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:25:37.930650 2552 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 14 17:25:38.126062 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:25:37.930653 2552 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 14 17:25:38.126062 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:25:37.930655 2552 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 14 17:25:38.126062 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:25:37.930658 2552 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 14 17:25:38.126062 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:25:37.930662 2552 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 14 17:25:38.126062 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:25:37.930664 2552 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 14 17:25:38.126062 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:25:37.930667 2552 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 14 17:25:38.126062 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:25:37.930670 2552 feature_gate.go:328] unrecognized feature gate: Example2 Jul 14 17:25:38.126062 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:25:37.930673 2552 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 14 17:25:38.126062 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:25:37.930675 2552 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 14 17:25:38.126062 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:25:37.930679 2552 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 14 17:25:38.126062 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:25:37.930682 2552 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 14 17:25:38.126062 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:25:37.930685 2552 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 14 17:25:38.126062 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:25:37.930689 2552 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 14 17:25:38.126062 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:25:37.930692 2552 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 14 17:25:38.126062 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:25:37.930694 2552 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 14 17:25:38.126062 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:25:37.930697 2552 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 14 17:25:38.126062 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:25:37.930700 2552 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 14 17:25:38.126062 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:25:37.930702 2552 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 14 17:25:38.126062 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:25:37.930705 2552 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 14 17:25:38.126062 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:25:37.930708 2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 14 17:25:38.131270 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:25:37.930710 2552 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 14 17:25:38.131270 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:25:37.930713 2552 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 14 17:25:38.131270 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:25:37.930716 2552 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 14 17:25:38.131270 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:25:37.930718 2552 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 14 17:25:38.131270 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:25:37.930721 2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 14 17:25:38.131270 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:25:37.930723 2552 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 14 17:25:38.131270 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:25:37.930726 2552 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 14 17:25:38.131270 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:25:37.930728 2552 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 14 17:25:38.131270 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:25:37.930731 2552 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 14 17:25:38.131270 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:25:37.930733 2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 14 17:25:38.131270 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:25:37.930736 2552 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 14 17:25:38.131270 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:25:37.930749 2552 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 14 17:25:38.131270 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:25:37.930752 2552 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 14 17:25:38.131270 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:25:37.930755 2552 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 14 17:25:38.131270 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:25:37.930758 2552 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 14 17:25:38.131270 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:25:37.930760 2552 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 14 17:25:38.131270 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:25:37.930763 2552 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 14 17:25:38.131270 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:25:37.930765 2552 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 14 17:25:38.131270 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:25:37.930768 2552 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 14 17:25:38.131270 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:25:37.930770 2552 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 14 17:25:38.132446 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:25:37.930773 2552 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 14 17:25:38.132446 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:25:37.930775 2552 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 14 17:25:38.132446 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:25:37.930778 2552 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 14 17:25:38.132446 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:25:37.930783 2552 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 14 17:25:38.132446 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:25:37.930786 2552 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 14 17:25:38.132446 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:25:37.930790 2552 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 14 17:25:38.132446 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:25:37.930794 2552 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 14 17:25:38.132446 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:25:37.930797 2552 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 14 17:25:38.132446 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:25:37.930799 2552 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 14 17:25:38.132446 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:25:37.930802 2552 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 14 17:25:38.132446 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:25:37.930805 2552 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 14 17:25:38.132446 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:25:37.930807 2552 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 14 17:25:38.132446 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:25:37.930810 2552 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 14 17:25:38.132446 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:25:37.930812 2552 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 14 17:25:38.132446 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:25:37.930815 2552 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 14 17:25:38.132446 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:25:37.930817 2552 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 14 17:25:38.132446 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:25:37.930820 2552 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 14 17:25:38.132446 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:25:37.930822 2552 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 14 17:25:38.132446 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:25:37.930825 2552 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 14 17:25:38.135800 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:25:37.930827 2552 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 14 17:25:38.135800 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:25:37.930830 2552 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 14 17:25:38.135800 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:25:37.930833 2552 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 14 17:25:38.135800 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:25:37.930839 2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 14 17:25:38.135800 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:25:37.930842 2552 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 14 17:25:38.135800 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:25:37.930844 2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 14 17:25:38.135800 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:25:37.930847 2552 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 14 17:25:38.135800 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:25:37.930849 2552 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 14 17:25:38.135800 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:25:37.930852 2552 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 14 17:25:38.135800 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:25:37.930854 2552 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 14 17:25:38.135800 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:25:37.930857 2552 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 14 17:25:38.135800 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:25:37.930859 2552 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 14 17:25:38.135800 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:25:37.930862 2552 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 14 17:25:38.135800 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:25:37.930864 2552 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 14 17:25:38.135800 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:25:37.931240 2552 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 14 17:25:38.135800 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:25:37.931245 2552 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 14 17:25:38.135800 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:25:37.931250 2552 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 14 17:25:38.135800 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:25:37.931252 2552 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 14 17:25:38.135800 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:25:37.931256 2552 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 14 17:25:38.135800 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:25:37.931258 2552 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 14 17:25:38.136701 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:25:37.931261 2552 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 14 17:25:38.136701 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:25:37.931263 2552 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 14 17:25:38.136701 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:25:37.931266 2552 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 14 17:25:38.136701 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:25:37.931269 2552 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 14 17:25:38.136701 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:25:37.931271 2552 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 14 17:25:38.136701 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:25:37.931274 2552 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 14 17:25:38.136701 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:25:37.931277 2552 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 14 17:25:38.136701 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:25:37.931280 2552 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 14 17:25:38.136701 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:25:37.931282 2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 14 17:25:38.136701 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:25:37.931285 2552 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 14 17:25:38.136701 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:25:37.931287 2552 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 14 17:25:38.136701 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:25:37.931289 2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 14 17:25:38.136701 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:25:37.931292 2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 14 17:25:38.136701 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:25:37.931294 2552 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 14 17:25:38.136701 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:25:37.931297 2552 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 14 17:25:38.136701 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:25:37.931301 2552 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 14 17:25:38.136701 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:25:37.931304 2552 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 14 17:25:38.136701 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:25:37.931306 2552 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 14 17:25:38.136701 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:25:37.931309 2552 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 14 17:25:38.136701 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:25:37.931311 2552 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 14 17:25:38.139588 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:25:37.931314 2552 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 14 17:25:38.139588 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:25:37.931316 2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 14 17:25:38.139588 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:25:37.931319 2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 14 17:25:38.139588 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:25:37.931337 2552 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 14 17:25:38.139588 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:25:37.931342 2552 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 14 17:25:38.139588 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:25:37.931345 2552 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 14 17:25:38.139588 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:25:37.931347 2552 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 14 17:25:38.139588 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:25:37.931349 2552 feature_gate.go:328] unrecognized feature gate: Example Jul 14 17:25:38.139588 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:25:37.931354 2552 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 14 17:25:38.139588 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:25:37.931357 2552 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 14 17:25:38.139588 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:25:37.931359 2552 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 14 17:25:38.139588 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:25:37.931364 2552 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 14 17:25:38.139588 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:25:37.931366 2552 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 14 17:25:38.139588 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:25:37.931369 2552 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 14 17:25:38.139588 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:25:37.931371 2552 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 14 17:25:38.139588 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:25:37.931375 2552 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 14 17:25:38.139588 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:25:37.931378 2552 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 14 17:25:38.139588 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:25:37.931380 2552 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 14 17:25:38.139588 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:25:37.931383 2552 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 14 17:25:38.139588 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:25:37.931385 2552 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 14 17:25:38.140419 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:25:37.931388 2552 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 14 17:25:38.140419 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:25:37.931390 2552 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 14 17:25:38.140419 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:25:37.931393 2552 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 14 17:25:38.140419 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:25:37.931396 2552 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 14 17:25:38.140419 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:25:37.931398 2552 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 14 17:25:38.140419 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:25:37.931402 2552 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 14 17:25:38.140419 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:25:37.931408 2552 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 14 17:25:38.140419 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:25:37.931414 2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 14 17:25:38.140419 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:25:37.931417 2552 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 14 17:25:38.140419 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:25:37.931419 2552 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 14 17:25:38.140419 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:25:37.931422 2552 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 14 17:25:38.140419 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:25:37.931425 2552 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 14 17:25:38.140419 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:25:37.931427 2552 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 14 17:25:38.140419 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:25:37.931430 2552 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 14 17:25:38.140419 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:25:37.931432 2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 14 17:25:38.140419 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:25:37.931435 2552 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 14 17:25:38.140419 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:25:37.931437 2552 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 14 17:25:38.140419 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:25:37.931440 2552 feature_gate.go:328] unrecognized feature gate: Example2 Jul 14 17:25:38.140419 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:25:37.931443 2552 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 14 17:25:38.140419 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:25:37.931446 2552 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 14 17:25:38.143771 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:25:37.931452 2552 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 14 17:25:38.143771 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:25:37.931455 2552 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 14 17:25:38.143771 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:25:37.931458 2552 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 14 17:25:38.143771 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:25:37.931461 2552 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 14 17:25:38.143771 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:25:37.931465 2552 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 14 17:25:38.143771 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:25:37.931468 2552 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 14 17:25:38.143771 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:25:37.931470 2552 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 14 17:25:38.143771 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:25:37.931473 2552 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 14 17:25:38.143771 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:25:37.931475 2552 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 14 17:25:38.143771 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:25:37.931479 2552 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 14 17:25:38.143771 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:25:37.931482 2552 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 14 17:25:38.143771 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:25:37.931486 2552 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 14 17:25:38.143771 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:25:37.931488 2552 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 14 17:25:38.143771 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:25:37.931491 2552 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 14 17:25:38.143771 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:25:37.931493 2552 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 14 17:25:38.143771 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:25:37.931496 2552 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 14 17:25:38.143771 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:25:37.931498 2552 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 14 17:25:38.143771 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:25:37.931501 2552 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 14 17:25:38.143771 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:25:37.931504 2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 14 17:25:38.144607 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:25:37.931507 2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 14 17:25:38.144607 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:25:37.931510 2552 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 14 17:25:38.144607 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:25:37.931512 2552 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 14 17:25:38.144607 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:25:37.931515 2552 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 14 17:25:38.144607 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:25:37.931518 2552 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 14 17:25:38.144607 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:25:37.931520 2552 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 14 17:25:38.144607 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:25:37.931522 2552 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 14 17:25:38.144607 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:25:37.931525 2552 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 14 17:25:38.144607 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:25:37.931527 2552 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 14 17:25:38.144607 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:25:37.931530 2552 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 14 17:25:38.144607 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:25:37.931532 2552 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 14 17:25:38.144607 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:25:37.931535 2552 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 14 17:25:38.144607 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:25:37.931537 2552 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 14 17:25:38.144607 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:25:37.931541 2552 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 14 17:25:38.144607 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:37.931623 2552 flags.go:64] FLAG: --address="0.0.0.0" Jul 14 17:25:38.144607 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:37.931631 2552 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 14 17:25:38.144607 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:37.931637 2552 flags.go:64] FLAG: --anonymous-auth="true" Jul 14 17:25:38.144607 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:37.931641 2552 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 14 17:25:38.144607 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:37.931646 2552 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 14 17:25:38.144607 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:37.931649 2552 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 14 17:25:38.144607 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:37.931653 2552 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 14 17:25:38.147527 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:37.931658 2552 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 14 17:25:38.147527 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:37.931661 2552 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 14 17:25:38.147527 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:37.931664 2552 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 14 17:25:38.147527 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:37.931667 2552 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 14 17:25:38.147527 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:37.931670 2552 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 14 17:25:38.147527 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:37.931674 2552 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 14 17:25:38.147527 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:37.931677 2552 flags.go:64] FLAG: --cgroup-root="" Jul 14 17:25:38.147527 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:37.931680 2552 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 14 17:25:38.147527 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:37.931683 2552 flags.go:64] FLAG: --client-ca-file="" Jul 14 17:25:38.147527 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:37.931685 2552 flags.go:64] FLAG: --cloud-provider="external" Jul 14 17:25:38.147527 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:37.931688 2552 flags.go:64] FLAG: --cluster-dns="[]" Jul 14 17:25:38.147527 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:37.931694 2552 flags.go:64] FLAG: --cluster-domain="" Jul 14 17:25:38.147527 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:37.931696 2552 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 14 17:25:38.147527 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:37.931699 2552 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 14 17:25:38.147527 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:37.931703 2552 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 14 17:25:38.147527 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:37.931706 2552 flags.go:64] FLAG: --container-log-max-files="5" Jul 14 17:25:38.147527 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:37.931710 2552 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 14 17:25:38.147527 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:37.931713 2552 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 14 17:25:38.147527 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:37.931716 2552 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 14 17:25:38.147527 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:37.931719 2552 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 14 17:25:38.147527 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:37.931722 2552 flags.go:64] FLAG: --contention-profiling="false" Jul 14 17:25:38.147527 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:37.931725 2552 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 14 17:25:38.147527 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:37.931728 2552 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 14 17:25:38.147527 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:37.931731 2552 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 14 17:25:38.148379 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:37.931735 2552 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 14 17:25:38.148379 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:37.931739 2552 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 14 17:25:38.148379 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:37.931742 2552 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 14 17:25:38.148379 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:37.931745 2552 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 14 17:25:38.148379 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:37.931748 2552 flags.go:64] FLAG: --enable-load-reader="false" Jul 14 17:25:38.148379 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:37.931751 2552 flags.go:64] FLAG: --enable-server="true" Jul 14 17:25:38.148379 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:37.931754 2552 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 14 17:25:38.148379 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:37.931759 2552 flags.go:64] FLAG: --event-burst="100" Jul 14 17:25:38.148379 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:37.931762 2552 flags.go:64] FLAG: --event-qps="50" Jul 14 17:25:38.148379 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:37.931765 2552 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 14 17:25:38.148379 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:37.931768 2552 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 14 17:25:38.148379 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:37.931771 2552 flags.go:64] FLAG: --eviction-hard="" Jul 14 17:25:38.148379 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:37.931775 2552 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 14 17:25:38.148379 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:37.931777 2552 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 14 17:25:38.148379 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:37.931780 2552 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 14 17:25:38.148379 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:37.931783 2552 flags.go:64] FLAG: --eviction-soft="" Jul 14 17:25:38.148379 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:37.931787 2552 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 14 17:25:38.148379 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:37.931790 2552 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 14 17:25:38.148379 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:37.931795 2552 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 14 17:25:38.148379 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:37.931802 2552 flags.go:64] FLAG: --experimental-mounter-path="" Jul 14 17:25:38.148379 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:37.931805 2552 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 14 17:25:38.148379 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:37.931808 2552 flags.go:64] FLAG: --fail-swap-on="true" Jul 14 17:25:38.148379 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:37.931811 2552 flags.go:64] FLAG: --feature-gates="" Jul 14 17:25:38.148379 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:37.931815 2552 flags.go:64] FLAG: --file-check-frequency="20s" Jul 14 17:25:38.148379 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:37.931818 2552 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 14 17:25:38.152520 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:37.931821 2552 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 14 17:25:38.152520 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:37.931824 2552 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 14 17:25:38.152520 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:37.931827 2552 flags.go:64] FLAG: --healthz-port="10248" Jul 14 17:25:38.152520 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:37.931830 2552 flags.go:64] FLAG: --help="false" Jul 14 17:25:38.152520 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:37.931833 2552 flags.go:64] FLAG: --hostname-override="ip-10-0-139-16.ec2.internal" Jul 14 17:25:38.152520 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:37.931836 2552 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 14 17:25:38.152520 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:37.931839 2552 flags.go:64] FLAG: --http-check-frequency="20s" Jul 14 17:25:38.152520 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:37.931843 2552 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 14 17:25:38.152520 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:37.931846 2552 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 14 17:25:38.152520 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:37.931850 2552 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 14 17:25:38.152520 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:37.931853 2552 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 14 17:25:38.152520 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:37.931856 2552 flags.go:64] FLAG: --image-service-endpoint="" Jul 14 17:25:38.152520 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:37.931859 2552 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 14 17:25:38.152520 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:37.931861 2552 flags.go:64] FLAG: --kube-api-burst="100" Jul 14 17:25:38.152520 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:37.931865 2552 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 14 17:25:38.152520 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:37.931868 2552 flags.go:64] FLAG: --kube-api-qps="50" Jul 14 17:25:38.152520 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:37.931871 2552 flags.go:64] FLAG: --kube-reserved="" Jul 14 17:25:38.152520 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:37.931874 2552 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 14 17:25:38.152520 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:37.931877 2552 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 14 17:25:38.152520 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:37.931880 2552 flags.go:64] FLAG: --kubelet-cgroups="" Jul 14 17:25:38.152520 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:37.931882 2552 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 14 17:25:38.152520 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:37.931885 2552 flags.go:64] FLAG: --lock-file="" Jul 14 17:25:38.152520 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:37.931888 2552 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 14 17:25:38.152520 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:37.931891 2552 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 14 17:25:38.153358 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:37.931893 2552 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 14 17:25:38.153358 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:37.931899 2552 flags.go:64] FLAG: --log-json-split-stream="false" Jul 14 17:25:38.153358 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:37.931904 2552 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 14 17:25:38.153358 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:37.931906 2552 flags.go:64] FLAG: --log-text-split-stream="false" Jul 14 17:25:38.153358 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:37.931914 2552 flags.go:64] FLAG: --logging-format="text" Jul 14 17:25:38.153358 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:37.931917 2552 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 14 17:25:38.153358 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:37.931920 2552 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 14 17:25:38.153358 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:37.931923 2552 flags.go:64] FLAG: --manifest-url="" Jul 14 17:25:38.153358 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:37.931926 2552 flags.go:64] FLAG: --manifest-url-header="" Jul 14 17:25:38.153358 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:37.931930 2552 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 14 17:25:38.153358 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:37.931933 2552 flags.go:64] FLAG: --max-open-files="1000000" Jul 14 17:25:38.153358 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:37.931937 2552 flags.go:64] FLAG: --max-pods="110" Jul 14 17:25:38.153358 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:37.931940 2552 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 14 17:25:38.153358 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:37.931943 2552 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 14 17:25:38.153358 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:37.931946 2552 flags.go:64] FLAG: --memory-manager-policy="None" Jul 14 17:25:38.153358 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:37.931951 2552 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 14 17:25:38.153358 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:37.931954 2552 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 14 17:25:38.153358 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:37.931957 2552 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 14 17:25:38.153358 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:37.931960 2552 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 14 17:25:38.153358 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:37.931967 2552 flags.go:64] FLAG: --node-status-max-images="50" Jul 14 17:25:38.153358 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:37.931970 2552 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 14 17:25:38.153358 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:37.931972 2552 flags.go:64] FLAG: --oom-score-adj="-999" Jul 14 17:25:38.153358 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:37.931976 2552 flags.go:64] FLAG: --pod-cidr="" Jul 14 17:25:38.157532 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:37.931979 2552 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b04c0b1f73af4d021dd8f0b51bfeb302c24482c093de5f2c43654ab56c506926" Jul 14 17:25:38.157532 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:37.931984 2552 flags.go:64] FLAG: --pod-manifest-path="" Jul 14 17:25:38.157532 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:37.931987 2552 flags.go:64] FLAG: --pod-max-pids="-1" Jul 14 17:25:38.157532 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:37.931991 2552 flags.go:64] FLAG: --pods-per-core="0" Jul 14 17:25:38.157532 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:37.931994 2552 flags.go:64] FLAG: --port="10250" Jul 14 17:25:38.157532 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:37.931996 2552 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 14 17:25:38.157532 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:37.931999 2552 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0cd272cb6a288546d" Jul 14 17:25:38.157532 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:37.932002 2552 flags.go:64] FLAG: --qos-reserved="" Jul 14 17:25:38.157532 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:37.932005 2552 flags.go:64] FLAG: --read-only-port="10255" Jul 14 17:25:38.157532 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:37.932008 2552 flags.go:64] FLAG: --register-node="true" Jul 14 17:25:38.157532 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:37.932011 2552 flags.go:64] FLAG: --register-with-taints="" Jul 14 17:25:38.157532 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:37.932016 2552 flags.go:64] FLAG: --registry-burst="10" Jul 14 17:25:38.157532 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:37.932018 2552 flags.go:64] FLAG: --registry-qps="5" Jul 14 17:25:38.157532 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:37.932021 2552 flags.go:64] FLAG: --reserved-cpus="" Jul 14 17:25:38.157532 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:37.932024 2552 flags.go:64] FLAG: --reserved-memory="" Jul 14 17:25:38.157532 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:37.932032 2552 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 14 17:25:38.157532 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:37.932035 2552 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 14 17:25:38.157532 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:37.932038 2552 flags.go:64] FLAG: --rotate-certificates="false" Jul 14 17:25:38.157532 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:37.932041 2552 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 14 17:25:38.157532 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:37.932044 2552 flags.go:64] FLAG: --runonce="false" Jul 14 17:25:38.157532 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:37.932047 2552 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 14 17:25:38.157532 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:37.932050 2552 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 14 17:25:38.157532 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:37.932053 2552 flags.go:64] FLAG: --seccomp-default="false" Jul 14 17:25:38.157532 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:37.932056 2552 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 14 17:25:38.157532 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:37.932058 2552 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 14 17:25:38.158374 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:37.932063 2552 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 14 17:25:38.158374 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:37.932066 2552 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 14 17:25:38.158374 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:37.932069 2552 flags.go:64] FLAG: --storage-driver-password="root" Jul 14 17:25:38.158374 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:37.932072 2552 flags.go:64] FLAG: --storage-driver-secure="false" Jul 14 17:25:38.158374 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:37.932075 2552 flags.go:64] FLAG: --storage-driver-table="stats" Jul 14 17:25:38.158374 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:37.932078 2552 flags.go:64] FLAG: --storage-driver-user="root" Jul 14 17:25:38.158374 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:37.932081 2552 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 14 17:25:38.158374 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:37.932084 2552 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 14 17:25:38.158374 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:37.932092 2552 flags.go:64] FLAG: --system-cgroups="" Jul 14 17:25:38.158374 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:37.932095 2552 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 14 17:25:38.158374 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:37.932100 2552 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 14 17:25:38.158374 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:37.932103 2552 flags.go:64] FLAG: --tls-cert-file="" Jul 14 17:25:38.158374 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:37.932106 2552 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 14 17:25:38.158374 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:37.932110 2552 flags.go:64] FLAG: --tls-min-version="" Jul 14 17:25:38.158374 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:37.932113 2552 flags.go:64] FLAG: --tls-private-key-file="" Jul 14 17:25:38.158374 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:37.932116 2552 flags.go:64] FLAG: --topology-manager-policy="none" Jul 14 17:25:38.158374 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:37.932119 2552 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 14 17:25:38.158374 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:37.932122 2552 flags.go:64] FLAG: --topology-manager-scope="container" Jul 14 17:25:38.158374 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:37.932126 2552 flags.go:64] FLAG: --v="2" Jul 14 17:25:38.158374 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:37.932134 2552 flags.go:64] FLAG: --version="false" Jul 14 17:25:38.158374 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:37.932138 2552 flags.go:64] FLAG: --vmodule="" Jul 14 17:25:38.158374 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:37.932142 2552 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 14 17:25:38.158374 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:37.932145 2552 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 14 17:25:38.158374 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:25:37.932310 2552 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 14 17:25:38.158374 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:25:37.932315 2552 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 14 17:25:38.161688 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:25:37.932319 2552 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 14 17:25:38.161688 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:25:37.932341 2552 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 14 17:25:38.161688 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:25:37.932345 2552 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 14 17:25:38.161688 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:25:37.932348 2552 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 14 17:25:38.161688 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:25:37.932351 2552 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 14 17:25:38.161688 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:25:37.932353 2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 14 17:25:38.161688 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:25:37.932356 2552 feature_gate.go:328] unrecognized feature gate: Example Jul 14 17:25:38.161688 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:25:37.932360 2552 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 14 17:25:38.161688 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:25:37.932363 2552 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 14 17:25:38.161688 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:25:37.932366 2552 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 14 17:25:38.161688 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:25:37.932368 2552 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 14 17:25:38.161688 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:25:37.932371 2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 14 17:25:38.161688 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:25:37.932373 2552 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 14 17:25:38.161688 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:25:37.932376 2552 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 14 17:25:38.161688 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:25:37.932379 2552 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 14 17:25:38.161688 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:25:37.932381 2552 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 14 17:25:38.161688 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:25:37.932385 2552 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 14 17:25:38.161688 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:25:37.932387 2552 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 14 17:25:38.161688 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:25:37.932390 2552 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 14 17:25:38.161688 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:25:37.932393 2552 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 14 17:25:38.262851 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:25:37.932395 2552 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 14 17:25:38.262851 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:25:37.932398 2552 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 14 17:25:38.262851 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:25:37.932400 2552 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 14 17:25:38.262851 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:25:37.932403 2552 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 14 17:25:38.262851 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:25:37.932405 2552 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 14 17:25:38.262851 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:25:37.932410 2552 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 14 17:25:38.262851 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:25:37.932412 2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 14 17:25:38.262851 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:25:37.932415 2552 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 14 17:25:38.262851 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:25:37.932417 2552 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 14 17:25:38.262851 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:25:37.932420 2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 14 17:25:38.262851 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:25:37.932423 2552 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 14 17:25:38.262851 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:25:37.932425 2552 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 14 17:25:38.262851 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:25:37.932428 2552 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 14 17:25:38.262851 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:25:37.932430 2552 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 14 17:25:38.262851 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:25:37.932433 2552 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 14 17:25:38.262851 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:25:37.932436 2552 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 14 17:25:38.262851 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:25:37.932438 2552 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 14 17:25:38.262851 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:25:37.932441 2552 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 14 17:25:38.262851 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:25:37.932443 2552 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 14 17:25:38.262851 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:25:37.932447 2552 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 14 17:25:38.265689 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:25:37.932449 2552 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 14 17:25:38.265689 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:25:37.932452 2552 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 14 17:25:38.265689 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:25:37.932454 2552 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 14 17:25:38.265689 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:25:37.932457 2552 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 14 17:25:38.265689 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:25:37.932459 2552 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 14 17:25:38.265689 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:25:37.932462 2552 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 14 17:25:38.265689 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:25:37.932466 2552 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 14 17:25:38.265689 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:25:37.932469 2552 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 14 17:25:38.265689 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:25:37.932472 2552 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 14 17:25:38.265689 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:25:37.932475 2552 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 14 17:25:38.265689 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:25:37.932478 2552 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 14 17:25:38.265689 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:25:37.932481 2552 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 14 17:25:38.265689 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:25:37.932483 2552 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 14 17:25:38.265689 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:25:37.932486 2552 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 14 17:25:38.265689 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:25:37.932488 2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 14 17:25:38.265689 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:25:37.932490 2552 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 14 17:25:38.265689 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:25:37.932493 2552 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 14 17:25:38.265689 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:25:37.932497 2552 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 14 17:25:38.265689 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:25:37.932499 2552 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 14 17:25:38.266530 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:25:37.932502 2552 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 14 17:25:38.266530 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:25:37.932504 2552 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 14 17:25:38.266530 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:25:37.932508 2552 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 14 17:25:38.266530 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:25:37.932511 2552 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 14 17:25:38.266530 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:25:37.932514 2552 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 14 17:25:38.266530 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:25:37.932517 2552 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 14 17:25:38.266530 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:25:37.932519 2552 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 14 17:25:38.266530 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:25:37.932522 2552 feature_gate.go:328] unrecognized feature gate: Example2 Jul 14 17:25:38.266530 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:25:37.932525 2552 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 14 17:25:38.266530 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:25:37.932528 2552 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 14 17:25:38.266530 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:25:37.932530 2552 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 14 17:25:38.266530 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:25:37.932533 2552 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 14 17:25:38.266530 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:25:37.932537 2552 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 14 17:25:38.266530 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:25:37.932541 2552 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 14 17:25:38.266530 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:25:37.932544 2552 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 14 17:25:38.266530 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:25:37.932547 2552 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 14 17:25:38.266530 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:25:37.932551 2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 14 17:25:38.266530 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:25:37.932555 2552 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 14 17:25:38.266530 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:25:37.932559 2552 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 14 17:25:38.270713 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:25:37.932561 2552 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 14 17:25:38.270713 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:25:37.932564 2552 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 14 17:25:38.270713 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:25:37.932567 2552 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 14 17:25:38.270713 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:25:37.932569 2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 14 17:25:38.270713 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:25:37.932573 2552 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 14 17:25:38.270713 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:25:37.932575 2552 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 14 17:25:38.270713 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:25:37.932578 2552 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 14 17:25:38.270713 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:25:37.932580 2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 14 17:25:38.270713 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:25:37.932583 2552 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 14 17:25:38.270713 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:25:37.932585 2552 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 14 17:25:38.270713 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:25:37.932588 2552 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 14 17:25:38.270713 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:25:37.932591 2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 14 17:25:38.270713 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:25:37.932594 2552 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 14 17:25:38.270713 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:25:37.932596 2552 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 14 17:25:38.270713 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:25:37.932598 2552 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 14 17:25:38.270713 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:25:37.932601 2552 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 14 17:25:38.270713 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:25:37.932604 2552 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 14 17:25:38.270713 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:25:37.932606 2552 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 14 17:25:38.270713 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:25:37.932609 2552 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 14 17:25:38.271559 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:37.933140 2552 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 14 17:25:38.271559 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:37.939869 2552 server.go:529] "Kubelet version" kubeletVersion="v1.34.9" Jul 14 17:25:38.271559 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:37.939884 2552 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 14 17:25:38.271559 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:37.940705 2552 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 14 17:25:38.271559 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:37.940713 2552 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 14 17:25:38.271559 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:25:37.940770 2552 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 14 17:25:38.271559 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:25:37.940776 2552 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 14 17:25:38.271559 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:25:37.940780 2552 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 14 17:25:38.271559 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:25:37.940783 2552 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 14 17:25:38.271559 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:25:37.940786 2552 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 14 17:25:38.271559 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:25:37.940789 2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 14 17:25:38.271559 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:25:37.940791 2552 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 14 17:25:38.271559 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:25:37.940794 2552 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 14 17:25:38.271559 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:25:37.940797 2552 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 14 17:25:38.271559 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:25:37.940800 2552 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 14 17:25:38.276607 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:25:37.940804 2552 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 14 17:25:38.276607 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:25:37.940807 2552 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 14 17:25:38.276607 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:25:37.940810 2552 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 14 17:25:38.276607 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:25:37.940813 2552 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 14 17:25:38.276607 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:25:37.940816 2552 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 14 17:25:38.276607 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:25:37.940818 2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 14 17:25:38.276607 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:25:37.940821 2552 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 14 17:25:38.276607 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:25:37.940824 2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 14 17:25:38.276607 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:25:37.940827 2552 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 14 17:25:38.276607 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:25:37.940829 2552 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 14 17:25:38.276607 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:25:37.940832 2552 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 14 17:25:38.276607 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:25:37.940835 2552 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 14 17:25:38.276607 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:25:37.940837 2552 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 14 17:25:38.276607 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:25:37.940840 2552 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 14 17:25:38.276607 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:25:37.940842 2552 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 14 17:25:38.276607 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:25:37.940845 2552 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 14 17:25:38.276607 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:25:37.940847 2552 feature_gate.go:328] unrecognized feature gate: Example2 Jul 14 17:25:38.276607 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:25:37.940850 2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 14 17:25:38.276607 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:25:37.940852 2552 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 14 17:25:38.277452 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:25:37.940856 2552 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 14 17:25:38.277452 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:25:37.940859 2552 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 14 17:25:38.277452 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:25:37.940861 2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 14 17:25:38.277452 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:25:37.940863 2552 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 14 17:25:38.277452 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:25:37.940866 2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 14 17:25:38.277452 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:25:37.940868 2552 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 14 17:25:38.277452 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:25:37.940871 2552 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 14 17:25:38.277452 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:25:37.940873 2552 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 14 17:25:38.277452 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:25:37.940876 2552 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 14 17:25:38.277452 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:25:37.940878 2552 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 14 17:25:38.277452 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:25:37.940881 2552 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 14 17:25:38.277452 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:25:37.940884 2552 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 14 17:25:38.277452 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:25:37.940886 2552 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 14 17:25:38.277452 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:25:37.940889 2552 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 14 17:25:38.277452 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:25:37.940891 2552 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 14 17:25:38.277452 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:25:37.940894 2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 14 17:25:38.277452 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:25:37.940897 2552 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 14 17:25:38.277452 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:25:37.940900 2552 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 14 17:25:38.277452 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:25:37.940902 2552 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 14 17:25:38.277452 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:25:37.940905 2552 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 14 17:25:38.278280 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:25:37.940908 2552 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 14 17:25:38.278280 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:25:37.940910 2552 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 14 17:25:38.278280 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:25:37.940913 2552 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 14 17:25:38.278280 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:25:37.940916 2552 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 14 17:25:38.278280 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:25:37.940918 2552 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 14 17:25:38.278280 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:25:37.940921 2552 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 14 17:25:38.278280 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:25:37.940924 2552 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 14 17:25:38.278280 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:25:37.940927 2552 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 14 17:25:38.278280 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:25:37.940931 2552 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 14 17:25:38.278280 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:25:37.940934 2552 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 14 17:25:38.278280 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:25:37.940939 2552 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 14 17:25:38.278280 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:25:37.940942 2552 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 14 17:25:38.278280 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:25:37.940945 2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 14 17:25:38.278280 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:25:37.940948 2552 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 14 17:25:38.278280 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:25:37.940952 2552 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 14 17:25:38.278280 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:25:37.940955 2552 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 14 17:25:38.278280 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:25:37.940958 2552 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 14 17:25:38.278280 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:25:37.940961 2552 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 14 17:25:38.278280 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:25:37.940964 2552 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 14 17:25:38.282924 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:25:37.940967 2552 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 14 17:25:38.282924 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:25:37.940970 2552 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 14 17:25:38.282924 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:25:37.940973 2552 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 14 17:25:38.282924 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:25:37.940975 2552 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 14 17:25:38.282924 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:25:37.940978 2552 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 14 17:25:38.282924 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:25:37.940981 2552 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 14 17:25:38.282924 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:25:37.940983 2552 feature_gate.go:328] unrecognized feature gate: Example Jul 14 17:25:38.282924 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:25:37.940986 2552 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 14 17:25:38.282924 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:25:37.940988 2552 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 14 17:25:38.282924 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:25:37.940991 2552 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 14 17:25:38.282924 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:25:37.940994 2552 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 14 17:25:38.282924 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:25:37.940997 2552 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 14 17:25:38.282924 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:25:37.940999 2552 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 14 17:25:38.282924 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:25:37.941002 2552 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 14 17:25:38.282924 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:25:37.941005 2552 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 14 17:25:38.282924 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:25:37.941007 2552 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 14 17:25:38.282924 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:25:37.941010 2552 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 14 17:25:38.282924 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:25:37.941012 2552 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 14 17:25:38.282924 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:25:37.941015 2552 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 14 17:25:38.282924 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:25:37.941017 2552 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 14 17:25:38.283760 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:25:37.941020 2552 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 14 17:25:38.283760 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:25:37.941022 2552 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 14 17:25:38.283760 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:25:37.941025 2552 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 14 17:25:38.283760 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:25:37.941029 2552 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 14 17:25:38.283760 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:25:37.941031 2552 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 14 17:25:38.283760 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:25:37.941034 2552 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 14 17:25:38.283760 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:25:37.941036 2552 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 14 17:25:38.283760 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:25:37.941039 2552 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 14 17:25:38.283760 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:25:37.941042 2552 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 14 17:25:38.283760 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:25:37.941044 2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 14 17:25:38.283760 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:25:37.941047 2552 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 14 17:25:38.283760 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:37.941052 2552 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 14 17:25:38.283760 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:25:37.941182 2552 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 14 17:25:38.283760 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:25:37.941188 2552 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 14 17:25:38.283760 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:25:37.941191 2552 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 14 17:25:38.284193 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:25:37.941194 2552 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 14 17:25:38.284193 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:25:37.941197 2552 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 14 17:25:38.284193 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:25:37.941199 2552 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 14 17:25:38.284193 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:25:37.941202 2552 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 14 17:25:38.284193 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:25:37.941205 2552 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 14 17:25:38.284193 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:25:37.941208 2552 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 14 17:25:38.284193 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:25:37.941210 2552 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 14 17:25:38.284193 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:25:37.941213 2552 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 14 17:25:38.284193 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:25:37.941216 2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 14 17:25:38.284193 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:25:37.941218 2552 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 14 17:25:38.284193 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:25:37.941221 2552 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 14 17:25:38.284193 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:25:37.941224 2552 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 14 17:25:38.284193 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:25:37.941226 2552 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 14 17:25:38.284193 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:25:37.941229 2552 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 14 17:25:38.284193 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:25:37.941232 2552 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 14 17:25:38.284193 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:25:37.941234 2552 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 14 17:25:38.284193 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:25:37.941237 2552 feature_gate.go:328] unrecognized feature gate: Example2 Jul 14 17:25:38.284193 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:25:37.941239 2552 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 14 17:25:38.284193 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:25:37.941242 2552 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 14 17:25:38.284193 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:25:37.941244 2552 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 14 17:25:38.286716 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:25:37.941247 2552 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 14 17:25:38.286716 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:25:37.941253 2552 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 14 17:25:38.286716 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:25:37.941255 2552 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 14 17:25:38.286716 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:25:37.941258 2552 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 14 17:25:38.286716 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:25:37.941260 2552 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 14 17:25:38.286716 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:25:37.941263 2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 14 17:25:38.286716 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:25:37.941266 2552 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 14 17:25:38.286716 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:25:37.941268 2552 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 14 17:25:38.286716 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:25:37.941271 2552 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 14 17:25:38.286716 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:25:37.941274 2552 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 14 17:25:38.286716 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:25:37.941276 2552 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 14 17:25:38.286716 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:25:37.941279 2552 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 14 17:25:38.286716 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:25:37.941281 2552 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 14 17:25:38.286716 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:25:37.941284 2552 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 14 17:25:38.286716 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:25:37.941286 2552 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 14 17:25:38.286716 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:25:37.941289 2552 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 14 17:25:38.286716 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:25:37.941292 2552 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 14 17:25:38.286716 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:25:37.941294 2552 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 14 17:25:38.286716 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:25:37.941297 2552 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 14 17:25:38.286716 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:25:37.941300 2552 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 14 17:25:38.287555 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:25:37.941302 2552 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 14 17:25:38.287555 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:25:37.941305 2552 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 14 17:25:38.287555 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:25:37.941307 2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 14 17:25:38.287555 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:25:37.941310 2552 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 14 17:25:38.287555 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:25:37.941313 2552 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 14 17:25:38.287555 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:25:37.941315 2552 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 14 17:25:38.287555 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:25:37.941318 2552 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 14 17:25:38.287555 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:25:37.941321 2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 14 17:25:38.287555 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:25:37.941338 2552 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 14 17:25:38.287555 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:25:37.941341 2552 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 14 17:25:38.287555 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:25:37.941345 2552 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 14 17:25:38.287555 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:25:37.941350 2552 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 14 17:25:38.287555 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:25:37.941355 2552 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 14 17:25:38.287555 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:25:37.941361 2552 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 14 17:25:38.287555 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:25:37.941365 2552 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 14 17:25:38.287555 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:25:37.941368 2552 feature_gate.go:328] unrecognized feature gate: Example Jul 14 17:25:38.287555 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:25:37.941372 2552 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 14 17:25:38.287555 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:25:37.941375 2552 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 14 17:25:38.287555 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:25:37.941380 2552 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 14 17:25:38.414960 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:25:37.941384 2552 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 14 17:25:38.414960 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:25:37.941387 2552 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 14 17:25:38.414960 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:25:37.941391 2552 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 14 17:25:38.414960 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:25:37.941395 2552 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 14 17:25:38.414960 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:25:37.941399 2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 14 17:25:38.414960 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:25:37.941402 2552 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 14 17:25:38.414960 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:25:37.941406 2552 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 14 17:25:38.414960 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:25:37.941409 2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 14 17:25:38.414960 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:25:37.941413 2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 14 17:25:38.414960 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:25:37.941417 2552 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 14 17:25:38.414960 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:25:37.941425 2552 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 14 17:25:38.414960 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:25:37.941431 2552 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 14 17:25:38.414960 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:25:37.941435 2552 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 14 17:25:38.414960 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:25:37.941439 2552 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 14 17:25:38.414960 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:25:37.941443 2552 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 14 17:25:38.414960 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:25:37.941448 2552 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 14 17:25:38.414960 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:25:37.941452 2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 14 17:25:38.414960 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:25:37.941455 2552 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 14 17:25:38.414960 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:25:37.941460 2552 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 14 17:25:38.415724 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:25:37.941465 2552 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 14 17:25:38.415724 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:25:37.941469 2552 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 14 17:25:38.415724 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:25:37.941473 2552 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 14 17:25:38.415724 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:25:37.941477 2552 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 14 17:25:38.415724 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:25:37.941480 2552 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 14 17:25:38.415724 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:25:37.941484 2552 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 14 17:25:38.415724 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:25:37.941488 2552 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 14 17:25:38.415724 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:25:37.941494 2552 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 14 17:25:38.415724 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:25:37.941498 2552 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 14 17:25:38.415724 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:25:37.941502 2552 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 14 17:25:38.415724 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:25:37.941506 2552 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 14 17:25:38.415724 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:25:37.941510 2552 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 14 17:25:38.415724 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:25:37.941514 2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 14 17:25:38.415724 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:25:37.941519 2552 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 14 17:25:38.415724 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:25:37.941521 2552 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 14 17:25:38.415724 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:25:37.941524 2552 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 14 17:25:38.415724 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:25:37.941526 2552 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 14 17:25:38.415724 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:25:37.941529 2552 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 14 17:25:38.419144 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:37.941534 2552 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 14 17:25:38.419144 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:37.941697 2552 server.go:962] "Client rotation is on, will bootstrap in background" Jul 14 17:25:38.419144 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:37.945573 2552 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 14 17:25:38.419144 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:37.946980 2552 server.go:1019] "Starting client certificate rotation" Jul 14 17:25:38.419144 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:37.947083 2552 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 14 17:25:38.419144 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:37.947125 2552 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 14 17:25:38.419144 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:37.954771 2552 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 14 17:25:38.419144 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:37.955900 2552 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 14 17:25:38.419144 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:37.966437 2552 log.go:25] "Validated CRI v1 runtime API" Jul 14 17:25:38.419144 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:37.968603 2552 log.go:25] "Validated CRI v1 image API" Jul 14 17:25:38.419144 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:37.969830 2552 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 14 17:25:38.419144 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:37.974049 2552 fs.go:135] Filesystem UUIDs: map[5e50b923-6419-4bd3-a732-5dbe8977a0ae:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 dbb65864-d0b1-4c35-b5a9-1bf60e28b30c:/dev/nvme0n1p3] Jul 14 17:25:38.419542 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:37.974063 2552 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 14 17:25:38.528777 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:37.979816 2552 manager.go:216] Machine: {Timestamp:2026-07-14 17:25:37.978312854 +0000 UTC m=+0.357426796 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3120064 MemoryCapacity:33164500992 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2ba3cadf0dc36c6d71561d403a98f6 SystemUUID:ec2ba3ca-df0d-c36c-6d71-561d403a98f6 BootID:4cdb4f6d-1ea7-4413-8c04-c94834240923 Filesystems:[{Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582250496 Type:vfs Inodes:4048401 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:56:22:30:dc:5f Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:56:22:30:dc:5f Speed:0 Mtu:9001} {Name:ovs-system MacAddress:ae:c9:2c:3b:bb:b1 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164500992 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 14 17:25:38.528777 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:37.979922 2552 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 14 17:25:38.528777 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:37.980004 2552 manager.go:232] Version: {KernelVersion:5.14.0-570.126.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260702-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 14 17:25:38.528777 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:37.982660 2552 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 14 17:25:38.528777 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:37.982680 2552 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-139-16.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 14 17:25:38.528777 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:37.983452 2552 topology_manager.go:138] "Creating topology manager with none policy" Jul 14 17:25:38.528777 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:37.983463 2552 container_manager_linux.go:309] "Creating device plugin manager" Jul 14 17:25:38.528777 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:37.983470 2552 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 14 17:25:38.530037 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:37.983483 2552 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 14 17:25:38.530037 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:37.984825 2552 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 14 17:25:38.530037 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:37.987629 2552 state_mem.go:36] "Initialized new in-memory state store" Jul 14 17:25:38.530037 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:37.987747 2552 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 14 17:25:38.530037 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:37.988449 2552 kubelet.go:486] "Attempting to sync node with API server" Jul 14 17:25:38.530037 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:37.988464 2552 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 14 17:25:38.530037 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:37.988478 2552 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 14 17:25:38.530037 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:37.988487 2552 kubelet.go:398] "Adding apiserver pod source" Jul 14 17:25:38.530037 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:37.988496 2552 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 14 17:25:38.530037 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:37.988799 2552 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 14 17:25:38.530037 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:37.988813 2552 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 14 17:25:38.530037 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:37.991673 2552 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 14 17:25:38.530037 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:37.992873 2552 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1" Jul 14 17:25:38.530037 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:37.995236 2552 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 14 17:25:38.530037 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:37.995274 2552 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 14 17:25:38.530037 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:37.995498 2552 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 14 17:25:38.530037 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:37.995514 2552 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 14 17:25:38.530037 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:37.995523 2552 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 14 17:25:38.530037 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:37.995531 2552 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 14 17:25:38.530037 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:37.995542 2552 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 14 17:25:38.530037 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:37.995550 2552 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 14 17:25:38.530037 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:37.996069 2552 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 14 17:25:38.530037 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:37.996077 2552 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 14 17:25:38.530037 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:37.996087 2552 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 14 17:25:38.530037 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:37.996095 2552 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 14 17:25:38.530037 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:37.996106 2552 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 14 17:25:38.530037 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:37.996117 2552 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 14 17:25:38.530037 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:37.997887 2552 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 14 17:25:38.530037 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:37.997897 2552 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 14 17:25:38.530037 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:38.000631 2552 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-139-16.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 14 17:25:38.530037 ip-10-0-139-16 kubenswrapper[2552]: E0714 17:25:38.000629 2552 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 14 17:25:38.530037 ip-10-0-139-16 kubenswrapper[2552]: E0714 17:25:38.000762 2552 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-139-16.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 14 17:25:38.530037 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:38.001598 2552 server.go:1268] "Started kubelet" Jul 14 17:25:38.530037 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:38.001646 2552 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 14 17:25:38.530037 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:38.001696 2552 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 14 17:25:38.530037 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:38.001761 2552 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 14 17:25:38.530037 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:38.003255 2552 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 14 17:25:38.530037 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:38.003257 2552 server.go:310] "Adding debug handlers to kubelet server" Jul 14 17:25:38.530037 ip-10-0-139-16 kubenswrapper[2552]: E0714 17:25:38.007916 2552 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 14 17:25:38.531345 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:38.008031 2552 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 14 17:25:38.531345 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:38.008039 2552 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 14 17:25:38.531345 ip-10-0-139-16 kubenswrapper[2552]: E0714 17:25:38.008198 2552 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-16.ec2.internal\" not found" Jul 14 17:25:38.531345 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:38.008675 2552 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 14 17:25:38.531345 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:38.008696 2552 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 14 17:25:38.531345 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:38.008675 2552 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 14 17:25:38.531345 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:38.008820 2552 reconstruct.go:97] "Volume reconstruction finished" Jul 14 17:25:38.531345 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:38.008831 2552 reconciler.go:29] "Reconciler: start to sync state" Jul 14 17:25:38.531345 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:38.008902 2552 factory.go:55] Registering systemd factory Jul 14 17:25:38.531345 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:38.008918 2552 factory.go:223] Registration of the systemd container factory successfully Jul 14 17:25:38.531345 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:38.009172 2552 factory.go:153] Registering CRI-O factory Jul 14 17:25:38.531345 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:38.009186 2552 factory.go:223] Registration of the crio container factory successfully Jul 14 17:25:38.531345 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:38.009244 2552 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 14 17:25:38.531345 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:38.009271 2552 factory.go:103] Registering Raw factory Jul 14 17:25:38.531345 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:38.009285 2552 manager.go:1196] Started watching for new ooms in manager Jul 14 17:25:38.531345 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:38.010236 2552 manager.go:349] Starting recovery of all containers Jul 14 17:25:38.531345 ip-10-0-139-16 kubenswrapper[2552]: E0714 17:25:38.010681 2552 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-139-16.ec2.internal.18c237f7602416ac default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-139-16.ec2.internal,UID:ip-10-0-139-16.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-139-16.ec2.internal,},FirstTimestamp:2026-07-14 17:25:38.001565356 +0000 UTC m=+0.380679299,LastTimestamp:2026-07-14 17:25:38.001565356 +0000 UTC m=+0.380679299,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-139-16.ec2.internal,}" Jul 14 17:25:38.531345 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:38.022283 2552 manager.go:354] Recovery completed Jul 14 17:25:38.531345 ip-10-0-139-16 kubenswrapper[2552]: E0714 17:25:38.024201 2552 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-139-16.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jul 14 17:25:38.531345 ip-10-0-139-16 kubenswrapper[2552]: E0714 17:25:38.024237 2552 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jul 14 17:25:38.531345 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:38.027416 2552 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 14 17:25:38.531345 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:38.029540 2552 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-16.ec2.internal" event="NodeHasSufficientMemory" Jul 14 17:25:38.531345 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:38.029575 2552 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-16.ec2.internal" event="NodeHasNoDiskPressure" Jul 14 17:25:38.531345 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:38.029587 2552 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-16.ec2.internal" event="NodeHasSufficientPID" Jul 14 17:25:38.531345 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:38.030068 2552 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 14 17:25:38.531345 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:38.030078 2552 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 14 17:25:38.531345 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:38.030080 2552 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 14 17:25:38.531345 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:38.030108 2552 state_mem.go:36] "Initialized new in-memory state store" Jul 14 17:25:38.531345 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:38.031405 2552 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-16.ec2.internal" event="NodeHasSufficientMemory" Jul 14 17:25:38.531345 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:38.031450 2552 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-16.ec2.internal" event="NodeHasNoDiskPressure" Jul 14 17:25:38.531345 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:38.031478 2552 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-16.ec2.internal" event="NodeHasSufficientPID" Jul 14 17:25:38.531345 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:38.031539 2552 policy_none.go:49] "None policy: Start" Jul 14 17:25:38.531345 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:38.031552 2552 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 14 17:25:38.531345 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:38.031562 2552 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 14 17:25:38.533531 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:38.032724 2552 policy_none.go:47] "Start" Jul 14 17:25:38.533531 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:38.033306 2552 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-8bn9m" Jul 14 17:25:38.533531 ip-10-0-139-16 kubenswrapper[2552]: E0714 17:25:38.041994 2552 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-139-16.ec2.internal.18c237f761cf3645 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-139-16.ec2.internal,UID:ip-10-0-139-16.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-139-16.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-139-16.ec2.internal,},FirstTimestamp:2026-07-14 17:25:38.029557317 +0000 UTC m=+0.408671266,LastTimestamp:2026-07-14 17:25:38.029557317 +0000 UTC m=+0.408671266,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-139-16.ec2.internal,}" Jul 14 17:25:38.533531 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:38.042726 2552 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-8bn9m" Jul 14 17:25:38.533531 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:38.066913 2552 manager.go:337] "Starting Device Plugin manager" Jul 14 17:25:38.533531 ip-10-0-139-16 kubenswrapper[2552]: E0714 17:25:38.066940 2552 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 14 17:25:38.533531 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:38.066952 2552 server.go:87] "Starting device plugin registration server" Jul 14 17:25:38.533531 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:38.067209 2552 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 14 17:25:38.533531 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:38.067221 2552 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 14 17:25:38.533531 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:38.067309 2552 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 14 17:25:38.533531 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:38.067400 2552 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 14 17:25:38.533531 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:38.067410 2552 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 14 17:25:38.533531 ip-10-0-139-16 kubenswrapper[2552]: E0714 17:25:38.067917 2552 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 14 17:25:38.533531 ip-10-0-139-16 kubenswrapper[2552]: E0714 17:25:38.067958 2552 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-139-16.ec2.internal\" not found" Jul 14 17:25:38.533531 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:38.168294 2552 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 14 17:25:38.533531 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:38.169237 2552 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-16.ec2.internal" event="NodeHasSufficientMemory" Jul 14 17:25:38.533531 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:38.169268 2552 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-16.ec2.internal" event="NodeHasNoDiskPressure" Jul 14 17:25:38.533531 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:38.169283 2552 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-16.ec2.internal" event="NodeHasSufficientPID" Jul 14 17:25:38.533531 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:38.169307 2552 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-139-16.ec2.internal" Jul 14 17:25:38.533531 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:38.343870 2552 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-139-16.ec2.internal" Jul 14 17:25:38.533531 ip-10-0-139-16 kubenswrapper[2552]: E0714 17:25:38.343896 2552 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-139-16.ec2.internal\": node \"ip-10-0-139-16.ec2.internal\" not found" Jul 14 17:25:38.533531 ip-10-0-139-16 kubenswrapper[2552]: E0714 17:25:38.358369 2552 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-16.ec2.internal\" not found" Jul 14 17:25:38.533531 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:38.380543 2552 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 14 17:25:38.533531 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:38.381681 2552 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 14 17:25:38.533531 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:38.381709 2552 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 14 17:25:38.533531 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:38.381727 2552 kubelet.go:2448] "Starting kubelet main sync loop" Jul 14 17:25:38.533531 ip-10-0-139-16 kubenswrapper[2552]: E0714 17:25:38.381754 2552 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jul 14 17:25:38.533531 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:38.384015 2552 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 14 17:25:38.599315 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:38.599125 2552 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-16.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-139-16.ec2.internal"] Jul 14 17:25:38.599447 ip-10-0-139-16 kubenswrapper[2552]: E0714 17:25:38.599138 2552 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-16.ec2.internal\" not found" Jul 14 17:25:38.599447 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:38.599431 2552 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 14 17:25:38.600384 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:38.600360 2552 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-16.ec2.internal" event="NodeHasSufficientMemory" Jul 14 17:25:38.600427 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:38.600397 2552 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-16.ec2.internal" event="NodeHasNoDiskPressure" Jul 14 17:25:38.600427 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:38.600414 2552 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-16.ec2.internal" event="NodeHasSufficientPID" Jul 14 17:25:38.601739 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:38.601727 2552 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 14 17:25:38.601870 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:38.601856 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-16.ec2.internal" Jul 14 17:25:38.601908 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:38.601885 2552 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 14 17:25:38.602465 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:38.602447 2552 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-16.ec2.internal" event="NodeHasSufficientMemory" Jul 14 17:25:38.602532 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:38.602476 2552 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-16.ec2.internal" event="NodeHasNoDiskPressure" Jul 14 17:25:38.602532 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:38.602492 2552 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-16.ec2.internal" event="NodeHasSufficientPID" Jul 14 17:25:38.602532 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:38.602503 2552 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-16.ec2.internal" event="NodeHasSufficientMemory" Jul 14 17:25:38.602532 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:38.602520 2552 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-16.ec2.internal" event="NodeHasNoDiskPressure" Jul 14 17:25:38.602532 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:38.602532 2552 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-16.ec2.internal" event="NodeHasSufficientPID" Jul 14 17:25:38.603930 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:38.603916 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-16.ec2.internal" Jul 14 17:25:38.603992 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:38.603941 2552 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 14 17:25:38.604601 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:38.604585 2552 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-16.ec2.internal" event="NodeHasSufficientMemory" Jul 14 17:25:38.604698 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:38.604612 2552 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-16.ec2.internal" event="NodeHasNoDiskPressure" Jul 14 17:25:38.604698 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:38.604626 2552 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-16.ec2.internal" event="NodeHasSufficientPID" Jul 14 17:25:38.617919 ip-10-0-139-16 kubenswrapper[2552]: E0714 17:25:38.617896 2552 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-139-16.ec2.internal\" not found" node="ip-10-0-139-16.ec2.internal" Jul 14 17:25:38.622424 ip-10-0-139-16 kubenswrapper[2552]: E0714 17:25:38.622409 2552 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-139-16.ec2.internal\" not found" node="ip-10-0-139-16.ec2.internal" Jul 14 17:25:38.700121 ip-10-0-139-16 kubenswrapper[2552]: E0714 17:25:38.700096 2552 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-16.ec2.internal\" not found" Jul 14 17:25:38.700839 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:38.700821 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/771081612d1c7db4aa39e9060dd20e70-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-139-16.ec2.internal\" (UID: \"771081612d1c7db4aa39e9060dd20e70\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-16.ec2.internal" Jul 14 17:25:38.700902 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:38.700847 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/771081612d1c7db4aa39e9060dd20e70-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-139-16.ec2.internal\" (UID: \"771081612d1c7db4aa39e9060dd20e70\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-16.ec2.internal" Jul 14 17:25:38.700902 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:38.700874 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/8df8d47ff6ebf83b9a6270b9d8e65671-config\") pod \"kube-apiserver-proxy-ip-10-0-139-16.ec2.internal\" (UID: \"8df8d47ff6ebf83b9a6270b9d8e65671\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-139-16.ec2.internal" Jul 14 17:25:38.801523 ip-10-0-139-16 kubenswrapper[2552]: E0714 17:25:38.801435 2552 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-16.ec2.internal\" not found" Jul 14 17:25:38.801523 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:38.801464 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/771081612d1c7db4aa39e9060dd20e70-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-139-16.ec2.internal\" (UID: \"771081612d1c7db4aa39e9060dd20e70\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-16.ec2.internal" Jul 14 17:25:38.801523 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:38.801493 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/771081612d1c7db4aa39e9060dd20e70-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-139-16.ec2.internal\" (UID: \"771081612d1c7db4aa39e9060dd20e70\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-16.ec2.internal" Jul 14 17:25:38.801523 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:38.801517 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/8df8d47ff6ebf83b9a6270b9d8e65671-config\") pod \"kube-apiserver-proxy-ip-10-0-139-16.ec2.internal\" (UID: \"8df8d47ff6ebf83b9a6270b9d8e65671\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-139-16.ec2.internal" Jul 14 17:25:38.801738 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:38.801524 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/771081612d1c7db4aa39e9060dd20e70-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-139-16.ec2.internal\" (UID: \"771081612d1c7db4aa39e9060dd20e70\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-16.ec2.internal" Jul 14 17:25:38.801738 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:38.801561 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/8df8d47ff6ebf83b9a6270b9d8e65671-config\") pod \"kube-apiserver-proxy-ip-10-0-139-16.ec2.internal\" (UID: \"8df8d47ff6ebf83b9a6270b9d8e65671\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-139-16.ec2.internal" Jul 14 17:25:38.801738 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:38.801576 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/771081612d1c7db4aa39e9060dd20e70-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-139-16.ec2.internal\" (UID: \"771081612d1c7db4aa39e9060dd20e70\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-16.ec2.internal" Jul 14 17:25:38.902612 ip-10-0-139-16 kubenswrapper[2552]: E0714 17:25:38.902568 2552 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-16.ec2.internal\" not found" Jul 14 17:25:38.919542 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:38.919517 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-16.ec2.internal" Jul 14 17:25:38.925542 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:38.925525 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-16.ec2.internal" Jul 14 17:25:38.945975 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:38.945947 2552 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 14 17:25:38.946379 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:38.946117 2552 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 14 17:25:39.003431 ip-10-0-139-16 kubenswrapper[2552]: E0714 17:25:39.003409 2552 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-16.ec2.internal\" not found" Jul 14 17:25:39.046098 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:39.046060 2552 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-13 17:20:38 +0000 UTC" deadline="2027-12-25 00:03:13.57139281 +0000 UTC" Jul 14 17:25:39.046098 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:39.046092 2552 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="12678h37m34.525303552s" Jul 14 17:25:39.084132 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:39.084076 2552 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 14 17:25:39.103800 ip-10-0-139-16 kubenswrapper[2552]: E0714 17:25:39.103776 2552 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-16.ec2.internal\" not found" Jul 14 17:25:39.152633 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:39.152616 2552 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 14 17:25:39.153545 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:39.153531 2552 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-16.ec2.internal" event="NodeHasSufficientMemory" Jul 14 17:25:39.153607 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:39.153560 2552 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-16.ec2.internal" event="NodeHasNoDiskPressure" Jul 14 17:25:39.153607 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:39.153571 2552 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-16.ec2.internal" event="NodeHasSufficientPID" Jul 14 17:25:39.204651 ip-10-0-139-16 kubenswrapper[2552]: E0714 17:25:39.204623 2552 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-16.ec2.internal\" not found" Jul 14 17:25:39.275622 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:39.275600 2552 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 14 17:25:39.305434 ip-10-0-139-16 kubenswrapper[2552]: E0714 17:25:39.305406 2552 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-16.ec2.internal\" not found" Jul 14 17:25:39.405576 ip-10-0-139-16 kubenswrapper[2552]: E0714 17:25:39.405542 2552 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-16.ec2.internal\" not found" Jul 14 17:25:39.405808 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:39.405759 2552 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 14 17:25:39.408940 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:39.408917 2552 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-16.ec2.internal" Jul 14 17:25:39.422122 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:39.422103 2552 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 14 17:25:39.423157 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:39.423141 2552 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-16.ec2.internal" Jul 14 17:25:39.432542 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:39.432526 2552 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 14 17:25:39.478232 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:25:39.478202 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8df8d47ff6ebf83b9a6270b9d8e65671.slice/crio-44b4c492aff78006d8bc6fabe923730a62e137bdbef0752234727c6dfe72245f WatchSource:0}: Error finding container 44b4c492aff78006d8bc6fabe923730a62e137bdbef0752234727c6dfe72245f: Status 404 returned error can't find the container with id 44b4c492aff78006d8bc6fabe923730a62e137bdbef0752234727c6dfe72245f Jul 14 17:25:39.478435 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:25:39.478419 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod771081612d1c7db4aa39e9060dd20e70.slice/crio-a66ffed40777ffa383587c7abb3bca205916dfcbcf13aed2c918fd9b29062000 WatchSource:0}: Error finding container a66ffed40777ffa383587c7abb3bca205916dfcbcf13aed2c918fd9b29062000: Status 404 returned error can't find the container with id a66ffed40777ffa383587c7abb3bca205916dfcbcf13aed2c918fd9b29062000 Jul 14 17:25:39.484960 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:39.484945 2552 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 14 17:25:39.990069 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:39.990037 2552 apiserver.go:52] "Watching apiserver" Jul 14 17:25:39.998849 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:39.998814 2552 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 14 17:25:39.999392 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:39.999362 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/kube-apiserver-proxy-ip-10-0-139-16.ec2.internal","openshift-image-registry/node-ca-4t8fg","openshift-multus/multus-additional-cni-plugins-5zj72","openshift-multus/multus-qs7cs","openshift-multus/network-metrics-daemon-7prlr","openshift-ovn-kubernetes/ovnkube-node-cwprj","kube-system/global-pull-secret-syncer-c9lb7","kube-system/konnectivity-agent-8r8r6","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-788c5","openshift-cluster-node-tuning-operator/tuned-g4msd","openshift-dns/node-resolver-g4bts","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-16.ec2.internal","openshift-network-diagnostics/network-check-target-vjlpd","openshift-network-operator/iptables-alerter-8wgvc"] Jul 14 17:25:40.001093 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:40.001073 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-c9lb7" Jul 14 17:25:40.001205 ip-10-0-139-16 kubenswrapper[2552]: E0714 17:25:40.001155 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-c9lb7" podUID="91eea036-14a4-466b-9006-5c3f7e104bf4" Jul 14 17:25:40.002270 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:40.002112 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vjlpd" Jul 14 17:25:40.002270 ip-10-0-139-16 kubenswrapper[2552]: E0714 17:25:40.002180 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vjlpd" podUID="5e75c85a-a73f-4890-854a-a8d3baff770b" Jul 14 17:25:40.003370 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:40.003310 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-5zj72" Jul 14 17:25:40.004845 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:40.004827 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-qs7cs" Jul 14 17:25:40.005750 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:40.005729 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 14 17:25:40.005939 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:40.005920 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7prlr" Jul 14 17:25:40.006012 ip-10-0-139-16 kubenswrapper[2552]: E0714 17:25:40.005986 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7prlr" podUID="029a166f-0530-4669-9095-ebe6f46b9d8c" Jul 14 17:25:40.006067 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:40.006034 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-fknmv\"" Jul 14 17:25:40.006102 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:40.006068 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 14 17:25:40.006374 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:40.006355 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 14 17:25:40.006455 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:40.006373 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 14 17:25:40.006455 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:40.006378 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 14 17:25:40.007095 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:40.007050 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 14 17:25:40.007179 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:40.007105 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-l6d42\"" Jul 14 17:25:40.007433 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:40.007416 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-cwprj" Jul 14 17:25:40.008937 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:40.008917 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-788c5" Jul 14 17:25:40.009720 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:40.009699 2552 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 14 17:25:40.010646 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:40.010282 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 14 17:25:40.010646 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:40.010358 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 14 17:25:40.010646 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:40.010427 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 14 17:25:40.010646 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:40.010571 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-lll87\"" Jul 14 17:25:40.010916 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:40.010753 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 14 17:25:40.011189 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:40.011097 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/91eea036-14a4-466b-9006-5c3f7e104bf4-dbus\") pod \"global-pull-secret-syncer-c9lb7\" (UID: \"91eea036-14a4-466b-9006-5c3f7e104bf4\") " pod="kube-system/global-pull-secret-syncer-c9lb7" Jul 14 17:25:40.011189 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:40.011137 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/375c4524-d713-47ea-9179-ad73a0a04604-multus-conf-dir\") pod \"multus-qs7cs\" (UID: \"375c4524-d713-47ea-9179-ad73a0a04604\") " pod="openshift-multus/multus-qs7cs" Jul 14 17:25:40.011308 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:40.011194 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/375c4524-d713-47ea-9179-ad73a0a04604-host-run-multus-certs\") pod \"multus-qs7cs\" (UID: \"375c4524-d713-47ea-9179-ad73a0a04604\") " pod="openshift-multus/multus-qs7cs" Jul 14 17:25:40.011308 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:40.011226 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/375c4524-d713-47ea-9179-ad73a0a04604-cnibin\") pod \"multus-qs7cs\" (UID: \"375c4524-d713-47ea-9179-ad73a0a04604\") " pod="openshift-multus/multus-qs7cs" Jul 14 17:25:40.011308 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:40.011261 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/375c4524-d713-47ea-9179-ad73a0a04604-etc-kubernetes\") pod \"multus-qs7cs\" (UID: \"375c4524-d713-47ea-9179-ad73a0a04604\") " pod="openshift-multus/multus-qs7cs" Jul 14 17:25:40.011308 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:40.011292 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lsnw8\" (UniqueName: \"kubernetes.io/projected/029a166f-0530-4669-9095-ebe6f46b9d8c-kube-api-access-lsnw8\") pod \"network-metrics-daemon-7prlr\" (UID: \"029a166f-0530-4669-9095-ebe6f46b9d8c\") " pod="openshift-multus/network-metrics-daemon-7prlr" Jul 14 17:25:40.011571 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:40.011413 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/375c4524-d713-47ea-9179-ad73a0a04604-host-var-lib-kubelet\") pod \"multus-qs7cs\" (UID: \"375c4524-d713-47ea-9179-ad73a0a04604\") " pod="openshift-multus/multus-qs7cs" Jul 14 17:25:40.011571 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:40.011456 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/375c4524-d713-47ea-9179-ad73a0a04604-multus-daemon-config\") pod \"multus-qs7cs\" (UID: \"375c4524-d713-47ea-9179-ad73a0a04604\") " pod="openshift-multus/multus-qs7cs" Jul 14 17:25:40.011571 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:40.011484 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/870e53a9-7c44-4fd8-866c-7b224a501770-kubelet-dir\") pod \"aws-ebs-csi-driver-node-788c5\" (UID: \"870e53a9-7c44-4fd8-866c-7b224a501770\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-788c5" Jul 14 17:25:40.011571 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:40.011522 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/870e53a9-7c44-4fd8-866c-7b224a501770-socket-dir\") pod \"aws-ebs-csi-driver-node-788c5\" (UID: \"870e53a9-7c44-4fd8-866c-7b224a501770\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-788c5" Jul 14 17:25:40.012314 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:40.011878 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/870e53a9-7c44-4fd8-866c-7b224a501770-registration-dir\") pod \"aws-ebs-csi-driver-node-788c5\" (UID: \"870e53a9-7c44-4fd8-866c-7b224a501770\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-788c5" Jul 14 17:25:40.012314 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:40.011914 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 14 17:25:40.012314 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:40.011931 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 14 17:25:40.012314 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:40.011974 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/91eea036-14a4-466b-9006-5c3f7e104bf4-original-pull-secret\") pod \"global-pull-secret-syncer-c9lb7\" (UID: \"91eea036-14a4-466b-9006-5c3f7e104bf4\") " pod="kube-system/global-pull-secret-syncer-c9lb7" Jul 14 17:25:40.012314 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:40.012071 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/375c4524-d713-47ea-9179-ad73a0a04604-multus-cni-dir\") pod \"multus-qs7cs\" (UID: \"375c4524-d713-47ea-9179-ad73a0a04604\") " pod="openshift-multus/multus-qs7cs" Jul 14 17:25:40.012314 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:40.012112 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/375c4524-d713-47ea-9179-ad73a0a04604-host-var-lib-cni-multus\") pod \"multus-qs7cs\" (UID: \"375c4524-d713-47ea-9179-ad73a0a04604\") " pod="openshift-multus/multus-qs7cs" Jul 14 17:25:40.012314 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:40.012308 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t8ctl\" (UniqueName: \"kubernetes.io/projected/375c4524-d713-47ea-9179-ad73a0a04604-kube-api-access-t8ctl\") pod \"multus-qs7cs\" (UID: \"375c4524-d713-47ea-9179-ad73a0a04604\") " pod="openshift-multus/multus-qs7cs" Jul 14 17:25:40.013046 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:40.012461 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/870e53a9-7c44-4fd8-866c-7b224a501770-device-dir\") pod \"aws-ebs-csi-driver-node-788c5\" (UID: \"870e53a9-7c44-4fd8-866c-7b224a501770\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-788c5" Jul 14 17:25:40.013046 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:40.012471 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 14 17:25:40.013046 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:40.012528 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/375c4524-d713-47ea-9179-ad73a0a04604-system-cni-dir\") pod \"multus-qs7cs\" (UID: \"375c4524-d713-47ea-9179-ad73a0a04604\") " pod="openshift-multus/multus-qs7cs" Jul 14 17:25:40.013046 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:40.012575 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/375c4524-d713-47ea-9179-ad73a0a04604-cni-binary-copy\") pod \"multus-qs7cs\" (UID: \"375c4524-d713-47ea-9179-ad73a0a04604\") " pod="openshift-multus/multus-qs7cs" Jul 14 17:25:40.013046 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:40.012585 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-lzxkm\"" Jul 14 17:25:40.013046 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:40.012605 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/375c4524-d713-47ea-9179-ad73a0a04604-host-run-k8s-cni-cncf-io\") pod \"multus-qs7cs\" (UID: \"375c4524-d713-47ea-9179-ad73a0a04604\") " pod="openshift-multus/multus-qs7cs" Jul 14 17:25:40.013046 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:40.012464 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 14 17:25:40.013046 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:40.012648 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/91eea036-14a4-466b-9006-5c3f7e104bf4-kubelet-config\") pod \"global-pull-secret-syncer-c9lb7\" (UID: \"91eea036-14a4-466b-9006-5c3f7e104bf4\") " pod="kube-system/global-pull-secret-syncer-c9lb7" Jul 14 17:25:40.013046 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:40.012677 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5m5jk\" (UniqueName: \"kubernetes.io/projected/5e75c85a-a73f-4890-854a-a8d3baff770b-kube-api-access-5m5jk\") pod \"network-check-target-vjlpd\" (UID: \"5e75c85a-a73f-4890-854a-a8d3baff770b\") " pod="openshift-network-diagnostics/network-check-target-vjlpd" Jul 14 17:25:40.013046 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:40.012706 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/375c4524-d713-47ea-9179-ad73a0a04604-os-release\") pod \"multus-qs7cs\" (UID: \"375c4524-d713-47ea-9179-ad73a0a04604\") " pod="openshift-multus/multus-qs7cs" Jul 14 17:25:40.013046 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:40.012825 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/375c4524-d713-47ea-9179-ad73a0a04604-host-var-lib-cni-bin\") pod \"multus-qs7cs\" (UID: \"375c4524-d713-47ea-9179-ad73a0a04604\") " pod="openshift-multus/multus-qs7cs" Jul 14 17:25:40.013046 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:40.012854 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/375c4524-d713-47ea-9179-ad73a0a04604-host-run-netns\") pod \"multus-qs7cs\" (UID: \"375c4524-d713-47ea-9179-ad73a0a04604\") " pod="openshift-multus/multus-qs7cs" Jul 14 17:25:40.013046 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:40.012886 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/375c4524-d713-47ea-9179-ad73a0a04604-multus-socket-dir-parent\") pod \"multus-qs7cs\" (UID: \"375c4524-d713-47ea-9179-ad73a0a04604\") " pod="openshift-multus/multus-qs7cs" Jul 14 17:25:40.013542 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:40.013180 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/375c4524-d713-47ea-9179-ad73a0a04604-hostroot\") pod \"multus-qs7cs\" (UID: \"375c4524-d713-47ea-9179-ad73a0a04604\") " pod="openshift-multus/multus-qs7cs" Jul 14 17:25:40.013542 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:40.013489 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/029a166f-0530-4669-9095-ebe6f46b9d8c-metrics-certs\") pod \"network-metrics-daemon-7prlr\" (UID: \"029a166f-0530-4669-9095-ebe6f46b9d8c\") " pod="openshift-multus/network-metrics-daemon-7prlr" Jul 14 17:25:40.013636 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:40.013591 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 14 17:25:40.013867 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:40.013848 2552 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 14 17:25:40.014318 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:40.014296 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-8wgvc" Jul 14 17:25:40.016167 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:40.016147 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-4t8fg" Jul 14 17:25:40.016630 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:40.016608 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 14 17:25:40.016700 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:40.016623 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 14 17:25:40.016745 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:40.016696 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 14 17:25:40.017040 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:40.017024 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-4js4s\"" Jul 14 17:25:40.017790 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:40.017658 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-g4msd" Jul 14 17:25:40.018707 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:40.018671 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 14 17:25:40.018828 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:40.018782 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 14 17:25:40.018941 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:40.018920 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-j4hfm\"" Jul 14 17:25:40.019059 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:40.019025 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-g4bts" Jul 14 17:25:40.019491 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:40.019200 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 14 17:25:40.020048 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:40.020027 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 14 17:25:40.020225 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:40.020207 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 14 17:25:40.020484 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:40.020278 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-fs5tj\"" Jul 14 17:25:40.020576 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:40.020511 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-8r8r6" Jul 14 17:25:40.022053 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:40.021844 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-bv78g\"" Jul 14 17:25:40.022053 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:40.021884 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 14 17:25:40.022306 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:40.022083 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 14 17:25:40.023149 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:40.023091 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-vdhb7\"" Jul 14 17:25:40.024293 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:40.023949 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 14 17:25:40.024293 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:40.023155 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 14 17:25:40.024424 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:40.024384 2552 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 14 17:25:40.044347 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:40.044314 2552 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-jv74h" Jul 14 17:25:40.049810 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:40.049788 2552 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-jv74h" Jul 14 17:25:40.110188 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:40.110163 2552 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 14 17:25:40.114692 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:40.114664 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/375c4524-d713-47ea-9179-ad73a0a04604-system-cni-dir\") pod \"multus-qs7cs\" (UID: \"375c4524-d713-47ea-9179-ad73a0a04604\") " pod="openshift-multus/multus-qs7cs" Jul 14 17:25:40.114803 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:40.114707 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/d3492336-881b-4f13-8d3a-b4d4ec05ad3c-run-systemd\") pod \"ovnkube-node-cwprj\" (UID: \"d3492336-881b-4f13-8d3a-b4d4ec05ad3c\") " pod="openshift-ovn-kubernetes/ovnkube-node-cwprj" Jul 14 17:25:40.114803 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:40.114734 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d3492336-881b-4f13-8d3a-b4d4ec05ad3c-etc-openvswitch\") pod \"ovnkube-node-cwprj\" (UID: \"d3492336-881b-4f13-8d3a-b4d4ec05ad3c\") " pod="openshift-ovn-kubernetes/ovnkube-node-cwprj" Jul 14 17:25:40.114803 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:40.114761 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/91eea036-14a4-466b-9006-5c3f7e104bf4-kubelet-config\") pod \"global-pull-secret-syncer-c9lb7\" (UID: \"91eea036-14a4-466b-9006-5c3f7e104bf4\") " pod="kube-system/global-pull-secret-syncer-c9lb7" Jul 14 17:25:40.114803 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:40.114789 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5m5jk\" (UniqueName: \"kubernetes.io/projected/5e75c85a-a73f-4890-854a-a8d3baff770b-kube-api-access-5m5jk\") pod \"network-check-target-vjlpd\" (UID: \"5e75c85a-a73f-4890-854a-a8d3baff770b\") " pod="openshift-network-diagnostics/network-check-target-vjlpd" Jul 14 17:25:40.114972 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:40.114811 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/375c4524-d713-47ea-9179-ad73a0a04604-os-release\") pod \"multus-qs7cs\" (UID: \"375c4524-d713-47ea-9179-ad73a0a04604\") " pod="openshift-multus/multus-qs7cs" Jul 14 17:25:40.114972 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:40.114835 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/375c4524-d713-47ea-9179-ad73a0a04604-host-var-lib-cni-bin\") pod \"multus-qs7cs\" (UID: \"375c4524-d713-47ea-9179-ad73a0a04604\") " pod="openshift-multus/multus-qs7cs" Jul 14 17:25:40.114972 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:40.114858 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/870e53a9-7c44-4fd8-866c-7b224a501770-sys-fs\") pod \"aws-ebs-csi-driver-node-788c5\" (UID: \"870e53a9-7c44-4fd8-866c-7b224a501770\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-788c5" Jul 14 17:25:40.114972 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:40.114883 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/d84237cc-b659-4943-b3da-ab9f602d4f86-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-5zj72\" (UID: \"d84237cc-b659-4943-b3da-ab9f602d4f86\") " pod="openshift-multus/multus-additional-cni-plugins-5zj72" Jul 14 17:25:40.114972 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:40.114907 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d3492336-881b-4f13-8d3a-b4d4ec05ad3c-var-lib-openvswitch\") pod \"ovnkube-node-cwprj\" (UID: \"d3492336-881b-4f13-8d3a-b4d4ec05ad3c\") " pod="openshift-ovn-kubernetes/ovnkube-node-cwprj" Jul 14 17:25:40.114972 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:40.114930 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d3492336-881b-4f13-8d3a-b4d4ec05ad3c-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-cwprj\" (UID: \"d3492336-881b-4f13-8d3a-b4d4ec05ad3c\") " pod="openshift-ovn-kubernetes/ovnkube-node-cwprj" Jul 14 17:25:40.114972 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:40.114954 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/d3492336-881b-4f13-8d3a-b4d4ec05ad3c-host-cni-netd\") pod \"ovnkube-node-cwprj\" (UID: \"d3492336-881b-4f13-8d3a-b4d4ec05ad3c\") " pod="openshift-ovn-kubernetes/ovnkube-node-cwprj" Jul 14 17:25:40.115296 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:40.114975 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/d3492336-881b-4f13-8d3a-b4d4ec05ad3c-ovnkube-script-lib\") pod \"ovnkube-node-cwprj\" (UID: \"d3492336-881b-4f13-8d3a-b4d4ec05ad3c\") " pod="openshift-ovn-kubernetes/ovnkube-node-cwprj" Jul 14 17:25:40.115296 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:40.114998 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/6f839747-4a79-42e4-81ca-00b3b6645d7f-agent-certs\") pod \"konnectivity-agent-8r8r6\" (UID: \"6f839747-4a79-42e4-81ca-00b3b6645d7f\") " pod="kube-system/konnectivity-agent-8r8r6" Jul 14 17:25:40.115296 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:40.115021 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-klz8g\" (UniqueName: \"kubernetes.io/projected/522da5d4-eacf-4950-ae39-d81bf6277175-kube-api-access-klz8g\") pod \"iptables-alerter-8wgvc\" (UID: \"522da5d4-eacf-4950-ae39-d81bf6277175\") " pod="openshift-network-operator/iptables-alerter-8wgvc" Jul 14 17:25:40.115296 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:40.115046 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4s6rv\" (UniqueName: \"kubernetes.io/projected/5b08dae7-1558-40a0-bb51-702d6974fc28-kube-api-access-4s6rv\") pod \"node-ca-4t8fg\" (UID: \"5b08dae7-1558-40a0-bb51-702d6974fc28\") " pod="openshift-image-registry/node-ca-4t8fg" Jul 14 17:25:40.115296 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:40.115062 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/375c4524-d713-47ea-9179-ad73a0a04604-os-release\") pod \"multus-qs7cs\" (UID: \"375c4524-d713-47ea-9179-ad73a0a04604\") " pod="openshift-multus/multus-qs7cs" Jul 14 17:25:40.115296 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:40.115067 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/ef0b0e1b-a97c-4926-9202-01e81c50ef97-etc-sysctl-conf\") pod \"tuned-g4msd\" (UID: \"ef0b0e1b-a97c-4926-9202-01e81c50ef97\") " pod="openshift-cluster-node-tuning-operator/tuned-g4msd" Jul 14 17:25:40.115296 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:40.115118 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ef0b0e1b-a97c-4926-9202-01e81c50ef97-sys\") pod \"tuned-g4msd\" (UID: \"ef0b0e1b-a97c-4926-9202-01e81c50ef97\") " pod="openshift-cluster-node-tuning-operator/tuned-g4msd" Jul 14 17:25:40.115296 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:40.115155 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/375c4524-d713-47ea-9179-ad73a0a04604-multus-socket-dir-parent\") pod \"multus-qs7cs\" (UID: \"375c4524-d713-47ea-9179-ad73a0a04604\") " pod="openshift-multus/multus-qs7cs" Jul 14 17:25:40.115296 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:40.115180 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/91eea036-14a4-466b-9006-5c3f7e104bf4-kubelet-config\") pod \"global-pull-secret-syncer-c9lb7\" (UID: \"91eea036-14a4-466b-9006-5c3f7e104bf4\") " pod="kube-system/global-pull-secret-syncer-c9lb7" Jul 14 17:25:40.115296 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:40.115184 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/d3492336-881b-4f13-8d3a-b4d4ec05ad3c-node-log\") pod \"ovnkube-node-cwprj\" (UID: \"d3492336-881b-4f13-8d3a-b4d4ec05ad3c\") " pod="openshift-ovn-kubernetes/ovnkube-node-cwprj" Jul 14 17:25:40.115296 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:40.115210 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dvxvp\" (UniqueName: \"kubernetes.io/projected/6a962207-915e-43fc-80f6-3edd2d3451fc-kube-api-access-dvxvp\") pod \"node-resolver-g4bts\" (UID: \"6a962207-915e-43fc-80f6-3edd2d3451fc\") " pod="openshift-dns/node-resolver-g4bts" Jul 14 17:25:40.115296 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:40.115216 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/375c4524-d713-47ea-9179-ad73a0a04604-host-var-lib-cni-bin\") pod \"multus-qs7cs\" (UID: \"375c4524-d713-47ea-9179-ad73a0a04604\") " pod="openshift-multus/multus-qs7cs" Jul 14 17:25:40.115296 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:40.115228 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/375c4524-d713-47ea-9179-ad73a0a04604-system-cni-dir\") pod \"multus-qs7cs\" (UID: \"375c4524-d713-47ea-9179-ad73a0a04604\") " pod="openshift-multus/multus-qs7cs" Jul 14 17:25:40.115296 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:40.115237 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/ef0b0e1b-a97c-4926-9202-01e81c50ef97-run\") pod \"tuned-g4msd\" (UID: \"ef0b0e1b-a97c-4926-9202-01e81c50ef97\") " pod="openshift-cluster-node-tuning-operator/tuned-g4msd" Jul 14 17:25:40.115941 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:40.115267 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/91eea036-14a4-466b-9006-5c3f7e104bf4-dbus\") pod \"global-pull-secret-syncer-c9lb7\" (UID: \"91eea036-14a4-466b-9006-5c3f7e104bf4\") " pod="kube-system/global-pull-secret-syncer-c9lb7" Jul 14 17:25:40.115941 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:40.115321 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/375c4524-d713-47ea-9179-ad73a0a04604-multus-conf-dir\") pod \"multus-qs7cs\" (UID: \"375c4524-d713-47ea-9179-ad73a0a04604\") " pod="openshift-multus/multus-qs7cs" Jul 14 17:25:40.115941 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:40.115366 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/375c4524-d713-47ea-9179-ad73a0a04604-host-run-multus-certs\") pod \"multus-qs7cs\" (UID: \"375c4524-d713-47ea-9179-ad73a0a04604\") " pod="openshift-multus/multus-qs7cs" Jul 14 17:25:40.115941 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:40.115388 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/375c4524-d713-47ea-9179-ad73a0a04604-multus-socket-dir-parent\") pod \"multus-qs7cs\" (UID: \"375c4524-d713-47ea-9179-ad73a0a04604\") " pod="openshift-multus/multus-qs7cs" Jul 14 17:25:40.115941 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:40.115393 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d84237cc-b659-4943-b3da-ab9f602d4f86-system-cni-dir\") pod \"multus-additional-cni-plugins-5zj72\" (UID: \"d84237cc-b659-4943-b3da-ab9f602d4f86\") " pod="openshift-multus/multus-additional-cni-plugins-5zj72" Jul 14 17:25:40.115941 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:40.115421 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/d84237cc-b659-4943-b3da-ab9f602d4f86-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-5zj72\" (UID: \"d84237cc-b659-4943-b3da-ab9f602d4f86\") " pod="openshift-multus/multus-additional-cni-plugins-5zj72" Jul 14 17:25:40.115941 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:40.115447 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vmbbb\" (UniqueName: \"kubernetes.io/projected/d84237cc-b659-4943-b3da-ab9f602d4f86-kube-api-access-vmbbb\") pod \"multus-additional-cni-plugins-5zj72\" (UID: \"d84237cc-b659-4943-b3da-ab9f602d4f86\") " pod="openshift-multus/multus-additional-cni-plugins-5zj72" Jul 14 17:25:40.115941 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:40.115449 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/375c4524-d713-47ea-9179-ad73a0a04604-multus-conf-dir\") pod \"multus-qs7cs\" (UID: \"375c4524-d713-47ea-9179-ad73a0a04604\") " pod="openshift-multus/multus-qs7cs" Jul 14 17:25:40.115941 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:40.115498 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/d3492336-881b-4f13-8d3a-b4d4ec05ad3c-systemd-units\") pod \"ovnkube-node-cwprj\" (UID: \"d3492336-881b-4f13-8d3a-b4d4ec05ad3c\") " pod="openshift-ovn-kubernetes/ovnkube-node-cwprj" Jul 14 17:25:40.115941 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:40.115536 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/375c4524-d713-47ea-9179-ad73a0a04604-host-run-multus-certs\") pod \"multus-qs7cs\" (UID: \"375c4524-d713-47ea-9179-ad73a0a04604\") " pod="openshift-multus/multus-qs7cs" Jul 14 17:25:40.115941 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:40.115563 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/91eea036-14a4-466b-9006-5c3f7e104bf4-dbus\") pod \"global-pull-secret-syncer-c9lb7\" (UID: \"91eea036-14a4-466b-9006-5c3f7e104bf4\") " pod="kube-system/global-pull-secret-syncer-c9lb7" Jul 14 17:25:40.115941 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:40.115579 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/522da5d4-eacf-4950-ae39-d81bf6277175-host-slash\") pod \"iptables-alerter-8wgvc\" (UID: \"522da5d4-eacf-4950-ae39-d81bf6277175\") " pod="openshift-network-operator/iptables-alerter-8wgvc" Jul 14 17:25:40.115941 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:40.115613 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/375c4524-d713-47ea-9179-ad73a0a04604-etc-kubernetes\") pod \"multus-qs7cs\" (UID: \"375c4524-d713-47ea-9179-ad73a0a04604\") " pod="openshift-multus/multus-qs7cs" Jul 14 17:25:40.115941 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:40.115641 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d84237cc-b659-4943-b3da-ab9f602d4f86-cnibin\") pod \"multus-additional-cni-plugins-5zj72\" (UID: \"d84237cc-b659-4943-b3da-ab9f602d4f86\") " pod="openshift-multus/multus-additional-cni-plugins-5zj72" Jul 14 17:25:40.116727 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:40.115677 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6a962207-915e-43fc-80f6-3edd2d3451fc-tmp-dir\") pod \"node-resolver-g4bts\" (UID: \"6a962207-915e-43fc-80f6-3edd2d3451fc\") " pod="openshift-dns/node-resolver-g4bts" Jul 14 17:25:40.116727 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:40.115696 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/375c4524-d713-47ea-9179-ad73a0a04604-etc-kubernetes\") pod \"multus-qs7cs\" (UID: \"375c4524-d713-47ea-9179-ad73a0a04604\") " pod="openshift-multus/multus-qs7cs" Jul 14 17:25:40.116727 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:40.115707 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ef0b0e1b-a97c-4926-9202-01e81c50ef97-host\") pod \"tuned-g4msd\" (UID: \"ef0b0e1b-a97c-4926-9202-01e81c50ef97\") " pod="openshift-cluster-node-tuning-operator/tuned-g4msd" Jul 14 17:25:40.116727 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:40.115740 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7zdx2\" (UniqueName: \"kubernetes.io/projected/ef0b0e1b-a97c-4926-9202-01e81c50ef97-kube-api-access-7zdx2\") pod \"tuned-g4msd\" (UID: \"ef0b0e1b-a97c-4926-9202-01e81c50ef97\") " pod="openshift-cluster-node-tuning-operator/tuned-g4msd" Jul 14 17:25:40.116727 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:40.115772 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/375c4524-d713-47ea-9179-ad73a0a04604-host-var-lib-kubelet\") pod \"multus-qs7cs\" (UID: \"375c4524-d713-47ea-9179-ad73a0a04604\") " pod="openshift-multus/multus-qs7cs" Jul 14 17:25:40.116727 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:40.115797 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/375c4524-d713-47ea-9179-ad73a0a04604-multus-daemon-config\") pod \"multus-qs7cs\" (UID: \"375c4524-d713-47ea-9179-ad73a0a04604\") " pod="openshift-multus/multus-qs7cs" Jul 14 17:25:40.116727 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:40.115852 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/375c4524-d713-47ea-9179-ad73a0a04604-host-var-lib-kubelet\") pod \"multus-qs7cs\" (UID: \"375c4524-d713-47ea-9179-ad73a0a04604\") " pod="openshift-multus/multus-qs7cs" Jul 14 17:25:40.116727 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:40.115900 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/870e53a9-7c44-4fd8-866c-7b224a501770-kubelet-dir\") pod \"aws-ebs-csi-driver-node-788c5\" (UID: \"870e53a9-7c44-4fd8-866c-7b224a501770\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-788c5" Jul 14 17:25:40.116727 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:40.115961 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/870e53a9-7c44-4fd8-866c-7b224a501770-kubelet-dir\") pod \"aws-ebs-csi-driver-node-788c5\" (UID: \"870e53a9-7c44-4fd8-866c-7b224a501770\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-788c5" Jul 14 17:25:40.116727 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:40.116000 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d84237cc-b659-4943-b3da-ab9f602d4f86-tuning-conf-dir\") pod \"multus-additional-cni-plugins-5zj72\" (UID: \"d84237cc-b659-4943-b3da-ab9f602d4f86\") " pod="openshift-multus/multus-additional-cni-plugins-5zj72" Jul 14 17:25:40.116727 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:40.116033 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/d3492336-881b-4f13-8d3a-b4d4ec05ad3c-log-socket\") pod \"ovnkube-node-cwprj\" (UID: \"d3492336-881b-4f13-8d3a-b4d4ec05ad3c\") " pod="openshift-ovn-kubernetes/ovnkube-node-cwprj" Jul 14 17:25:40.116727 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:40.116056 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/d3492336-881b-4f13-8d3a-b4d4ec05ad3c-ovnkube-config\") pod \"ovnkube-node-cwprj\" (UID: \"d3492336-881b-4f13-8d3a-b4d4ec05ad3c\") " pod="openshift-ovn-kubernetes/ovnkube-node-cwprj" Jul 14 17:25:40.116727 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:40.116082 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/6a962207-915e-43fc-80f6-3edd2d3451fc-hosts-file\") pod \"node-resolver-g4bts\" (UID: \"6a962207-915e-43fc-80f6-3edd2d3451fc\") " pod="openshift-dns/node-resolver-g4bts" Jul 14 17:25:40.116727 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:40.116106 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/522da5d4-eacf-4950-ae39-d81bf6277175-iptables-alerter-script\") pod \"iptables-alerter-8wgvc\" (UID: \"522da5d4-eacf-4950-ae39-d81bf6277175\") " pod="openshift-network-operator/iptables-alerter-8wgvc" Jul 14 17:25:40.117383 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:40.116138 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/91eea036-14a4-466b-9006-5c3f7e104bf4-original-pull-secret\") pod \"global-pull-secret-syncer-c9lb7\" (UID: \"91eea036-14a4-466b-9006-5c3f7e104bf4\") " pod="kube-system/global-pull-secret-syncer-c9lb7" Jul 14 17:25:40.117383 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:40.116161 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t8ctl\" (UniqueName: \"kubernetes.io/projected/375c4524-d713-47ea-9179-ad73a0a04604-kube-api-access-t8ctl\") pod \"multus-qs7cs\" (UID: \"375c4524-d713-47ea-9179-ad73a0a04604\") " pod="openshift-multus/multus-qs7cs" Jul 14 17:25:40.117383 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:40.116185 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/870e53a9-7c44-4fd8-866c-7b224a501770-device-dir\") pod \"aws-ebs-csi-driver-node-788c5\" (UID: \"870e53a9-7c44-4fd8-866c-7b224a501770\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-788c5" Jul 14 17:25:40.117383 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:40.116207 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/d3492336-881b-4f13-8d3a-b4d4ec05ad3c-run-ovn\") pod \"ovnkube-node-cwprj\" (UID: \"d3492336-881b-4f13-8d3a-b4d4ec05ad3c\") " pod="openshift-ovn-kubernetes/ovnkube-node-cwprj" Jul 14 17:25:40.117383 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:40.116230 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jm2gx\" (UniqueName: \"kubernetes.io/projected/d3492336-881b-4f13-8d3a-b4d4ec05ad3c-kube-api-access-jm2gx\") pod \"ovnkube-node-cwprj\" (UID: \"d3492336-881b-4f13-8d3a-b4d4ec05ad3c\") " pod="openshift-ovn-kubernetes/ovnkube-node-cwprj" Jul 14 17:25:40.117383 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:40.116252 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/ef0b0e1b-a97c-4926-9202-01e81c50ef97-etc-systemd\") pod \"tuned-g4msd\" (UID: \"ef0b0e1b-a97c-4926-9202-01e81c50ef97\") " pod="openshift-cluster-node-tuning-operator/tuned-g4msd" Jul 14 17:25:40.117383 ip-10-0-139-16 kubenswrapper[2552]: E0714 17:25:40.116271 2552 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 14 17:25:40.117383 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:40.116274 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ef0b0e1b-a97c-4926-9202-01e81c50ef97-var-lib-kubelet\") pod \"tuned-g4msd\" (UID: \"ef0b0e1b-a97c-4926-9202-01e81c50ef97\") " pod="openshift-cluster-node-tuning-operator/tuned-g4msd" Jul 14 17:25:40.117383 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:40.116354 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/375c4524-d713-47ea-9179-ad73a0a04604-multus-daemon-config\") pod \"multus-qs7cs\" (UID: \"375c4524-d713-47ea-9179-ad73a0a04604\") " pod="openshift-multus/multus-qs7cs" Jul 14 17:25:40.117383 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:40.116321 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/375c4524-d713-47ea-9179-ad73a0a04604-cni-binary-copy\") pod \"multus-qs7cs\" (UID: \"375c4524-d713-47ea-9179-ad73a0a04604\") " pod="openshift-multus/multus-qs7cs" Jul 14 17:25:40.117383 ip-10-0-139-16 kubenswrapper[2552]: E0714 17:25:40.116635 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/91eea036-14a4-466b-9006-5c3f7e104bf4-original-pull-secret podName:91eea036-14a4-466b-9006-5c3f7e104bf4 nodeName:}" failed. No retries permitted until 2026-07-14 17:25:40.616581291 +0000 UTC m=+2.995695226 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/91eea036-14a4-466b-9006-5c3f7e104bf4-original-pull-secret") pod "global-pull-secret-syncer-c9lb7" (UID: "91eea036-14a4-466b-9006-5c3f7e104bf4") : object "kube-system"/"original-pull-secret" not registered Jul 14 17:25:40.117383 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:40.116918 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/d3492336-881b-4f13-8d3a-b4d4ec05ad3c-host-kubelet\") pod \"ovnkube-node-cwprj\" (UID: \"d3492336-881b-4f13-8d3a-b4d4ec05ad3c\") " pod="openshift-ovn-kubernetes/ovnkube-node-cwprj" Jul 14 17:25:40.117383 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:40.116959 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d3492336-881b-4f13-8d3a-b4d4ec05ad3c-host-slash\") pod \"ovnkube-node-cwprj\" (UID: \"d3492336-881b-4f13-8d3a-b4d4ec05ad3c\") " pod="openshift-ovn-kubernetes/ovnkube-node-cwprj" Jul 14 17:25:40.117383 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:40.116993 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/5b08dae7-1558-40a0-bb51-702d6974fc28-serviceca\") pod \"node-ca-4t8fg\" (UID: \"5b08dae7-1558-40a0-bb51-702d6974fc28\") " pod="openshift-image-registry/node-ca-4t8fg" Jul 14 17:25:40.118075 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:40.117018 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/ef0b0e1b-a97c-4926-9202-01e81c50ef97-etc-sysconfig\") pod \"tuned-g4msd\" (UID: \"ef0b0e1b-a97c-4926-9202-01e81c50ef97\") " pod="openshift-cluster-node-tuning-operator/tuned-g4msd" Jul 14 17:25:40.118075 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:40.117050 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/ef0b0e1b-a97c-4926-9202-01e81c50ef97-etc-tuned\") pod \"tuned-g4msd\" (UID: \"ef0b0e1b-a97c-4926-9202-01e81c50ef97\") " pod="openshift-cluster-node-tuning-operator/tuned-g4msd" Jul 14 17:25:40.118075 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:40.117078 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ef0b0e1b-a97c-4926-9202-01e81c50ef97-tmp\") pod \"tuned-g4msd\" (UID: \"ef0b0e1b-a97c-4926-9202-01e81c50ef97\") " pod="openshift-cluster-node-tuning-operator/tuned-g4msd" Jul 14 17:25:40.118075 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:40.117114 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/375c4524-d713-47ea-9179-ad73a0a04604-host-run-k8s-cni-cncf-io\") pod \"multus-qs7cs\" (UID: \"375c4524-d713-47ea-9179-ad73a0a04604\") " pod="openshift-multus/multus-qs7cs" Jul 14 17:25:40.118075 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:40.117148 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/d84237cc-b659-4943-b3da-ab9f602d4f86-os-release\") pod \"multus-additional-cni-plugins-5zj72\" (UID: \"d84237cc-b659-4943-b3da-ab9f602d4f86\") " pod="openshift-multus/multus-additional-cni-plugins-5zj72" Jul 14 17:25:40.118075 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:40.117677 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/375c4524-d713-47ea-9179-ad73a0a04604-cni-binary-copy\") pod \"multus-qs7cs\" (UID: \"375c4524-d713-47ea-9179-ad73a0a04604\") " pod="openshift-multus/multus-qs7cs" Jul 14 17:25:40.118075 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:40.117804 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/375c4524-d713-47ea-9179-ad73a0a04604-host-run-k8s-cni-cncf-io\") pod \"multus-qs7cs\" (UID: \"375c4524-d713-47ea-9179-ad73a0a04604\") " pod="openshift-multus/multus-qs7cs" Jul 14 17:25:40.118075 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:40.117173 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d3492336-881b-4f13-8d3a-b4d4ec05ad3c-host-run-netns\") pod \"ovnkube-node-cwprj\" (UID: \"d3492336-881b-4f13-8d3a-b4d4ec05ad3c\") " pod="openshift-ovn-kubernetes/ovnkube-node-cwprj" Jul 14 17:25:40.118475 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:40.118152 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/870e53a9-7c44-4fd8-866c-7b224a501770-device-dir\") pod \"aws-ebs-csi-driver-node-788c5\" (UID: \"870e53a9-7c44-4fd8-866c-7b224a501770\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-788c5" Jul 14 17:25:40.118475 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:40.118192 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ef0b0e1b-a97c-4926-9202-01e81c50ef97-etc-kubernetes\") pod \"tuned-g4msd\" (UID: \"ef0b0e1b-a97c-4926-9202-01e81c50ef97\") " pod="openshift-cluster-node-tuning-operator/tuned-g4msd" Jul 14 17:25:40.118475 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:40.118228 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/375c4524-d713-47ea-9179-ad73a0a04604-host-run-netns\") pod \"multus-qs7cs\" (UID: \"375c4524-d713-47ea-9179-ad73a0a04604\") " pod="openshift-multus/multus-qs7cs" Jul 14 17:25:40.118475 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:40.118262 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d3492336-881b-4f13-8d3a-b4d4ec05ad3c-host-run-ovn-kubernetes\") pod \"ovnkube-node-cwprj\" (UID: \"d3492336-881b-4f13-8d3a-b4d4ec05ad3c\") " pod="openshift-ovn-kubernetes/ovnkube-node-cwprj" Jul 14 17:25:40.118475 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:40.118288 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/5b08dae7-1558-40a0-bb51-702d6974fc28-host\") pod \"node-ca-4t8fg\" (UID: \"5b08dae7-1558-40a0-bb51-702d6974fc28\") " pod="openshift-image-registry/node-ca-4t8fg" Jul 14 17:25:40.118475 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:40.118319 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/375c4524-d713-47ea-9179-ad73a0a04604-hostroot\") pod \"multus-qs7cs\" (UID: \"375c4524-d713-47ea-9179-ad73a0a04604\") " pod="openshift-multus/multus-qs7cs" Jul 14 17:25:40.118475 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:40.118370 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/029a166f-0530-4669-9095-ebe6f46b9d8c-metrics-certs\") pod \"network-metrics-daemon-7prlr\" (UID: \"029a166f-0530-4669-9095-ebe6f46b9d8c\") " pod="openshift-multus/network-metrics-daemon-7prlr" Jul 14 17:25:40.118475 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:40.118400 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/870e53a9-7c44-4fd8-866c-7b224a501770-etc-selinux\") pod \"aws-ebs-csi-driver-node-788c5\" (UID: \"870e53a9-7c44-4fd8-866c-7b224a501770\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-788c5" Jul 14 17:25:40.118475 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:40.118425 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/d3492336-881b-4f13-8d3a-b4d4ec05ad3c-env-overrides\") pod \"ovnkube-node-cwprj\" (UID: \"d3492336-881b-4f13-8d3a-b4d4ec05ad3c\") " pod="openshift-ovn-kubernetes/ovnkube-node-cwprj" Jul 14 17:25:40.118475 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:40.118455 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/d3492336-881b-4f13-8d3a-b4d4ec05ad3c-ovn-node-metrics-cert\") pod \"ovnkube-node-cwprj\" (UID: \"d3492336-881b-4f13-8d3a-b4d4ec05ad3c\") " pod="openshift-ovn-kubernetes/ovnkube-node-cwprj" Jul 14 17:25:40.118930 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:40.118487 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d3492336-881b-4f13-8d3a-b4d4ec05ad3c-run-openvswitch\") pod \"ovnkube-node-cwprj\" (UID: \"d3492336-881b-4f13-8d3a-b4d4ec05ad3c\") " pod="openshift-ovn-kubernetes/ovnkube-node-cwprj" Jul 14 17:25:40.118930 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:40.118524 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/ef0b0e1b-a97c-4926-9202-01e81c50ef97-etc-modprobe-d\") pod \"tuned-g4msd\" (UID: \"ef0b0e1b-a97c-4926-9202-01e81c50ef97\") " pod="openshift-cluster-node-tuning-operator/tuned-g4msd" Jul 14 17:25:40.118930 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:40.118552 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/ef0b0e1b-a97c-4926-9202-01e81c50ef97-etc-sysctl-d\") pod \"tuned-g4msd\" (UID: \"ef0b0e1b-a97c-4926-9202-01e81c50ef97\") " pod="openshift-cluster-node-tuning-operator/tuned-g4msd" Jul 14 17:25:40.118930 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:40.118582 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/375c4524-d713-47ea-9179-ad73a0a04604-cnibin\") pod \"multus-qs7cs\" (UID: \"375c4524-d713-47ea-9179-ad73a0a04604\") " pod="openshift-multus/multus-qs7cs" Jul 14 17:25:40.118930 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:40.118622 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lsnw8\" (UniqueName: \"kubernetes.io/projected/029a166f-0530-4669-9095-ebe6f46b9d8c-kube-api-access-lsnw8\") pod \"network-metrics-daemon-7prlr\" (UID: \"029a166f-0530-4669-9095-ebe6f46b9d8c\") " pod="openshift-multus/network-metrics-daemon-7prlr" Jul 14 17:25:40.118930 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:40.118659 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ef0b0e1b-a97c-4926-9202-01e81c50ef97-lib-modules\") pod \"tuned-g4msd\" (UID: \"ef0b0e1b-a97c-4926-9202-01e81c50ef97\") " pod="openshift-cluster-node-tuning-operator/tuned-g4msd" Jul 14 17:25:40.118930 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:40.118721 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/375c4524-d713-47ea-9179-ad73a0a04604-host-run-netns\") pod \"multus-qs7cs\" (UID: \"375c4524-d713-47ea-9179-ad73a0a04604\") " pod="openshift-multus/multus-qs7cs" Jul 14 17:25:40.118930 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:40.118800 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/375c4524-d713-47ea-9179-ad73a0a04604-hostroot\") pod \"multus-qs7cs\" (UID: \"375c4524-d713-47ea-9179-ad73a0a04604\") " pod="openshift-multus/multus-qs7cs" Jul 14 17:25:40.118930 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:40.118804 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/375c4524-d713-47ea-9179-ad73a0a04604-cnibin\") pod \"multus-qs7cs\" (UID: \"375c4524-d713-47ea-9179-ad73a0a04604\") " pod="openshift-multus/multus-qs7cs" Jul 14 17:25:40.119366 ip-10-0-139-16 kubenswrapper[2552]: E0714 17:25:40.119128 2552 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 14 17:25:40.119366 ip-10-0-139-16 kubenswrapper[2552]: E0714 17:25:40.119188 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/029a166f-0530-4669-9095-ebe6f46b9d8c-metrics-certs podName:029a166f-0530-4669-9095-ebe6f46b9d8c nodeName:}" failed. No retries permitted until 2026-07-14 17:25:40.619170879 +0000 UTC m=+2.998284827 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/029a166f-0530-4669-9095-ebe6f46b9d8c-metrics-certs") pod "network-metrics-daemon-7prlr" (UID: "029a166f-0530-4669-9095-ebe6f46b9d8c") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 14 17:25:40.119366 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:40.119229 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/870e53a9-7c44-4fd8-866c-7b224a501770-socket-dir\") pod \"aws-ebs-csi-driver-node-788c5\" (UID: \"870e53a9-7c44-4fd8-866c-7b224a501770\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-788c5" Jul 14 17:25:40.119366 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:40.119265 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/870e53a9-7c44-4fd8-866c-7b224a501770-registration-dir\") pod \"aws-ebs-csi-driver-node-788c5\" (UID: \"870e53a9-7c44-4fd8-866c-7b224a501770\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-788c5" Jul 14 17:25:40.119366 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:40.119300 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-slttf\" (UniqueName: \"kubernetes.io/projected/870e53a9-7c44-4fd8-866c-7b224a501770-kube-api-access-slttf\") pod \"aws-ebs-csi-driver-node-788c5\" (UID: \"870e53a9-7c44-4fd8-866c-7b224a501770\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-788c5" Jul 14 17:25:40.119366 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:40.119348 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d84237cc-b659-4943-b3da-ab9f602d4f86-cni-binary-copy\") pod \"multus-additional-cni-plugins-5zj72\" (UID: \"d84237cc-b659-4943-b3da-ab9f602d4f86\") " pod="openshift-multus/multus-additional-cni-plugins-5zj72" Jul 14 17:25:40.119658 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:40.119396 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/375c4524-d713-47ea-9179-ad73a0a04604-multus-cni-dir\") pod \"multus-qs7cs\" (UID: \"375c4524-d713-47ea-9179-ad73a0a04604\") " pod="openshift-multus/multus-qs7cs" Jul 14 17:25:40.119658 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:40.119428 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/375c4524-d713-47ea-9179-ad73a0a04604-host-var-lib-cni-multus\") pod \"multus-qs7cs\" (UID: \"375c4524-d713-47ea-9179-ad73a0a04604\") " pod="openshift-multus/multus-qs7cs" Jul 14 17:25:40.119658 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:40.119460 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d3492336-881b-4f13-8d3a-b4d4ec05ad3c-host-cni-bin\") pod \"ovnkube-node-cwprj\" (UID: \"d3492336-881b-4f13-8d3a-b4d4ec05ad3c\") " pod="openshift-ovn-kubernetes/ovnkube-node-cwprj" Jul 14 17:25:40.119658 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:40.119492 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/6f839747-4a79-42e4-81ca-00b3b6645d7f-konnectivity-ca\") pod \"konnectivity-agent-8r8r6\" (UID: \"6f839747-4a79-42e4-81ca-00b3b6645d7f\") " pod="kube-system/konnectivity-agent-8r8r6" Jul 14 17:25:40.119900 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:40.119674 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/870e53a9-7c44-4fd8-866c-7b224a501770-socket-dir\") pod \"aws-ebs-csi-driver-node-788c5\" (UID: \"870e53a9-7c44-4fd8-866c-7b224a501770\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-788c5" Jul 14 17:25:40.119900 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:40.119737 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/870e53a9-7c44-4fd8-866c-7b224a501770-registration-dir\") pod \"aws-ebs-csi-driver-node-788c5\" (UID: \"870e53a9-7c44-4fd8-866c-7b224a501770\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-788c5" Jul 14 17:25:40.119900 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:40.119821 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/375c4524-d713-47ea-9179-ad73a0a04604-multus-cni-dir\") pod \"multus-qs7cs\" (UID: \"375c4524-d713-47ea-9179-ad73a0a04604\") " pod="openshift-multus/multus-qs7cs" Jul 14 17:25:40.119900 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:40.119873 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/375c4524-d713-47ea-9179-ad73a0a04604-host-var-lib-cni-multus\") pod \"multus-qs7cs\" (UID: \"375c4524-d713-47ea-9179-ad73a0a04604\") " pod="openshift-multus/multus-qs7cs" Jul 14 17:25:40.121052 ip-10-0-139-16 kubenswrapper[2552]: E0714 17:25:40.121032 2552 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 14 17:25:40.121197 ip-10-0-139-16 kubenswrapper[2552]: E0714 17:25:40.121062 2552 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 14 17:25:40.121197 ip-10-0-139-16 kubenswrapper[2552]: E0714 17:25:40.121074 2552 projected.go:196] Error preparing data for projected volume kube-api-access-5m5jk for pod openshift-network-diagnostics/network-check-target-vjlpd: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 14 17:25:40.121197 ip-10-0-139-16 kubenswrapper[2552]: E0714 17:25:40.121139 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5e75c85a-a73f-4890-854a-a8d3baff770b-kube-api-access-5m5jk podName:5e75c85a-a73f-4890-854a-a8d3baff770b nodeName:}" failed. No retries permitted until 2026-07-14 17:25:40.62112491 +0000 UTC m=+3.000238854 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-5m5jk" (UniqueName: "kubernetes.io/projected/5e75c85a-a73f-4890-854a-a8d3baff770b-kube-api-access-5m5jk") pod "network-check-target-vjlpd" (UID: "5e75c85a-a73f-4890-854a-a8d3baff770b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 14 17:25:40.124138 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:40.124115 2552 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 14 17:25:40.128908 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:40.128880 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lsnw8\" (UniqueName: \"kubernetes.io/projected/029a166f-0530-4669-9095-ebe6f46b9d8c-kube-api-access-lsnw8\") pod \"network-metrics-daemon-7prlr\" (UID: \"029a166f-0530-4669-9095-ebe6f46b9d8c\") " pod="openshift-multus/network-metrics-daemon-7prlr" Jul 14 17:25:40.129985 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:40.129963 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t8ctl\" (UniqueName: \"kubernetes.io/projected/375c4524-d713-47ea-9179-ad73a0a04604-kube-api-access-t8ctl\") pod \"multus-qs7cs\" (UID: \"375c4524-d713-47ea-9179-ad73a0a04604\") " pod="openshift-multus/multus-qs7cs" Jul 14 17:25:40.221400 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:40.219724 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/d3492336-881b-4f13-8d3a-b4d4ec05ad3c-run-systemd\") pod \"ovnkube-node-cwprj\" (UID: \"d3492336-881b-4f13-8d3a-b4d4ec05ad3c\") " pod="openshift-ovn-kubernetes/ovnkube-node-cwprj" Jul 14 17:25:40.221400 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:40.219766 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d3492336-881b-4f13-8d3a-b4d4ec05ad3c-etc-openvswitch\") pod \"ovnkube-node-cwprj\" (UID: \"d3492336-881b-4f13-8d3a-b4d4ec05ad3c\") " pod="openshift-ovn-kubernetes/ovnkube-node-cwprj" Jul 14 17:25:40.221400 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:40.219807 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/870e53a9-7c44-4fd8-866c-7b224a501770-sys-fs\") pod \"aws-ebs-csi-driver-node-788c5\" (UID: \"870e53a9-7c44-4fd8-866c-7b224a501770\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-788c5" Jul 14 17:25:40.221400 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:40.219853 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/d84237cc-b659-4943-b3da-ab9f602d4f86-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-5zj72\" (UID: \"d84237cc-b659-4943-b3da-ab9f602d4f86\") " pod="openshift-multus/multus-additional-cni-plugins-5zj72" Jul 14 17:25:40.221400 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:40.219879 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d3492336-881b-4f13-8d3a-b4d4ec05ad3c-var-lib-openvswitch\") pod \"ovnkube-node-cwprj\" (UID: \"d3492336-881b-4f13-8d3a-b4d4ec05ad3c\") " pod="openshift-ovn-kubernetes/ovnkube-node-cwprj" Jul 14 17:25:40.221400 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:40.219902 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d3492336-881b-4f13-8d3a-b4d4ec05ad3c-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-cwprj\" (UID: \"d3492336-881b-4f13-8d3a-b4d4ec05ad3c\") " pod="openshift-ovn-kubernetes/ovnkube-node-cwprj" Jul 14 17:25:40.221400 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:40.219926 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/d3492336-881b-4f13-8d3a-b4d4ec05ad3c-host-cni-netd\") pod \"ovnkube-node-cwprj\" (UID: \"d3492336-881b-4f13-8d3a-b4d4ec05ad3c\") " pod="openshift-ovn-kubernetes/ovnkube-node-cwprj" Jul 14 17:25:40.221400 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:40.219948 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/d3492336-881b-4f13-8d3a-b4d4ec05ad3c-ovnkube-script-lib\") pod \"ovnkube-node-cwprj\" (UID: \"d3492336-881b-4f13-8d3a-b4d4ec05ad3c\") " pod="openshift-ovn-kubernetes/ovnkube-node-cwprj" Jul 14 17:25:40.221400 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:40.219970 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/6f839747-4a79-42e4-81ca-00b3b6645d7f-agent-certs\") pod \"konnectivity-agent-8r8r6\" (UID: \"6f839747-4a79-42e4-81ca-00b3b6645d7f\") " pod="kube-system/konnectivity-agent-8r8r6" Jul 14 17:25:40.221400 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:40.219993 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-klz8g\" (UniqueName: \"kubernetes.io/projected/522da5d4-eacf-4950-ae39-d81bf6277175-kube-api-access-klz8g\") pod \"iptables-alerter-8wgvc\" (UID: \"522da5d4-eacf-4950-ae39-d81bf6277175\") " pod="openshift-network-operator/iptables-alerter-8wgvc" Jul 14 17:25:40.221400 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:40.220015 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4s6rv\" (UniqueName: \"kubernetes.io/projected/5b08dae7-1558-40a0-bb51-702d6974fc28-kube-api-access-4s6rv\") pod \"node-ca-4t8fg\" (UID: \"5b08dae7-1558-40a0-bb51-702d6974fc28\") " pod="openshift-image-registry/node-ca-4t8fg" Jul 14 17:25:40.221400 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:40.220038 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/ef0b0e1b-a97c-4926-9202-01e81c50ef97-etc-sysctl-conf\") pod \"tuned-g4msd\" (UID: \"ef0b0e1b-a97c-4926-9202-01e81c50ef97\") " pod="openshift-cluster-node-tuning-operator/tuned-g4msd" Jul 14 17:25:40.221400 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:40.220064 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ef0b0e1b-a97c-4926-9202-01e81c50ef97-sys\") pod \"tuned-g4msd\" (UID: \"ef0b0e1b-a97c-4926-9202-01e81c50ef97\") " pod="openshift-cluster-node-tuning-operator/tuned-g4msd" Jul 14 17:25:40.221400 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:40.220092 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/d3492336-881b-4f13-8d3a-b4d4ec05ad3c-node-log\") pod \"ovnkube-node-cwprj\" (UID: \"d3492336-881b-4f13-8d3a-b4d4ec05ad3c\") " pod="openshift-ovn-kubernetes/ovnkube-node-cwprj" Jul 14 17:25:40.222155 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:40.220114 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dvxvp\" (UniqueName: \"kubernetes.io/projected/6a962207-915e-43fc-80f6-3edd2d3451fc-kube-api-access-dvxvp\") pod \"node-resolver-g4bts\" (UID: \"6a962207-915e-43fc-80f6-3edd2d3451fc\") " pod="openshift-dns/node-resolver-g4bts" Jul 14 17:25:40.222155 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:40.220137 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/ef0b0e1b-a97c-4926-9202-01e81c50ef97-run\") pod \"tuned-g4msd\" (UID: \"ef0b0e1b-a97c-4926-9202-01e81c50ef97\") " pod="openshift-cluster-node-tuning-operator/tuned-g4msd" Jul 14 17:25:40.222155 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:40.220162 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d84237cc-b659-4943-b3da-ab9f602d4f86-system-cni-dir\") pod \"multus-additional-cni-plugins-5zj72\" (UID: \"d84237cc-b659-4943-b3da-ab9f602d4f86\") " pod="openshift-multus/multus-additional-cni-plugins-5zj72" Jul 14 17:25:40.222155 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:40.220186 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/d84237cc-b659-4943-b3da-ab9f602d4f86-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-5zj72\" (UID: \"d84237cc-b659-4943-b3da-ab9f602d4f86\") " pod="openshift-multus/multus-additional-cni-plugins-5zj72" Jul 14 17:25:40.222155 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:40.220210 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vmbbb\" (UniqueName: \"kubernetes.io/projected/d84237cc-b659-4943-b3da-ab9f602d4f86-kube-api-access-vmbbb\") pod \"multus-additional-cni-plugins-5zj72\" (UID: \"d84237cc-b659-4943-b3da-ab9f602d4f86\") " pod="openshift-multus/multus-additional-cni-plugins-5zj72" Jul 14 17:25:40.222155 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:40.220262 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/d3492336-881b-4f13-8d3a-b4d4ec05ad3c-systemd-units\") pod \"ovnkube-node-cwprj\" (UID: \"d3492336-881b-4f13-8d3a-b4d4ec05ad3c\") " pod="openshift-ovn-kubernetes/ovnkube-node-cwprj" Jul 14 17:25:40.222155 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:40.220288 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/522da5d4-eacf-4950-ae39-d81bf6277175-host-slash\") pod \"iptables-alerter-8wgvc\" (UID: \"522da5d4-eacf-4950-ae39-d81bf6277175\") " pod="openshift-network-operator/iptables-alerter-8wgvc" Jul 14 17:25:40.222155 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:40.220317 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d84237cc-b659-4943-b3da-ab9f602d4f86-cnibin\") pod \"multus-additional-cni-plugins-5zj72\" (UID: \"d84237cc-b659-4943-b3da-ab9f602d4f86\") " pod="openshift-multus/multus-additional-cni-plugins-5zj72" Jul 14 17:25:40.222155 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:40.220358 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6a962207-915e-43fc-80f6-3edd2d3451fc-tmp-dir\") pod \"node-resolver-g4bts\" (UID: \"6a962207-915e-43fc-80f6-3edd2d3451fc\") " pod="openshift-dns/node-resolver-g4bts" Jul 14 17:25:40.222155 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:40.220393 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ef0b0e1b-a97c-4926-9202-01e81c50ef97-host\") pod \"tuned-g4msd\" (UID: \"ef0b0e1b-a97c-4926-9202-01e81c50ef97\") " pod="openshift-cluster-node-tuning-operator/tuned-g4msd" Jul 14 17:25:40.222155 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:40.220416 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7zdx2\" (UniqueName: \"kubernetes.io/projected/ef0b0e1b-a97c-4926-9202-01e81c50ef97-kube-api-access-7zdx2\") pod \"tuned-g4msd\" (UID: \"ef0b0e1b-a97c-4926-9202-01e81c50ef97\") " pod="openshift-cluster-node-tuning-operator/tuned-g4msd" Jul 14 17:25:40.222155 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:40.220442 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d84237cc-b659-4943-b3da-ab9f602d4f86-tuning-conf-dir\") pod \"multus-additional-cni-plugins-5zj72\" (UID: \"d84237cc-b659-4943-b3da-ab9f602d4f86\") " pod="openshift-multus/multus-additional-cni-plugins-5zj72" Jul 14 17:25:40.222155 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:40.220469 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/d3492336-881b-4f13-8d3a-b4d4ec05ad3c-log-socket\") pod \"ovnkube-node-cwprj\" (UID: \"d3492336-881b-4f13-8d3a-b4d4ec05ad3c\") " pod="openshift-ovn-kubernetes/ovnkube-node-cwprj" Jul 14 17:25:40.222155 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:40.220491 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/d3492336-881b-4f13-8d3a-b4d4ec05ad3c-ovnkube-config\") pod \"ovnkube-node-cwprj\" (UID: \"d3492336-881b-4f13-8d3a-b4d4ec05ad3c\") " pod="openshift-ovn-kubernetes/ovnkube-node-cwprj" Jul 14 17:25:40.222783 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:40.220514 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/6a962207-915e-43fc-80f6-3edd2d3451fc-hosts-file\") pod \"node-resolver-g4bts\" (UID: \"6a962207-915e-43fc-80f6-3edd2d3451fc\") " pod="openshift-dns/node-resolver-g4bts" Jul 14 17:25:40.222783 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:40.220551 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/522da5d4-eacf-4950-ae39-d81bf6277175-iptables-alerter-script\") pod \"iptables-alerter-8wgvc\" (UID: \"522da5d4-eacf-4950-ae39-d81bf6277175\") " pod="openshift-network-operator/iptables-alerter-8wgvc" Jul 14 17:25:40.222783 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:40.220607 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/d3492336-881b-4f13-8d3a-b4d4ec05ad3c-run-ovn\") pod \"ovnkube-node-cwprj\" (UID: \"d3492336-881b-4f13-8d3a-b4d4ec05ad3c\") " pod="openshift-ovn-kubernetes/ovnkube-node-cwprj" Jul 14 17:25:40.222783 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:40.220635 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jm2gx\" (UniqueName: \"kubernetes.io/projected/d3492336-881b-4f13-8d3a-b4d4ec05ad3c-kube-api-access-jm2gx\") pod \"ovnkube-node-cwprj\" (UID: \"d3492336-881b-4f13-8d3a-b4d4ec05ad3c\") " pod="openshift-ovn-kubernetes/ovnkube-node-cwprj" Jul 14 17:25:40.222783 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:40.220658 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/ef0b0e1b-a97c-4926-9202-01e81c50ef97-etc-systemd\") pod \"tuned-g4msd\" (UID: \"ef0b0e1b-a97c-4926-9202-01e81c50ef97\") " pod="openshift-cluster-node-tuning-operator/tuned-g4msd" Jul 14 17:25:40.222783 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:40.220681 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ef0b0e1b-a97c-4926-9202-01e81c50ef97-var-lib-kubelet\") pod \"tuned-g4msd\" (UID: \"ef0b0e1b-a97c-4926-9202-01e81c50ef97\") " pod="openshift-cluster-node-tuning-operator/tuned-g4msd" Jul 14 17:25:40.222783 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:40.220706 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/d3492336-881b-4f13-8d3a-b4d4ec05ad3c-host-kubelet\") pod \"ovnkube-node-cwprj\" (UID: \"d3492336-881b-4f13-8d3a-b4d4ec05ad3c\") " pod="openshift-ovn-kubernetes/ovnkube-node-cwprj" Jul 14 17:25:40.222783 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:40.220729 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d3492336-881b-4f13-8d3a-b4d4ec05ad3c-host-slash\") pod \"ovnkube-node-cwprj\" (UID: \"d3492336-881b-4f13-8d3a-b4d4ec05ad3c\") " pod="openshift-ovn-kubernetes/ovnkube-node-cwprj" Jul 14 17:25:40.222783 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:40.220760 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/5b08dae7-1558-40a0-bb51-702d6974fc28-serviceca\") pod \"node-ca-4t8fg\" (UID: \"5b08dae7-1558-40a0-bb51-702d6974fc28\") " pod="openshift-image-registry/node-ca-4t8fg" Jul 14 17:25:40.222783 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:40.220782 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/ef0b0e1b-a97c-4926-9202-01e81c50ef97-etc-sysconfig\") pod \"tuned-g4msd\" (UID: \"ef0b0e1b-a97c-4926-9202-01e81c50ef97\") " pod="openshift-cluster-node-tuning-operator/tuned-g4msd" Jul 14 17:25:40.222783 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:40.220831 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/ef0b0e1b-a97c-4926-9202-01e81c50ef97-etc-tuned\") pod \"tuned-g4msd\" (UID: \"ef0b0e1b-a97c-4926-9202-01e81c50ef97\") " pod="openshift-cluster-node-tuning-operator/tuned-g4msd" Jul 14 17:25:40.222783 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:40.220834 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/d3492336-881b-4f13-8d3a-b4d4ec05ad3c-host-cni-netd\") pod \"ovnkube-node-cwprj\" (UID: \"d3492336-881b-4f13-8d3a-b4d4ec05ad3c\") " pod="openshift-ovn-kubernetes/ovnkube-node-cwprj" Jul 14 17:25:40.222783 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:40.220852 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ef0b0e1b-a97c-4926-9202-01e81c50ef97-tmp\") pod \"tuned-g4msd\" (UID: \"ef0b0e1b-a97c-4926-9202-01e81c50ef97\") " pod="openshift-cluster-node-tuning-operator/tuned-g4msd" Jul 14 17:25:40.222783 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:40.220887 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/d3492336-881b-4f13-8d3a-b4d4ec05ad3c-run-systemd\") pod \"ovnkube-node-cwprj\" (UID: \"d3492336-881b-4f13-8d3a-b4d4ec05ad3c\") " pod="openshift-ovn-kubernetes/ovnkube-node-cwprj" Jul 14 17:25:40.222783 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:40.220892 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/d84237cc-b659-4943-b3da-ab9f602d4f86-os-release\") pod \"multus-additional-cni-plugins-5zj72\" (UID: \"d84237cc-b659-4943-b3da-ab9f602d4f86\") " pod="openshift-multus/multus-additional-cni-plugins-5zj72" Jul 14 17:25:40.223494 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:40.220898 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d84237cc-b659-4943-b3da-ab9f602d4f86-tuning-conf-dir\") pod \"multus-additional-cni-plugins-5zj72\" (UID: \"d84237cc-b659-4943-b3da-ab9f602d4f86\") " pod="openshift-multus/multus-additional-cni-plugins-5zj72" Jul 14 17:25:40.223494 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:40.220921 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d3492336-881b-4f13-8d3a-b4d4ec05ad3c-host-run-netns\") pod \"ovnkube-node-cwprj\" (UID: \"d3492336-881b-4f13-8d3a-b4d4ec05ad3c\") " pod="openshift-ovn-kubernetes/ovnkube-node-cwprj" Jul 14 17:25:40.223494 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:40.220926 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d3492336-881b-4f13-8d3a-b4d4ec05ad3c-etc-openvswitch\") pod \"ovnkube-node-cwprj\" (UID: \"d3492336-881b-4f13-8d3a-b4d4ec05ad3c\") " pod="openshift-ovn-kubernetes/ovnkube-node-cwprj" Jul 14 17:25:40.223494 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:40.220946 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/ef0b0e1b-a97c-4926-9202-01e81c50ef97-run\") pod \"tuned-g4msd\" (UID: \"ef0b0e1b-a97c-4926-9202-01e81c50ef97\") " pod="openshift-cluster-node-tuning-operator/tuned-g4msd" Jul 14 17:25:40.223494 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:40.220963 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d3492336-881b-4f13-8d3a-b4d4ec05ad3c-host-run-netns\") pod \"ovnkube-node-cwprj\" (UID: \"d3492336-881b-4f13-8d3a-b4d4ec05ad3c\") " pod="openshift-ovn-kubernetes/ovnkube-node-cwprj" Jul 14 17:25:40.223494 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:40.220971 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/d3492336-881b-4f13-8d3a-b4d4ec05ad3c-log-socket\") pod \"ovnkube-node-cwprj\" (UID: \"d3492336-881b-4f13-8d3a-b4d4ec05ad3c\") " pod="openshift-ovn-kubernetes/ovnkube-node-cwprj" Jul 14 17:25:40.223494 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:40.221411 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/d84237cc-b659-4943-b3da-ab9f602d4f86-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-5zj72\" (UID: \"d84237cc-b659-4943-b3da-ab9f602d4f86\") " pod="openshift-multus/multus-additional-cni-plugins-5zj72" Jul 14 17:25:40.223494 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:40.221447 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/d3492336-881b-4f13-8d3a-b4d4ec05ad3c-ovnkube-script-lib\") pod \"ovnkube-node-cwprj\" (UID: \"d3492336-881b-4f13-8d3a-b4d4ec05ad3c\") " pod="openshift-ovn-kubernetes/ovnkube-node-cwprj" Jul 14 17:25:40.223494 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:40.221479 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/d84237cc-b659-4943-b3da-ab9f602d4f86-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-5zj72\" (UID: \"d84237cc-b659-4943-b3da-ab9f602d4f86\") " pod="openshift-multus/multus-additional-cni-plugins-5zj72" Jul 14 17:25:40.223494 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:40.221566 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/d3492336-881b-4f13-8d3a-b4d4ec05ad3c-node-log\") pod \"ovnkube-node-cwprj\" (UID: \"d3492336-881b-4f13-8d3a-b4d4ec05ad3c\") " pod="openshift-ovn-kubernetes/ovnkube-node-cwprj" Jul 14 17:25:40.223494 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:40.221580 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/ef0b0e1b-a97c-4926-9202-01e81c50ef97-etc-systemd\") pod \"tuned-g4msd\" (UID: \"ef0b0e1b-a97c-4926-9202-01e81c50ef97\") " pod="openshift-cluster-node-tuning-operator/tuned-g4msd" Jul 14 17:25:40.223494 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:40.221633 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ef0b0e1b-a97c-4926-9202-01e81c50ef97-var-lib-kubelet\") pod \"tuned-g4msd\" (UID: \"ef0b0e1b-a97c-4926-9202-01e81c50ef97\") " pod="openshift-cluster-node-tuning-operator/tuned-g4msd" Jul 14 17:25:40.223494 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:40.221657 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/d3492336-881b-4f13-8d3a-b4d4ec05ad3c-systemd-units\") pod \"ovnkube-node-cwprj\" (UID: \"d3492336-881b-4f13-8d3a-b4d4ec05ad3c\") " pod="openshift-ovn-kubernetes/ovnkube-node-cwprj" Jul 14 17:25:40.223494 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:40.221674 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/d3492336-881b-4f13-8d3a-b4d4ec05ad3c-host-kubelet\") pod \"ovnkube-node-cwprj\" (UID: \"d3492336-881b-4f13-8d3a-b4d4ec05ad3c\") " pod="openshift-ovn-kubernetes/ovnkube-node-cwprj" Jul 14 17:25:40.223494 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:40.221709 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/522da5d4-eacf-4950-ae39-d81bf6277175-host-slash\") pod \"iptables-alerter-8wgvc\" (UID: \"522da5d4-eacf-4950-ae39-d81bf6277175\") " pod="openshift-network-operator/iptables-alerter-8wgvc" Jul 14 17:25:40.224185 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:40.221709 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d3492336-881b-4f13-8d3a-b4d4ec05ad3c-var-lib-openvswitch\") pod \"ovnkube-node-cwprj\" (UID: \"d3492336-881b-4f13-8d3a-b4d4ec05ad3c\") " pod="openshift-ovn-kubernetes/ovnkube-node-cwprj" Jul 14 17:25:40.224185 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:40.221717 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d3492336-881b-4f13-8d3a-b4d4ec05ad3c-host-slash\") pod \"ovnkube-node-cwprj\" (UID: \"d3492336-881b-4f13-8d3a-b4d4ec05ad3c\") " pod="openshift-ovn-kubernetes/ovnkube-node-cwprj" Jul 14 17:25:40.224185 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:40.221745 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d3492336-881b-4f13-8d3a-b4d4ec05ad3c-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-cwprj\" (UID: \"d3492336-881b-4f13-8d3a-b4d4ec05ad3c\") " pod="openshift-ovn-kubernetes/ovnkube-node-cwprj" Jul 14 17:25:40.224185 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:40.221756 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d84237cc-b659-4943-b3da-ab9f602d4f86-cnibin\") pod \"multus-additional-cni-plugins-5zj72\" (UID: \"d84237cc-b659-4943-b3da-ab9f602d4f86\") " pod="openshift-multus/multus-additional-cni-plugins-5zj72" Jul 14 17:25:40.224185 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:40.221789 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ef0b0e1b-a97c-4926-9202-01e81c50ef97-etc-kubernetes\") pod \"tuned-g4msd\" (UID: \"ef0b0e1b-a97c-4926-9202-01e81c50ef97\") " pod="openshift-cluster-node-tuning-operator/tuned-g4msd" Jul 14 17:25:40.224185 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:40.221811 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ef0b0e1b-a97c-4926-9202-01e81c50ef97-host\") pod \"tuned-g4msd\" (UID: \"ef0b0e1b-a97c-4926-9202-01e81c50ef97\") " pod="openshift-cluster-node-tuning-operator/tuned-g4msd" Jul 14 17:25:40.224185 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:40.221819 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d3492336-881b-4f13-8d3a-b4d4ec05ad3c-host-run-ovn-kubernetes\") pod \"ovnkube-node-cwprj\" (UID: \"d3492336-881b-4f13-8d3a-b4d4ec05ad3c\") " pod="openshift-ovn-kubernetes/ovnkube-node-cwprj" Jul 14 17:25:40.224185 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:40.221834 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/ef0b0e1b-a97c-4926-9202-01e81c50ef97-etc-sysctl-conf\") pod \"tuned-g4msd\" (UID: \"ef0b0e1b-a97c-4926-9202-01e81c50ef97\") " pod="openshift-cluster-node-tuning-operator/tuned-g4msd" Jul 14 17:25:40.224185 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:40.221843 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/5b08dae7-1558-40a0-bb51-702d6974fc28-host\") pod \"node-ca-4t8fg\" (UID: \"5b08dae7-1558-40a0-bb51-702d6974fc28\") " pod="openshift-image-registry/node-ca-4t8fg" Jul 14 17:25:40.224185 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:40.221882 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/870e53a9-7c44-4fd8-866c-7b224a501770-etc-selinux\") pod \"aws-ebs-csi-driver-node-788c5\" (UID: \"870e53a9-7c44-4fd8-866c-7b224a501770\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-788c5" Jul 14 17:25:40.224185 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:40.221980 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/d3492336-881b-4f13-8d3a-b4d4ec05ad3c-env-overrides\") pod \"ovnkube-node-cwprj\" (UID: \"d3492336-881b-4f13-8d3a-b4d4ec05ad3c\") " pod="openshift-ovn-kubernetes/ovnkube-node-cwprj" Jul 14 17:25:40.224185 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:40.222008 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/d3492336-881b-4f13-8d3a-b4d4ec05ad3c-ovn-node-metrics-cert\") pod \"ovnkube-node-cwprj\" (UID: \"d3492336-881b-4f13-8d3a-b4d4ec05ad3c\") " pod="openshift-ovn-kubernetes/ovnkube-node-cwprj" Jul 14 17:25:40.224185 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:40.222036 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d3492336-881b-4f13-8d3a-b4d4ec05ad3c-run-openvswitch\") pod \"ovnkube-node-cwprj\" (UID: \"d3492336-881b-4f13-8d3a-b4d4ec05ad3c\") " pod="openshift-ovn-kubernetes/ovnkube-node-cwprj" Jul 14 17:25:40.224185 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:40.222038 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/870e53a9-7c44-4fd8-866c-7b224a501770-sys-fs\") pod \"aws-ebs-csi-driver-node-788c5\" (UID: \"870e53a9-7c44-4fd8-866c-7b224a501770\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-788c5" Jul 14 17:25:40.224845 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:40.222060 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/ef0b0e1b-a97c-4926-9202-01e81c50ef97-etc-modprobe-d\") pod \"tuned-g4msd\" (UID: \"ef0b0e1b-a97c-4926-9202-01e81c50ef97\") " pod="openshift-cluster-node-tuning-operator/tuned-g4msd" Jul 14 17:25:40.224845 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:40.222085 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/ef0b0e1b-a97c-4926-9202-01e81c50ef97-etc-sysctl-d\") pod \"tuned-g4msd\" (UID: \"ef0b0e1b-a97c-4926-9202-01e81c50ef97\") " pod="openshift-cluster-node-tuning-operator/tuned-g4msd" Jul 14 17:25:40.224845 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:40.222096 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ef0b0e1b-a97c-4926-9202-01e81c50ef97-etc-kubernetes\") pod \"tuned-g4msd\" (UID: \"ef0b0e1b-a97c-4926-9202-01e81c50ef97\") " pod="openshift-cluster-node-tuning-operator/tuned-g4msd" Jul 14 17:25:40.224845 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:40.222113 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ef0b0e1b-a97c-4926-9202-01e81c50ef97-lib-modules\") pod \"tuned-g4msd\" (UID: \"ef0b0e1b-a97c-4926-9202-01e81c50ef97\") " pod="openshift-cluster-node-tuning-operator/tuned-g4msd" Jul 14 17:25:40.224845 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:40.222131 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/522da5d4-eacf-4950-ae39-d81bf6277175-iptables-alerter-script\") pod \"iptables-alerter-8wgvc\" (UID: \"522da5d4-eacf-4950-ae39-d81bf6277175\") " pod="openshift-network-operator/iptables-alerter-8wgvc" Jul 14 17:25:40.224845 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:40.222144 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ef0b0e1b-a97c-4926-9202-01e81c50ef97-sys\") pod \"tuned-g4msd\" (UID: \"ef0b0e1b-a97c-4926-9202-01e81c50ef97\") " pod="openshift-cluster-node-tuning-operator/tuned-g4msd" Jul 14 17:25:40.224845 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:40.222143 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-slttf\" (UniqueName: \"kubernetes.io/projected/870e53a9-7c44-4fd8-866c-7b224a501770-kube-api-access-slttf\") pod \"aws-ebs-csi-driver-node-788c5\" (UID: \"870e53a9-7c44-4fd8-866c-7b224a501770\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-788c5" Jul 14 17:25:40.224845 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:40.222179 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d84237cc-b659-4943-b3da-ab9f602d4f86-cni-binary-copy\") pod \"multus-additional-cni-plugins-5zj72\" (UID: \"d84237cc-b659-4943-b3da-ab9f602d4f86\") " pod="openshift-multus/multus-additional-cni-plugins-5zj72" Jul 14 17:25:40.224845 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:40.222211 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d3492336-881b-4f13-8d3a-b4d4ec05ad3c-host-cni-bin\") pod \"ovnkube-node-cwprj\" (UID: \"d3492336-881b-4f13-8d3a-b4d4ec05ad3c\") " pod="openshift-ovn-kubernetes/ovnkube-node-cwprj" Jul 14 17:25:40.224845 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:40.222226 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/d84237cc-b659-4943-b3da-ab9f602d4f86-os-release\") pod \"multus-additional-cni-plugins-5zj72\" (UID: \"d84237cc-b659-4943-b3da-ab9f602d4f86\") " pod="openshift-multus/multus-additional-cni-plugins-5zj72" Jul 14 17:25:40.224845 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:40.222236 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/6f839747-4a79-42e4-81ca-00b3b6645d7f-konnectivity-ca\") pod \"konnectivity-agent-8r8r6\" (UID: \"6f839747-4a79-42e4-81ca-00b3b6645d7f\") " pod="kube-system/konnectivity-agent-8r8r6" Jul 14 17:25:40.224845 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:40.220975 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d84237cc-b659-4943-b3da-ab9f602d4f86-system-cni-dir\") pod \"multus-additional-cni-plugins-5zj72\" (UID: \"d84237cc-b659-4943-b3da-ab9f602d4f86\") " pod="openshift-multus/multus-additional-cni-plugins-5zj72" Jul 14 17:25:40.224845 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:40.222441 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/ef0b0e1b-a97c-4926-9202-01e81c50ef97-etc-sysconfig\") pod \"tuned-g4msd\" (UID: \"ef0b0e1b-a97c-4926-9202-01e81c50ef97\") " pod="openshift-cluster-node-tuning-operator/tuned-g4msd" Jul 14 17:25:40.224845 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:40.222585 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/ef0b0e1b-a97c-4926-9202-01e81c50ef97-etc-sysctl-d\") pod \"tuned-g4msd\" (UID: \"ef0b0e1b-a97c-4926-9202-01e81c50ef97\") " pod="openshift-cluster-node-tuning-operator/tuned-g4msd" Jul 14 17:25:40.225545 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:40.222596 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/5b08dae7-1558-40a0-bb51-702d6974fc28-serviceca\") pod \"node-ca-4t8fg\" (UID: \"5b08dae7-1558-40a0-bb51-702d6974fc28\") " pod="openshift-image-registry/node-ca-4t8fg" Jul 14 17:25:40.225545 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:40.222695 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ef0b0e1b-a97c-4926-9202-01e81c50ef97-lib-modules\") pod \"tuned-g4msd\" (UID: \"ef0b0e1b-a97c-4926-9202-01e81c50ef97\") " pod="openshift-cluster-node-tuning-operator/tuned-g4msd" Jul 14 17:25:40.225545 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:40.222729 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/d3492336-881b-4f13-8d3a-b4d4ec05ad3c-ovnkube-config\") pod \"ovnkube-node-cwprj\" (UID: \"d3492336-881b-4f13-8d3a-b4d4ec05ad3c\") " pod="openshift-ovn-kubernetes/ovnkube-node-cwprj" Jul 14 17:25:40.225545 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:40.222974 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6a962207-915e-43fc-80f6-3edd2d3451fc-tmp-dir\") pod \"node-resolver-g4bts\" (UID: \"6a962207-915e-43fc-80f6-3edd2d3451fc\") " pod="openshift-dns/node-resolver-g4bts" Jul 14 17:25:40.225545 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:40.223064 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/6a962207-915e-43fc-80f6-3edd2d3451fc-hosts-file\") pod \"node-resolver-g4bts\" (UID: \"6a962207-915e-43fc-80f6-3edd2d3451fc\") " pod="openshift-dns/node-resolver-g4bts" Jul 14 17:25:40.225545 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:40.223257 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d3492336-881b-4f13-8d3a-b4d4ec05ad3c-host-cni-bin\") pod \"ovnkube-node-cwprj\" (UID: \"d3492336-881b-4f13-8d3a-b4d4ec05ad3c\") " pod="openshift-ovn-kubernetes/ovnkube-node-cwprj" Jul 14 17:25:40.225545 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:40.223758 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/6f839747-4a79-42e4-81ca-00b3b6645d7f-konnectivity-ca\") pod \"konnectivity-agent-8r8r6\" (UID: \"6f839747-4a79-42e4-81ca-00b3b6645d7f\") " pod="kube-system/konnectivity-agent-8r8r6" Jul 14 17:25:40.225545 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:40.223880 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/870e53a9-7c44-4fd8-866c-7b224a501770-etc-selinux\") pod \"aws-ebs-csi-driver-node-788c5\" (UID: \"870e53a9-7c44-4fd8-866c-7b224a501770\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-788c5" Jul 14 17:25:40.225545 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:40.223921 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d3492336-881b-4f13-8d3a-b4d4ec05ad3c-host-run-ovn-kubernetes\") pod \"ovnkube-node-cwprj\" (UID: \"d3492336-881b-4f13-8d3a-b4d4ec05ad3c\") " pod="openshift-ovn-kubernetes/ovnkube-node-cwprj" Jul 14 17:25:40.225545 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:40.223962 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/5b08dae7-1558-40a0-bb51-702d6974fc28-host\") pod \"node-ca-4t8fg\" (UID: \"5b08dae7-1558-40a0-bb51-702d6974fc28\") " pod="openshift-image-registry/node-ca-4t8fg" Jul 14 17:25:40.225545 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:40.224001 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/d3492336-881b-4f13-8d3a-b4d4ec05ad3c-run-ovn\") pod \"ovnkube-node-cwprj\" (UID: \"d3492336-881b-4f13-8d3a-b4d4ec05ad3c\") " pod="openshift-ovn-kubernetes/ovnkube-node-cwprj" Jul 14 17:25:40.225545 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:40.224338 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/d3492336-881b-4f13-8d3a-b4d4ec05ad3c-env-overrides\") pod \"ovnkube-node-cwprj\" (UID: \"d3492336-881b-4f13-8d3a-b4d4ec05ad3c\") " pod="openshift-ovn-kubernetes/ovnkube-node-cwprj" Jul 14 17:25:40.225545 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:40.224390 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d3492336-881b-4f13-8d3a-b4d4ec05ad3c-run-openvswitch\") pod \"ovnkube-node-cwprj\" (UID: \"d3492336-881b-4f13-8d3a-b4d4ec05ad3c\") " pod="openshift-ovn-kubernetes/ovnkube-node-cwprj" Jul 14 17:25:40.225545 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:40.224454 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d84237cc-b659-4943-b3da-ab9f602d4f86-cni-binary-copy\") pod \"multus-additional-cni-plugins-5zj72\" (UID: \"d84237cc-b659-4943-b3da-ab9f602d4f86\") " pod="openshift-multus/multus-additional-cni-plugins-5zj72" Jul 14 17:25:40.225545 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:40.224595 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/ef0b0e1b-a97c-4926-9202-01e81c50ef97-etc-modprobe-d\") pod \"tuned-g4msd\" (UID: \"ef0b0e1b-a97c-4926-9202-01e81c50ef97\") " pod="openshift-cluster-node-tuning-operator/tuned-g4msd" Jul 14 17:25:40.226524 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:40.226483 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/ef0b0e1b-a97c-4926-9202-01e81c50ef97-etc-tuned\") pod \"tuned-g4msd\" (UID: \"ef0b0e1b-a97c-4926-9202-01e81c50ef97\") " pod="openshift-cluster-node-tuning-operator/tuned-g4msd" Jul 14 17:25:40.226844 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:40.226530 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/d3492336-881b-4f13-8d3a-b4d4ec05ad3c-ovn-node-metrics-cert\") pod \"ovnkube-node-cwprj\" (UID: \"d3492336-881b-4f13-8d3a-b4d4ec05ad3c\") " pod="openshift-ovn-kubernetes/ovnkube-node-cwprj" Jul 14 17:25:40.226844 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:40.226721 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ef0b0e1b-a97c-4926-9202-01e81c50ef97-tmp\") pod \"tuned-g4msd\" (UID: \"ef0b0e1b-a97c-4926-9202-01e81c50ef97\") " pod="openshift-cluster-node-tuning-operator/tuned-g4msd" Jul 14 17:25:40.228590 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:40.228535 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/6f839747-4a79-42e4-81ca-00b3b6645d7f-agent-certs\") pod \"konnectivity-agent-8r8r6\" (UID: \"6f839747-4a79-42e4-81ca-00b3b6645d7f\") " pod="kube-system/konnectivity-agent-8r8r6" Jul 14 17:25:40.229188 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:40.229115 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dvxvp\" (UniqueName: \"kubernetes.io/projected/6a962207-915e-43fc-80f6-3edd2d3451fc-kube-api-access-dvxvp\") pod \"node-resolver-g4bts\" (UID: \"6a962207-915e-43fc-80f6-3edd2d3451fc\") " pod="openshift-dns/node-resolver-g4bts" Jul 14 17:25:40.229719 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:40.229693 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jm2gx\" (UniqueName: \"kubernetes.io/projected/d3492336-881b-4f13-8d3a-b4d4ec05ad3c-kube-api-access-jm2gx\") pod \"ovnkube-node-cwprj\" (UID: \"d3492336-881b-4f13-8d3a-b4d4ec05ad3c\") " pod="openshift-ovn-kubernetes/ovnkube-node-cwprj" Jul 14 17:25:40.229808 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:40.229782 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vmbbb\" (UniqueName: \"kubernetes.io/projected/d84237cc-b659-4943-b3da-ab9f602d4f86-kube-api-access-vmbbb\") pod \"multus-additional-cni-plugins-5zj72\" (UID: \"d84237cc-b659-4943-b3da-ab9f602d4f86\") " pod="openshift-multus/multus-additional-cni-plugins-5zj72" Jul 14 17:25:40.230057 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:40.230014 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7zdx2\" (UniqueName: \"kubernetes.io/projected/ef0b0e1b-a97c-4926-9202-01e81c50ef97-kube-api-access-7zdx2\") pod \"tuned-g4msd\" (UID: \"ef0b0e1b-a97c-4926-9202-01e81c50ef97\") " pod="openshift-cluster-node-tuning-operator/tuned-g4msd" Jul 14 17:25:40.230364 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:40.230345 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4s6rv\" (UniqueName: \"kubernetes.io/projected/5b08dae7-1558-40a0-bb51-702d6974fc28-kube-api-access-4s6rv\") pod \"node-ca-4t8fg\" (UID: \"5b08dae7-1558-40a0-bb51-702d6974fc28\") " pod="openshift-image-registry/node-ca-4t8fg" Jul 14 17:25:40.231298 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:40.231276 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-klz8g\" (UniqueName: \"kubernetes.io/projected/522da5d4-eacf-4950-ae39-d81bf6277175-kube-api-access-klz8g\") pod \"iptables-alerter-8wgvc\" (UID: \"522da5d4-eacf-4950-ae39-d81bf6277175\") " pod="openshift-network-operator/iptables-alerter-8wgvc" Jul 14 17:25:40.231407 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:40.231387 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-slttf\" (UniqueName: \"kubernetes.io/projected/870e53a9-7c44-4fd8-866c-7b224a501770-kube-api-access-slttf\") pod \"aws-ebs-csi-driver-node-788c5\" (UID: \"870e53a9-7c44-4fd8-866c-7b224a501770\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-788c5" Jul 14 17:25:40.316499 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:40.316427 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-5zj72" Jul 14 17:25:40.325418 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:25:40.325388 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd84237cc_b659_4943_b3da_ab9f602d4f86.slice/crio-903bc34a26eb4fe3cb38dc03383e4a56dd7453cdb66e4aa237d0577e839c34d4 WatchSource:0}: Error finding container 903bc34a26eb4fe3cb38dc03383e4a56dd7453cdb66e4aa237d0577e839c34d4: Status 404 returned error can't find the container with id 903bc34a26eb4fe3cb38dc03383e4a56dd7453cdb66e4aa237d0577e839c34d4 Jul 14 17:25:40.327526 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:40.327507 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-qs7cs" Jul 14 17:25:40.335441 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:25:40.335402 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod375c4524_d713_47ea_9179_ad73a0a04604.slice/crio-4a8e8416a4101591cb29e7c7117ad32acfc46e0a578dc1a459b9c5f1a55dab40 WatchSource:0}: Error finding container 4a8e8416a4101591cb29e7c7117ad32acfc46e0a578dc1a459b9c5f1a55dab40: Status 404 returned error can't find the container with id 4a8e8416a4101591cb29e7c7117ad32acfc46e0a578dc1a459b9c5f1a55dab40 Jul 14 17:25:40.336681 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:40.336508 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-cwprj" Jul 14 17:25:40.343758 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:40.343639 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-788c5" Jul 14 17:25:40.345084 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:25:40.345021 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd3492336_881b_4f13_8d3a_b4d4ec05ad3c.slice/crio-6fe2dadfec738f78fc7b3e90ce6c6b6e8b64f01b67fcfa250a6d2d7730747ab9 WatchSource:0}: Error finding container 6fe2dadfec738f78fc7b3e90ce6c6b6e8b64f01b67fcfa250a6d2d7730747ab9: Status 404 returned error can't find the container with id 6fe2dadfec738f78fc7b3e90ce6c6b6e8b64f01b67fcfa250a6d2d7730747ab9 Jul 14 17:25:40.352095 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:40.352074 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-8wgvc" Jul 14 17:25:40.352281 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:25:40.352256 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod870e53a9_7c44_4fd8_866c_7b224a501770.slice/crio-ffbef2d26a9f45cbeb1a62db3fb94fc43f3d51eddcf5986cd269d3e1c3f0c3ae WatchSource:0}: Error finding container ffbef2d26a9f45cbeb1a62db3fb94fc43f3d51eddcf5986cd269d3e1c3f0c3ae: Status 404 returned error can't find the container with id ffbef2d26a9f45cbeb1a62db3fb94fc43f3d51eddcf5986cd269d3e1c3f0c3ae Jul 14 17:25:40.361845 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:40.361810 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-4t8fg" Jul 14 17:25:40.362263 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:25:40.362236 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod522da5d4_eacf_4950_ae39_d81bf6277175.slice/crio-7a9d223e8fa0e91ff33adac407fb5a0fa4a30e73ae2c15c9641fd609c8ba0f50 WatchSource:0}: Error finding container 7a9d223e8fa0e91ff33adac407fb5a0fa4a30e73ae2c15c9641fd609c8ba0f50: Status 404 returned error can't find the container with id 7a9d223e8fa0e91ff33adac407fb5a0fa4a30e73ae2c15c9641fd609c8ba0f50 Jul 14 17:25:40.371501 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:25:40.371482 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5b08dae7_1558_40a0_bb51_702d6974fc28.slice/crio-d35cf312b81b223083fc4de59a73877b2de6f92aacc0c0ba4f6d5946d165dee9 WatchSource:0}: Error finding container d35cf312b81b223083fc4de59a73877b2de6f92aacc0c0ba4f6d5946d165dee9: Status 404 returned error can't find the container with id d35cf312b81b223083fc4de59a73877b2de6f92aacc0c0ba4f6d5946d165dee9 Jul 14 17:25:40.372320 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:40.372179 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-g4msd" Jul 14 17:25:40.379476 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:40.379457 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-g4bts" Jul 14 17:25:40.381650 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:25:40.381619 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podef0b0e1b_a97c_4926_9202_01e81c50ef97.slice/crio-39fae210156a73f9268cb5c99410b15e5c7f3db919282e2cd6610a31f5197802 WatchSource:0}: Error finding container 39fae210156a73f9268cb5c99410b15e5c7f3db919282e2cd6610a31f5197802: Status 404 returned error can't find the container with id 39fae210156a73f9268cb5c99410b15e5c7f3db919282e2cd6610a31f5197802 Jul 14 17:25:40.387588 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:40.387242 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-8r8r6" Jul 14 17:25:40.389893 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:40.389854 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-788c5" event={"ID":"870e53a9-7c44-4fd8-866c-7b224a501770","Type":"ContainerStarted","Data":"ffbef2d26a9f45cbeb1a62db3fb94fc43f3d51eddcf5986cd269d3e1c3f0c3ae"} Jul 14 17:25:40.397208 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:40.397092 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-cwprj" event={"ID":"d3492336-881b-4f13-8d3a-b4d4ec05ad3c","Type":"ContainerStarted","Data":"6fe2dadfec738f78fc7b3e90ce6c6b6e8b64f01b67fcfa250a6d2d7730747ab9"} Jul 14 17:25:40.399118 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:40.399076 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-qs7cs" event={"ID":"375c4524-d713-47ea-9179-ad73a0a04604","Type":"ContainerStarted","Data":"4a8e8416a4101591cb29e7c7117ad32acfc46e0a578dc1a459b9c5f1a55dab40"} Jul 14 17:25:40.400264 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:40.400132 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-16.ec2.internal" event={"ID":"8df8d47ff6ebf83b9a6270b9d8e65671","Type":"ContainerStarted","Data":"44b4c492aff78006d8bc6fabe923730a62e137bdbef0752234727c6dfe72245f"} Jul 14 17:25:40.401620 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:40.401554 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-16.ec2.internal" event={"ID":"771081612d1c7db4aa39e9060dd20e70","Type":"ContainerStarted","Data":"a66ffed40777ffa383587c7abb3bca205916dfcbcf13aed2c918fd9b29062000"} Jul 14 17:25:40.403392 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:40.403353 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-g4msd" event={"ID":"ef0b0e1b-a97c-4926-9202-01e81c50ef97","Type":"ContainerStarted","Data":"39fae210156a73f9268cb5c99410b15e5c7f3db919282e2cd6610a31f5197802"} Jul 14 17:25:40.404212 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:25:40.404190 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6f839747_4a79_42e4_81ca_00b3b6645d7f.slice/crio-3a384147f8ec2ec7cd99e0134ca3170bc3d6662cc6400cfc5d0e01e187a28dbb WatchSource:0}: Error finding container 3a384147f8ec2ec7cd99e0134ca3170bc3d6662cc6400cfc5d0e01e187a28dbb: Status 404 returned error can't find the container with id 3a384147f8ec2ec7cd99e0134ca3170bc3d6662cc6400cfc5d0e01e187a28dbb Jul 14 17:25:40.405454 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:40.405406 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-4t8fg" event={"ID":"5b08dae7-1558-40a0-bb51-702d6974fc28","Type":"ContainerStarted","Data":"d35cf312b81b223083fc4de59a73877b2de6f92aacc0c0ba4f6d5946d165dee9"} Jul 14 17:25:40.406904 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:40.406820 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-8wgvc" event={"ID":"522da5d4-eacf-4950-ae39-d81bf6277175","Type":"ContainerStarted","Data":"7a9d223e8fa0e91ff33adac407fb5a0fa4a30e73ae2c15c9641fd609c8ba0f50"} Jul 14 17:25:40.408561 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:40.408527 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-5zj72" event={"ID":"d84237cc-b659-4943-b3da-ab9f602d4f86","Type":"ContainerStarted","Data":"903bc34a26eb4fe3cb38dc03383e4a56dd7453cdb66e4aa237d0577e839c34d4"} Jul 14 17:25:40.625704 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:40.625624 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/91eea036-14a4-466b-9006-5c3f7e104bf4-original-pull-secret\") pod \"global-pull-secret-syncer-c9lb7\" (UID: \"91eea036-14a4-466b-9006-5c3f7e104bf4\") " pod="kube-system/global-pull-secret-syncer-c9lb7" Jul 14 17:25:40.625704 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:40.625667 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/029a166f-0530-4669-9095-ebe6f46b9d8c-metrics-certs\") pod \"network-metrics-daemon-7prlr\" (UID: \"029a166f-0530-4669-9095-ebe6f46b9d8c\") " pod="openshift-multus/network-metrics-daemon-7prlr" Jul 14 17:25:40.625704 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:40.625693 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5m5jk\" (UniqueName: \"kubernetes.io/projected/5e75c85a-a73f-4890-854a-a8d3baff770b-kube-api-access-5m5jk\") pod \"network-check-target-vjlpd\" (UID: \"5e75c85a-a73f-4890-854a-a8d3baff770b\") " pod="openshift-network-diagnostics/network-check-target-vjlpd" Jul 14 17:25:40.625957 ip-10-0-139-16 kubenswrapper[2552]: E0714 17:25:40.625796 2552 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 14 17:25:40.625957 ip-10-0-139-16 kubenswrapper[2552]: E0714 17:25:40.625808 2552 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 14 17:25:40.625957 ip-10-0-139-16 kubenswrapper[2552]: E0714 17:25:40.625832 2552 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 14 17:25:40.625957 ip-10-0-139-16 kubenswrapper[2552]: E0714 17:25:40.625842 2552 projected.go:196] Error preparing data for projected volume kube-api-access-5m5jk for pod openshift-network-diagnostics/network-check-target-vjlpd: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 14 17:25:40.625957 ip-10-0-139-16 kubenswrapper[2552]: E0714 17:25:40.625796 2552 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 14 17:25:40.625957 ip-10-0-139-16 kubenswrapper[2552]: E0714 17:25:40.625868 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/91eea036-14a4-466b-9006-5c3f7e104bf4-original-pull-secret podName:91eea036-14a4-466b-9006-5c3f7e104bf4 nodeName:}" failed. No retries permitted until 2026-07-14 17:25:41.625848422 +0000 UTC m=+4.004962366 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/91eea036-14a4-466b-9006-5c3f7e104bf4-original-pull-secret") pod "global-pull-secret-syncer-c9lb7" (UID: "91eea036-14a4-466b-9006-5c3f7e104bf4") : object "kube-system"/"original-pull-secret" not registered Jul 14 17:25:40.625957 ip-10-0-139-16 kubenswrapper[2552]: E0714 17:25:40.625905 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5e75c85a-a73f-4890-854a-a8d3baff770b-kube-api-access-5m5jk podName:5e75c85a-a73f-4890-854a-a8d3baff770b nodeName:}" failed. No retries permitted until 2026-07-14 17:25:41.625888255 +0000 UTC m=+4.005002186 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-5m5jk" (UniqueName: "kubernetes.io/projected/5e75c85a-a73f-4890-854a-a8d3baff770b-kube-api-access-5m5jk") pod "network-check-target-vjlpd" (UID: "5e75c85a-a73f-4890-854a-a8d3baff770b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 14 17:25:40.625957 ip-10-0-139-16 kubenswrapper[2552]: E0714 17:25:40.625919 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/029a166f-0530-4669-9095-ebe6f46b9d8c-metrics-certs podName:029a166f-0530-4669-9095-ebe6f46b9d8c nodeName:}" failed. No retries permitted until 2026-07-14 17:25:41.625913189 +0000 UTC m=+4.005027118 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/029a166f-0530-4669-9095-ebe6f46b9d8c-metrics-certs") pod "network-metrics-daemon-7prlr" (UID: "029a166f-0530-4669-9095-ebe6f46b9d8c") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 14 17:25:41.052279 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:41.052122 2552 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-13 17:20:40 +0000 UTC" deadline="2027-12-31 22:57:03.306415966 +0000 UTC" Jul 14 17:25:41.052279 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:41.052179 2552 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12845h31m22.254239902s" Jul 14 17:25:41.383466 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:41.382887 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7prlr" Jul 14 17:25:41.383466 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:41.382925 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vjlpd" Jul 14 17:25:41.383466 ip-10-0-139-16 kubenswrapper[2552]: E0714 17:25:41.383036 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7prlr" podUID="029a166f-0530-4669-9095-ebe6f46b9d8c" Jul 14 17:25:41.383466 ip-10-0-139-16 kubenswrapper[2552]: E0714 17:25:41.383150 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vjlpd" podUID="5e75c85a-a73f-4890-854a-a8d3baff770b" Jul 14 17:25:41.415135 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:41.415098 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-8r8r6" event={"ID":"6f839747-4a79-42e4-81ca-00b3b6645d7f","Type":"ContainerStarted","Data":"3a384147f8ec2ec7cd99e0134ca3170bc3d6662cc6400cfc5d0e01e187a28dbb"} Jul 14 17:25:41.416370 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:41.416344 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-g4bts" event={"ID":"6a962207-915e-43fc-80f6-3edd2d3451fc","Type":"ContainerStarted","Data":"83b88d332219ff80bdaedfcdb7a93a969cae8b07ae84e382e019f5364a6a8397"} Jul 14 17:25:41.634817 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:41.633817 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/91eea036-14a4-466b-9006-5c3f7e104bf4-original-pull-secret\") pod \"global-pull-secret-syncer-c9lb7\" (UID: \"91eea036-14a4-466b-9006-5c3f7e104bf4\") " pod="kube-system/global-pull-secret-syncer-c9lb7" Jul 14 17:25:41.634817 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:41.633884 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/029a166f-0530-4669-9095-ebe6f46b9d8c-metrics-certs\") pod \"network-metrics-daemon-7prlr\" (UID: \"029a166f-0530-4669-9095-ebe6f46b9d8c\") " pod="openshift-multus/network-metrics-daemon-7prlr" Jul 14 17:25:41.634817 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:41.633928 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5m5jk\" (UniqueName: \"kubernetes.io/projected/5e75c85a-a73f-4890-854a-a8d3baff770b-kube-api-access-5m5jk\") pod \"network-check-target-vjlpd\" (UID: \"5e75c85a-a73f-4890-854a-a8d3baff770b\") " pod="openshift-network-diagnostics/network-check-target-vjlpd" Jul 14 17:25:41.634817 ip-10-0-139-16 kubenswrapper[2552]: E0714 17:25:41.634081 2552 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 14 17:25:41.634817 ip-10-0-139-16 kubenswrapper[2552]: E0714 17:25:41.634104 2552 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 14 17:25:41.634817 ip-10-0-139-16 kubenswrapper[2552]: E0714 17:25:41.634117 2552 projected.go:196] Error preparing data for projected volume kube-api-access-5m5jk for pod openshift-network-diagnostics/network-check-target-vjlpd: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 14 17:25:41.634817 ip-10-0-139-16 kubenswrapper[2552]: E0714 17:25:41.634173 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5e75c85a-a73f-4890-854a-a8d3baff770b-kube-api-access-5m5jk podName:5e75c85a-a73f-4890-854a-a8d3baff770b nodeName:}" failed. No retries permitted until 2026-07-14 17:25:43.634155639 +0000 UTC m=+6.013269573 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-5m5jk" (UniqueName: "kubernetes.io/projected/5e75c85a-a73f-4890-854a-a8d3baff770b-kube-api-access-5m5jk") pod "network-check-target-vjlpd" (UID: "5e75c85a-a73f-4890-854a-a8d3baff770b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 14 17:25:41.634817 ip-10-0-139-16 kubenswrapper[2552]: E0714 17:25:41.634247 2552 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 14 17:25:41.634817 ip-10-0-139-16 kubenswrapper[2552]: E0714 17:25:41.634287 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/91eea036-14a4-466b-9006-5c3f7e104bf4-original-pull-secret podName:91eea036-14a4-466b-9006-5c3f7e104bf4 nodeName:}" failed. No retries permitted until 2026-07-14 17:25:43.634273059 +0000 UTC m=+6.013386991 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/91eea036-14a4-466b-9006-5c3f7e104bf4-original-pull-secret") pod "global-pull-secret-syncer-c9lb7" (UID: "91eea036-14a4-466b-9006-5c3f7e104bf4") : object "kube-system"/"original-pull-secret" not registered Jul 14 17:25:41.634817 ip-10-0-139-16 kubenswrapper[2552]: E0714 17:25:41.634362 2552 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 14 17:25:41.634817 ip-10-0-139-16 kubenswrapper[2552]: E0714 17:25:41.634394 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/029a166f-0530-4669-9095-ebe6f46b9d8c-metrics-certs podName:029a166f-0530-4669-9095-ebe6f46b9d8c nodeName:}" failed. No retries permitted until 2026-07-14 17:25:43.634383934 +0000 UTC m=+6.013497866 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/029a166f-0530-4669-9095-ebe6f46b9d8c-metrics-certs") pod "network-metrics-daemon-7prlr" (UID: "029a166f-0530-4669-9095-ebe6f46b9d8c") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 14 17:25:42.052794 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:42.052679 2552 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-13 17:20:40 +0000 UTC" deadline="2028-01-15 03:28:16.267036017 +0000 UTC" Jul 14 17:25:42.052794 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:42.052719 2552 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13186h2m34.214321962s" Jul 14 17:25:42.384452 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:42.383881 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-c9lb7" Jul 14 17:25:42.384452 ip-10-0-139-16 kubenswrapper[2552]: E0714 17:25:42.384019 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-c9lb7" podUID="91eea036-14a4-466b-9006-5c3f7e104bf4" Jul 14 17:25:43.382534 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:43.382504 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7prlr" Jul 14 17:25:43.382919 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:43.382507 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vjlpd" Jul 14 17:25:43.382919 ip-10-0-139-16 kubenswrapper[2552]: E0714 17:25:43.382653 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7prlr" podUID="029a166f-0530-4669-9095-ebe6f46b9d8c" Jul 14 17:25:43.382919 ip-10-0-139-16 kubenswrapper[2552]: E0714 17:25:43.382709 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vjlpd" podUID="5e75c85a-a73f-4890-854a-a8d3baff770b" Jul 14 17:25:43.651437 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:43.650519 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/029a166f-0530-4669-9095-ebe6f46b9d8c-metrics-certs\") pod \"network-metrics-daemon-7prlr\" (UID: \"029a166f-0530-4669-9095-ebe6f46b9d8c\") " pod="openshift-multus/network-metrics-daemon-7prlr" Jul 14 17:25:43.651437 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:43.650576 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5m5jk\" (UniqueName: \"kubernetes.io/projected/5e75c85a-a73f-4890-854a-a8d3baff770b-kube-api-access-5m5jk\") pod \"network-check-target-vjlpd\" (UID: \"5e75c85a-a73f-4890-854a-a8d3baff770b\") " pod="openshift-network-diagnostics/network-check-target-vjlpd" Jul 14 17:25:43.651437 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:43.650624 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/91eea036-14a4-466b-9006-5c3f7e104bf4-original-pull-secret\") pod \"global-pull-secret-syncer-c9lb7\" (UID: \"91eea036-14a4-466b-9006-5c3f7e104bf4\") " pod="kube-system/global-pull-secret-syncer-c9lb7" Jul 14 17:25:43.651437 ip-10-0-139-16 kubenswrapper[2552]: E0714 17:25:43.650756 2552 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 14 17:25:43.651437 ip-10-0-139-16 kubenswrapper[2552]: E0714 17:25:43.650814 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/91eea036-14a4-466b-9006-5c3f7e104bf4-original-pull-secret podName:91eea036-14a4-466b-9006-5c3f7e104bf4 nodeName:}" failed. No retries permitted until 2026-07-14 17:25:47.650794812 +0000 UTC m=+10.029908746 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/91eea036-14a4-466b-9006-5c3f7e104bf4-original-pull-secret") pod "global-pull-secret-syncer-c9lb7" (UID: "91eea036-14a4-466b-9006-5c3f7e104bf4") : object "kube-system"/"original-pull-secret" not registered Jul 14 17:25:43.651437 ip-10-0-139-16 kubenswrapper[2552]: E0714 17:25:43.651186 2552 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 14 17:25:43.651437 ip-10-0-139-16 kubenswrapper[2552]: E0714 17:25:43.651205 2552 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 14 17:25:43.651437 ip-10-0-139-16 kubenswrapper[2552]: E0714 17:25:43.651230 2552 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 14 17:25:43.651437 ip-10-0-139-16 kubenswrapper[2552]: E0714 17:25:43.651234 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/029a166f-0530-4669-9095-ebe6f46b9d8c-metrics-certs podName:029a166f-0530-4669-9095-ebe6f46b9d8c nodeName:}" failed. No retries permitted until 2026-07-14 17:25:47.651218743 +0000 UTC m=+10.030332676 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/029a166f-0530-4669-9095-ebe6f46b9d8c-metrics-certs") pod "network-metrics-daemon-7prlr" (UID: "029a166f-0530-4669-9095-ebe6f46b9d8c") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 14 17:25:43.651437 ip-10-0-139-16 kubenswrapper[2552]: E0714 17:25:43.651243 2552 projected.go:196] Error preparing data for projected volume kube-api-access-5m5jk for pod openshift-network-diagnostics/network-check-target-vjlpd: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 14 17:25:43.651437 ip-10-0-139-16 kubenswrapper[2552]: E0714 17:25:43.651291 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5e75c85a-a73f-4890-854a-a8d3baff770b-kube-api-access-5m5jk podName:5e75c85a-a73f-4890-854a-a8d3baff770b nodeName:}" failed. No retries permitted until 2026-07-14 17:25:47.651276065 +0000 UTC m=+10.030389998 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-5m5jk" (UniqueName: "kubernetes.io/projected/5e75c85a-a73f-4890-854a-a8d3baff770b-kube-api-access-5m5jk") pod "network-check-target-vjlpd" (UID: "5e75c85a-a73f-4890-854a-a8d3baff770b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 14 17:25:44.383097 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:44.382986 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-c9lb7" Jul 14 17:25:44.383584 ip-10-0-139-16 kubenswrapper[2552]: E0714 17:25:44.383126 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-c9lb7" podUID="91eea036-14a4-466b-9006-5c3f7e104bf4" Jul 14 17:25:45.382490 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:45.382188 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vjlpd" Jul 14 17:25:45.382490 ip-10-0-139-16 kubenswrapper[2552]: E0714 17:25:45.382306 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vjlpd" podUID="5e75c85a-a73f-4890-854a-a8d3baff770b" Jul 14 17:25:45.382729 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:45.382558 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7prlr" Jul 14 17:25:45.382729 ip-10-0-139-16 kubenswrapper[2552]: E0714 17:25:45.382665 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7prlr" podUID="029a166f-0530-4669-9095-ebe6f46b9d8c" Jul 14 17:25:46.382799 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:46.382767 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-c9lb7" Jul 14 17:25:46.383234 ip-10-0-139-16 kubenswrapper[2552]: E0714 17:25:46.382907 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-c9lb7" podUID="91eea036-14a4-466b-9006-5c3f7e104bf4" Jul 14 17:25:47.382557 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:47.382521 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7prlr" Jul 14 17:25:47.382736 ip-10-0-139-16 kubenswrapper[2552]: E0714 17:25:47.382664 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7prlr" podUID="029a166f-0530-4669-9095-ebe6f46b9d8c" Jul 14 17:25:47.382736 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:47.382690 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vjlpd" Jul 14 17:25:47.382858 ip-10-0-139-16 kubenswrapper[2552]: E0714 17:25:47.382761 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vjlpd" podUID="5e75c85a-a73f-4890-854a-a8d3baff770b" Jul 14 17:25:47.685635 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:47.685600 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5m5jk\" (UniqueName: \"kubernetes.io/projected/5e75c85a-a73f-4890-854a-a8d3baff770b-kube-api-access-5m5jk\") pod \"network-check-target-vjlpd\" (UID: \"5e75c85a-a73f-4890-854a-a8d3baff770b\") " pod="openshift-network-diagnostics/network-check-target-vjlpd" Jul 14 17:25:47.685830 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:47.685673 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/91eea036-14a4-466b-9006-5c3f7e104bf4-original-pull-secret\") pod \"global-pull-secret-syncer-c9lb7\" (UID: \"91eea036-14a4-466b-9006-5c3f7e104bf4\") " pod="kube-system/global-pull-secret-syncer-c9lb7" Jul 14 17:25:47.685830 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:47.685710 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/029a166f-0530-4669-9095-ebe6f46b9d8c-metrics-certs\") pod \"network-metrics-daemon-7prlr\" (UID: \"029a166f-0530-4669-9095-ebe6f46b9d8c\") " pod="openshift-multus/network-metrics-daemon-7prlr" Jul 14 17:25:47.685830 ip-10-0-139-16 kubenswrapper[2552]: E0714 17:25:47.685754 2552 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 14 17:25:47.685830 ip-10-0-139-16 kubenswrapper[2552]: E0714 17:25:47.685779 2552 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 14 17:25:47.685830 ip-10-0-139-16 kubenswrapper[2552]: E0714 17:25:47.685792 2552 projected.go:196] Error preparing data for projected volume kube-api-access-5m5jk for pod openshift-network-diagnostics/network-check-target-vjlpd: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 14 17:25:47.685830 ip-10-0-139-16 kubenswrapper[2552]: E0714 17:25:47.685814 2552 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 14 17:25:47.686120 ip-10-0-139-16 kubenswrapper[2552]: E0714 17:25:47.685848 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5e75c85a-a73f-4890-854a-a8d3baff770b-kube-api-access-5m5jk podName:5e75c85a-a73f-4890-854a-a8d3baff770b nodeName:}" failed. No retries permitted until 2026-07-14 17:25:55.68582842 +0000 UTC m=+18.064942358 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-5m5jk" (UniqueName: "kubernetes.io/projected/5e75c85a-a73f-4890-854a-a8d3baff770b-kube-api-access-5m5jk") pod "network-check-target-vjlpd" (UID: "5e75c85a-a73f-4890-854a-a8d3baff770b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 14 17:25:47.686120 ip-10-0-139-16 kubenswrapper[2552]: E0714 17:25:47.685893 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/029a166f-0530-4669-9095-ebe6f46b9d8c-metrics-certs podName:029a166f-0530-4669-9095-ebe6f46b9d8c nodeName:}" failed. No retries permitted until 2026-07-14 17:25:55.685858702 +0000 UTC m=+18.064972632 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/029a166f-0530-4669-9095-ebe6f46b9d8c-metrics-certs") pod "network-metrics-daemon-7prlr" (UID: "029a166f-0530-4669-9095-ebe6f46b9d8c") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 14 17:25:47.686120 ip-10-0-139-16 kubenswrapper[2552]: E0714 17:25:47.685815 2552 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 14 17:25:47.686120 ip-10-0-139-16 kubenswrapper[2552]: E0714 17:25:47.685966 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/91eea036-14a4-466b-9006-5c3f7e104bf4-original-pull-secret podName:91eea036-14a4-466b-9006-5c3f7e104bf4 nodeName:}" failed. No retries permitted until 2026-07-14 17:25:55.685950693 +0000 UTC m=+18.065064626 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/91eea036-14a4-466b-9006-5c3f7e104bf4-original-pull-secret") pod "global-pull-secret-syncer-c9lb7" (UID: "91eea036-14a4-466b-9006-5c3f7e104bf4") : object "kube-system"/"original-pull-secret" not registered Jul 14 17:25:48.383451 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:48.383406 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-c9lb7" Jul 14 17:25:48.383927 ip-10-0-139-16 kubenswrapper[2552]: E0714 17:25:48.383519 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-c9lb7" podUID="91eea036-14a4-466b-9006-5c3f7e104bf4" Jul 14 17:25:49.382808 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:49.382765 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7prlr" Jul 14 17:25:49.382982 ip-10-0-139-16 kubenswrapper[2552]: E0714 17:25:49.382905 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7prlr" podUID="029a166f-0530-4669-9095-ebe6f46b9d8c" Jul 14 17:25:49.383198 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:49.382782 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vjlpd" Jul 14 17:25:49.383198 ip-10-0-139-16 kubenswrapper[2552]: E0714 17:25:49.383158 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vjlpd" podUID="5e75c85a-a73f-4890-854a-a8d3baff770b" Jul 14 17:25:50.382417 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:50.382298 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-c9lb7" Jul 14 17:25:50.382868 ip-10-0-139-16 kubenswrapper[2552]: E0714 17:25:50.382459 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-c9lb7" podUID="91eea036-14a4-466b-9006-5c3f7e104bf4" Jul 14 17:25:51.382531 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:51.382445 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vjlpd" Jul 14 17:25:51.382937 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:51.382445 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7prlr" Jul 14 17:25:51.382937 ip-10-0-139-16 kubenswrapper[2552]: E0714 17:25:51.382563 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vjlpd" podUID="5e75c85a-a73f-4890-854a-a8d3baff770b" Jul 14 17:25:51.382937 ip-10-0-139-16 kubenswrapper[2552]: E0714 17:25:51.382629 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7prlr" podUID="029a166f-0530-4669-9095-ebe6f46b9d8c" Jul 14 17:25:52.382454 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:52.382419 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-c9lb7" Jul 14 17:25:52.382640 ip-10-0-139-16 kubenswrapper[2552]: E0714 17:25:52.382553 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-c9lb7" podUID="91eea036-14a4-466b-9006-5c3f7e104bf4" Jul 14 17:25:53.382283 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:53.382245 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vjlpd" Jul 14 17:25:53.382477 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:53.382254 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7prlr" Jul 14 17:25:53.382477 ip-10-0-139-16 kubenswrapper[2552]: E0714 17:25:53.382396 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vjlpd" podUID="5e75c85a-a73f-4890-854a-a8d3baff770b" Jul 14 17:25:53.382600 ip-10-0-139-16 kubenswrapper[2552]: E0714 17:25:53.382487 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7prlr" podUID="029a166f-0530-4669-9095-ebe6f46b9d8c" Jul 14 17:25:54.382498 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:54.382464 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-c9lb7" Jul 14 17:25:54.382945 ip-10-0-139-16 kubenswrapper[2552]: E0714 17:25:54.382597 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-c9lb7" podUID="91eea036-14a4-466b-9006-5c3f7e104bf4" Jul 14 17:25:55.382964 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:55.382925 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7prlr" Jul 14 17:25:55.382964 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:55.382956 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vjlpd" Jul 14 17:25:55.383460 ip-10-0-139-16 kubenswrapper[2552]: E0714 17:25:55.383067 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7prlr" podUID="029a166f-0530-4669-9095-ebe6f46b9d8c" Jul 14 17:25:55.383460 ip-10-0-139-16 kubenswrapper[2552]: E0714 17:25:55.383135 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vjlpd" podUID="5e75c85a-a73f-4890-854a-a8d3baff770b" Jul 14 17:25:55.745635 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:55.745539 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/91eea036-14a4-466b-9006-5c3f7e104bf4-original-pull-secret\") pod \"global-pull-secret-syncer-c9lb7\" (UID: \"91eea036-14a4-466b-9006-5c3f7e104bf4\") " pod="kube-system/global-pull-secret-syncer-c9lb7" Jul 14 17:25:55.745635 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:55.745589 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/029a166f-0530-4669-9095-ebe6f46b9d8c-metrics-certs\") pod \"network-metrics-daemon-7prlr\" (UID: \"029a166f-0530-4669-9095-ebe6f46b9d8c\") " pod="openshift-multus/network-metrics-daemon-7prlr" Jul 14 17:25:55.745635 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:55.745628 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5m5jk\" (UniqueName: \"kubernetes.io/projected/5e75c85a-a73f-4890-854a-a8d3baff770b-kube-api-access-5m5jk\") pod \"network-check-target-vjlpd\" (UID: \"5e75c85a-a73f-4890-854a-a8d3baff770b\") " pod="openshift-network-diagnostics/network-check-target-vjlpd" Jul 14 17:25:55.745870 ip-10-0-139-16 kubenswrapper[2552]: E0714 17:25:55.745690 2552 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 14 17:25:55.745870 ip-10-0-139-16 kubenswrapper[2552]: E0714 17:25:55.745750 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/91eea036-14a4-466b-9006-5c3f7e104bf4-original-pull-secret podName:91eea036-14a4-466b-9006-5c3f7e104bf4 nodeName:}" failed. No retries permitted until 2026-07-14 17:26:11.745732403 +0000 UTC m=+34.124846335 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/91eea036-14a4-466b-9006-5c3f7e104bf4-original-pull-secret") pod "global-pull-secret-syncer-c9lb7" (UID: "91eea036-14a4-466b-9006-5c3f7e104bf4") : object "kube-system"/"original-pull-secret" not registered Jul 14 17:25:55.745870 ip-10-0-139-16 kubenswrapper[2552]: E0714 17:25:55.745754 2552 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 14 17:25:55.745870 ip-10-0-139-16 kubenswrapper[2552]: E0714 17:25:55.745808 2552 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 14 17:25:55.745870 ip-10-0-139-16 kubenswrapper[2552]: E0714 17:25:55.745817 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/029a166f-0530-4669-9095-ebe6f46b9d8c-metrics-certs podName:029a166f-0530-4669-9095-ebe6f46b9d8c nodeName:}" failed. No retries permitted until 2026-07-14 17:26:11.745802051 +0000 UTC m=+34.124915992 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/029a166f-0530-4669-9095-ebe6f46b9d8c-metrics-certs") pod "network-metrics-daemon-7prlr" (UID: "029a166f-0530-4669-9095-ebe6f46b9d8c") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 14 17:25:55.745870 ip-10-0-139-16 kubenswrapper[2552]: E0714 17:25:55.745823 2552 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 14 17:25:55.745870 ip-10-0-139-16 kubenswrapper[2552]: E0714 17:25:55.745835 2552 projected.go:196] Error preparing data for projected volume kube-api-access-5m5jk for pod openshift-network-diagnostics/network-check-target-vjlpd: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 14 17:25:55.745870 ip-10-0-139-16 kubenswrapper[2552]: E0714 17:25:55.745872 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5e75c85a-a73f-4890-854a-a8d3baff770b-kube-api-access-5m5jk podName:5e75c85a-a73f-4890-854a-a8d3baff770b nodeName:}" failed. No retries permitted until 2026-07-14 17:26:11.745860747 +0000 UTC m=+34.124974697 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-5m5jk" (UniqueName: "kubernetes.io/projected/5e75c85a-a73f-4890-854a-a8d3baff770b-kube-api-access-5m5jk") pod "network-check-target-vjlpd" (UID: "5e75c85a-a73f-4890-854a-a8d3baff770b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 14 17:25:56.382245 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:56.382210 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-c9lb7" Jul 14 17:25:56.382428 ip-10-0-139-16 kubenswrapper[2552]: E0714 17:25:56.382341 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-c9lb7" podUID="91eea036-14a4-466b-9006-5c3f7e104bf4" Jul 14 17:25:57.382843 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:57.382805 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7prlr" Jul 14 17:25:57.383200 ip-10-0-139-16 kubenswrapper[2552]: E0714 17:25:57.382922 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7prlr" podUID="029a166f-0530-4669-9095-ebe6f46b9d8c" Jul 14 17:25:57.383200 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:57.382951 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vjlpd" Jul 14 17:25:57.383200 ip-10-0-139-16 kubenswrapper[2552]: E0714 17:25:57.383009 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vjlpd" podUID="5e75c85a-a73f-4890-854a-a8d3baff770b" Jul 14 17:25:58.383054 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:58.383015 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-c9lb7" Jul 14 17:25:58.383502 ip-10-0-139-16 kubenswrapper[2552]: E0714 17:25:58.383125 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-c9lb7" podUID="91eea036-14a4-466b-9006-5c3f7e104bf4" Jul 14 17:25:59.382199 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:59.381991 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7prlr" Jul 14 17:25:59.382316 ip-10-0-139-16 kubenswrapper[2552]: E0714 17:25:59.382288 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7prlr" podUID="029a166f-0530-4669-9095-ebe6f46b9d8c" Jul 14 17:25:59.382411 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:59.382054 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vjlpd" Jul 14 17:25:59.382463 ip-10-0-139-16 kubenswrapper[2552]: E0714 17:25:59.382414 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vjlpd" podUID="5e75c85a-a73f-4890-854a-a8d3baff770b" Jul 14 17:25:59.454969 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:59.454944 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-16.ec2.internal" event={"ID":"8df8d47ff6ebf83b9a6270b9d8e65671","Type":"ContainerStarted","Data":"5e363d544aba33f8b649f89f53677043896ff7f42d7af9c2b1912eaffbe99720"} Jul 14 17:25:59.456241 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:59.456221 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-g4msd" event={"ID":"ef0b0e1b-a97c-4926-9202-01e81c50ef97","Type":"ContainerStarted","Data":"eff723d2b9332cd38e927528965e9e8ee368a82ac6521d468b0302b51ec1a6b3"} Jul 14 17:25:59.471428 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:59.471386 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-16.ec2.internal" podStartSLOduration=20.471374095 podStartE2EDuration="20.471374095s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-14 17:25:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 17:25:59.471102034 +0000 UTC m=+21.850215986" watchObservedRunningTime="2026-07-14 17:25:59.471374095 +0000 UTC m=+21.850488048" Jul 14 17:25:59.486727 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:25:59.486684 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-g4msd" podStartSLOduration=2.653371593 podStartE2EDuration="21.486670038s" totalImagesPullingTime="18.833298445s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-14 17:25:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 17:25:59.486529637 +0000 UTC m=+21.865643599" watchObservedRunningTime="2026-07-14 17:25:59.486670038 +0000 UTC m=+21.865784010" Jul 14 17:26:00.382493 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:00.382283 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-c9lb7" Jul 14 17:26:00.382716 ip-10-0-139-16 kubenswrapper[2552]: E0714 17:26:00.382567 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-c9lb7" podUID="91eea036-14a4-466b-9006-5c3f7e104bf4" Jul 14 17:26:00.460054 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:00.460009 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-qs7cs" event={"ID":"375c4524-d713-47ea-9179-ad73a0a04604","Type":"ContainerStarted","Data":"619c2b6dc6d687526a9ce41e90fba756047931d792fe6b13dfc1b7fe9bcccf7d"} Jul 14 17:26:00.464282 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:00.464258 2552 generic.go:356] "Generic (PLEG): container finished" podID="771081612d1c7db4aa39e9060dd20e70" containerID="dac714d411dcfe3104ee491e7ea0a3bbdbbc99a82598c87207024bbe76549222" exitCode=0 Jul 14 17:26:00.464423 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:00.464345 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-16.ec2.internal" event={"ID":"771081612d1c7db4aa39e9060dd20e70","Type":"ContainerDied","Data":"dac714d411dcfe3104ee491e7ea0a3bbdbbc99a82598c87207024bbe76549222"} Jul 14 17:26:00.465689 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:00.465666 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-8r8r6" event={"ID":"6f839747-4a79-42e4-81ca-00b3b6645d7f","Type":"ContainerStarted","Data":"4fdedb856d73085063ab9daa761cd127a5fd6dbb56c76dfd62e8c350167bade8"} Jul 14 17:26:00.466931 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:00.466909 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-4t8fg" event={"ID":"5b08dae7-1558-40a0-bb51-702d6974fc28","Type":"ContainerStarted","Data":"3e716b5e75080efaf5cbe7c0137852925adbde16371bc0667a99fbc03653e094"} Jul 14 17:26:00.468275 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:00.468256 2552 generic.go:356] "Generic (PLEG): container finished" podID="d84237cc-b659-4943-b3da-ab9f602d4f86" containerID="f86b3726ab538ffe9cc784cb87dcacd5a38c3041fe76d314da67e1cb909bfefe" exitCode=0 Jul 14 17:26:00.468378 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:00.468315 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-5zj72" event={"ID":"d84237cc-b659-4943-b3da-ab9f602d4f86","Type":"ContainerDied","Data":"f86b3726ab538ffe9cc784cb87dcacd5a38c3041fe76d314da67e1cb909bfefe"} Jul 14 17:26:00.469767 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:00.469741 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-g4bts" event={"ID":"6a962207-915e-43fc-80f6-3edd2d3451fc","Type":"ContainerStarted","Data":"b7550c4bce224f9ff964a2f9e781bbd3f93088f151ae6bcd70fca9880739d484"} Jul 14 17:26:00.471219 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:00.471197 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-788c5" event={"ID":"870e53a9-7c44-4fd8-866c-7b224a501770","Type":"ContainerStarted","Data":"6820dfc024d9c20aef9c4a83cdfac97c1ace5f426b95ec8c6a7c0bbe639ffec0"} Jul 14 17:26:00.473824 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:00.473808 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cwprj_d3492336-881b-4f13-8d3a-b4d4ec05ad3c/ovn-acl-logging/0.log" Jul 14 17:26:00.474127 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:00.474109 2552 generic.go:356] "Generic (PLEG): container finished" podID="d3492336-881b-4f13-8d3a-b4d4ec05ad3c" containerID="c6291b3b39ad39401e844a7ec9ef76c244020a2f53ba44ec3f6b16b997484f7f" exitCode=1 Jul 14 17:26:00.474197 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:00.474178 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-cwprj" event={"ID":"d3492336-881b-4f13-8d3a-b4d4ec05ad3c","Type":"ContainerStarted","Data":"02c37aeb915ed370c156a424dec8d415518e4eae376fb226b5c42db8c1c61c05"} Jul 14 17:26:00.474272 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:00.474260 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-cwprj" event={"ID":"d3492336-881b-4f13-8d3a-b4d4ec05ad3c","Type":"ContainerStarted","Data":"f64d0cfab55eb27d63955c70e1fa6c23b44a1b5f4bd7f2f371aef718f6607510"} Jul 14 17:26:00.474348 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:00.474314 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-cwprj" event={"ID":"d3492336-881b-4f13-8d3a-b4d4ec05ad3c","Type":"ContainerStarted","Data":"d5b5643a3578205bc17d0bc20383d1e88c2cd1a0fdedae625d6c0c4b2e01a119"} Jul 14 17:26:00.474409 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:00.474385 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-cwprj" event={"ID":"d3492336-881b-4f13-8d3a-b4d4ec05ad3c","Type":"ContainerStarted","Data":"3377ed7cef38a0c3c5c6c8fa3c31b39f9cff7d7a6f76a11636f05453f7ad26b1"} Jul 14 17:26:00.474463 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:00.474437 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-cwprj" event={"ID":"d3492336-881b-4f13-8d3a-b4d4ec05ad3c","Type":"ContainerStarted","Data":"19a215d96ffefbdc7a1ba565f0b206440898f6b1887946491eb8fd7e89d75365"} Jul 14 17:26:00.474519 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:00.474486 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-cwprj" event={"ID":"d3492336-881b-4f13-8d3a-b4d4ec05ad3c","Type":"ContainerDied","Data":"c6291b3b39ad39401e844a7ec9ef76c244020a2f53ba44ec3f6b16b997484f7f"} Jul 14 17:26:00.477518 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:00.477484 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-qs7cs" podStartSLOduration=3.072335357 podStartE2EDuration="22.477473217s" totalImagesPullingTime="19.40513786s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-14 17:25:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 17:26:00.476926411 +0000 UTC m=+22.856040362" watchObservedRunningTime="2026-07-14 17:26:00.477473217 +0000 UTC m=+22.856587168" Jul 14 17:26:00.512343 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:00.512071 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-g4bts" podStartSLOduration=4.022433469 podStartE2EDuration="22.512049622s" totalImagesPullingTime="18.489616153s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-14 17:25:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 17:26:00.511320388 +0000 UTC m=+22.890434340" watchObservedRunningTime="2026-07-14 17:26:00.512049622 +0000 UTC m=+22.891163575" Jul 14 17:26:00.527551 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:00.527499 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-8r8r6" podStartSLOduration=8.236696913 podStartE2EDuration="22.527479886s" totalImagesPullingTime="14.290782973s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 17:25:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 17:26:00.526029592 +0000 UTC m=+22.905143546" watchObservedRunningTime="2026-07-14 17:26:00.527479886 +0000 UTC m=+22.906593839" Jul 14 17:26:00.556341 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:00.556217 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-4t8fg" podStartSLOduration=11.936720529 podStartE2EDuration="22.556197125s" totalImagesPullingTime="10.619476596s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-14 17:25:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 17:26:00.55601232 +0000 UTC m=+22.935126275" watchObservedRunningTime="2026-07-14 17:26:00.556197125 +0000 UTC m=+22.935311079" Jul 14 17:26:00.924298 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:00.924277 2552 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 14 17:26:01.082733 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:01.082597 2552 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-14T17:26:00.924294083Z","UUID":"47c0f96b-befc-4243-9bdd-99fae221def5","Handler":null,"Name":"","Endpoint":""} Jul 14 17:26:01.083938 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:01.083918 2552 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 14 17:26:01.084048 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:01.083957 2552 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 14 17:26:01.382846 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:01.382816 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vjlpd" Jul 14 17:26:01.383125 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:01.382886 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7prlr" Jul 14 17:26:01.383125 ip-10-0-139-16 kubenswrapper[2552]: E0714 17:26:01.382980 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7prlr" podUID="029a166f-0530-4669-9095-ebe6f46b9d8c" Jul 14 17:26:01.383238 ip-10-0-139-16 kubenswrapper[2552]: E0714 17:26:01.383133 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vjlpd" podUID="5e75c85a-a73f-4890-854a-a8d3baff770b" Jul 14 17:26:01.478998 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:01.478960 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-788c5" event={"ID":"870e53a9-7c44-4fd8-866c-7b224a501770","Type":"ContainerStarted","Data":"23c81827d850931d446c2a8188d004100e138d38490833377a82998464813392"} Jul 14 17:26:01.480957 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:01.480930 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-8wgvc" event={"ID":"522da5d4-eacf-4950-ae39-d81bf6277175","Type":"ContainerStarted","Data":"dd099e7bc9cf879343e8358cc9c7b325d816125ed742e3356c34d8f50154313a"} Jul 14 17:26:01.510055 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:01.509996 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-8wgvc" podStartSLOduration=4.677258733 podStartE2EDuration="23.509974028s" totalImagesPullingTime="18.832715295s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-14 17:25:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 17:26:01.495478288 +0000 UTC m=+23.874592241" watchObservedRunningTime="2026-07-14 17:26:01.509974028 +0000 UTC m=+23.889087983" Jul 14 17:26:02.382294 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:02.382214 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-c9lb7" Jul 14 17:26:02.382476 ip-10-0-139-16 kubenswrapper[2552]: E0714 17:26:02.382375 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-c9lb7" podUID="91eea036-14a4-466b-9006-5c3f7e104bf4" Jul 14 17:26:02.485848 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:02.485807 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-16.ec2.internal" event={"ID":"771081612d1c7db4aa39e9060dd20e70","Type":"ContainerStarted","Data":"013bcd4644e3282c527db5aec40547689c2a39370476d278e3b6198ebf2937cc"} Jul 14 17:26:02.488294 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:02.488262 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-788c5" event={"ID":"870e53a9-7c44-4fd8-866c-7b224a501770","Type":"ContainerStarted","Data":"6776461cc7f6a8f061873b50c36f02bc9cd033680d32d51a2f8dc44c57dc834a"} Jul 14 17:26:02.491749 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:02.491728 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cwprj_d3492336-881b-4f13-8d3a-b4d4ec05ad3c/ovn-acl-logging/0.log" Jul 14 17:26:02.492251 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:02.492230 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-cwprj" event={"ID":"d3492336-881b-4f13-8d3a-b4d4ec05ad3c","Type":"ContainerStarted","Data":"3a98495e8c6b3fbdeccc281f08437facfc9ad48797b10c002b41eda78122c3d5"} Jul 14 17:26:02.518486 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:02.518442 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-788c5" podStartSLOduration=3.74041684 podStartE2EDuration="24.518428385s" totalImagesPullingTime="20.778011545s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-14 17:25:38 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 17:26:02.518377856 +0000 UTC m=+24.897491808" watchObservedRunningTime="2026-07-14 17:26:02.518428385 +0000 UTC m=+24.897542337" Jul 14 17:26:02.518694 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:02.518663 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-16.ec2.internal" podStartSLOduration=23.518652346 podStartE2EDuration="23.518652346s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-14 17:25:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 17:26:02.501701497 +0000 UTC m=+24.880815450" watchObservedRunningTime="2026-07-14 17:26:02.518652346 +0000 UTC m=+24.897766299" Jul 14 17:26:02.711136 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:02.711052 2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-8r8r6" Jul 14 17:26:02.711782 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:02.711762 2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-8r8r6" Jul 14 17:26:03.382680 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:03.382649 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7prlr" Jul 14 17:26:03.382859 ip-10-0-139-16 kubenswrapper[2552]: E0714 17:26:03.382783 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7prlr" podUID="029a166f-0530-4669-9095-ebe6f46b9d8c" Jul 14 17:26:03.382859 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:03.382827 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vjlpd" Jul 14 17:26:03.382971 ip-10-0-139-16 kubenswrapper[2552]: E0714 17:26:03.382916 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vjlpd" podUID="5e75c85a-a73f-4890-854a-a8d3baff770b" Jul 14 17:26:04.382417 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:04.382384 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-c9lb7" Jul 14 17:26:04.382892 ip-10-0-139-16 kubenswrapper[2552]: E0714 17:26:04.382518 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-c9lb7" podUID="91eea036-14a4-466b-9006-5c3f7e104bf4" Jul 14 17:26:04.983295 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:04.983094 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-8r8r6" Jul 14 17:26:04.983426 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:04.983352 2552 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Jul 14 17:26:04.983693 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:04.983671 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-8r8r6" Jul 14 17:26:05.382623 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:05.382517 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7prlr" Jul 14 17:26:05.383296 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:05.382545 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vjlpd" Jul 14 17:26:05.383296 ip-10-0-139-16 kubenswrapper[2552]: E0714 17:26:05.382658 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7prlr" podUID="029a166f-0530-4669-9095-ebe6f46b9d8c" Jul 14 17:26:05.383296 ip-10-0-139-16 kubenswrapper[2552]: E0714 17:26:05.382704 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vjlpd" podUID="5e75c85a-a73f-4890-854a-a8d3baff770b" Jul 14 17:26:05.500862 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:05.500827 2552 generic.go:356] "Generic (PLEG): container finished" podID="d84237cc-b659-4943-b3da-ab9f602d4f86" containerID="1d1bc23f6291e8836cfae32f8031785298edb70db20f9b7dbbd157db60471c0f" exitCode=0 Jul 14 17:26:05.501009 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:05.500913 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-5zj72" event={"ID":"d84237cc-b659-4943-b3da-ab9f602d4f86","Type":"ContainerDied","Data":"1d1bc23f6291e8836cfae32f8031785298edb70db20f9b7dbbd157db60471c0f"} Jul 14 17:26:05.504300 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:05.504283 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cwprj_d3492336-881b-4f13-8d3a-b4d4ec05ad3c/ovn-acl-logging/0.log" Jul 14 17:26:05.504676 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:05.504652 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-cwprj" event={"ID":"d3492336-881b-4f13-8d3a-b4d4ec05ad3c","Type":"ContainerStarted","Data":"6d3ffa72fb6923b2d4a7ccd7ac17546be14bfbf2b48581f9e912d0a1955e3f44"} Jul 14 17:26:05.504931 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:05.504912 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-cwprj" Jul 14 17:26:05.505007 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:05.504984 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-cwprj" Jul 14 17:26:05.505069 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:05.505050 2552 scope.go:117] "RemoveContainer" containerID="c6291b3b39ad39401e844a7ec9ef76c244020a2f53ba44ec3f6b16b997484f7f" Jul 14 17:26:05.520905 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:05.520886 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-cwprj" Jul 14 17:26:06.382537 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:06.382504 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-c9lb7" Jul 14 17:26:06.382704 ip-10-0-139-16 kubenswrapper[2552]: E0714 17:26:06.382642 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-c9lb7" podUID="91eea036-14a4-466b-9006-5c3f7e104bf4" Jul 14 17:26:06.510709 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:06.510682 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cwprj_d3492336-881b-4f13-8d3a-b4d4ec05ad3c/ovn-acl-logging/0.log" Jul 14 17:26:06.511079 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:06.511058 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-cwprj" event={"ID":"d3492336-881b-4f13-8d3a-b4d4ec05ad3c","Type":"ContainerStarted","Data":"2dc8eab1c97dc2e255b57e4d9d331564c248b5786b47d6b5598c7dc9401e480f"} Jul 14 17:26:06.511247 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:06.511227 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-cwprj" Jul 14 17:26:06.525956 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:06.525805 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-cwprj" Jul 14 17:26:06.539013 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:06.538917 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-cwprj" podStartSLOduration=9.591298977 podStartE2EDuration="28.538898718s" totalImagesPullingTime="18.947599741s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-14 17:25:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 17:26:06.535988313 +0000 UTC m=+28.915102288" watchObservedRunningTime="2026-07-14 17:26:06.538898718 +0000 UTC m=+28.918012681" Jul 14 17:26:07.266677 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:07.266645 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-c9lb7"] Jul 14 17:26:07.266837 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:07.266803 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-c9lb7" Jul 14 17:26:07.266916 ip-10-0-139-16 kubenswrapper[2552]: E0714 17:26:07.266893 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-c9lb7" podUID="91eea036-14a4-466b-9006-5c3f7e104bf4" Jul 14 17:26:07.269774 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:07.269744 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-vjlpd"] Jul 14 17:26:07.269893 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:07.269845 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vjlpd" Jul 14 17:26:07.269964 ip-10-0-139-16 kubenswrapper[2552]: E0714 17:26:07.269940 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vjlpd" podUID="5e75c85a-a73f-4890-854a-a8d3baff770b" Jul 14 17:26:07.270414 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:07.270390 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-7prlr"] Jul 14 17:26:07.270505 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:07.270494 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7prlr" Jul 14 17:26:07.270605 ip-10-0-139-16 kubenswrapper[2552]: E0714 17:26:07.270588 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7prlr" podUID="029a166f-0530-4669-9095-ebe6f46b9d8c" Jul 14 17:26:07.515038 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:07.515001 2552 generic.go:356] "Generic (PLEG): container finished" podID="d84237cc-b659-4943-b3da-ab9f602d4f86" containerID="491f42b11b5b07f151ce04ccdf8b37ff6c89df014788f93deb333d0b3e211b77" exitCode=0 Jul 14 17:26:07.515430 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:07.515063 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-5zj72" event={"ID":"d84237cc-b659-4943-b3da-ab9f602d4f86","Type":"ContainerDied","Data":"491f42b11b5b07f151ce04ccdf8b37ff6c89df014788f93deb333d0b3e211b77"} Jul 14 17:26:08.382797 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:08.382775 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-c9lb7" Jul 14 17:26:08.382877 ip-10-0-139-16 kubenswrapper[2552]: E0714 17:26:08.382858 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-c9lb7" podUID="91eea036-14a4-466b-9006-5c3f7e104bf4" Jul 14 17:26:08.519477 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:08.519396 2552 generic.go:356] "Generic (PLEG): container finished" podID="d84237cc-b659-4943-b3da-ab9f602d4f86" containerID="c76d5b8a2b90fe49e27895fdd65606e796a9234d325fee16dd84135ffff2ef1f" exitCode=0 Jul 14 17:26:08.519477 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:08.519442 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-5zj72" event={"ID":"d84237cc-b659-4943-b3da-ab9f602d4f86","Type":"ContainerDied","Data":"c76d5b8a2b90fe49e27895fdd65606e796a9234d325fee16dd84135ffff2ef1f"} Jul 14 17:26:09.382348 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:09.382259 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vjlpd" Jul 14 17:26:09.382348 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:09.382284 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7prlr" Jul 14 17:26:09.382552 ip-10-0-139-16 kubenswrapper[2552]: E0714 17:26:09.382373 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vjlpd" podUID="5e75c85a-a73f-4890-854a-a8d3baff770b" Jul 14 17:26:09.382552 ip-10-0-139-16 kubenswrapper[2552]: E0714 17:26:09.382522 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7prlr" podUID="029a166f-0530-4669-9095-ebe6f46b9d8c" Jul 14 17:26:10.382753 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:10.382608 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-c9lb7" Jul 14 17:26:10.382753 ip-10-0-139-16 kubenswrapper[2552]: E0714 17:26:10.382728 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-c9lb7" podUID="91eea036-14a4-466b-9006-5c3f7e104bf4" Jul 14 17:26:11.382946 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:11.382913 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7prlr" Jul 14 17:26:11.383413 ip-10-0-139-16 kubenswrapper[2552]: E0714 17:26:11.383040 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7prlr" podUID="029a166f-0530-4669-9095-ebe6f46b9d8c" Jul 14 17:26:11.383413 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:11.383106 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vjlpd" Jul 14 17:26:11.383413 ip-10-0-139-16 kubenswrapper[2552]: E0714 17:26:11.383228 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vjlpd" podUID="5e75c85a-a73f-4890-854a-a8d3baff770b" Jul 14 17:26:11.763836 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:11.763745 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5m5jk\" (UniqueName: \"kubernetes.io/projected/5e75c85a-a73f-4890-854a-a8d3baff770b-kube-api-access-5m5jk\") pod \"network-check-target-vjlpd\" (UID: \"5e75c85a-a73f-4890-854a-a8d3baff770b\") " pod="openshift-network-diagnostics/network-check-target-vjlpd" Jul 14 17:26:11.763836 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:11.763821 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/91eea036-14a4-466b-9006-5c3f7e104bf4-original-pull-secret\") pod \"global-pull-secret-syncer-c9lb7\" (UID: \"91eea036-14a4-466b-9006-5c3f7e104bf4\") " pod="kube-system/global-pull-secret-syncer-c9lb7" Jul 14 17:26:11.764071 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:11.763866 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/029a166f-0530-4669-9095-ebe6f46b9d8c-metrics-certs\") pod \"network-metrics-daemon-7prlr\" (UID: \"029a166f-0530-4669-9095-ebe6f46b9d8c\") " pod="openshift-multus/network-metrics-daemon-7prlr" Jul 14 17:26:11.764071 ip-10-0-139-16 kubenswrapper[2552]: E0714 17:26:11.763898 2552 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 14 17:26:11.764071 ip-10-0-139-16 kubenswrapper[2552]: E0714 17:26:11.763927 2552 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 14 17:26:11.764071 ip-10-0-139-16 kubenswrapper[2552]: E0714 17:26:11.763939 2552 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 14 17:26:11.764071 ip-10-0-139-16 kubenswrapper[2552]: E0714 17:26:11.763955 2552 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 14 17:26:11.764071 ip-10-0-139-16 kubenswrapper[2552]: E0714 17:26:11.764010 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/029a166f-0530-4669-9095-ebe6f46b9d8c-metrics-certs podName:029a166f-0530-4669-9095-ebe6f46b9d8c nodeName:}" failed. No retries permitted until 2026-07-14 17:26:43.763990354 +0000 UTC m=+66.143104286 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/029a166f-0530-4669-9095-ebe6f46b9d8c-metrics-certs") pod "network-metrics-daemon-7prlr" (UID: "029a166f-0530-4669-9095-ebe6f46b9d8c") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 14 17:26:11.764071 ip-10-0-139-16 kubenswrapper[2552]: E0714 17:26:11.764027 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/91eea036-14a4-466b-9006-5c3f7e104bf4-original-pull-secret podName:91eea036-14a4-466b-9006-5c3f7e104bf4 nodeName:}" failed. No retries permitted until 2026-07-14 17:26:43.764017338 +0000 UTC m=+66.143131268 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/91eea036-14a4-466b-9006-5c3f7e104bf4-original-pull-secret") pod "global-pull-secret-syncer-c9lb7" (UID: "91eea036-14a4-466b-9006-5c3f7e104bf4") : object "kube-system"/"original-pull-secret" not registered Jul 14 17:26:11.764071 ip-10-0-139-16 kubenswrapper[2552]: E0714 17:26:11.763942 2552 projected.go:196] Error preparing data for projected volume kube-api-access-5m5jk for pod openshift-network-diagnostics/network-check-target-vjlpd: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 14 17:26:11.764466 ip-10-0-139-16 kubenswrapper[2552]: E0714 17:26:11.764090 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5e75c85a-a73f-4890-854a-a8d3baff770b-kube-api-access-5m5jk podName:5e75c85a-a73f-4890-854a-a8d3baff770b nodeName:}" failed. No retries permitted until 2026-07-14 17:26:43.764070037 +0000 UTC m=+66.143183967 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-5m5jk" (UniqueName: "kubernetes.io/projected/5e75c85a-a73f-4890-854a-a8d3baff770b-kube-api-access-5m5jk") pod "network-check-target-vjlpd" (UID: "5e75c85a-a73f-4890-854a-a8d3baff770b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 14 17:26:12.382250 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:12.382215 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-c9lb7" Jul 14 17:26:12.382442 ip-10-0-139-16 kubenswrapper[2552]: E0714 17:26:12.382362 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-c9lb7" podUID="91eea036-14a4-466b-9006-5c3f7e104bf4" Jul 14 17:26:12.399802 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:12.399777 2552 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-16.ec2.internal" event="NodeReady" Jul 14 17:26:12.400181 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:12.399914 2552 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 14 17:26:12.433653 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:12.433574 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-hznkp"] Jul 14 17:26:12.464711 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:12.464680 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-899c5876f-m6hqz"] Jul 14 17:26:12.464880 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:12.464838 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-hznkp" Jul 14 17:26:12.471002 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:12.470973 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 14 17:26:12.471002 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:12.470996 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-cv7gf\"" Jul 14 17:26:12.472160 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:12.471778 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\"" Jul 14 17:26:12.472160 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:12.471789 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 14 17:26:12.473737 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:12.473558 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\"" Jul 14 17:26:12.478530 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:12.478511 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-68d9dd94cf-dq264"] Jul 14 17:26:12.478686 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:12.478638 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-899c5876f-m6hqz" Jul 14 17:26:12.481459 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:12.481440 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jul 14 17:26:12.481564 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:12.481546 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jul 14 17:26:12.481635 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:12.481554 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jul 14 17:26:12.481973 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:12.481953 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-smpv7\"" Jul 14 17:26:12.494794 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:12.494775 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-5484d54d6d-2b7v2"] Jul 14 17:26:12.494910 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:12.494895 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-68d9dd94cf-dq264" Jul 14 17:26:12.498672 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:12.498217 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-kx2xb\"" Jul 14 17:26:12.498672 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:12.498401 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\"" Jul 14 17:26:12.498672 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:12.498545 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 14 17:26:12.499079 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:12.499062 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\"" Jul 14 17:26:12.499722 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:12.499449 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 14 17:26:12.500895 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:12.500868 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jul 14 17:26:12.512870 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:12.512837 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-65db858894-q49pd"] Jul 14 17:26:12.513080 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:12.513061 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-5484d54d6d-2b7v2" Jul 14 17:26:12.516368 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:12.516346 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\"" Jul 14 17:26:12.516470 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:12.516380 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\"" Jul 14 17:26:12.516581 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:12.516563 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\"" Jul 14 17:26:12.516655 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:12.516573 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jul 14 17:26:12.516959 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:12.516940 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jul 14 17:26:12.517054 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:12.517008 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-t9wnw\"" Jul 14 17:26:12.517528 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:12.517510 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\"" Jul 14 17:26:12.517611 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:12.517539 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\"" Jul 14 17:26:12.529344 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:12.529308 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-7nwwb"] Jul 14 17:26:12.529451 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:12.529415 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-q49pd" Jul 14 17:26:12.532362 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:12.531946 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\"" Jul 14 17:26:12.532362 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:12.532168 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-9d27l\"" Jul 14 17:26:12.532362 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:12.532201 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\"" Jul 14 17:26:12.532362 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:12.532264 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\"" Jul 14 17:26:12.539144 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:12.539125 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-7866497494-gnw2z"] Jul 14 17:26:12.539269 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:12.539248 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-7nwwb" Jul 14 17:26:12.541854 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:12.541834 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-n8whf\"" Jul 14 17:26:12.541948 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:12.541912 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\"" Jul 14 17:26:12.542031 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:12.541998 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\"" Jul 14 17:26:12.553265 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:12.553247 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-6xn2k"] Jul 14 17:26:12.553423 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:12.553405 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-7866497494-gnw2z" Jul 14 17:26:12.556345 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:12.556284 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\"" Jul 14 17:26:12.556345 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:12.556302 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\"" Jul 14 17:26:12.556510 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:12.556289 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\"" Jul 14 17:26:12.556510 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:12.556294 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\"" Jul 14 17:26:12.556682 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:12.556524 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-cq4kc\"" Jul 14 17:26:12.560949 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:12.560915 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\"" Jul 14 17:26:12.567561 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:12.567543 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-7695fc6c8c-wzm2l"] Jul 14 17:26:12.567561 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:12.567557 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-6xn2k" Jul 14 17:26:12.570587 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:12.570561 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-ls9sr\"" Jul 14 17:26:12.570704 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:12.570676 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0f57e94d-cace-4645-a5cb-47f7dd6dc854-registry-tls\") pod \"image-registry-899c5876f-m6hqz\" (UID: \"0f57e94d-cace-4645-a5cb-47f7dd6dc854\") " pod="openshift-image-registry/image-registry-899c5876f-m6hqz" Jul 14 17:26:12.570780 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:12.570726 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/5a0f3a9b-3347-43e5-910b-229e446543ad-snapshots\") pod \"insights-operator-68d9dd94cf-dq264\" (UID: \"5a0f3a9b-3347-43e5-910b-229e446543ad\") " pod="openshift-insights/insights-operator-68d9dd94cf-dq264" Jul 14 17:26:12.570780 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:12.570770 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-65699\" (UniqueName: \"kubernetes.io/projected/0f57e94d-cace-4645-a5cb-47f7dd6dc854-kube-api-access-65699\") pod \"image-registry-899c5876f-m6hqz\" (UID: \"0f57e94d-cace-4645-a5cb-47f7dd6dc854\") " pod="openshift-image-registry/image-registry-899c5876f-m6hqz" Jul 14 17:26:12.570889 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:12.570802 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5a0f3a9b-3347-43e5-910b-229e446543ad-tmp\") pod \"insights-operator-68d9dd94cf-dq264\" (UID: \"5a0f3a9b-3347-43e5-910b-229e446543ad\") " pod="openshift-insights/insights-operator-68d9dd94cf-dq264" Jul 14 17:26:12.570889 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:12.570834 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/5a0f3a9b-3347-43e5-910b-229e446543ad-serving-cert\") pod \"insights-operator-68d9dd94cf-dq264\" (UID: \"5a0f3a9b-3347-43e5-910b-229e446543ad\") " pod="openshift-insights/insights-operator-68d9dd94cf-dq264" Jul 14 17:26:12.570889 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:12.570862 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\"" Jul 14 17:26:12.571030 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:12.570899 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/f60de25a-6c7c-41f4-87ce-de3f4eca5c3a-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-hznkp\" (UID: \"f60de25a-6c7c-41f4-87ce-de3f4eca5c3a\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-hznkp" Jul 14 17:26:12.571030 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:12.570936 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/0f57e94d-cace-4645-a5cb-47f7dd6dc854-registry-certificates\") pod \"image-registry-899c5876f-m6hqz\" (UID: \"0f57e94d-cace-4645-a5cb-47f7dd6dc854\") " pod="openshift-image-registry/image-registry-899c5876f-m6hqz" Jul 14 17:26:12.571030 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:12.570964 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/0f57e94d-cace-4645-a5cb-47f7dd6dc854-installation-pull-secrets\") pod \"image-registry-899c5876f-m6hqz\" (UID: \"0f57e94d-cace-4645-a5cb-47f7dd6dc854\") " pod="openshift-image-registry/image-registry-899c5876f-m6hqz" Jul 14 17:26:12.571030 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:12.570995 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5a0f3a9b-3347-43e5-910b-229e446543ad-service-ca-bundle\") pod \"insights-operator-68d9dd94cf-dq264\" (UID: \"5a0f3a9b-3347-43e5-910b-229e446543ad\") " pod="openshift-insights/insights-operator-68d9dd94cf-dq264" Jul 14 17:26:12.571221 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:12.571029 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/f60de25a-6c7c-41f4-87ce-de3f4eca5c3a-telemetry-config\") pod \"cluster-monitoring-operator-5f7f494dd4-hznkp\" (UID: \"f60de25a-6c7c-41f4-87ce-de3f4eca5c3a\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-hznkp" Jul 14 17:26:12.571221 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:12.571062 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/0f57e94d-cace-4645-a5cb-47f7dd6dc854-trusted-ca\") pod \"image-registry-899c5876f-m6hqz\" (UID: \"0f57e94d-cace-4645-a5cb-47f7dd6dc854\") " pod="openshift-image-registry/image-registry-899c5876f-m6hqz" Jul 14 17:26:12.571221 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:12.571071 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\"" Jul 14 17:26:12.571221 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:12.571090 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-86fm6\" (UniqueName: \"kubernetes.io/projected/5a0f3a9b-3347-43e5-910b-229e446543ad-kube-api-access-86fm6\") pod \"insights-operator-68d9dd94cf-dq264\" (UID: \"5a0f3a9b-3347-43e5-910b-229e446543ad\") " pod="openshift-insights/insights-operator-68d9dd94cf-dq264" Jul 14 17:26:12.571221 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:12.571134 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/0f57e94d-cace-4645-a5cb-47f7dd6dc854-image-registry-private-configuration\") pod \"image-registry-899c5876f-m6hqz\" (UID: \"0f57e94d-cace-4645-a5cb-47f7dd6dc854\") " pod="openshift-image-registry/image-registry-899c5876f-m6hqz" Jul 14 17:26:12.571221 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:12.571178 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5a0f3a9b-3347-43e5-910b-229e446543ad-trusted-ca-bundle\") pod \"insights-operator-68d9dd94cf-dq264\" (UID: \"5a0f3a9b-3347-43e5-910b-229e446543ad\") " pod="openshift-insights/insights-operator-68d9dd94cf-dq264" Jul 14 17:26:12.571221 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:12.571210 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-scczt\" (UniqueName: \"kubernetes.io/projected/f60de25a-6c7c-41f4-87ce-de3f4eca5c3a-kube-api-access-scczt\") pod \"cluster-monitoring-operator-5f7f494dd4-hznkp\" (UID: \"f60de25a-6c7c-41f4-87ce-de3f4eca5c3a\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-hznkp" Jul 14 17:26:12.571579 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:12.571236 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/0f57e94d-cace-4645-a5cb-47f7dd6dc854-ca-trust-extracted\") pod \"image-registry-899c5876f-m6hqz\" (UID: \"0f57e94d-cace-4645-a5cb-47f7dd6dc854\") " pod="openshift-image-registry/image-registry-899c5876f-m6hqz" Jul 14 17:26:12.571579 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:12.571266 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/0f57e94d-cace-4645-a5cb-47f7dd6dc854-bound-sa-token\") pod \"image-registry-899c5876f-m6hqz\" (UID: \"0f57e94d-cace-4645-a5cb-47f7dd6dc854\") " pod="openshift-image-registry/image-registry-899c5876f-m6hqz" Jul 14 17:26:12.571579 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:12.571347 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\"" Jul 14 17:26:12.571579 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:12.571560 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\"" Jul 14 17:26:12.579403 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:12.579380 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-869dcfcdcd-ckl8p"] Jul 14 17:26:12.579525 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:12.579512 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-wzm2l" Jul 14 17:26:12.581779 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:12.581754 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\"" Jul 14 17:26:12.581970 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:12.581952 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-7vh64\"" Jul 14 17:26:12.582182 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:12.582164 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\"" Jul 14 17:26:12.582266 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:12.582237 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\"" Jul 14 17:26:12.582492 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:12.582472 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\"" Jul 14 17:26:12.591576 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:12.591559 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-r7tpq"] Jul 14 17:26:12.591689 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:12.591673 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-ckl8p" Jul 14 17:26:12.594429 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:12.594409 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 14 17:26:12.594527 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:12.594479 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-s459h\"" Jul 14 17:26:12.594527 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:12.594517 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 14 17:26:12.605791 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:12.605770 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-7nwwb"] Jul 14 17:26:12.605878 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:12.605804 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-65db858894-q49pd"] Jul 14 17:26:12.605878 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:12.605833 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-w4vkl"] Jul 14 17:26:12.605962 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:12.605948 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-r7tpq" Jul 14 17:26:12.608969 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:12.608950 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 14 17:26:12.609088 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:12.609019 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-6ft2z\"" Jul 14 17:26:12.609088 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:12.609019 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 14 17:26:12.619742 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:12.619722 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-hznkp"] Jul 14 17:26:12.619842 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:12.619756 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-68d9dd94cf-dq264"] Jul 14 17:26:12.619842 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:12.619776 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-7866497494-gnw2z"] Jul 14 17:26:12.619842 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:12.619796 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-7695fc6c8c-wzm2l"] Jul 14 17:26:12.619842 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:12.619812 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-869dcfcdcd-ckl8p"] Jul 14 17:26:12.619842 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:12.619824 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-899c5876f-m6hqz"] Jul 14 17:26:12.619842 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:12.619836 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-6xn2k"] Jul 14 17:26:12.620061 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:12.619848 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-w4vkl"] Jul 14 17:26:12.620061 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:12.619869 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-r7tpq"] Jul 14 17:26:12.620061 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:12.619887 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-5484d54d6d-2b7v2"] Jul 14 17:26:12.620061 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:12.619846 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-w4vkl" Jul 14 17:26:12.622782 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:12.622761 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 14 17:26:12.622887 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:12.622839 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-2lrmp\"" Jul 14 17:26:12.622954 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:12.622912 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 14 17:26:12.623010 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:12.622982 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 14 17:26:12.654457 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:12.654420 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 17:26:12.672342 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:12.672301 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/0f57e94d-cace-4645-a5cb-47f7dd6dc854-image-registry-private-configuration\") pod \"image-registry-899c5876f-m6hqz\" (UID: \"0f57e94d-cace-4645-a5cb-47f7dd6dc854\") " pod="openshift-image-registry/image-registry-899c5876f-m6hqz" Jul 14 17:26:12.672513 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:12.672361 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sw7dj\" (UniqueName: \"kubernetes.io/projected/62900e1e-659d-4c6e-9e31-2933f84ebc70-kube-api-access-sw7dj\") pod \"kube-storage-version-migrator-operator-799cb7f958-6xn2k\" (UID: \"62900e1e-659d-4c6e-9e31-2933f84ebc70\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-6xn2k" Jul 14 17:26:12.672513 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:12.672395 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/62900e1e-659d-4c6e-9e31-2933f84ebc70-serving-cert\") pod \"kube-storage-version-migrator-operator-799cb7f958-6xn2k\" (UID: \"62900e1e-659d-4c6e-9e31-2933f84ebc70\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-6xn2k" Jul 14 17:26:12.672513 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:12.672437 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5a0f3a9b-3347-43e5-910b-229e446543ad-trusted-ca-bundle\") pod \"insights-operator-68d9dd94cf-dq264\" (UID: \"5a0f3a9b-3347-43e5-910b-229e446543ad\") " pod="openshift-insights/insights-operator-68d9dd94cf-dq264" Jul 14 17:26:12.672513 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:12.672464 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/b3c71861-4db9-4850-a44b-6f5d44a94235-config\") pod \"console-operator-7866497494-gnw2z\" (UID: \"b3c71861-4db9-4850-a44b-6f5d44a94235\") " pod="openshift-console-operator/console-operator-7866497494-gnw2z" Jul 14 17:26:12.672513 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:12.672500 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-scczt\" (UniqueName: \"kubernetes.io/projected/f60de25a-6c7c-41f4-87ce-de3f4eca5c3a-kube-api-access-scczt\") pod \"cluster-monitoring-operator-5f7f494dd4-hznkp\" (UID: \"f60de25a-6c7c-41f4-87ce-de3f4eca5c3a\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-hznkp" Jul 14 17:26:12.672772 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:12.672550 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/0f57e94d-cace-4645-a5cb-47f7dd6dc854-ca-trust-extracted\") pod \"image-registry-899c5876f-m6hqz\" (UID: \"0f57e94d-cace-4645-a5cb-47f7dd6dc854\") " pod="openshift-image-registry/image-registry-899c5876f-m6hqz" Jul 14 17:26:12.672772 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:12.672587 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/0f57e94d-cace-4645-a5cb-47f7dd6dc854-bound-sa-token\") pod \"image-registry-899c5876f-m6hqz\" (UID: \"0f57e94d-cace-4645-a5cb-47f7dd6dc854\") " pod="openshift-image-registry/image-registry-899c5876f-m6hqz" Jul 14 17:26:12.672772 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:12.672617 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g6tx7\" (UniqueName: \"kubernetes.io/projected/fbb398bf-d6aa-4566-8bdb-a78349ea23c7-kube-api-access-g6tx7\") pod \"volume-data-source-validator-78495597f6-7nwwb\" (UID: \"fbb398bf-d6aa-4566-8bdb-a78349ea23c7\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-7nwwb" Jul 14 17:26:12.672772 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:12.672656 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0f57e94d-cace-4645-a5cb-47f7dd6dc854-registry-tls\") pod \"image-registry-899c5876f-m6hqz\" (UID: \"0f57e94d-cace-4645-a5cb-47f7dd6dc854\") " pod="openshift-image-registry/image-registry-899c5876f-m6hqz" Jul 14 17:26:12.672772 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:12.672682 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/9a20f557-1033-431a-8986-88c97723b31c-stats-auth\") pod \"router-default-5484d54d6d-2b7v2\" (UID: \"9a20f557-1033-431a-8986-88c97723b31c\") " pod="openshift-ingress/router-default-5484d54d6d-2b7v2" Jul 14 17:26:12.672772 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:12.672717 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-65699\" (UniqueName: \"kubernetes.io/projected/0f57e94d-cace-4645-a5cb-47f7dd6dc854-kube-api-access-65699\") pod \"image-registry-899c5876f-m6hqz\" (UID: \"0f57e94d-cace-4645-a5cb-47f7dd6dc854\") " pod="openshift-image-registry/image-registry-899c5876f-m6hqz" Jul 14 17:26:12.672772 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:12.672743 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5a0f3a9b-3347-43e5-910b-229e446543ad-tmp\") pod \"insights-operator-68d9dd94cf-dq264\" (UID: \"5a0f3a9b-3347-43e5-910b-229e446543ad\") " pod="openshift-insights/insights-operator-68d9dd94cf-dq264" Jul 14 17:26:12.672772 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:12.672767 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/5a0f3a9b-3347-43e5-910b-229e446543ad-serving-cert\") pod \"insights-operator-68d9dd94cf-dq264\" (UID: \"5a0f3a9b-3347-43e5-910b-229e446543ad\") " pod="openshift-insights/insights-operator-68d9dd94cf-dq264" Jul 14 17:26:12.673140 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:12.672800 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/0f57e94d-cace-4645-a5cb-47f7dd6dc854-trusted-ca\") pod \"image-registry-899c5876f-m6hqz\" (UID: \"0f57e94d-cace-4645-a5cb-47f7dd6dc854\") " pod="openshift-image-registry/image-registry-899c5876f-m6hqz" Jul 14 17:26:12.673140 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:12.672828 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/f60de25a-6c7c-41f4-87ce-de3f4eca5c3a-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-hznkp\" (UID: \"f60de25a-6c7c-41f4-87ce-de3f4eca5c3a\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-hznkp" Jul 14 17:26:12.673140 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:12.672854 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9a20f557-1033-431a-8986-88c97723b31c-metrics-certs\") pod \"router-default-5484d54d6d-2b7v2\" (UID: \"9a20f557-1033-431a-8986-88c97723b31c\") " pod="openshift-ingress/router-default-5484d54d6d-2b7v2" Jul 14 17:26:12.673140 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:12.672882 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5a0f3a9b-3347-43e5-910b-229e446543ad-service-ca-bundle\") pod \"insights-operator-68d9dd94cf-dq264\" (UID: \"5a0f3a9b-3347-43e5-910b-229e446543ad\") " pod="openshift-insights/insights-operator-68d9dd94cf-dq264" Jul 14 17:26:12.673140 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:12.672914 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/f60de25a-6c7c-41f4-87ce-de3f4eca5c3a-telemetry-config\") pod \"cluster-monitoring-operator-5f7f494dd4-hznkp\" (UID: \"f60de25a-6c7c-41f4-87ce-de3f4eca5c3a\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-hznkp" Jul 14 17:26:12.673140 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:12.672939 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/9a20f557-1033-431a-8986-88c97723b31c-default-certificate\") pod \"router-default-5484d54d6d-2b7v2\" (UID: \"9a20f557-1033-431a-8986-88c97723b31c\") " pod="openshift-ingress/router-default-5484d54d6d-2b7v2" Jul 14 17:26:12.673140 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:12.672977 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dnfwj\" (UniqueName: \"kubernetes.io/projected/b3c71861-4db9-4850-a44b-6f5d44a94235-kube-api-access-dnfwj\") pod \"console-operator-7866497494-gnw2z\" (UID: \"b3c71861-4db9-4850-a44b-6f5d44a94235\") " pod="openshift-console-operator/console-operator-7866497494-gnw2z" Jul 14 17:26:12.673140 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:12.673013 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sxdwr\" (UniqueName: \"kubernetes.io/projected/9a20f557-1033-431a-8986-88c97723b31c-kube-api-access-sxdwr\") pod \"router-default-5484d54d6d-2b7v2\" (UID: \"9a20f557-1033-431a-8986-88c97723b31c\") " pod="openshift-ingress/router-default-5484d54d6d-2b7v2" Jul 14 17:26:12.673140 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:12.673040 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/0f57e94d-cace-4645-a5cb-47f7dd6dc854-ca-trust-extracted\") pod \"image-registry-899c5876f-m6hqz\" (UID: \"0f57e94d-cace-4645-a5cb-47f7dd6dc854\") " pod="openshift-image-registry/image-registry-899c5876f-m6hqz" Jul 14 17:26:12.673140 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:12.673044 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/e0e19152-87b3-4e28-9739-36d5639e5eb1-serving-cert\") pod \"service-ca-operator-7695fc6c8c-wzm2l\" (UID: \"e0e19152-87b3-4e28-9739-36d5639e5eb1\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-wzm2l" Jul 14 17:26:12.673140 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:12.673098 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-569wb\" (UniqueName: \"kubernetes.io/projected/e508c23b-e275-4952-8fef-8294dfe75474-kube-api-access-569wb\") pod \"cluster-samples-operator-65db858894-q49pd\" (UID: \"e508c23b-e275-4952-8fef-8294dfe75474\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-q49pd" Jul 14 17:26:12.673140 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:12.673126 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/e0e19152-87b3-4e28-9739-36d5639e5eb1-config\") pod \"service-ca-operator-7695fc6c8c-wzm2l\" (UID: \"e0e19152-87b3-4e28-9739-36d5639e5eb1\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-wzm2l" Jul 14 17:26:12.673760 ip-10-0-139-16 kubenswrapper[2552]: E0714 17:26:12.673132 2552 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 14 17:26:12.673760 ip-10-0-139-16 kubenswrapper[2552]: E0714 17:26:12.673161 2552 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-899c5876f-m6hqz: secret "image-registry-tls" not found Jul 14 17:26:12.673760 ip-10-0-139-16 kubenswrapper[2552]: E0714 17:26:12.673165 2552 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 14 17:26:12.673760 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:12.673171 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9a20f557-1033-431a-8986-88c97723b31c-service-ca-bundle\") pod \"router-default-5484d54d6d-2b7v2\" (UID: \"9a20f557-1033-431a-8986-88c97723b31c\") " pod="openshift-ingress/router-default-5484d54d6d-2b7v2" Jul 14 17:26:12.673760 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:12.673201 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/5a0f3a9b-3347-43e5-910b-229e446543ad-snapshots\") pod \"insights-operator-68d9dd94cf-dq264\" (UID: \"5a0f3a9b-3347-43e5-910b-229e446543ad\") " pod="openshift-insights/insights-operator-68d9dd94cf-dq264" Jul 14 17:26:12.673760 ip-10-0-139-16 kubenswrapper[2552]: E0714 17:26:12.673221 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f60de25a-6c7c-41f4-87ce-de3f4eca5c3a-cluster-monitoring-operator-tls podName:f60de25a-6c7c-41f4-87ce-de3f4eca5c3a nodeName:}" failed. No retries permitted until 2026-07-14 17:26:13.17320682 +0000 UTC m=+35.552320750 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/f60de25a-6c7c-41f4-87ce-de3f4eca5c3a-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-hznkp" (UID: "f60de25a-6c7c-41f4-87ce-de3f4eca5c3a") : secret "cluster-monitoring-operator-tls" not found Jul 14 17:26:12.673760 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:12.673257 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5a0f3a9b-3347-43e5-910b-229e446543ad-trusted-ca-bundle\") pod \"insights-operator-68d9dd94cf-dq264\" (UID: \"5a0f3a9b-3347-43e5-910b-229e446543ad\") " pod="openshift-insights/insights-operator-68d9dd94cf-dq264" Jul 14 17:26:12.673760 ip-10-0-139-16 kubenswrapper[2552]: E0714 17:26:12.673310 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0f57e94d-cace-4645-a5cb-47f7dd6dc854-registry-tls podName:0f57e94d-cace-4645-a5cb-47f7dd6dc854 nodeName:}" failed. No retries permitted until 2026-07-14 17:26:13.173295403 +0000 UTC m=+35.552409332 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/0f57e94d-cace-4645-a5cb-47f7dd6dc854-registry-tls") pod "image-registry-899c5876f-m6hqz" (UID: "0f57e94d-cace-4645-a5cb-47f7dd6dc854") : secret "image-registry-tls" not found Jul 14 17:26:12.673760 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:12.673736 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5a0f3a9b-3347-43e5-910b-229e446543ad-service-ca-bundle\") pod \"insights-operator-68d9dd94cf-dq264\" (UID: \"5a0f3a9b-3347-43e5-910b-229e446543ad\") " pod="openshift-insights/insights-operator-68d9dd94cf-dq264" Jul 14 17:26:12.674146 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:12.673924 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5a0f3a9b-3347-43e5-910b-229e446543ad-tmp\") pod \"insights-operator-68d9dd94cf-dq264\" (UID: \"5a0f3a9b-3347-43e5-910b-229e446543ad\") " pod="openshift-insights/insights-operator-68d9dd94cf-dq264" Jul 14 17:26:12.674146 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:12.673997 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4hwn7\" (UniqueName: \"kubernetes.io/projected/e0e19152-87b3-4e28-9739-36d5639e5eb1-kube-api-access-4hwn7\") pod \"service-ca-operator-7695fc6c8c-wzm2l\" (UID: \"e0e19152-87b3-4e28-9739-36d5639e5eb1\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-wzm2l" Jul 14 17:26:12.674146 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:12.674049 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/b3c71861-4db9-4850-a44b-6f5d44a94235-serving-cert\") pod \"console-operator-7866497494-gnw2z\" (UID: \"b3c71861-4db9-4850-a44b-6f5d44a94235\") " pod="openshift-console-operator/console-operator-7866497494-gnw2z" Jul 14 17:26:12.674146 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:12.674085 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/62900e1e-659d-4c6e-9e31-2933f84ebc70-config\") pod \"kube-storage-version-migrator-operator-799cb7f958-6xn2k\" (UID: \"62900e1e-659d-4c6e-9e31-2933f84ebc70\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-6xn2k" Jul 14 17:26:12.674343 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:12.674158 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-86fm6\" (UniqueName: \"kubernetes.io/projected/5a0f3a9b-3347-43e5-910b-229e446543ad-kube-api-access-86fm6\") pod \"insights-operator-68d9dd94cf-dq264\" (UID: \"5a0f3a9b-3347-43e5-910b-229e446543ad\") " pod="openshift-insights/insights-operator-68d9dd94cf-dq264" Jul 14 17:26:12.674343 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:12.674285 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/0f57e94d-cace-4645-a5cb-47f7dd6dc854-trusted-ca\") pod \"image-registry-899c5876f-m6hqz\" (UID: \"0f57e94d-cace-4645-a5cb-47f7dd6dc854\") " pod="openshift-image-registry/image-registry-899c5876f-m6hqz" Jul 14 17:26:12.674444 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:12.674351 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/e508c23b-e275-4952-8fef-8294dfe75474-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-q49pd\" (UID: \"e508c23b-e275-4952-8fef-8294dfe75474\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-q49pd" Jul 14 17:26:12.674444 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:12.674378 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fzlft\" (UniqueName: \"kubernetes.io/projected/aa9ffe90-3c13-4508-861a-97379e7154aa-kube-api-access-fzlft\") pod \"network-check-source-869dcfcdcd-ckl8p\" (UID: \"aa9ffe90-3c13-4508-861a-97379e7154aa\") " pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-ckl8p" Jul 14 17:26:12.674444 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:12.674389 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/5a0f3a9b-3347-43e5-910b-229e446543ad-snapshots\") pod \"insights-operator-68d9dd94cf-dq264\" (UID: \"5a0f3a9b-3347-43e5-910b-229e446543ad\") " pod="openshift-insights/insights-operator-68d9dd94cf-dq264" Jul 14 17:26:12.674444 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:12.674409 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/0f57e94d-cace-4645-a5cb-47f7dd6dc854-registry-certificates\") pod \"image-registry-899c5876f-m6hqz\" (UID: \"0f57e94d-cace-4645-a5cb-47f7dd6dc854\") " pod="openshift-image-registry/image-registry-899c5876f-m6hqz" Jul 14 17:26:12.674444 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:12.674434 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/0f57e94d-cace-4645-a5cb-47f7dd6dc854-installation-pull-secrets\") pod \"image-registry-899c5876f-m6hqz\" (UID: \"0f57e94d-cace-4645-a5cb-47f7dd6dc854\") " pod="openshift-image-registry/image-registry-899c5876f-m6hqz" Jul 14 17:26:12.674641 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:12.674482 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/b3c71861-4db9-4850-a44b-6f5d44a94235-trusted-ca\") pod \"console-operator-7866497494-gnw2z\" (UID: \"b3c71861-4db9-4850-a44b-6f5d44a94235\") " pod="openshift-console-operator/console-operator-7866497494-gnw2z" Jul 14 17:26:12.674641 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:12.674518 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/f60de25a-6c7c-41f4-87ce-de3f4eca5c3a-telemetry-config\") pod \"cluster-monitoring-operator-5f7f494dd4-hznkp\" (UID: \"f60de25a-6c7c-41f4-87ce-de3f4eca5c3a\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-hznkp" Jul 14 17:26:12.674952 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:12.674887 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/0f57e94d-cace-4645-a5cb-47f7dd6dc854-registry-certificates\") pod \"image-registry-899c5876f-m6hqz\" (UID: \"0f57e94d-cace-4645-a5cb-47f7dd6dc854\") " pod="openshift-image-registry/image-registry-899c5876f-m6hqz" Jul 14 17:26:12.677857 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:12.677706 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/5a0f3a9b-3347-43e5-910b-229e446543ad-serving-cert\") pod \"insights-operator-68d9dd94cf-dq264\" (UID: \"5a0f3a9b-3347-43e5-910b-229e446543ad\") " pod="openshift-insights/insights-operator-68d9dd94cf-dq264" Jul 14 17:26:12.677963 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:12.677713 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/0f57e94d-cace-4645-a5cb-47f7dd6dc854-image-registry-private-configuration\") pod \"image-registry-899c5876f-m6hqz\" (UID: \"0f57e94d-cace-4645-a5cb-47f7dd6dc854\") " pod="openshift-image-registry/image-registry-899c5876f-m6hqz" Jul 14 17:26:12.677963 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:12.677754 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/0f57e94d-cace-4645-a5cb-47f7dd6dc854-installation-pull-secrets\") pod \"image-registry-899c5876f-m6hqz\" (UID: \"0f57e94d-cace-4645-a5cb-47f7dd6dc854\") " pod="openshift-image-registry/image-registry-899c5876f-m6hqz" Jul 14 17:26:12.683126 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:12.683096 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-86fm6\" (UniqueName: \"kubernetes.io/projected/5a0f3a9b-3347-43e5-910b-229e446543ad-kube-api-access-86fm6\") pod \"insights-operator-68d9dd94cf-dq264\" (UID: \"5a0f3a9b-3347-43e5-910b-229e446543ad\") " pod="openshift-insights/insights-operator-68d9dd94cf-dq264" Jul 14 17:26:12.683278 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:12.683245 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/0f57e94d-cace-4645-a5cb-47f7dd6dc854-bound-sa-token\") pod \"image-registry-899c5876f-m6hqz\" (UID: \"0f57e94d-cace-4645-a5cb-47f7dd6dc854\") " pod="openshift-image-registry/image-registry-899c5876f-m6hqz" Jul 14 17:26:12.683427 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:12.683408 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-65699\" (UniqueName: \"kubernetes.io/projected/0f57e94d-cace-4645-a5cb-47f7dd6dc854-kube-api-access-65699\") pod \"image-registry-899c5876f-m6hqz\" (UID: \"0f57e94d-cace-4645-a5cb-47f7dd6dc854\") " pod="openshift-image-registry/image-registry-899c5876f-m6hqz" Jul 14 17:26:12.683551 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:12.683500 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-scczt\" (UniqueName: \"kubernetes.io/projected/f60de25a-6c7c-41f4-87ce-de3f4eca5c3a-kube-api-access-scczt\") pod \"cluster-monitoring-operator-5f7f494dd4-hznkp\" (UID: \"f60de25a-6c7c-41f4-87ce-de3f4eca5c3a\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-hznkp" Jul 14 17:26:12.769082 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:12.769035 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 17:26:12.774897 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:12.774871 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sxdwr\" (UniqueName: \"kubernetes.io/projected/9a20f557-1033-431a-8986-88c97723b31c-kube-api-access-sxdwr\") pod \"router-default-5484d54d6d-2b7v2\" (UID: \"9a20f557-1033-431a-8986-88c97723b31c\") " pod="openshift-ingress/router-default-5484d54d6d-2b7v2" Jul 14 17:26:12.775029 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:12.774914 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/e0e19152-87b3-4e28-9739-36d5639e5eb1-serving-cert\") pod \"service-ca-operator-7695fc6c8c-wzm2l\" (UID: \"e0e19152-87b3-4e28-9739-36d5639e5eb1\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-wzm2l" Jul 14 17:26:12.775029 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:12.774943 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-569wb\" (UniqueName: \"kubernetes.io/projected/e508c23b-e275-4952-8fef-8294dfe75474-kube-api-access-569wb\") pod \"cluster-samples-operator-65db858894-q49pd\" (UID: \"e508c23b-e275-4952-8fef-8294dfe75474\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-q49pd" Jul 14 17:26:12.775029 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:12.774963 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/e0e19152-87b3-4e28-9739-36d5639e5eb1-config\") pod \"service-ca-operator-7695fc6c8c-wzm2l\" (UID: \"e0e19152-87b3-4e28-9739-36d5639e5eb1\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-wzm2l" Jul 14 17:26:12.775029 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:12.774995 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n4tjk\" (UniqueName: \"kubernetes.io/projected/d1d42aeb-1ff1-42fd-a566-fea29b751242-kube-api-access-n4tjk\") pod \"dns-default-r7tpq\" (UID: \"d1d42aeb-1ff1-42fd-a566-fea29b751242\") " pod="openshift-dns/dns-default-r7tpq" Jul 14 17:26:12.775262 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:12.775035 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9a20f557-1033-431a-8986-88c97723b31c-service-ca-bundle\") pod \"router-default-5484d54d6d-2b7v2\" (UID: \"9a20f557-1033-431a-8986-88c97723b31c\") " pod="openshift-ingress/router-default-5484d54d6d-2b7v2" Jul 14 17:26:12.775262 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:12.775103 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4hwn7\" (UniqueName: \"kubernetes.io/projected/e0e19152-87b3-4e28-9739-36d5639e5eb1-kube-api-access-4hwn7\") pod \"service-ca-operator-7695fc6c8c-wzm2l\" (UID: \"e0e19152-87b3-4e28-9739-36d5639e5eb1\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-wzm2l" Jul 14 17:26:12.775262 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:12.775149 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/b3c71861-4db9-4850-a44b-6f5d44a94235-serving-cert\") pod \"console-operator-7866497494-gnw2z\" (UID: \"b3c71861-4db9-4850-a44b-6f5d44a94235\") " pod="openshift-console-operator/console-operator-7866497494-gnw2z" Jul 14 17:26:12.775262 ip-10-0-139-16 kubenswrapper[2552]: E0714 17:26:12.775163 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/9a20f557-1033-431a-8986-88c97723b31c-service-ca-bundle podName:9a20f557-1033-431a-8986-88c97723b31c nodeName:}" failed. No retries permitted until 2026-07-14 17:26:13.275143993 +0000 UTC m=+35.654257925 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/9a20f557-1033-431a-8986-88c97723b31c-service-ca-bundle") pod "router-default-5484d54d6d-2b7v2" (UID: "9a20f557-1033-431a-8986-88c97723b31c") : configmap references non-existent config key: service-ca.crt Jul 14 17:26:12.775262 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:12.775191 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/62900e1e-659d-4c6e-9e31-2933f84ebc70-config\") pod \"kube-storage-version-migrator-operator-799cb7f958-6xn2k\" (UID: \"62900e1e-659d-4c6e-9e31-2933f84ebc70\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-6xn2k" Jul 14 17:26:12.775262 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:12.775236 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/e508c23b-e275-4952-8fef-8294dfe75474-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-q49pd\" (UID: \"e508c23b-e275-4952-8fef-8294dfe75474\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-q49pd" Jul 14 17:26:12.775594 ip-10-0-139-16 kubenswrapper[2552]: E0714 17:26:12.775308 2552 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 14 17:26:12.775594 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:12.775343 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fzlft\" (UniqueName: \"kubernetes.io/projected/aa9ffe90-3c13-4508-861a-97379e7154aa-kube-api-access-fzlft\") pod \"network-check-source-869dcfcdcd-ckl8p\" (UID: \"aa9ffe90-3c13-4508-861a-97379e7154aa\") " pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-ckl8p" Jul 14 17:26:12.775594 ip-10-0-139-16 kubenswrapper[2552]: E0714 17:26:12.775363 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e508c23b-e275-4952-8fef-8294dfe75474-samples-operator-tls podName:e508c23b-e275-4952-8fef-8294dfe75474 nodeName:}" failed. No retries permitted until 2026-07-14 17:26:13.275350798 +0000 UTC m=+35.654464728 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/e508c23b-e275-4952-8fef-8294dfe75474-samples-operator-tls") pod "cluster-samples-operator-65db858894-q49pd" (UID: "e508c23b-e275-4952-8fef-8294dfe75474") : secret "samples-operator-tls" not found Jul 14 17:26:12.775594 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:12.775392 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d1d42aeb-1ff1-42fd-a566-fea29b751242-tmp-dir\") pod \"dns-default-r7tpq\" (UID: \"d1d42aeb-1ff1-42fd-a566-fea29b751242\") " pod="openshift-dns/dns-default-r7tpq" Jul 14 17:26:12.775594 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:12.775425 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m4t6n\" (UniqueName: \"kubernetes.io/projected/c3b4f75d-a278-455b-8de5-d9d580cc77ec-kube-api-access-m4t6n\") pod \"ingress-canary-w4vkl\" (UID: \"c3b4f75d-a278-455b-8de5-d9d580cc77ec\") " pod="openshift-ingress-canary/ingress-canary-w4vkl" Jul 14 17:26:12.775594 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:12.775451 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/b3c71861-4db9-4850-a44b-6f5d44a94235-trusted-ca\") pod \"console-operator-7866497494-gnw2z\" (UID: \"b3c71861-4db9-4850-a44b-6f5d44a94235\") " pod="openshift-console-operator/console-operator-7866497494-gnw2z" Jul 14 17:26:12.775594 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:12.775496 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sw7dj\" (UniqueName: \"kubernetes.io/projected/62900e1e-659d-4c6e-9e31-2933f84ebc70-kube-api-access-sw7dj\") pod \"kube-storage-version-migrator-operator-799cb7f958-6xn2k\" (UID: \"62900e1e-659d-4c6e-9e31-2933f84ebc70\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-6xn2k" Jul 14 17:26:12.775594 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:12.775530 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/62900e1e-659d-4c6e-9e31-2933f84ebc70-serving-cert\") pod \"kube-storage-version-migrator-operator-799cb7f958-6xn2k\" (UID: \"62900e1e-659d-4c6e-9e31-2933f84ebc70\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-6xn2k" Jul 14 17:26:12.775594 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:12.775583 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/b3c71861-4db9-4850-a44b-6f5d44a94235-config\") pod \"console-operator-7866497494-gnw2z\" (UID: \"b3c71861-4db9-4850-a44b-6f5d44a94235\") " pod="openshift-console-operator/console-operator-7866497494-gnw2z" Jul 14 17:26:12.776032 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:12.775633 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g6tx7\" (UniqueName: \"kubernetes.io/projected/fbb398bf-d6aa-4566-8bdb-a78349ea23c7-kube-api-access-g6tx7\") pod \"volume-data-source-validator-78495597f6-7nwwb\" (UID: \"fbb398bf-d6aa-4566-8bdb-a78349ea23c7\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-7nwwb" Jul 14 17:26:12.776032 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:12.775671 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/e0e19152-87b3-4e28-9739-36d5639e5eb1-config\") pod \"service-ca-operator-7695fc6c8c-wzm2l\" (UID: \"e0e19152-87b3-4e28-9739-36d5639e5eb1\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-wzm2l" Jul 14 17:26:12.776032 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:12.775678 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/d1d42aeb-1ff1-42fd-a566-fea29b751242-config-volume\") pod \"dns-default-r7tpq\" (UID: \"d1d42aeb-1ff1-42fd-a566-fea29b751242\") " pod="openshift-dns/dns-default-r7tpq" Jul 14 17:26:12.776032 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:12.775701 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c3b4f75d-a278-455b-8de5-d9d580cc77ec-cert\") pod \"ingress-canary-w4vkl\" (UID: \"c3b4f75d-a278-455b-8de5-d9d580cc77ec\") " pod="openshift-ingress-canary/ingress-canary-w4vkl" Jul 14 17:26:12.776032 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:12.775752 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/9a20f557-1033-431a-8986-88c97723b31c-stats-auth\") pod \"router-default-5484d54d6d-2b7v2\" (UID: \"9a20f557-1033-431a-8986-88c97723b31c\") " pod="openshift-ingress/router-default-5484d54d6d-2b7v2" Jul 14 17:26:12.776032 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:12.775809 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d1d42aeb-1ff1-42fd-a566-fea29b751242-metrics-tls\") pod \"dns-default-r7tpq\" (UID: \"d1d42aeb-1ff1-42fd-a566-fea29b751242\") " pod="openshift-dns/dns-default-r7tpq" Jul 14 17:26:12.776032 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:12.775832 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/62900e1e-659d-4c6e-9e31-2933f84ebc70-config\") pod \"kube-storage-version-migrator-operator-799cb7f958-6xn2k\" (UID: \"62900e1e-659d-4c6e-9e31-2933f84ebc70\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-6xn2k" Jul 14 17:26:12.776032 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:12.775855 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9a20f557-1033-431a-8986-88c97723b31c-metrics-certs\") pod \"router-default-5484d54d6d-2b7v2\" (UID: \"9a20f557-1033-431a-8986-88c97723b31c\") " pod="openshift-ingress/router-default-5484d54d6d-2b7v2" Jul 14 17:26:12.776032 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:12.775912 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/9a20f557-1033-431a-8986-88c97723b31c-default-certificate\") pod \"router-default-5484d54d6d-2b7v2\" (UID: \"9a20f557-1033-431a-8986-88c97723b31c\") " pod="openshift-ingress/router-default-5484d54d6d-2b7v2" Jul 14 17:26:12.776032 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:12.775939 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dnfwj\" (UniqueName: \"kubernetes.io/projected/b3c71861-4db9-4850-a44b-6f5d44a94235-kube-api-access-dnfwj\") pod \"console-operator-7866497494-gnw2z\" (UID: \"b3c71861-4db9-4850-a44b-6f5d44a94235\") " pod="openshift-console-operator/console-operator-7866497494-gnw2z" Jul 14 17:26:12.776572 ip-10-0-139-16 kubenswrapper[2552]: E0714 17:26:12.776252 2552 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 14 17:26:12.776572 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:12.776253 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/b3c71861-4db9-4850-a44b-6f5d44a94235-config\") pod \"console-operator-7866497494-gnw2z\" (UID: \"b3c71861-4db9-4850-a44b-6f5d44a94235\") " pod="openshift-console-operator/console-operator-7866497494-gnw2z" Jul 14 17:26:12.776572 ip-10-0-139-16 kubenswrapper[2552]: E0714 17:26:12.776293 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9a20f557-1033-431a-8986-88c97723b31c-metrics-certs podName:9a20f557-1033-431a-8986-88c97723b31c nodeName:}" failed. No retries permitted until 2026-07-14 17:26:13.276278954 +0000 UTC m=+35.655392884 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9a20f557-1033-431a-8986-88c97723b31c-metrics-certs") pod "router-default-5484d54d6d-2b7v2" (UID: "9a20f557-1033-431a-8986-88c97723b31c") : secret "router-metrics-certs-default" not found Jul 14 17:26:12.776572 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:12.776317 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/b3c71861-4db9-4850-a44b-6f5d44a94235-trusted-ca\") pod \"console-operator-7866497494-gnw2z\" (UID: \"b3c71861-4db9-4850-a44b-6f5d44a94235\") " pod="openshift-console-operator/console-operator-7866497494-gnw2z" Jul 14 17:26:12.778364 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:12.778305 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/e0e19152-87b3-4e28-9739-36d5639e5eb1-serving-cert\") pod \"service-ca-operator-7695fc6c8c-wzm2l\" (UID: \"e0e19152-87b3-4e28-9739-36d5639e5eb1\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-wzm2l" Jul 14 17:26:12.778475 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:12.778454 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/b3c71861-4db9-4850-a44b-6f5d44a94235-serving-cert\") pod \"console-operator-7866497494-gnw2z\" (UID: \"b3c71861-4db9-4850-a44b-6f5d44a94235\") " pod="openshift-console-operator/console-operator-7866497494-gnw2z" Jul 14 17:26:12.778530 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:12.778505 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/62900e1e-659d-4c6e-9e31-2933f84ebc70-serving-cert\") pod \"kube-storage-version-migrator-operator-799cb7f958-6xn2k\" (UID: \"62900e1e-659d-4c6e-9e31-2933f84ebc70\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-6xn2k" Jul 14 17:26:12.778584 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:12.778559 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/9a20f557-1033-431a-8986-88c97723b31c-stats-auth\") pod \"router-default-5484d54d6d-2b7v2\" (UID: \"9a20f557-1033-431a-8986-88c97723b31c\") " pod="openshift-ingress/router-default-5484d54d6d-2b7v2" Jul 14 17:26:12.779136 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:12.779116 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/9a20f557-1033-431a-8986-88c97723b31c-default-certificate\") pod \"router-default-5484d54d6d-2b7v2\" (UID: \"9a20f557-1033-431a-8986-88c97723b31c\") " pod="openshift-ingress/router-default-5484d54d6d-2b7v2" Jul 14 17:26:12.786193 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:12.786133 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4hwn7\" (UniqueName: \"kubernetes.io/projected/e0e19152-87b3-4e28-9739-36d5639e5eb1-kube-api-access-4hwn7\") pod \"service-ca-operator-7695fc6c8c-wzm2l\" (UID: \"e0e19152-87b3-4e28-9739-36d5639e5eb1\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-wzm2l" Jul 14 17:26:12.786799 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:12.786774 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sw7dj\" (UniqueName: \"kubernetes.io/projected/62900e1e-659d-4c6e-9e31-2933f84ebc70-kube-api-access-sw7dj\") pod \"kube-storage-version-migrator-operator-799cb7f958-6xn2k\" (UID: \"62900e1e-659d-4c6e-9e31-2933f84ebc70\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-6xn2k" Jul 14 17:26:12.787966 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:12.787915 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-569wb\" (UniqueName: \"kubernetes.io/projected/e508c23b-e275-4952-8fef-8294dfe75474-kube-api-access-569wb\") pod \"cluster-samples-operator-65db858894-q49pd\" (UID: \"e508c23b-e275-4952-8fef-8294dfe75474\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-q49pd" Jul 14 17:26:12.788165 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:12.788134 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sxdwr\" (UniqueName: \"kubernetes.io/projected/9a20f557-1033-431a-8986-88c97723b31c-kube-api-access-sxdwr\") pod \"router-default-5484d54d6d-2b7v2\" (UID: \"9a20f557-1033-431a-8986-88c97723b31c\") " pod="openshift-ingress/router-default-5484d54d6d-2b7v2" Jul 14 17:26:12.788549 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:12.788506 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g6tx7\" (UniqueName: \"kubernetes.io/projected/fbb398bf-d6aa-4566-8bdb-a78349ea23c7-kube-api-access-g6tx7\") pod \"volume-data-source-validator-78495597f6-7nwwb\" (UID: \"fbb398bf-d6aa-4566-8bdb-a78349ea23c7\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-7nwwb" Jul 14 17:26:12.788646 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:12.788575 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fzlft\" (UniqueName: \"kubernetes.io/projected/aa9ffe90-3c13-4508-861a-97379e7154aa-kube-api-access-fzlft\") pod \"network-check-source-869dcfcdcd-ckl8p\" (UID: \"aa9ffe90-3c13-4508-861a-97379e7154aa\") " pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-ckl8p" Jul 14 17:26:12.788707 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:12.788660 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dnfwj\" (UniqueName: \"kubernetes.io/projected/b3c71861-4db9-4850-a44b-6f5d44a94235-kube-api-access-dnfwj\") pod \"console-operator-7866497494-gnw2z\" (UID: \"b3c71861-4db9-4850-a44b-6f5d44a94235\") " pod="openshift-console-operator/console-operator-7866497494-gnw2z" Jul 14 17:26:12.816852 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:12.816815 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-68d9dd94cf-dq264" Jul 14 17:26:12.849557 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:12.849525 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-7nwwb" Jul 14 17:26:12.863136 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:12.862965 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-7866497494-gnw2z" Jul 14 17:26:12.877351 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:12.877309 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d1d42aeb-1ff1-42fd-a566-fea29b751242-metrics-tls\") pod \"dns-default-r7tpq\" (UID: \"d1d42aeb-1ff1-42fd-a566-fea29b751242\") " pod="openshift-dns/dns-default-r7tpq" Jul 14 17:26:12.878308 ip-10-0-139-16 kubenswrapper[2552]: E0714 17:26:12.877856 2552 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 14 17:26:12.878308 ip-10-0-139-16 kubenswrapper[2552]: E0714 17:26:12.877937 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d1d42aeb-1ff1-42fd-a566-fea29b751242-metrics-tls podName:d1d42aeb-1ff1-42fd-a566-fea29b751242 nodeName:}" failed. No retries permitted until 2026-07-14 17:26:13.377915794 +0000 UTC m=+35.757029736 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d1d42aeb-1ff1-42fd-a566-fea29b751242-metrics-tls") pod "dns-default-r7tpq" (UID: "d1d42aeb-1ff1-42fd-a566-fea29b751242") : secret "dns-default-metrics-tls" not found Jul 14 17:26:12.878308 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:12.877789 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n4tjk\" (UniqueName: \"kubernetes.io/projected/d1d42aeb-1ff1-42fd-a566-fea29b751242-kube-api-access-n4tjk\") pod \"dns-default-r7tpq\" (UID: \"d1d42aeb-1ff1-42fd-a566-fea29b751242\") " pod="openshift-dns/dns-default-r7tpq" Jul 14 17:26:12.878308 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:12.878267 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d1d42aeb-1ff1-42fd-a566-fea29b751242-tmp-dir\") pod \"dns-default-r7tpq\" (UID: \"d1d42aeb-1ff1-42fd-a566-fea29b751242\") " pod="openshift-dns/dns-default-r7tpq" Jul 14 17:26:12.878308 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:12.878310 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m4t6n\" (UniqueName: \"kubernetes.io/projected/c3b4f75d-a278-455b-8de5-d9d580cc77ec-kube-api-access-m4t6n\") pod \"ingress-canary-w4vkl\" (UID: \"c3b4f75d-a278-455b-8de5-d9d580cc77ec\") " pod="openshift-ingress-canary/ingress-canary-w4vkl" Jul 14 17:26:12.880511 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:12.878398 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/d1d42aeb-1ff1-42fd-a566-fea29b751242-config-volume\") pod \"dns-default-r7tpq\" (UID: \"d1d42aeb-1ff1-42fd-a566-fea29b751242\") " pod="openshift-dns/dns-default-r7tpq" Jul 14 17:26:12.880511 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:12.878433 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c3b4f75d-a278-455b-8de5-d9d580cc77ec-cert\") pod \"ingress-canary-w4vkl\" (UID: \"c3b4f75d-a278-455b-8de5-d9d580cc77ec\") " pod="openshift-ingress-canary/ingress-canary-w4vkl" Jul 14 17:26:12.880511 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:12.878628 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d1d42aeb-1ff1-42fd-a566-fea29b751242-tmp-dir\") pod \"dns-default-r7tpq\" (UID: \"d1d42aeb-1ff1-42fd-a566-fea29b751242\") " pod="openshift-dns/dns-default-r7tpq" Jul 14 17:26:12.881393 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:12.880671 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/d1d42aeb-1ff1-42fd-a566-fea29b751242-config-volume\") pod \"dns-default-r7tpq\" (UID: \"d1d42aeb-1ff1-42fd-a566-fea29b751242\") " pod="openshift-dns/dns-default-r7tpq" Jul 14 17:26:12.881393 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:12.880793 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-6xn2k" Jul 14 17:26:12.886308 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:12.886279 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c3b4f75d-a278-455b-8de5-d9d580cc77ec-cert\") pod \"ingress-canary-w4vkl\" (UID: \"c3b4f75d-a278-455b-8de5-d9d580cc77ec\") " pod="openshift-ingress-canary/ingress-canary-w4vkl" Jul 14 17:26:12.887457 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:12.887438 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m4t6n\" (UniqueName: \"kubernetes.io/projected/c3b4f75d-a278-455b-8de5-d9d580cc77ec-kube-api-access-m4t6n\") pod \"ingress-canary-w4vkl\" (UID: \"c3b4f75d-a278-455b-8de5-d9d580cc77ec\") " pod="openshift-ingress-canary/ingress-canary-w4vkl" Jul 14 17:26:12.887796 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:12.887778 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n4tjk\" (UniqueName: \"kubernetes.io/projected/d1d42aeb-1ff1-42fd-a566-fea29b751242-kube-api-access-n4tjk\") pod \"dns-default-r7tpq\" (UID: \"d1d42aeb-1ff1-42fd-a566-fea29b751242\") " pod="openshift-dns/dns-default-r7tpq" Jul 14 17:26:12.888559 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:12.888546 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-wzm2l" Jul 14 17:26:12.900848 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:12.900817 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-ckl8p" Jul 14 17:26:12.930539 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:12.930512 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-w4vkl" Jul 14 17:26:13.051889 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:13.048899 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-68d9dd94cf-dq264"] Jul 14 17:26:13.051889 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:13.050757 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-7nwwb"] Jul 14 17:26:13.102037 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:13.101948 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-7866497494-gnw2z"] Jul 14 17:26:13.132081 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:13.132038 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-6xn2k"] Jul 14 17:26:13.153130 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:13.153098 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-7695fc6c8c-wzm2l"] Jul 14 17:26:13.156625 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:13.156528 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-869dcfcdcd-ckl8p"] Jul 14 17:26:13.170656 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:13.170632 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-w4vkl"] Jul 14 17:26:13.184397 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:13.184373 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0f57e94d-cace-4645-a5cb-47f7dd6dc854-registry-tls\") pod \"image-registry-899c5876f-m6hqz\" (UID: \"0f57e94d-cace-4645-a5cb-47f7dd6dc854\") " pod="openshift-image-registry/image-registry-899c5876f-m6hqz" Jul 14 17:26:13.184493 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:13.184418 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/f60de25a-6c7c-41f4-87ce-de3f4eca5c3a-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-hznkp\" (UID: \"f60de25a-6c7c-41f4-87ce-de3f4eca5c3a\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-hznkp" Jul 14 17:26:13.184549 ip-10-0-139-16 kubenswrapper[2552]: E0714 17:26:13.184523 2552 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 14 17:26:13.184602 ip-10-0-139-16 kubenswrapper[2552]: E0714 17:26:13.184548 2552 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 14 17:26:13.184602 ip-10-0-139-16 kubenswrapper[2552]: E0714 17:26:13.184567 2552 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-899c5876f-m6hqz: secret "image-registry-tls" not found Jul 14 17:26:13.184602 ip-10-0-139-16 kubenswrapper[2552]: E0714 17:26:13.184573 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f60de25a-6c7c-41f4-87ce-de3f4eca5c3a-cluster-monitoring-operator-tls podName:f60de25a-6c7c-41f4-87ce-de3f4eca5c3a nodeName:}" failed. No retries permitted until 2026-07-14 17:26:14.184560449 +0000 UTC m=+36.563674380 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/f60de25a-6c7c-41f4-87ce-de3f4eca5c3a-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-hznkp" (UID: "f60de25a-6c7c-41f4-87ce-de3f4eca5c3a") : secret "cluster-monitoring-operator-tls" not found Jul 14 17:26:13.184766 ip-10-0-139-16 kubenswrapper[2552]: E0714 17:26:13.184624 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0f57e94d-cace-4645-a5cb-47f7dd6dc854-registry-tls podName:0f57e94d-cace-4645-a5cb-47f7dd6dc854 nodeName:}" failed. No retries permitted until 2026-07-14 17:26:14.184604948 +0000 UTC m=+36.563718894 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/0f57e94d-cace-4645-a5cb-47f7dd6dc854-registry-tls") pod "image-registry-899c5876f-m6hqz" (UID: "0f57e94d-cace-4645-a5cb-47f7dd6dc854") : secret "image-registry-tls" not found Jul 14 17:26:13.227612 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:26:13.227586 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5a0f3a9b_3347_43e5_910b_229e446543ad.slice/crio-a86c7c7fc58775b2b486a0036815bd52049ce162495c510e2568001434e364aa WatchSource:0}: Error finding container a86c7c7fc58775b2b486a0036815bd52049ce162495c510e2568001434e364aa: Status 404 returned error can't find the container with id a86c7c7fc58775b2b486a0036815bd52049ce162495c510e2568001434e364aa Jul 14 17:26:13.228266 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:26:13.228244 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfbb398bf_d6aa_4566_8bdb_a78349ea23c7.slice/crio-c337df2b06491a6d01cde1f026c09de5a9be118aac6d3899f6acfc2e12be9b86 WatchSource:0}: Error finding container c337df2b06491a6d01cde1f026c09de5a9be118aac6d3899f6acfc2e12be9b86: Status 404 returned error can't find the container with id c337df2b06491a6d01cde1f026c09de5a9be118aac6d3899f6acfc2e12be9b86 Jul 14 17:26:13.228972 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:26:13.228947 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb3c71861_4db9_4850_a44b_6f5d44a94235.slice/crio-0cfbe0422c1cc8c3397f454d3de538f929502dff837ac2f4740e5519b2c64858 WatchSource:0}: Error finding container 0cfbe0422c1cc8c3397f454d3de538f929502dff837ac2f4740e5519b2c64858: Status 404 returned error can't find the container with id 0cfbe0422c1cc8c3397f454d3de538f929502dff837ac2f4740e5519b2c64858 Jul 14 17:26:13.229887 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:26:13.229701 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod62900e1e_659d_4c6e_9e31_2933f84ebc70.slice/crio-f1688f6e1b3f68cef1705661429fc2559cdb7b490c3d69aaf68cdcdfb6d41b0e WatchSource:0}: Error finding container f1688f6e1b3f68cef1705661429fc2559cdb7b490c3d69aaf68cdcdfb6d41b0e: Status 404 returned error can't find the container with id f1688f6e1b3f68cef1705661429fc2559cdb7b490c3d69aaf68cdcdfb6d41b0e Jul 14 17:26:13.231034 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:26:13.230861 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode0e19152_87b3_4e28_9739_36d5639e5eb1.slice/crio-3725aae6bc25f641d1bb3b170727fc88aa08294d185f8ff4d57559457122255c WatchSource:0}: Error finding container 3725aae6bc25f641d1bb3b170727fc88aa08294d185f8ff4d57559457122255c: Status 404 returned error can't find the container with id 3725aae6bc25f641d1bb3b170727fc88aa08294d185f8ff4d57559457122255c Jul 14 17:26:13.231512 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:26:13.231445 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaa9ffe90_3c13_4508_861a_97379e7154aa.slice/crio-02b8242b82603a5d5b9609e4f51a735c41c80c6c3e8a65931f23dcb6341054f4 WatchSource:0}: Error finding container 02b8242b82603a5d5b9609e4f51a735c41c80c6c3e8a65931f23dcb6341054f4: Status 404 returned error can't find the container with id 02b8242b82603a5d5b9609e4f51a735c41c80c6c3e8a65931f23dcb6341054f4 Jul 14 17:26:13.232311 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:26:13.232282 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc3b4f75d_a278_455b_8de5_d9d580cc77ec.slice/crio-0971a728014a6cac8c8b5e4e9884ce4aff3a81cd7383c9a7e9352fdbeb07e979 WatchSource:0}: Error finding container 0971a728014a6cac8c8b5e4e9884ce4aff3a81cd7383c9a7e9352fdbeb07e979: Status 404 returned error can't find the container with id 0971a728014a6cac8c8b5e4e9884ce4aff3a81cd7383c9a7e9352fdbeb07e979 Jul 14 17:26:13.285545 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:13.285525 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9a20f557-1033-431a-8986-88c97723b31c-service-ca-bundle\") pod \"router-default-5484d54d6d-2b7v2\" (UID: \"9a20f557-1033-431a-8986-88c97723b31c\") " pod="openshift-ingress/router-default-5484d54d6d-2b7v2" Jul 14 17:26:13.285607 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:13.285573 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/e508c23b-e275-4952-8fef-8294dfe75474-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-q49pd\" (UID: \"e508c23b-e275-4952-8fef-8294dfe75474\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-q49pd" Jul 14 17:26:13.285778 ip-10-0-139-16 kubenswrapper[2552]: E0714 17:26:13.285758 2552 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 14 17:26:13.285842 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:13.285756 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9a20f557-1033-431a-8986-88c97723b31c-metrics-certs\") pod \"router-default-5484d54d6d-2b7v2\" (UID: \"9a20f557-1033-431a-8986-88c97723b31c\") " pod="openshift-ingress/router-default-5484d54d6d-2b7v2" Jul 14 17:26:13.285842 ip-10-0-139-16 kubenswrapper[2552]: E0714 17:26:13.285811 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/9a20f557-1033-431a-8986-88c97723b31c-service-ca-bundle podName:9a20f557-1033-431a-8986-88c97723b31c nodeName:}" failed. No retries permitted until 2026-07-14 17:26:14.285797316 +0000 UTC m=+36.664911250 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/9a20f557-1033-431a-8986-88c97723b31c-service-ca-bundle") pod "router-default-5484d54d6d-2b7v2" (UID: "9a20f557-1033-431a-8986-88c97723b31c") : configmap references non-existent config key: service-ca.crt Jul 14 17:26:13.285842 ip-10-0-139-16 kubenswrapper[2552]: E0714 17:26:13.285829 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e508c23b-e275-4952-8fef-8294dfe75474-samples-operator-tls podName:e508c23b-e275-4952-8fef-8294dfe75474 nodeName:}" failed. No retries permitted until 2026-07-14 17:26:14.285822229 +0000 UTC m=+36.664936158 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/e508c23b-e275-4952-8fef-8294dfe75474-samples-operator-tls") pod "cluster-samples-operator-65db858894-q49pd" (UID: "e508c23b-e275-4952-8fef-8294dfe75474") : secret "samples-operator-tls" not found Jul 14 17:26:13.285842 ip-10-0-139-16 kubenswrapper[2552]: E0714 17:26:13.285831 2552 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 14 17:26:13.285997 ip-10-0-139-16 kubenswrapper[2552]: E0714 17:26:13.285890 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9a20f557-1033-431a-8986-88c97723b31c-metrics-certs podName:9a20f557-1033-431a-8986-88c97723b31c nodeName:}" failed. No retries permitted until 2026-07-14 17:26:14.285874148 +0000 UTC m=+36.664988081 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9a20f557-1033-431a-8986-88c97723b31c-metrics-certs") pod "router-default-5484d54d6d-2b7v2" (UID: "9a20f557-1033-431a-8986-88c97723b31c") : secret "router-metrics-certs-default" not found Jul 14 17:26:13.382043 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:13.381889 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7prlr" Jul 14 17:26:13.382183 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:13.381913 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vjlpd" Jul 14 17:26:13.384749 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:13.384725 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-ph225\"" Jul 14 17:26:13.384853 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:13.384763 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-hwsmr\"" Jul 14 17:26:13.384978 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:13.384963 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 14 17:26:13.386293 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:13.386273 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d1d42aeb-1ff1-42fd-a566-fea29b751242-metrics-tls\") pod \"dns-default-r7tpq\" (UID: \"d1d42aeb-1ff1-42fd-a566-fea29b751242\") " pod="openshift-dns/dns-default-r7tpq" Jul 14 17:26:13.386451 ip-10-0-139-16 kubenswrapper[2552]: E0714 17:26:13.386433 2552 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 14 17:26:13.386513 ip-10-0-139-16 kubenswrapper[2552]: E0714 17:26:13.386503 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d1d42aeb-1ff1-42fd-a566-fea29b751242-metrics-tls podName:d1d42aeb-1ff1-42fd-a566-fea29b751242 nodeName:}" failed. No retries permitted until 2026-07-14 17:26:14.386484167 +0000 UTC m=+36.765598111 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d1d42aeb-1ff1-42fd-a566-fea29b751242-metrics-tls") pod "dns-default-r7tpq" (UID: "d1d42aeb-1ff1-42fd-a566-fea29b751242") : secret "dns-default-metrics-tls" not found Jul 14 17:26:13.534101 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:13.534074 2552 generic.go:356] "Generic (PLEG): container finished" podID="d84237cc-b659-4943-b3da-ab9f602d4f86" containerID="a4b60623b83d9a25f669a9f95520065db267158266c9c589b0528a1da2bb5f2a" exitCode=0 Jul 14 17:26:13.534852 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:13.534140 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-5zj72" event={"ID":"d84237cc-b659-4943-b3da-ab9f602d4f86","Type":"ContainerDied","Data":"a4b60623b83d9a25f669a9f95520065db267158266c9c589b0528a1da2bb5f2a"} Jul 14 17:26:13.535214 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:13.535192 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-wzm2l" event={"ID":"e0e19152-87b3-4e28-9739-36d5639e5eb1","Type":"ContainerStarted","Data":"3725aae6bc25f641d1bb3b170727fc88aa08294d185f8ff4d57559457122255c"} Jul 14 17:26:13.536256 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:13.536234 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-6xn2k" event={"ID":"62900e1e-659d-4c6e-9e31-2933f84ebc70","Type":"ContainerStarted","Data":"f1688f6e1b3f68cef1705661429fc2559cdb7b490c3d69aaf68cdcdfb6d41b0e"} Jul 14 17:26:13.537308 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:13.537288 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-w4vkl" event={"ID":"c3b4f75d-a278-455b-8de5-d9d580cc77ec","Type":"ContainerStarted","Data":"0971a728014a6cac8c8b5e4e9884ce4aff3a81cd7383c9a7e9352fdbeb07e979"} Jul 14 17:26:13.538595 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:13.538567 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-ckl8p" event={"ID":"aa9ffe90-3c13-4508-861a-97379e7154aa","Type":"ContainerStarted","Data":"02b8242b82603a5d5b9609e4f51a735c41c80c6c3e8a65931f23dcb6341054f4"} Jul 14 17:26:13.539817 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:13.539796 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-68d9dd94cf-dq264" event={"ID":"5a0f3a9b-3347-43e5-910b-229e446543ad","Type":"ContainerStarted","Data":"a86c7c7fc58775b2b486a0036815bd52049ce162495c510e2568001434e364aa"} Jul 14 17:26:13.540756 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:13.540738 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7866497494-gnw2z" event={"ID":"b3c71861-4db9-4850-a44b-6f5d44a94235","Type":"ContainerStarted","Data":"0cfbe0422c1cc8c3397f454d3de538f929502dff837ac2f4740e5519b2c64858"} Jul 14 17:26:13.541694 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:13.541677 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-7nwwb" event={"ID":"fbb398bf-d6aa-4566-8bdb-a78349ea23c7","Type":"ContainerStarted","Data":"c337df2b06491a6d01cde1f026c09de5a9be118aac6d3899f6acfc2e12be9b86"} Jul 14 17:26:13.755162 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:13.755133 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-6cf856758c-85r72"] Jul 14 17:26:13.769460 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:13.769433 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-6cf856758c-85r72"] Jul 14 17:26:13.769460 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:13.769452 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6cf856758c-85r72" Jul 14 17:26:13.772160 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:13.772142 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\"" Jul 14 17:26:13.772160 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:13.772152 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-5std2\"" Jul 14 17:26:13.772375 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:13.772167 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\"" Jul 14 17:26:13.893091 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:13.893006 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/e9d1e6ea-2ff1-4ea8-aee5-8f7bac1dcb0f-nginx-conf\") pod \"networking-console-plugin-6cf856758c-85r72\" (UID: \"e9d1e6ea-2ff1-4ea8-aee5-8f7bac1dcb0f\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-85r72" Jul 14 17:26:13.893091 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:13.893053 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/e9d1e6ea-2ff1-4ea8-aee5-8f7bac1dcb0f-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-85r72\" (UID: \"e9d1e6ea-2ff1-4ea8-aee5-8f7bac1dcb0f\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-85r72" Jul 14 17:26:13.979517 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:13.979461 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 17:26:13.995399 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:13.994346 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/e9d1e6ea-2ff1-4ea8-aee5-8f7bac1dcb0f-nginx-conf\") pod \"networking-console-plugin-6cf856758c-85r72\" (UID: \"e9d1e6ea-2ff1-4ea8-aee5-8f7bac1dcb0f\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-85r72" Jul 14 17:26:13.995399 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:13.994386 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/e9d1e6ea-2ff1-4ea8-aee5-8f7bac1dcb0f-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-85r72\" (UID: \"e9d1e6ea-2ff1-4ea8-aee5-8f7bac1dcb0f\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-85r72" Jul 14 17:26:13.995399 ip-10-0-139-16 kubenswrapper[2552]: E0714 17:26:13.994608 2552 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 14 17:26:13.995399 ip-10-0-139-16 kubenswrapper[2552]: E0714 17:26:13.994669 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e9d1e6ea-2ff1-4ea8-aee5-8f7bac1dcb0f-networking-console-plugin-cert podName:e9d1e6ea-2ff1-4ea8-aee5-8f7bac1dcb0f nodeName:}" failed. No retries permitted until 2026-07-14 17:26:14.494650445 +0000 UTC m=+36.873764387 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/e9d1e6ea-2ff1-4ea8-aee5-8f7bac1dcb0f-networking-console-plugin-cert") pod "networking-console-plugin-6cf856758c-85r72" (UID: "e9d1e6ea-2ff1-4ea8-aee5-8f7bac1dcb0f") : secret "networking-console-plugin-cert" not found Jul 14 17:26:13.995938 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:13.995913 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/e9d1e6ea-2ff1-4ea8-aee5-8f7bac1dcb0f-nginx-conf\") pod \"networking-console-plugin-6cf856758c-85r72\" (UID: \"e9d1e6ea-2ff1-4ea8-aee5-8f7bac1dcb0f\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-85r72" Jul 14 17:26:14.081991 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:14.081237 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 17:26:14.199339 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:14.198806 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0f57e94d-cace-4645-a5cb-47f7dd6dc854-registry-tls\") pod \"image-registry-899c5876f-m6hqz\" (UID: \"0f57e94d-cace-4645-a5cb-47f7dd6dc854\") " pod="openshift-image-registry/image-registry-899c5876f-m6hqz" Jul 14 17:26:14.199339 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:14.198891 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/f60de25a-6c7c-41f4-87ce-de3f4eca5c3a-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-hznkp\" (UID: \"f60de25a-6c7c-41f4-87ce-de3f4eca5c3a\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-hznkp" Jul 14 17:26:14.199339 ip-10-0-139-16 kubenswrapper[2552]: E0714 17:26:14.199012 2552 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 14 17:26:14.199339 ip-10-0-139-16 kubenswrapper[2552]: E0714 17:26:14.199037 2552 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-899c5876f-m6hqz: secret "image-registry-tls" not found Jul 14 17:26:14.199339 ip-10-0-139-16 kubenswrapper[2552]: E0714 17:26:14.199104 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0f57e94d-cace-4645-a5cb-47f7dd6dc854-registry-tls podName:0f57e94d-cace-4645-a5cb-47f7dd6dc854 nodeName:}" failed. No retries permitted until 2026-07-14 17:26:16.199082887 +0000 UTC m=+38.578196818 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/0f57e94d-cace-4645-a5cb-47f7dd6dc854-registry-tls") pod "image-registry-899c5876f-m6hqz" (UID: "0f57e94d-cace-4645-a5cb-47f7dd6dc854") : secret "image-registry-tls" not found Jul 14 17:26:14.199339 ip-10-0-139-16 kubenswrapper[2552]: E0714 17:26:14.199182 2552 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 14 17:26:14.199339 ip-10-0-139-16 kubenswrapper[2552]: E0714 17:26:14.199236 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f60de25a-6c7c-41f4-87ce-de3f4eca5c3a-cluster-monitoring-operator-tls podName:f60de25a-6c7c-41f4-87ce-de3f4eca5c3a nodeName:}" failed. No retries permitted until 2026-07-14 17:26:16.199220764 +0000 UTC m=+38.578334694 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/f60de25a-6c7c-41f4-87ce-de3f4eca5c3a-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-hznkp" (UID: "f60de25a-6c7c-41f4-87ce-de3f4eca5c3a") : secret "cluster-monitoring-operator-tls" not found Jul 14 17:26:14.300613 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:14.300535 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9a20f557-1033-431a-8986-88c97723b31c-metrics-certs\") pod \"router-default-5484d54d6d-2b7v2\" (UID: \"9a20f557-1033-431a-8986-88c97723b31c\") " pod="openshift-ingress/router-default-5484d54d6d-2b7v2" Jul 14 17:26:14.300786 ip-10-0-139-16 kubenswrapper[2552]: E0714 17:26:14.300708 2552 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 14 17:26:14.300847 ip-10-0-139-16 kubenswrapper[2552]: E0714 17:26:14.300787 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9a20f557-1033-431a-8986-88c97723b31c-metrics-certs podName:9a20f557-1033-431a-8986-88c97723b31c nodeName:}" failed. No retries permitted until 2026-07-14 17:26:16.300766019 +0000 UTC m=+38.679879964 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9a20f557-1033-431a-8986-88c97723b31c-metrics-certs") pod "router-default-5484d54d6d-2b7v2" (UID: "9a20f557-1033-431a-8986-88c97723b31c") : secret "router-metrics-certs-default" not found Jul 14 17:26:14.301163 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:14.301139 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9a20f557-1033-431a-8986-88c97723b31c-service-ca-bundle\") pod \"router-default-5484d54d6d-2b7v2\" (UID: \"9a20f557-1033-431a-8986-88c97723b31c\") " pod="openshift-ingress/router-default-5484d54d6d-2b7v2" Jul 14 17:26:14.301247 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:14.301218 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/e508c23b-e275-4952-8fef-8294dfe75474-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-q49pd\" (UID: \"e508c23b-e275-4952-8fef-8294dfe75474\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-q49pd" Jul 14 17:26:14.301361 ip-10-0-139-16 kubenswrapper[2552]: E0714 17:26:14.301346 2552 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 14 17:26:14.301419 ip-10-0-139-16 kubenswrapper[2552]: E0714 17:26:14.301400 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e508c23b-e275-4952-8fef-8294dfe75474-samples-operator-tls podName:e508c23b-e275-4952-8fef-8294dfe75474 nodeName:}" failed. No retries permitted until 2026-07-14 17:26:16.301385006 +0000 UTC m=+38.680498939 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/e508c23b-e275-4952-8fef-8294dfe75474-samples-operator-tls") pod "cluster-samples-operator-65db858894-q49pd" (UID: "e508c23b-e275-4952-8fef-8294dfe75474") : secret "samples-operator-tls" not found Jul 14 17:26:14.301484 ip-10-0-139-16 kubenswrapper[2552]: E0714 17:26:14.301470 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/9a20f557-1033-431a-8986-88c97723b31c-service-ca-bundle podName:9a20f557-1033-431a-8986-88c97723b31c nodeName:}" failed. No retries permitted until 2026-07-14 17:26:16.30146011 +0000 UTC m=+38.680574041 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/9a20f557-1033-431a-8986-88c97723b31c-service-ca-bundle") pod "router-default-5484d54d6d-2b7v2" (UID: "9a20f557-1033-431a-8986-88c97723b31c") : configmap references non-existent config key: service-ca.crt Jul 14 17:26:14.385791 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:14.385096 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-c9lb7" Jul 14 17:26:14.388559 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:14.388200 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 14 17:26:14.402588 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:14.402363 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d1d42aeb-1ff1-42fd-a566-fea29b751242-metrics-tls\") pod \"dns-default-r7tpq\" (UID: \"d1d42aeb-1ff1-42fd-a566-fea29b751242\") " pod="openshift-dns/dns-default-r7tpq" Jul 14 17:26:14.402588 ip-10-0-139-16 kubenswrapper[2552]: E0714 17:26:14.402513 2552 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 14 17:26:14.402588 ip-10-0-139-16 kubenswrapper[2552]: E0714 17:26:14.402578 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d1d42aeb-1ff1-42fd-a566-fea29b751242-metrics-tls podName:d1d42aeb-1ff1-42fd-a566-fea29b751242 nodeName:}" failed. No retries permitted until 2026-07-14 17:26:16.402558186 +0000 UTC m=+38.781672122 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d1d42aeb-1ff1-42fd-a566-fea29b751242-metrics-tls") pod "dns-default-r7tpq" (UID: "d1d42aeb-1ff1-42fd-a566-fea29b751242") : secret "dns-default-metrics-tls" not found Jul 14 17:26:14.503520 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:14.503353 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/e9d1e6ea-2ff1-4ea8-aee5-8f7bac1dcb0f-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-85r72\" (UID: \"e9d1e6ea-2ff1-4ea8-aee5-8f7bac1dcb0f\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-85r72" Jul 14 17:26:14.503520 ip-10-0-139-16 kubenswrapper[2552]: E0714 17:26:14.503519 2552 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 14 17:26:14.503757 ip-10-0-139-16 kubenswrapper[2552]: E0714 17:26:14.503592 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e9d1e6ea-2ff1-4ea8-aee5-8f7bac1dcb0f-networking-console-plugin-cert podName:e9d1e6ea-2ff1-4ea8-aee5-8f7bac1dcb0f nodeName:}" failed. No retries permitted until 2026-07-14 17:26:15.503570962 +0000 UTC m=+37.882684893 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/e9d1e6ea-2ff1-4ea8-aee5-8f7bac1dcb0f-networking-console-plugin-cert") pod "networking-console-plugin-6cf856758c-85r72" (UID: "e9d1e6ea-2ff1-4ea8-aee5-8f7bac1dcb0f") : secret "networking-console-plugin-cert" not found Jul 14 17:26:14.554712 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:14.554675 2552 generic.go:356] "Generic (PLEG): container finished" podID="d84237cc-b659-4943-b3da-ab9f602d4f86" containerID="1f5dbddac1f17d438189039173dfb6dda4570e3cac3466593f77ac5a4f218f4c" exitCode=0 Jul 14 17:26:14.555152 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:14.554727 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-5zj72" event={"ID":"d84237cc-b659-4943-b3da-ab9f602d4f86","Type":"ContainerDied","Data":"1f5dbddac1f17d438189039173dfb6dda4570e3cac3466593f77ac5a4f218f4c"} Jul 14 17:26:15.515528 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:15.514944 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/e9d1e6ea-2ff1-4ea8-aee5-8f7bac1dcb0f-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-85r72\" (UID: \"e9d1e6ea-2ff1-4ea8-aee5-8f7bac1dcb0f\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-85r72" Jul 14 17:26:15.515528 ip-10-0-139-16 kubenswrapper[2552]: E0714 17:26:15.515101 2552 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 14 17:26:15.515528 ip-10-0-139-16 kubenswrapper[2552]: E0714 17:26:15.515169 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e9d1e6ea-2ff1-4ea8-aee5-8f7bac1dcb0f-networking-console-plugin-cert podName:e9d1e6ea-2ff1-4ea8-aee5-8f7bac1dcb0f nodeName:}" failed. No retries permitted until 2026-07-14 17:26:17.515148948 +0000 UTC m=+39.894262880 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/e9d1e6ea-2ff1-4ea8-aee5-8f7bac1dcb0f-networking-console-plugin-cert") pod "networking-console-plugin-6cf856758c-85r72" (UID: "e9d1e6ea-2ff1-4ea8-aee5-8f7bac1dcb0f") : secret "networking-console-plugin-cert" not found Jul 14 17:26:15.565089 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:15.564258 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-7nwwb" event={"ID":"fbb398bf-d6aa-4566-8bdb-a78349ea23c7","Type":"ContainerStarted","Data":"878dd5d799cb4e1bfd93565aaa344dd8b9b29d7ea5da110dde55e731d2c699fe"} Jul 14 17:26:15.574379 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:15.573642 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-5zj72" event={"ID":"d84237cc-b659-4943-b3da-ab9f602d4f86","Type":"ContainerStarted","Data":"7d5efc898fd0de69c39864f061f8126a93a6d2e3d145ab7911e1d42e44daefb1"} Jul 14 17:26:15.581379 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:15.580568 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-7nwwb" podStartSLOduration=24.386898025 podStartE2EDuration="26.580548125s" totalImagesPullingTime="2.1936501s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 17:25:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 17:26:15.57990666 +0000 UTC m=+37.959020625" watchObservedRunningTime="2026-07-14 17:26:15.580548125 +0000 UTC m=+37.959662078" Jul 14 17:26:15.603065 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:15.602876 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-5zj72" podStartSLOduration=7.81335485 podStartE2EDuration="37.60285518s" totalImagesPullingTime="29.78950033s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-14 17:25:38 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 17:26:15.60042896 +0000 UTC m=+37.979542922" watchObservedRunningTime="2026-07-14 17:26:15.60285518 +0000 UTC m=+37.981969132" Jul 14 17:26:15.722923 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:15.722795 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 17:26:15.773517 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:15.773430 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 17:26:16.221616 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:16.221586 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0f57e94d-cace-4645-a5cb-47f7dd6dc854-registry-tls\") pod \"image-registry-899c5876f-m6hqz\" (UID: \"0f57e94d-cace-4645-a5cb-47f7dd6dc854\") " pod="openshift-image-registry/image-registry-899c5876f-m6hqz" Jul 14 17:26:16.221812 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:16.221648 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/f60de25a-6c7c-41f4-87ce-de3f4eca5c3a-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-hznkp\" (UID: \"f60de25a-6c7c-41f4-87ce-de3f4eca5c3a\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-hznkp" Jul 14 17:26:16.221812 ip-10-0-139-16 kubenswrapper[2552]: E0714 17:26:16.221748 2552 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 14 17:26:16.221812 ip-10-0-139-16 kubenswrapper[2552]: E0714 17:26:16.221773 2552 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-899c5876f-m6hqz: secret "image-registry-tls" not found Jul 14 17:26:16.221812 ip-10-0-139-16 kubenswrapper[2552]: E0714 17:26:16.221775 2552 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 14 17:26:16.222009 ip-10-0-139-16 kubenswrapper[2552]: E0714 17:26:16.221848 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0f57e94d-cace-4645-a5cb-47f7dd6dc854-registry-tls podName:0f57e94d-cace-4645-a5cb-47f7dd6dc854 nodeName:}" failed. No retries permitted until 2026-07-14 17:26:20.221828369 +0000 UTC m=+42.600942305 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/0f57e94d-cace-4645-a5cb-47f7dd6dc854-registry-tls") pod "image-registry-899c5876f-m6hqz" (UID: "0f57e94d-cace-4645-a5cb-47f7dd6dc854") : secret "image-registry-tls" not found Jul 14 17:26:16.222009 ip-10-0-139-16 kubenswrapper[2552]: E0714 17:26:16.221872 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f60de25a-6c7c-41f4-87ce-de3f4eca5c3a-cluster-monitoring-operator-tls podName:f60de25a-6c7c-41f4-87ce-de3f4eca5c3a nodeName:}" failed. No retries permitted until 2026-07-14 17:26:20.221861839 +0000 UTC m=+42.600975771 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/f60de25a-6c7c-41f4-87ce-de3f4eca5c3a-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-hznkp" (UID: "f60de25a-6c7c-41f4-87ce-de3f4eca5c3a") : secret "cluster-monitoring-operator-tls" not found Jul 14 17:26:16.255105 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:16.254883 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 17:26:16.323676 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:16.323127 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9a20f557-1033-431a-8986-88c97723b31c-service-ca-bundle\") pod \"router-default-5484d54d6d-2b7v2\" (UID: \"9a20f557-1033-431a-8986-88c97723b31c\") " pod="openshift-ingress/router-default-5484d54d6d-2b7v2" Jul 14 17:26:16.323676 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:16.323207 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/e508c23b-e275-4952-8fef-8294dfe75474-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-q49pd\" (UID: \"e508c23b-e275-4952-8fef-8294dfe75474\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-q49pd" Jul 14 17:26:16.323676 ip-10-0-139-16 kubenswrapper[2552]: E0714 17:26:16.323263 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/9a20f557-1033-431a-8986-88c97723b31c-service-ca-bundle podName:9a20f557-1033-431a-8986-88c97723b31c nodeName:}" failed. No retries permitted until 2026-07-14 17:26:20.323246217 +0000 UTC m=+42.702360147 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/9a20f557-1033-431a-8986-88c97723b31c-service-ca-bundle") pod "router-default-5484d54d6d-2b7v2" (UID: "9a20f557-1033-431a-8986-88c97723b31c") : configmap references non-existent config key: service-ca.crt Jul 14 17:26:16.323676 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:16.323392 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9a20f557-1033-431a-8986-88c97723b31c-metrics-certs\") pod \"router-default-5484d54d6d-2b7v2\" (UID: \"9a20f557-1033-431a-8986-88c97723b31c\") " pod="openshift-ingress/router-default-5484d54d6d-2b7v2" Jul 14 17:26:16.323676 ip-10-0-139-16 kubenswrapper[2552]: E0714 17:26:16.323500 2552 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 14 17:26:16.323676 ip-10-0-139-16 kubenswrapper[2552]: E0714 17:26:16.323544 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9a20f557-1033-431a-8986-88c97723b31c-metrics-certs podName:9a20f557-1033-431a-8986-88c97723b31c nodeName:}" failed. No retries permitted until 2026-07-14 17:26:20.323531694 +0000 UTC m=+42.702645630 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9a20f557-1033-431a-8986-88c97723b31c-metrics-certs") pod "router-default-5484d54d6d-2b7v2" (UID: "9a20f557-1033-431a-8986-88c97723b31c") : secret "router-metrics-certs-default" not found Jul 14 17:26:16.323676 ip-10-0-139-16 kubenswrapper[2552]: E0714 17:26:16.323609 2552 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 14 17:26:16.323676 ip-10-0-139-16 kubenswrapper[2552]: E0714 17:26:16.323648 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e508c23b-e275-4952-8fef-8294dfe75474-samples-operator-tls podName:e508c23b-e275-4952-8fef-8294dfe75474 nodeName:}" failed. No retries permitted until 2026-07-14 17:26:20.323637039 +0000 UTC m=+42.702750969 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/e508c23b-e275-4952-8fef-8294dfe75474-samples-operator-tls") pod "cluster-samples-operator-65db858894-q49pd" (UID: "e508c23b-e275-4952-8fef-8294dfe75474") : secret "samples-operator-tls" not found Jul 14 17:26:16.396040 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:16.396005 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 17:26:16.424028 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:16.423968 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d1d42aeb-1ff1-42fd-a566-fea29b751242-metrics-tls\") pod \"dns-default-r7tpq\" (UID: \"d1d42aeb-1ff1-42fd-a566-fea29b751242\") " pod="openshift-dns/dns-default-r7tpq" Jul 14 17:26:16.424184 ip-10-0-139-16 kubenswrapper[2552]: E0714 17:26:16.424129 2552 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 14 17:26:16.424253 ip-10-0-139-16 kubenswrapper[2552]: E0714 17:26:16.424206 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d1d42aeb-1ff1-42fd-a566-fea29b751242-metrics-tls podName:d1d42aeb-1ff1-42fd-a566-fea29b751242 nodeName:}" failed. No retries permitted until 2026-07-14 17:26:20.424186375 +0000 UTC m=+42.803300306 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d1d42aeb-1ff1-42fd-a566-fea29b751242-metrics-tls") pod "dns-default-r7tpq" (UID: "d1d42aeb-1ff1-42fd-a566-fea29b751242") : secret "dns-default-metrics-tls" not found Jul 14 17:26:16.497114 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:16.497026 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 17:26:17.323313 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:17.323166 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 17:26:17.424052 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:17.424015 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 17:26:17.523688 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:17.523658 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 17:26:17.534548 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:17.534522 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/e9d1e6ea-2ff1-4ea8-aee5-8f7bac1dcb0f-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-85r72\" (UID: \"e9d1e6ea-2ff1-4ea8-aee5-8f7bac1dcb0f\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-85r72" Jul 14 17:26:17.534684 ip-10-0-139-16 kubenswrapper[2552]: E0714 17:26:17.534671 2552 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 14 17:26:17.534746 ip-10-0-139-16 kubenswrapper[2552]: E0714 17:26:17.534735 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e9d1e6ea-2ff1-4ea8-aee5-8f7bac1dcb0f-networking-console-plugin-cert podName:e9d1e6ea-2ff1-4ea8-aee5-8f7bac1dcb0f nodeName:}" failed. No retries permitted until 2026-07-14 17:26:21.534719812 +0000 UTC m=+43.913833749 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/e9d1e6ea-2ff1-4ea8-aee5-8f7bac1dcb0f-networking-console-plugin-cert") pod "networking-console-plugin-6cf856758c-85r72" (UID: "e9d1e6ea-2ff1-4ea8-aee5-8f7bac1dcb0f") : secret "networking-console-plugin-cert" not found Jul 14 17:26:18.223568 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:18.223533 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 17:26:18.322197 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:18.322158 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 17:26:18.618135 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:18.618053 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 17:26:18.678787 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:18.678754 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 17:26:18.769577 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:18.769549 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 17:26:18.870044 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:18.869965 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 17:26:19.775767 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:19.775711 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 17:26:19.876577 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:19.876521 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 17:26:19.976431 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:19.976350 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 17:26:20.259003 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:20.258972 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0f57e94d-cace-4645-a5cb-47f7dd6dc854-registry-tls\") pod \"image-registry-899c5876f-m6hqz\" (UID: \"0f57e94d-cace-4645-a5cb-47f7dd6dc854\") " pod="openshift-image-registry/image-registry-899c5876f-m6hqz" Jul 14 17:26:20.259164 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:20.259024 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/f60de25a-6c7c-41f4-87ce-de3f4eca5c3a-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-hznkp\" (UID: \"f60de25a-6c7c-41f4-87ce-de3f4eca5c3a\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-hznkp" Jul 14 17:26:20.259164 ip-10-0-139-16 kubenswrapper[2552]: E0714 17:26:20.259131 2552 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 14 17:26:20.259164 ip-10-0-139-16 kubenswrapper[2552]: E0714 17:26:20.259149 2552 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-899c5876f-m6hqz: secret "image-registry-tls" not found Jul 14 17:26:20.259257 ip-10-0-139-16 kubenswrapper[2552]: E0714 17:26:20.259197 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0f57e94d-cace-4645-a5cb-47f7dd6dc854-registry-tls podName:0f57e94d-cace-4645-a5cb-47f7dd6dc854 nodeName:}" failed. No retries permitted until 2026-07-14 17:26:28.259182262 +0000 UTC m=+50.638296195 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/0f57e94d-cace-4645-a5cb-47f7dd6dc854-registry-tls") pod "image-registry-899c5876f-m6hqz" (UID: "0f57e94d-cace-4645-a5cb-47f7dd6dc854") : secret "image-registry-tls" not found Jul 14 17:26:20.259257 ip-10-0-139-16 kubenswrapper[2552]: E0714 17:26:20.259246 2552 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 14 17:26:20.259322 ip-10-0-139-16 kubenswrapper[2552]: E0714 17:26:20.259293 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f60de25a-6c7c-41f4-87ce-de3f4eca5c3a-cluster-monitoring-operator-tls podName:f60de25a-6c7c-41f4-87ce-de3f4eca5c3a nodeName:}" failed. No retries permitted until 2026-07-14 17:26:28.25928065 +0000 UTC m=+50.638394579 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/f60de25a-6c7c-41f4-87ce-de3f4eca5c3a-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-hznkp" (UID: "f60de25a-6c7c-41f4-87ce-de3f4eca5c3a") : secret "cluster-monitoring-operator-tls" not found Jul 14 17:26:20.360156 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:20.360129 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9a20f557-1033-431a-8986-88c97723b31c-metrics-certs\") pod \"router-default-5484d54d6d-2b7v2\" (UID: \"9a20f557-1033-431a-8986-88c97723b31c\") " pod="openshift-ingress/router-default-5484d54d6d-2b7v2" Jul 14 17:26:20.360231 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:20.360180 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9a20f557-1033-431a-8986-88c97723b31c-service-ca-bundle\") pod \"router-default-5484d54d6d-2b7v2\" (UID: \"9a20f557-1033-431a-8986-88c97723b31c\") " pod="openshift-ingress/router-default-5484d54d6d-2b7v2" Jul 14 17:26:20.360300 ip-10-0-139-16 kubenswrapper[2552]: E0714 17:26:20.360282 2552 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 14 17:26:20.360365 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:20.360318 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/e508c23b-e275-4952-8fef-8294dfe75474-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-q49pd\" (UID: \"e508c23b-e275-4952-8fef-8294dfe75474\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-q49pd" Jul 14 17:26:20.360408 ip-10-0-139-16 kubenswrapper[2552]: E0714 17:26:20.360378 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9a20f557-1033-431a-8986-88c97723b31c-metrics-certs podName:9a20f557-1033-431a-8986-88c97723b31c nodeName:}" failed. No retries permitted until 2026-07-14 17:26:28.360358961 +0000 UTC m=+50.739472914 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9a20f557-1033-431a-8986-88c97723b31c-metrics-certs") pod "router-default-5484d54d6d-2b7v2" (UID: "9a20f557-1033-431a-8986-88c97723b31c") : secret "router-metrics-certs-default" not found Jul 14 17:26:20.360454 ip-10-0-139-16 kubenswrapper[2552]: E0714 17:26:20.360414 2552 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 14 17:26:20.360454 ip-10-0-139-16 kubenswrapper[2552]: E0714 17:26:20.360437 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/9a20f557-1033-431a-8986-88c97723b31c-service-ca-bundle podName:9a20f557-1033-431a-8986-88c97723b31c nodeName:}" failed. No retries permitted until 2026-07-14 17:26:28.360426713 +0000 UTC m=+50.739540657 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/9a20f557-1033-431a-8986-88c97723b31c-service-ca-bundle") pod "router-default-5484d54d6d-2b7v2" (UID: "9a20f557-1033-431a-8986-88c97723b31c") : configmap references non-existent config key: service-ca.crt Jul 14 17:26:20.360454 ip-10-0-139-16 kubenswrapper[2552]: E0714 17:26:20.360452 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e508c23b-e275-4952-8fef-8294dfe75474-samples-operator-tls podName:e508c23b-e275-4952-8fef-8294dfe75474 nodeName:}" failed. No retries permitted until 2026-07-14 17:26:28.360444 +0000 UTC m=+50.739557934 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/e508c23b-e275-4952-8fef-8294dfe75474-samples-operator-tls") pod "cluster-samples-operator-65db858894-q49pd" (UID: "e508c23b-e275-4952-8fef-8294dfe75474") : secret "samples-operator-tls" not found Jul 14 17:26:20.461682 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:20.461645 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d1d42aeb-1ff1-42fd-a566-fea29b751242-metrics-tls\") pod \"dns-default-r7tpq\" (UID: \"d1d42aeb-1ff1-42fd-a566-fea29b751242\") " pod="openshift-dns/dns-default-r7tpq" Jul 14 17:26:20.461840 ip-10-0-139-16 kubenswrapper[2552]: E0714 17:26:20.461793 2552 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 14 17:26:20.462009 ip-10-0-139-16 kubenswrapper[2552]: E0714 17:26:20.461851 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d1d42aeb-1ff1-42fd-a566-fea29b751242-metrics-tls podName:d1d42aeb-1ff1-42fd-a566-fea29b751242 nodeName:}" failed. No retries permitted until 2026-07-14 17:26:28.461835619 +0000 UTC m=+50.840949549 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d1d42aeb-1ff1-42fd-a566-fea29b751242-metrics-tls") pod "dns-default-r7tpq" (UID: "d1d42aeb-1ff1-42fd-a566-fea29b751242") : secret "dns-default-metrics-tls" not found Jul 14 17:26:21.238631 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:21.238597 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 17:26:21.571110 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:21.570999 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/e9d1e6ea-2ff1-4ea8-aee5-8f7bac1dcb0f-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-85r72\" (UID: \"e9d1e6ea-2ff1-4ea8-aee5-8f7bac1dcb0f\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-85r72" Jul 14 17:26:21.571377 ip-10-0-139-16 kubenswrapper[2552]: E0714 17:26:21.571176 2552 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 14 17:26:21.571377 ip-10-0-139-16 kubenswrapper[2552]: E0714 17:26:21.571259 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e9d1e6ea-2ff1-4ea8-aee5-8f7bac1dcb0f-networking-console-plugin-cert podName:e9d1e6ea-2ff1-4ea8-aee5-8f7bac1dcb0f nodeName:}" failed. No retries permitted until 2026-07-14 17:26:29.571238271 +0000 UTC m=+51.950352207 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/e9d1e6ea-2ff1-4ea8-aee5-8f7bac1dcb0f-networking-console-plugin-cert") pod "networking-console-plugin-6cf856758c-85r72" (UID: "e9d1e6ea-2ff1-4ea8-aee5-8f7bac1dcb0f") : secret "networking-console-plugin-cert" not found Jul 14 17:26:21.597446 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:21.597408 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-68d9dd94cf-dq264" event={"ID":"5a0f3a9b-3347-43e5-910b-229e446543ad","Type":"ContainerStarted","Data":"82015b6fd02ed184f8a339973d1960a3506abbaea10df507cfe3f5b652345bee"} Jul 14 17:26:21.599153 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:21.599131 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-gnw2z_b3c71861-4db9-4850-a44b-6f5d44a94235/console-operator/0.log" Jul 14 17:26:21.599266 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:21.599172 2552 generic.go:356] "Generic (PLEG): container finished" podID="b3c71861-4db9-4850-a44b-6f5d44a94235" containerID="601ceb66580c508098517f7aeb9a7dc83f13241f804c3424fce8e8f07c764685" exitCode=255 Jul 14 17:26:21.599266 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:21.599248 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7866497494-gnw2z" event={"ID":"b3c71861-4db9-4850-a44b-6f5d44a94235","Type":"ContainerDied","Data":"601ceb66580c508098517f7aeb9a7dc83f13241f804c3424fce8e8f07c764685"} Jul 14 17:26:21.599669 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:21.599536 2552 scope.go:117] "RemoveContainer" containerID="601ceb66580c508098517f7aeb9a7dc83f13241f804c3424fce8e8f07c764685" Jul 14 17:26:21.601556 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:21.601195 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-wzm2l" event={"ID":"e0e19152-87b3-4e28-9739-36d5639e5eb1","Type":"ContainerStarted","Data":"8a0cbdb34cb6f89b15c4b673046eb4903da0a9c4927e1d2f2e776e5775587eb1"} Jul 14 17:26:21.603347 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:21.603311 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-6xn2k" event={"ID":"62900e1e-659d-4c6e-9e31-2933f84ebc70","Type":"ContainerStarted","Data":"be235381990de68e2d729070148123ea99cc85d9723c025a4bef45f16a6cf479"} Jul 14 17:26:21.605142 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:21.605118 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-w4vkl" event={"ID":"c3b4f75d-a278-455b-8de5-d9d580cc77ec","Type":"ContainerStarted","Data":"65a8db03544afccda21bb1eae6284596d11f985274b4024f4a920132e3fef0a8"} Jul 14 17:26:21.606766 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:21.606745 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-ckl8p" event={"ID":"aa9ffe90-3c13-4508-861a-97379e7154aa","Type":"ContainerStarted","Data":"2fe674ce7cc3e053507126606d9aaec7fdce7d7e4ee52a5b5a40f2b3f7ab5f14"} Jul 14 17:26:21.615838 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:21.615794 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-68d9dd94cf-dq264" podStartSLOduration=35.235284369 podStartE2EDuration="42.615777541s" totalImagesPullingTime="7.380493172s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 17:25:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 17:26:21.615512281 +0000 UTC m=+43.994626235" watchObservedRunningTime="2026-07-14 17:26:21.615777541 +0000 UTC m=+43.994891498" Jul 14 17:26:21.652574 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:21.652289 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-ckl8p" podStartSLOduration=25.306507197 podStartE2EDuration="32.65226829s" totalImagesPullingTime="7.345761093s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 17:25:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 17:26:21.63164287 +0000 UTC m=+44.010756823" watchObservedRunningTime="2026-07-14 17:26:21.65226829 +0000 UTC m=+44.031382222" Jul 14 17:26:21.674046 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:21.673778 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-6xn2k" podStartSLOduration=25.328840711 podStartE2EDuration="32.673757278s" totalImagesPullingTime="7.344916567s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 17:25:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 17:26:21.672123359 +0000 UTC m=+44.051237313" watchObservedRunningTime="2026-07-14 17:26:21.673757278 +0000 UTC m=+44.052871230" Jul 14 17:26:21.686535 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:21.686509 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-7tgt2"] Jul 14 17:26:21.707253 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:21.706223 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-w4vkl" podStartSLOduration=2.3533349980000002 podStartE2EDuration="9.706202348s" totalImagesPullingTime="7.35286735s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 17:26:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 17:26:21.705821994 +0000 UTC m=+44.084935950" watchObservedRunningTime="2026-07-14 17:26:21.706202348 +0000 UTC m=+44.085316301" Jul 14 17:26:21.713203 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:21.713051 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-7tgt2"] Jul 14 17:26:21.713550 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:21.713442 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-7tgt2" Jul 14 17:26:21.717937 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:21.717268 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 14 17:26:21.717937 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:21.717617 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-nk7rg\"" Jul 14 17:26:21.717937 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:21.717801 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 14 17:26:21.723707 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:21.722480 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-wzm2l" podStartSLOduration=16.376603375 podStartE2EDuration="23.72246264s" totalImagesPullingTime="7.345859265s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 17:25:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 17:26:21.721738439 +0000 UTC m=+44.100852392" watchObservedRunningTime="2026-07-14 17:26:21.72246264 +0000 UTC m=+44.101576593" Jul 14 17:26:21.745200 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:21.745157 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 17:26:21.780389 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:21.780360 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sp9dz\" (UniqueName: \"kubernetes.io/projected/a616b344-63a5-4f64-a433-f2be1e21e745-kube-api-access-sp9dz\") pod \"insights-runtime-extractor-7tgt2\" (UID: \"a616b344-63a5-4f64-a433-f2be1e21e745\") " pod="openshift-insights/insights-runtime-extractor-7tgt2" Jul 14 17:26:21.780872 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:21.780847 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/a616b344-63a5-4f64-a433-f2be1e21e745-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-7tgt2\" (UID: \"a616b344-63a5-4f64-a433-f2be1e21e745\") " pod="openshift-insights/insights-runtime-extractor-7tgt2" Jul 14 17:26:21.781084 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:21.781067 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/a616b344-63a5-4f64-a433-f2be1e21e745-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-7tgt2\" (UID: \"a616b344-63a5-4f64-a433-f2be1e21e745\") " pod="openshift-insights/insights-runtime-extractor-7tgt2" Jul 14 17:26:21.781258 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:21.781245 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/a616b344-63a5-4f64-a433-f2be1e21e745-data-volume\") pod \"insights-runtime-extractor-7tgt2\" (UID: \"a616b344-63a5-4f64-a433-f2be1e21e745\") " pod="openshift-insights/insights-runtime-extractor-7tgt2" Jul 14 17:26:21.781502 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:21.781469 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/a616b344-63a5-4f64-a433-f2be1e21e745-crio-socket\") pod \"insights-runtime-extractor-7tgt2\" (UID: \"a616b344-63a5-4f64-a433-f2be1e21e745\") " pod="openshift-insights/insights-runtime-extractor-7tgt2" Jul 14 17:26:21.882240 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:21.882203 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sp9dz\" (UniqueName: \"kubernetes.io/projected/a616b344-63a5-4f64-a433-f2be1e21e745-kube-api-access-sp9dz\") pod \"insights-runtime-extractor-7tgt2\" (UID: \"a616b344-63a5-4f64-a433-f2be1e21e745\") " pod="openshift-insights/insights-runtime-extractor-7tgt2" Jul 14 17:26:21.882415 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:21.882307 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/a616b344-63a5-4f64-a433-f2be1e21e745-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-7tgt2\" (UID: \"a616b344-63a5-4f64-a433-f2be1e21e745\") " pod="openshift-insights/insights-runtime-extractor-7tgt2" Jul 14 17:26:21.882415 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:21.882365 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/a616b344-63a5-4f64-a433-f2be1e21e745-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-7tgt2\" (UID: \"a616b344-63a5-4f64-a433-f2be1e21e745\") " pod="openshift-insights/insights-runtime-extractor-7tgt2" Jul 14 17:26:21.882415 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:21.882410 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/a616b344-63a5-4f64-a433-f2be1e21e745-data-volume\") pod \"insights-runtime-extractor-7tgt2\" (UID: \"a616b344-63a5-4f64-a433-f2be1e21e745\") " pod="openshift-insights/insights-runtime-extractor-7tgt2" Jul 14 17:26:21.882580 ip-10-0-139-16 kubenswrapper[2552]: E0714 17:26:21.882443 2552 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 14 17:26:21.882580 ip-10-0-139-16 kubenswrapper[2552]: E0714 17:26:21.882492 2552 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 14 17:26:21.882580 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:21.882504 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/a616b344-63a5-4f64-a433-f2be1e21e745-crio-socket\") pod \"insights-runtime-extractor-7tgt2\" (UID: \"a616b344-63a5-4f64-a433-f2be1e21e745\") " pod="openshift-insights/insights-runtime-extractor-7tgt2" Jul 14 17:26:21.882580 ip-10-0-139-16 kubenswrapper[2552]: E0714 17:26:21.882520 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a616b344-63a5-4f64-a433-f2be1e21e745-insights-runtime-extractor-tls podName:a616b344-63a5-4f64-a433-f2be1e21e745 nodeName:}" failed. No retries permitted until 2026-07-14 17:26:22.382497938 +0000 UTC m=+44.761611869 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/a616b344-63a5-4f64-a433-f2be1e21e745-insights-runtime-extractor-tls") pod "insights-runtime-extractor-7tgt2" (UID: "a616b344-63a5-4f64-a433-f2be1e21e745") : secret "insights-runtime-extractor-tls" not found Jul 14 17:26:21.882580 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:21.882447 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/a616b344-63a5-4f64-a433-f2be1e21e745-crio-socket\") pod \"insights-runtime-extractor-7tgt2\" (UID: \"a616b344-63a5-4f64-a433-f2be1e21e745\") " pod="openshift-insights/insights-runtime-extractor-7tgt2" Jul 14 17:26:21.882580 ip-10-0-139-16 kubenswrapper[2552]: E0714 17:26:21.882553 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/a616b344-63a5-4f64-a433-f2be1e21e745-kube-rbac-proxy-cm podName:a616b344-63a5-4f64-a433-f2be1e21e745 nodeName:}" failed. No retries permitted until 2026-07-14 17:26:22.38253349 +0000 UTC m=+44.761647440 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/a616b344-63a5-4f64-a433-f2be1e21e745-kube-rbac-proxy-cm") pod "insights-runtime-extractor-7tgt2" (UID: "a616b344-63a5-4f64-a433-f2be1e21e745") : configmap "kube-rbac-proxy" not found Jul 14 17:26:21.882824 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:21.882801 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/a616b344-63a5-4f64-a433-f2be1e21e745-data-volume\") pod \"insights-runtime-extractor-7tgt2\" (UID: \"a616b344-63a5-4f64-a433-f2be1e21e745\") " pod="openshift-insights/insights-runtime-extractor-7tgt2" Jul 14 17:26:21.884855 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:21.884834 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 17:26:21.894228 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:21.894208 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sp9dz\" (UniqueName: \"kubernetes.io/projected/a616b344-63a5-4f64-a433-f2be1e21e745-kube-api-access-sp9dz\") pod \"insights-runtime-extractor-7tgt2\" (UID: \"a616b344-63a5-4f64-a433-f2be1e21e745\") " pod="openshift-insights/insights-runtime-extractor-7tgt2" Jul 14 17:26:22.050863 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:22.050820 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-7f59b54f6c-w28cd"] Jul 14 17:26:22.055012 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:22.054974 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 17:26:22.065713 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:22.065688 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-7f59b54f6c-w28cd"] Jul 14 17:26:22.065833 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:22.065802 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-w28cd" Jul 14 17:26:22.068420 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:22.068390 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\"" Jul 14 17:26:22.068538 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:22.068470 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\"" Jul 14 17:26:22.068609 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:22.068536 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-75fcv\"" Jul 14 17:26:22.084479 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:22.084452 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7wzpl\" (UniqueName: \"kubernetes.io/projected/258a76f8-f467-4a03-b3fa-b118cb969775-kube-api-access-7wzpl\") pod \"migrator-7f59b54f6c-w28cd\" (UID: \"258a76f8-f467-4a03-b3fa-b118cb969775\") " pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-w28cd" Jul 14 17:26:22.120708 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:22.120679 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 17:26:22.177662 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:22.177634 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 17:26:22.185762 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:22.185741 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7wzpl\" (UniqueName: \"kubernetes.io/projected/258a76f8-f467-4a03-b3fa-b118cb969775-kube-api-access-7wzpl\") pod \"migrator-7f59b54f6c-w28cd\" (UID: \"258a76f8-f467-4a03-b3fa-b118cb969775\") " pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-w28cd" Jul 14 17:26:22.193188 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:22.193168 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7wzpl\" (UniqueName: \"kubernetes.io/projected/258a76f8-f467-4a03-b3fa-b118cb969775-kube-api-access-7wzpl\") pod \"migrator-7f59b54f6c-w28cd\" (UID: \"258a76f8-f467-4a03-b3fa-b118cb969775\") " pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-w28cd" Jul 14 17:26:22.370344 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:22.370235 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 17:26:22.376976 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:22.376960 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-w28cd" Jul 14 17:26:22.388135 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:22.388114 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/a616b344-63a5-4f64-a433-f2be1e21e745-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-7tgt2\" (UID: \"a616b344-63a5-4f64-a433-f2be1e21e745\") " pod="openshift-insights/insights-runtime-extractor-7tgt2" Jul 14 17:26:22.388234 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:22.388155 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/a616b344-63a5-4f64-a433-f2be1e21e745-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-7tgt2\" (UID: \"a616b344-63a5-4f64-a433-f2be1e21e745\") " pod="openshift-insights/insights-runtime-extractor-7tgt2" Jul 14 17:26:22.388294 ip-10-0-139-16 kubenswrapper[2552]: E0714 17:26:22.388277 2552 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 14 17:26:22.388367 ip-10-0-139-16 kubenswrapper[2552]: E0714 17:26:22.388316 2552 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 14 17:26:22.388423 ip-10-0-139-16 kubenswrapper[2552]: E0714 17:26:22.388373 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a616b344-63a5-4f64-a433-f2be1e21e745-insights-runtime-extractor-tls podName:a616b344-63a5-4f64-a433-f2be1e21e745 nodeName:}" failed. No retries permitted until 2026-07-14 17:26:23.388351994 +0000 UTC m=+45.767465924 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/a616b344-63a5-4f64-a433-f2be1e21e745-insights-runtime-extractor-tls") pod "insights-runtime-extractor-7tgt2" (UID: "a616b344-63a5-4f64-a433-f2be1e21e745") : secret "insights-runtime-extractor-tls" not found Jul 14 17:26:22.388423 ip-10-0-139-16 kubenswrapper[2552]: E0714 17:26:22.388395 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/a616b344-63a5-4f64-a433-f2be1e21e745-kube-rbac-proxy-cm podName:a616b344-63a5-4f64-a433-f2be1e21e745 nodeName:}" failed. No retries permitted until 2026-07-14 17:26:23.388384561 +0000 UTC m=+45.767498490 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/a616b344-63a5-4f64-a433-f2be1e21e745-kube-rbac-proxy-cm") pod "insights-runtime-extractor-7tgt2" (UID: "a616b344-63a5-4f64-a433-f2be1e21e745") : configmap "kube-rbac-proxy" not found Jul 14 17:26:22.472811 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:22.472747 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 17:26:22.530472 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:22.530442 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-7f59b54f6c-w28cd"] Jul 14 17:26:22.533098 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:26:22.533072 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod258a76f8_f467_4a03_b3fa_b118cb969775.slice/crio-6bdf6db78b187c67d9110ef17bdfd374ed6379a174bdafc92101e7e0b0db0065 WatchSource:0}: Error finding container 6bdf6db78b187c67d9110ef17bdfd374ed6379a174bdafc92101e7e0b0db0065: Status 404 returned error can't find the container with id 6bdf6db78b187c67d9110ef17bdfd374ed6379a174bdafc92101e7e0b0db0065 Jul 14 17:26:22.610870 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:22.610839 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-w28cd" event={"ID":"258a76f8-f467-4a03-b3fa-b118cb969775","Type":"ContainerStarted","Data":"6bdf6db78b187c67d9110ef17bdfd374ed6379a174bdafc92101e7e0b0db0065"} Jul 14 17:26:22.612364 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:22.612346 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-gnw2z_b3c71861-4db9-4850-a44b-6f5d44a94235/console-operator/1.log" Jul 14 17:26:22.612754 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:22.612741 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-gnw2z_b3c71861-4db9-4850-a44b-6f5d44a94235/console-operator/0.log" Jul 14 17:26:22.612802 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:22.612771 2552 generic.go:356] "Generic (PLEG): container finished" podID="b3c71861-4db9-4850-a44b-6f5d44a94235" containerID="e638eec05ad34945969499d50e465e972270661d514ce3fb294617c0d4605d43" exitCode=255 Jul 14 17:26:22.612887 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:22.612870 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7866497494-gnw2z" event={"ID":"b3c71861-4db9-4850-a44b-6f5d44a94235","Type":"ContainerDied","Data":"e638eec05ad34945969499d50e465e972270661d514ce3fb294617c0d4605d43"} Jul 14 17:26:22.612933 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:22.612919 2552 scope.go:117] "RemoveContainer" containerID="601ceb66580c508098517f7aeb9a7dc83f13241f804c3424fce8e8f07c764685" Jul 14 17:26:22.613201 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:22.613108 2552 scope.go:117] "RemoveContainer" containerID="e638eec05ad34945969499d50e465e972270661d514ce3fb294617c0d4605d43" Jul 14 17:26:22.613340 ip-10-0-139-16 kubenswrapper[2552]: E0714 17:26:22.613307 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-7866497494-gnw2z_openshift-console-operator(b3c71861-4db9-4850-a44b-6f5d44a94235)\"" pod="openshift-console-operator/console-operator-7866497494-gnw2z" podUID="b3c71861-4db9-4850-a44b-6f5d44a94235" Jul 14 17:26:22.863566 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:22.863532 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-7866497494-gnw2z" Jul 14 17:26:22.863718 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:22.863585 2552 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-7866497494-gnw2z" Jul 14 17:26:22.879372 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:22.879342 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 17:26:22.929989 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:22.929906 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 17:26:23.180456 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:23.180387 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-g4bts_6a962207-915e-43fc-80f6-3edd2d3451fc/dns-node-resolver/0.log" Jul 14 17:26:23.398462 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:23.398430 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/a616b344-63a5-4f64-a433-f2be1e21e745-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-7tgt2\" (UID: \"a616b344-63a5-4f64-a433-f2be1e21e745\") " pod="openshift-insights/insights-runtime-extractor-7tgt2" Jul 14 17:26:23.398844 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:23.398477 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/a616b344-63a5-4f64-a433-f2be1e21e745-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-7tgt2\" (UID: \"a616b344-63a5-4f64-a433-f2be1e21e745\") " pod="openshift-insights/insights-runtime-extractor-7tgt2" Jul 14 17:26:23.398844 ip-10-0-139-16 kubenswrapper[2552]: E0714 17:26:23.398552 2552 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 14 17:26:23.398844 ip-10-0-139-16 kubenswrapper[2552]: E0714 17:26:23.398597 2552 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 14 17:26:23.398844 ip-10-0-139-16 kubenswrapper[2552]: E0714 17:26:23.398604 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/a616b344-63a5-4f64-a433-f2be1e21e745-kube-rbac-proxy-cm podName:a616b344-63a5-4f64-a433-f2be1e21e745 nodeName:}" failed. No retries permitted until 2026-07-14 17:26:25.398592109 +0000 UTC m=+47.777706039 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/a616b344-63a5-4f64-a433-f2be1e21e745-kube-rbac-proxy-cm") pod "insights-runtime-extractor-7tgt2" (UID: "a616b344-63a5-4f64-a433-f2be1e21e745") : configmap "kube-rbac-proxy" not found Jul 14 17:26:23.398844 ip-10-0-139-16 kubenswrapper[2552]: E0714 17:26:23.398670 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a616b344-63a5-4f64-a433-f2be1e21e745-insights-runtime-extractor-tls podName:a616b344-63a5-4f64-a433-f2be1e21e745 nodeName:}" failed. No retries permitted until 2026-07-14 17:26:25.398653757 +0000 UTC m=+47.777767693 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/a616b344-63a5-4f64-a433-f2be1e21e745-insights-runtime-extractor-tls") pod "insights-runtime-extractor-7tgt2" (UID: "a616b344-63a5-4f64-a433-f2be1e21e745") : secret "insights-runtime-extractor-tls" not found Jul 14 17:26:23.581232 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:23.581208 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-4t8fg_5b08dae7-1558-40a0-bb51-702d6974fc28/node-ca/0.log" Jul 14 17:26:23.616886 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:23.616858 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-gnw2z_b3c71861-4db9-4850-a44b-6f5d44a94235/console-operator/1.log" Jul 14 17:26:23.617182 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:23.617168 2552 scope.go:117] "RemoveContainer" containerID="e638eec05ad34945969499d50e465e972270661d514ce3fb294617c0d4605d43" Jul 14 17:26:23.617348 ip-10-0-139-16 kubenswrapper[2552]: E0714 17:26:23.617307 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-7866497494-gnw2z_openshift-console-operator(b3c71861-4db9-4850-a44b-6f5d44a94235)\"" pod="openshift-console-operator/console-operator-7866497494-gnw2z" podUID="b3c71861-4db9-4850-a44b-6f5d44a94235" Jul 14 17:26:24.379491 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:24.379465 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-w4vkl_c3b4f75d-a278-455b-8de5-d9d580cc77ec/serve-healthcheck-canary/0.log" Jul 14 17:26:24.448228 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:24.448200 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-79f68b9f4f-gbspj"] Jul 14 17:26:24.465251 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:24.465226 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-79f68b9f4f-gbspj"] Jul 14 17:26:24.465383 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:24.465319 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-79f68b9f4f-gbspj" Jul 14 17:26:24.467780 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:24.467760 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\"" Jul 14 17:26:24.467877 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:24.467764 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\"" Jul 14 17:26:24.468900 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:24.468879 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-pdmlm\"" Jul 14 17:26:24.469014 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:24.468922 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\"" Jul 14 17:26:24.469014 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:24.468935 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\"" Jul 14 17:26:24.511095 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:24.511064 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6qdzf\" (UniqueName: \"kubernetes.io/projected/57f1df96-acf2-4672-a528-b6f24e6741b1-kube-api-access-6qdzf\") pod \"service-ca-79f68b9f4f-gbspj\" (UID: \"57f1df96-acf2-4672-a528-b6f24e6741b1\") " pod="openshift-service-ca/service-ca-79f68b9f4f-gbspj" Jul 14 17:26:24.511277 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:24.511259 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/57f1df96-acf2-4672-a528-b6f24e6741b1-signing-key\") pod \"service-ca-79f68b9f4f-gbspj\" (UID: \"57f1df96-acf2-4672-a528-b6f24e6741b1\") " pod="openshift-service-ca/service-ca-79f68b9f4f-gbspj" Jul 14 17:26:24.511344 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:24.511308 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/57f1df96-acf2-4672-a528-b6f24e6741b1-signing-cabundle\") pod \"service-ca-79f68b9f4f-gbspj\" (UID: \"57f1df96-acf2-4672-a528-b6f24e6741b1\") " pod="openshift-service-ca/service-ca-79f68b9f4f-gbspj" Jul 14 17:26:24.549117 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:24.548833 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 17:26:24.612744 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:24.612714 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/57f1df96-acf2-4672-a528-b6f24e6741b1-signing-key\") pod \"service-ca-79f68b9f4f-gbspj\" (UID: \"57f1df96-acf2-4672-a528-b6f24e6741b1\") " pod="openshift-service-ca/service-ca-79f68b9f4f-gbspj" Jul 14 17:26:24.612897 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:24.612753 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/57f1df96-acf2-4672-a528-b6f24e6741b1-signing-cabundle\") pod \"service-ca-79f68b9f4f-gbspj\" (UID: \"57f1df96-acf2-4672-a528-b6f24e6741b1\") " pod="openshift-service-ca/service-ca-79f68b9f4f-gbspj" Jul 14 17:26:24.613066 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:24.613013 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6qdzf\" (UniqueName: \"kubernetes.io/projected/57f1df96-acf2-4672-a528-b6f24e6741b1-kube-api-access-6qdzf\") pod \"service-ca-79f68b9f4f-gbspj\" (UID: \"57f1df96-acf2-4672-a528-b6f24e6741b1\") " pod="openshift-service-ca/service-ca-79f68b9f4f-gbspj" Jul 14 17:26:24.613405 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:24.613385 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/57f1df96-acf2-4672-a528-b6f24e6741b1-signing-cabundle\") pod \"service-ca-79f68b9f4f-gbspj\" (UID: \"57f1df96-acf2-4672-a528-b6f24e6741b1\") " pod="openshift-service-ca/service-ca-79f68b9f4f-gbspj" Jul 14 17:26:24.615140 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:24.615119 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/57f1df96-acf2-4672-a528-b6f24e6741b1-signing-key\") pod \"service-ca-79f68b9f4f-gbspj\" (UID: \"57f1df96-acf2-4672-a528-b6f24e6741b1\") " pod="openshift-service-ca/service-ca-79f68b9f4f-gbspj" Jul 14 17:26:24.621964 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:24.621932 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-w28cd" event={"ID":"258a76f8-f467-4a03-b3fa-b118cb969775","Type":"ContainerStarted","Data":"cbc954e0e0a11c9cd826177478ab98d088d7c8f4889de5712bf3a2bc44f4a5cf"} Jul 14 17:26:24.622068 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:24.621992 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-w28cd" event={"ID":"258a76f8-f467-4a03-b3fa-b118cb969775","Type":"ContainerStarted","Data":"60fb7bd37fd0a8f6c11c6a5b10944955544e64c78e2a4d34f0513b048a621233"} Jul 14 17:26:24.622450 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:24.622432 2552 scope.go:117] "RemoveContainer" containerID="e638eec05ad34945969499d50e465e972270661d514ce3fb294617c0d4605d43" Jul 14 17:26:24.622588 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:24.622571 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6qdzf\" (UniqueName: \"kubernetes.io/projected/57f1df96-acf2-4672-a528-b6f24e6741b1-kube-api-access-6qdzf\") pod \"service-ca-79f68b9f4f-gbspj\" (UID: \"57f1df96-acf2-4672-a528-b6f24e6741b1\") " pod="openshift-service-ca/service-ca-79f68b9f4f-gbspj" Jul 14 17:26:24.622648 ip-10-0-139-16 kubenswrapper[2552]: E0714 17:26:24.622604 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-7866497494-gnw2z_openshift-console-operator(b3c71861-4db9-4850-a44b-6f5d44a94235)\"" pod="openshift-console-operator/console-operator-7866497494-gnw2z" podUID="b3c71861-4db9-4850-a44b-6f5d44a94235" Jul 14 17:26:24.638390 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:24.638347 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-w28cd" podStartSLOduration=0.808834499 podStartE2EDuration="2.638316965s" totalImagesPullingTime="1.829482466s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 17:26:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 17:26:24.636894409 +0000 UTC m=+47.016008371" watchObservedRunningTime="2026-07-14 17:26:24.638316965 +0000 UTC m=+47.017430977" Jul 14 17:26:24.776553 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:24.776521 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-79f68b9f4f-gbspj" Jul 14 17:26:24.916220 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:24.916167 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-79f68b9f4f-gbspj"] Jul 14 17:26:24.918615 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:26:24.918592 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod57f1df96_acf2_4672_a528_b6f24e6741b1.slice/crio-af32a2037c7047f9af67971f1c45dbd4645b36edb88e110a7c55737c2e7f8e8f WatchSource:0}: Error finding container af32a2037c7047f9af67971f1c45dbd4645b36edb88e110a7c55737c2e7f8e8f: Status 404 returned error can't find the container with id af32a2037c7047f9af67971f1c45dbd4645b36edb88e110a7c55737c2e7f8e8f Jul 14 17:26:25.086100 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:25.086057 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 17:26:25.421267 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:25.421234 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/a616b344-63a5-4f64-a433-f2be1e21e745-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-7tgt2\" (UID: \"a616b344-63a5-4f64-a433-f2be1e21e745\") " pod="openshift-insights/insights-runtime-extractor-7tgt2" Jul 14 17:26:25.421482 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:25.421281 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/a616b344-63a5-4f64-a433-f2be1e21e745-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-7tgt2\" (UID: \"a616b344-63a5-4f64-a433-f2be1e21e745\") " pod="openshift-insights/insights-runtime-extractor-7tgt2" Jul 14 17:26:25.421482 ip-10-0-139-16 kubenswrapper[2552]: E0714 17:26:25.421446 2552 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 14 17:26:25.421482 ip-10-0-139-16 kubenswrapper[2552]: E0714 17:26:25.421465 2552 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 14 17:26:25.421634 ip-10-0-139-16 kubenswrapper[2552]: E0714 17:26:25.421506 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a616b344-63a5-4f64-a433-f2be1e21e745-insights-runtime-extractor-tls podName:a616b344-63a5-4f64-a433-f2be1e21e745 nodeName:}" failed. No retries permitted until 2026-07-14 17:26:29.421492158 +0000 UTC m=+51.800606093 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/a616b344-63a5-4f64-a433-f2be1e21e745-insights-runtime-extractor-tls") pod "insights-runtime-extractor-7tgt2" (UID: "a616b344-63a5-4f64-a433-f2be1e21e745") : secret "insights-runtime-extractor-tls" not found Jul 14 17:26:25.421634 ip-10-0-139-16 kubenswrapper[2552]: E0714 17:26:25.421520 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/a616b344-63a5-4f64-a433-f2be1e21e745-kube-rbac-proxy-cm podName:a616b344-63a5-4f64-a433-f2be1e21e745 nodeName:}" failed. No retries permitted until 2026-07-14 17:26:29.421514211 +0000 UTC m=+51.800628141 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/a616b344-63a5-4f64-a433-f2be1e21e745-kube-rbac-proxy-cm") pod "insights-runtime-extractor-7tgt2" (UID: "a616b344-63a5-4f64-a433-f2be1e21e745") : configmap "kube-rbac-proxy" not found Jul 14 17:26:25.555778 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:25.555744 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 17:26:25.627109 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:25.627068 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-79f68b9f4f-gbspj" event={"ID":"57f1df96-acf2-4672-a528-b6f24e6741b1","Type":"ContainerStarted","Data":"15cff3228d316bbfeb98a75eae8edf90fd99ead593061ec38760f9bf4e793a2f"} Jul 14 17:26:25.627272 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:25.627130 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-79f68b9f4f-gbspj" event={"ID":"57f1df96-acf2-4672-a528-b6f24e6741b1","Type":"ContainerStarted","Data":"af32a2037c7047f9af67971f1c45dbd4645b36edb88e110a7c55737c2e7f8e8f"} Jul 14 17:26:25.643519 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:25.643474 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-79f68b9f4f-gbspj" podStartSLOduration=1.643459081 podStartE2EDuration="1.643459081s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 17:26:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 17:26:25.643163209 +0000 UTC m=+48.022277161" watchObservedRunningTime="2026-07-14 17:26:25.643459081 +0000 UTC m=+48.022573039" Jul 14 17:26:26.278064 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:26.278026 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 17:26:26.392256 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:26.392186 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 17:26:26.492857 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:26.492824 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 17:26:26.593688 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:26.593608 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 17:26:26.705868 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:26.705831 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 17:26:27.182585 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:27.182551 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 17:26:27.578134 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:27.578101 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 17:26:28.347970 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:28.347932 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0f57e94d-cace-4645-a5cb-47f7dd6dc854-registry-tls\") pod \"image-registry-899c5876f-m6hqz\" (UID: \"0f57e94d-cace-4645-a5cb-47f7dd6dc854\") " pod="openshift-image-registry/image-registry-899c5876f-m6hqz" Jul 14 17:26:28.348359 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:28.348016 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/f60de25a-6c7c-41f4-87ce-de3f4eca5c3a-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-hznkp\" (UID: \"f60de25a-6c7c-41f4-87ce-de3f4eca5c3a\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-hznkp" Jul 14 17:26:28.348359 ip-10-0-139-16 kubenswrapper[2552]: E0714 17:26:28.348086 2552 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 14 17:26:28.348359 ip-10-0-139-16 kubenswrapper[2552]: E0714 17:26:28.348108 2552 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-899c5876f-m6hqz: secret "image-registry-tls" not found Jul 14 17:26:28.348359 ip-10-0-139-16 kubenswrapper[2552]: E0714 17:26:28.348111 2552 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 14 17:26:28.348359 ip-10-0-139-16 kubenswrapper[2552]: E0714 17:26:28.348182 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0f57e94d-cace-4645-a5cb-47f7dd6dc854-registry-tls podName:0f57e94d-cace-4645-a5cb-47f7dd6dc854 nodeName:}" failed. No retries permitted until 2026-07-14 17:26:44.348166323 +0000 UTC m=+66.727280269 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/0f57e94d-cace-4645-a5cb-47f7dd6dc854-registry-tls") pod "image-registry-899c5876f-m6hqz" (UID: "0f57e94d-cace-4645-a5cb-47f7dd6dc854") : secret "image-registry-tls" not found Jul 14 17:26:28.348359 ip-10-0-139-16 kubenswrapper[2552]: E0714 17:26:28.348198 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f60de25a-6c7c-41f4-87ce-de3f4eca5c3a-cluster-monitoring-operator-tls podName:f60de25a-6c7c-41f4-87ce-de3f4eca5c3a nodeName:}" failed. No retries permitted until 2026-07-14 17:26:44.348191785 +0000 UTC m=+66.727305714 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/f60de25a-6c7c-41f4-87ce-de3f4eca5c3a-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-hznkp" (UID: "f60de25a-6c7c-41f4-87ce-de3f4eca5c3a") : secret "cluster-monitoring-operator-tls" not found Jul 14 17:26:28.379817 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:28.379789 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 17:26:28.448644 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:28.448620 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9a20f557-1033-431a-8986-88c97723b31c-service-ca-bundle\") pod \"router-default-5484d54d6d-2b7v2\" (UID: \"9a20f557-1033-431a-8986-88c97723b31c\") " pod="openshift-ingress/router-default-5484d54d6d-2b7v2" Jul 14 17:26:28.448772 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:28.448666 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/e508c23b-e275-4952-8fef-8294dfe75474-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-q49pd\" (UID: \"e508c23b-e275-4952-8fef-8294dfe75474\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-q49pd" Jul 14 17:26:28.448821 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:28.448771 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9a20f557-1033-431a-8986-88c97723b31c-metrics-certs\") pod \"router-default-5484d54d6d-2b7v2\" (UID: \"9a20f557-1033-431a-8986-88c97723b31c\") " pod="openshift-ingress/router-default-5484d54d6d-2b7v2" Jul 14 17:26:28.448860 ip-10-0-139-16 kubenswrapper[2552]: E0714 17:26:28.448840 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/9a20f557-1033-431a-8986-88c97723b31c-service-ca-bundle podName:9a20f557-1033-431a-8986-88c97723b31c nodeName:}" failed. No retries permitted until 2026-07-14 17:26:44.448822476 +0000 UTC m=+66.827936406 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/9a20f557-1033-431a-8986-88c97723b31c-service-ca-bundle") pod "router-default-5484d54d6d-2b7v2" (UID: "9a20f557-1033-431a-8986-88c97723b31c") : configmap references non-existent config key: service-ca.crt Jul 14 17:26:28.448909 ip-10-0-139-16 kubenswrapper[2552]: E0714 17:26:28.448865 2552 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 14 17:26:28.448950 ip-10-0-139-16 kubenswrapper[2552]: E0714 17:26:28.448926 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9a20f557-1033-431a-8986-88c97723b31c-metrics-certs podName:9a20f557-1033-431a-8986-88c97723b31c nodeName:}" failed. No retries permitted until 2026-07-14 17:26:44.448909918 +0000 UTC m=+66.828023854 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9a20f557-1033-431a-8986-88c97723b31c-metrics-certs") pod "router-default-5484d54d6d-2b7v2" (UID: "9a20f557-1033-431a-8986-88c97723b31c") : secret "router-metrics-certs-default" not found Jul 14 17:26:28.451124 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:28.451098 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/e508c23b-e275-4952-8fef-8294dfe75474-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-q49pd\" (UID: \"e508c23b-e275-4952-8fef-8294dfe75474\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-q49pd" Jul 14 17:26:28.549694 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:28.549664 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d1d42aeb-1ff1-42fd-a566-fea29b751242-metrics-tls\") pod \"dns-default-r7tpq\" (UID: \"d1d42aeb-1ff1-42fd-a566-fea29b751242\") " pod="openshift-dns/dns-default-r7tpq" Jul 14 17:26:28.549828 ip-10-0-139-16 kubenswrapper[2552]: E0714 17:26:28.549811 2552 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 14 17:26:28.549881 ip-10-0-139-16 kubenswrapper[2552]: E0714 17:26:28.549871 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d1d42aeb-1ff1-42fd-a566-fea29b751242-metrics-tls podName:d1d42aeb-1ff1-42fd-a566-fea29b751242 nodeName:}" failed. No retries permitted until 2026-07-14 17:26:44.549854318 +0000 UTC m=+66.928968251 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d1d42aeb-1ff1-42fd-a566-fea29b751242-metrics-tls") pod "dns-default-r7tpq" (UID: "d1d42aeb-1ff1-42fd-a566-fea29b751242") : secret "dns-default-metrics-tls" not found Jul 14 17:26:28.580120 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:28.580095 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 17:26:28.739225 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:28.739193 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-q49pd" Jul 14 17:26:28.761992 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:28.761905 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 17:26:28.878492 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:28.878469 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-65db858894-q49pd"] Jul 14 17:26:28.984909 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:28.984881 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 17:26:29.184914 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:29.184844 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 17:26:29.457052 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:29.456962 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/a616b344-63a5-4f64-a433-f2be1e21e745-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-7tgt2\" (UID: \"a616b344-63a5-4f64-a433-f2be1e21e745\") " pod="openshift-insights/insights-runtime-extractor-7tgt2" Jul 14 17:26:29.457052 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:29.457007 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/a616b344-63a5-4f64-a433-f2be1e21e745-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-7tgt2\" (UID: \"a616b344-63a5-4f64-a433-f2be1e21e745\") " pod="openshift-insights/insights-runtime-extractor-7tgt2" Jul 14 17:26:29.457475 ip-10-0-139-16 kubenswrapper[2552]: E0714 17:26:29.457085 2552 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 14 17:26:29.457475 ip-10-0-139-16 kubenswrapper[2552]: E0714 17:26:29.457117 2552 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 14 17:26:29.457475 ip-10-0-139-16 kubenswrapper[2552]: E0714 17:26:29.457136 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/a616b344-63a5-4f64-a433-f2be1e21e745-kube-rbac-proxy-cm podName:a616b344-63a5-4f64-a433-f2be1e21e745 nodeName:}" failed. No retries permitted until 2026-07-14 17:26:37.457118531 +0000 UTC m=+59.836232461 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/a616b344-63a5-4f64-a433-f2be1e21e745-kube-rbac-proxy-cm") pod "insights-runtime-extractor-7tgt2" (UID: "a616b344-63a5-4f64-a433-f2be1e21e745") : configmap "kube-rbac-proxy" not found Jul 14 17:26:29.457475 ip-10-0-139-16 kubenswrapper[2552]: E0714 17:26:29.457172 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a616b344-63a5-4f64-a433-f2be1e21e745-insights-runtime-extractor-tls podName:a616b344-63a5-4f64-a433-f2be1e21e745 nodeName:}" failed. No retries permitted until 2026-07-14 17:26:37.457157116 +0000 UTC m=+59.836271046 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/a616b344-63a5-4f64-a433-f2be1e21e745-insights-runtime-extractor-tls") pod "insights-runtime-extractor-7tgt2" (UID: "a616b344-63a5-4f64-a433-f2be1e21e745") : secret "insights-runtime-extractor-tls" not found Jul 14 17:26:29.578320 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:29.578287 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 17:26:29.641964 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:29.641925 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-q49pd" event={"ID":"e508c23b-e275-4952-8fef-8294dfe75474","Type":"ContainerStarted","Data":"278b02c85ca3497a4f17f2368d117c43c8a62c5da584fda988e593a6d46bc350"} Jul 14 17:26:29.659563 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:29.659514 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/e9d1e6ea-2ff1-4ea8-aee5-8f7bac1dcb0f-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-85r72\" (UID: \"e9d1e6ea-2ff1-4ea8-aee5-8f7bac1dcb0f\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-85r72" Jul 14 17:26:29.659752 ip-10-0-139-16 kubenswrapper[2552]: E0714 17:26:29.659622 2552 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 14 17:26:29.659752 ip-10-0-139-16 kubenswrapper[2552]: E0714 17:26:29.659693 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e9d1e6ea-2ff1-4ea8-aee5-8f7bac1dcb0f-networking-console-plugin-cert podName:e9d1e6ea-2ff1-4ea8-aee5-8f7bac1dcb0f nodeName:}" failed. No retries permitted until 2026-07-14 17:26:45.659671288 +0000 UTC m=+68.038785217 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/e9d1e6ea-2ff1-4ea8-aee5-8f7bac1dcb0f-networking-console-plugin-cert") pod "networking-console-plugin-6cf856758c-85r72" (UID: "e9d1e6ea-2ff1-4ea8-aee5-8f7bac1dcb0f") : secret "networking-console-plugin-cert" not found Jul 14 17:26:30.071375 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:30.071319 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 17:26:30.171370 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:30.171337 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 17:26:30.243239 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:30.243205 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 17:26:30.772886 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:30.772830 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 17:26:30.978523 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:30.978498 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 17:26:31.078611 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:31.078528 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 17:26:31.378750 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:31.378651 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 17:26:31.577653 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:31.577615 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 17:26:31.654202 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:31.654114 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-q49pd" event={"ID":"e508c23b-e275-4952-8fef-8294dfe75474","Type":"ContainerStarted","Data":"c6bc0b39bd8dbd3972304c077ef021745fe51f6c6bde7e11e50add173036f36f"} Jul 14 17:26:31.654400 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:31.654204 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-q49pd" event={"ID":"e508c23b-e275-4952-8fef-8294dfe75474","Type":"ContainerStarted","Data":"12ccb93eb34e22cefb853666078ea2b9ff541522f0a9a9168abebc24679a6fdf"} Jul 14 17:26:31.670077 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:31.670032 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-q49pd" podStartSLOduration=41.769909469 podStartE2EDuration="43.67001826s" totalImagesPullingTime="1.900108791s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 17:25:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 17:26:31.668629299 +0000 UTC m=+54.047743263" watchObservedRunningTime="2026-07-14 17:26:31.67001826 +0000 UTC m=+54.049132202" Jul 14 17:26:31.673032 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:31.673004 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 17:26:31.724926 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:31.724897 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 17:26:32.172309 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:32.172268 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 17:26:32.400525 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:32.400487 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 17:26:32.502202 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:32.502178 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 17:26:32.778609 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:32.778532 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 17:26:32.974417 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:32.974388 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 17:26:33.383016 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:33.382982 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 17:26:33.485798 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:33.485769 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 17:26:33.588452 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:33.588417 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 17:26:34.083722 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:34.083689 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 17:26:34.575759 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:34.575728 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 17:26:34.776415 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:34.776349 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 17:26:34.986080 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:34.986051 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 17:26:35.087839 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:35.087806 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 17:26:35.187809 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:35.187775 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 17:26:35.382981 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:35.382905 2552 scope.go:117] "RemoveContainer" containerID="e638eec05ad34945969499d50e465e972270661d514ce3fb294617c0d4605d43" Jul 14 17:26:35.456663 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:35.456635 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 17:26:35.669187 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:35.669122 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-gnw2z_b3c71861-4db9-4850-a44b-6f5d44a94235/console-operator/2.log" Jul 14 17:26:35.669589 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:35.669550 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-gnw2z_b3c71861-4db9-4850-a44b-6f5d44a94235/console-operator/1.log" Jul 14 17:26:35.669589 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:35.669581 2552 generic.go:356] "Generic (PLEG): container finished" podID="b3c71861-4db9-4850-a44b-6f5d44a94235" containerID="34aca4f196f91657ae4cd45a630d5cf4594966e98a999f6736ff2c8a184f3aa3" exitCode=255 Jul 14 17:26:35.669699 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:35.669636 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7866497494-gnw2z" event={"ID":"b3c71861-4db9-4850-a44b-6f5d44a94235","Type":"ContainerDied","Data":"34aca4f196f91657ae4cd45a630d5cf4594966e98a999f6736ff2c8a184f3aa3"} Jul 14 17:26:35.669699 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:35.669682 2552 scope.go:117] "RemoveContainer" containerID="e638eec05ad34945969499d50e465e972270661d514ce3fb294617c0d4605d43" Jul 14 17:26:35.670012 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:35.669995 2552 scope.go:117] "RemoveContainer" containerID="34aca4f196f91657ae4cd45a630d5cf4594966e98a999f6736ff2c8a184f3aa3" Jul 14 17:26:35.670199 ip-10-0-139-16 kubenswrapper[2552]: E0714 17:26:35.670181 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-7866497494-gnw2z_openshift-console-operator(b3c71861-4db9-4850-a44b-6f5d44a94235)\"" pod="openshift-console-operator/console-operator-7866497494-gnw2z" podUID="b3c71861-4db9-4850-a44b-6f5d44a94235" Jul 14 17:26:35.975070 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:35.975041 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 17:26:36.179625 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:36.179588 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 17:26:36.462540 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:36.462508 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 17:26:36.575853 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:36.575825 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 17:26:36.675208 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:36.675181 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-gnw2z_b3c71861-4db9-4850-a44b-6f5d44a94235/console-operator/2.log" Jul 14 17:26:36.979487 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:36.979445 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 17:26:37.532065 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:37.532022 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/a616b344-63a5-4f64-a433-f2be1e21e745-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-7tgt2\" (UID: \"a616b344-63a5-4f64-a433-f2be1e21e745\") " pod="openshift-insights/insights-runtime-extractor-7tgt2" Jul 14 17:26:37.532353 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:37.532083 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/a616b344-63a5-4f64-a433-f2be1e21e745-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-7tgt2\" (UID: \"a616b344-63a5-4f64-a433-f2be1e21e745\") " pod="openshift-insights/insights-runtime-extractor-7tgt2" Jul 14 17:26:37.532688 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:37.532661 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/a616b344-63a5-4f64-a433-f2be1e21e745-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-7tgt2\" (UID: \"a616b344-63a5-4f64-a433-f2be1e21e745\") " pod="openshift-insights/insights-runtime-extractor-7tgt2" Jul 14 17:26:37.534352 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:37.534311 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/a616b344-63a5-4f64-a433-f2be1e21e745-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-7tgt2\" (UID: \"a616b344-63a5-4f64-a433-f2be1e21e745\") " pod="openshift-insights/insights-runtime-extractor-7tgt2" Jul 14 17:26:37.631924 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:37.631873 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-7tgt2" Jul 14 17:26:37.751936 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:37.751909 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-7tgt2"] Jul 14 17:26:37.755878 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:26:37.755851 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda616b344_63a5_4f64_a433_f2be1e21e745.slice/crio-37f887423af5c278df9dff327c65a25c61b6bf179c02b45002341c1542655c6a WatchSource:0}: Error finding container 37f887423af5c278df9dff327c65a25c61b6bf179c02b45002341c1542655c6a: Status 404 returned error can't find the container with id 37f887423af5c278df9dff327c65a25c61b6bf179c02b45002341c1542655c6a Jul 14 17:26:38.533579 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:38.533548 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-cwprj" Jul 14 17:26:38.685445 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:38.685407 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-7tgt2" event={"ID":"a616b344-63a5-4f64-a433-f2be1e21e745","Type":"ContainerStarted","Data":"37f887423af5c278df9dff327c65a25c61b6bf179c02b45002341c1542655c6a"} Jul 14 17:26:38.987866 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:38.987753 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 17:26:39.087936 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:39.087888 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 17:26:41.697205 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:41.697173 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-7tgt2" event={"ID":"a616b344-63a5-4f64-a433-f2be1e21e745","Type":"ContainerStarted","Data":"a3451c568c98bde4781908dfaafc2795be47864c781c2f50bcbe073f22d91ef8"} Jul 14 17:26:42.701702 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:42.701625 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-7tgt2" event={"ID":"a616b344-63a5-4f64-a433-f2be1e21e745","Type":"ContainerStarted","Data":"0a781b43b359964562453e2d601e93c6244c928416a53d435f0cabc9548afb8c"} Jul 14 17:26:42.863897 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:42.863862 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-7866497494-gnw2z" Jul 14 17:26:42.864079 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:42.863924 2552 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-7866497494-gnw2z" Jul 14 17:26:42.864344 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:42.864312 2552 scope.go:117] "RemoveContainer" containerID="34aca4f196f91657ae4cd45a630d5cf4594966e98a999f6736ff2c8a184f3aa3" Jul 14 17:26:42.864547 ip-10-0-139-16 kubenswrapper[2552]: E0714 17:26:42.864521 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-7866497494-gnw2z_openshift-console-operator(b3c71861-4db9-4850-a44b-6f5d44a94235)\"" pod="openshift-console-operator/console-operator-7866497494-gnw2z" podUID="b3c71861-4db9-4850-a44b-6f5d44a94235" Jul 14 17:26:43.790976 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:43.790948 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5m5jk\" (UniqueName: \"kubernetes.io/projected/5e75c85a-a73f-4890-854a-a8d3baff770b-kube-api-access-5m5jk\") pod \"network-check-target-vjlpd\" (UID: \"5e75c85a-a73f-4890-854a-a8d3baff770b\") " pod="openshift-network-diagnostics/network-check-target-vjlpd" Jul 14 17:26:43.791350 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:43.791000 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/91eea036-14a4-466b-9006-5c3f7e104bf4-original-pull-secret\") pod \"global-pull-secret-syncer-c9lb7\" (UID: \"91eea036-14a4-466b-9006-5c3f7e104bf4\") " pod="kube-system/global-pull-secret-syncer-c9lb7" Jul 14 17:26:43.791350 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:43.791038 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/029a166f-0530-4669-9095-ebe6f46b9d8c-metrics-certs\") pod \"network-metrics-daemon-7prlr\" (UID: \"029a166f-0530-4669-9095-ebe6f46b9d8c\") " pod="openshift-multus/network-metrics-daemon-7prlr" Jul 14 17:26:43.793587 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:43.793563 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5m5jk\" (UniqueName: \"kubernetes.io/projected/5e75c85a-a73f-4890-854a-a8d3baff770b-kube-api-access-5m5jk\") pod \"network-check-target-vjlpd\" (UID: \"5e75c85a-a73f-4890-854a-a8d3baff770b\") " pod="openshift-network-diagnostics/network-check-target-vjlpd" Jul 14 17:26:43.794196 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:43.794176 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 14 17:26:43.795210 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:43.795192 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 14 17:26:43.803784 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:43.803758 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/029a166f-0530-4669-9095-ebe6f46b9d8c-metrics-certs\") pod \"network-metrics-daemon-7prlr\" (UID: \"029a166f-0530-4669-9095-ebe6f46b9d8c\") " pod="openshift-multus/network-metrics-daemon-7prlr" Jul 14 17:26:43.803891 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:43.803767 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/91eea036-14a4-466b-9006-5c3f7e104bf4-original-pull-secret\") pod \"global-pull-secret-syncer-c9lb7\" (UID: \"91eea036-14a4-466b-9006-5c3f7e104bf4\") " pod="kube-system/global-pull-secret-syncer-c9lb7" Jul 14 17:26:43.994282 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:43.994249 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-hwsmr\"" Jul 14 17:26:43.998668 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:43.998648 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-ph225\"" Jul 14 17:26:44.002895 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:44.002876 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7prlr" Jul 14 17:26:44.007087 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:44.007067 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vjlpd" Jul 14 17:26:44.099681 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:44.099656 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-c9lb7" Jul 14 17:26:44.247566 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:44.247535 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-9c945d444-zp4f4"] Jul 14 17:26:44.304827 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:44.304755 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-57c774564c-j4ql5"] Jul 14 17:26:44.304981 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:44.304874 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-9c945d444-zp4f4" Jul 14 17:26:44.307782 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:44.307757 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Jul 14 17:26:44.307924 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:44.307860 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-72wfz\"" Jul 14 17:26:44.307924 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:44.307864 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\"" Jul 14 17:26:44.308182 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:44.308163 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Jul 14 17:26:44.308808 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:44.308789 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Jul 14 17:26:44.321989 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:44.321729 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-9c945d444-zp4f4"] Jul 14 17:26:44.321989 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:44.321772 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-57c774564c-j4ql5"] Jul 14 17:26:44.321989 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:44.321798 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-849fcc9b5c-xqb2d"] Jul 14 17:26:44.322405 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:44.321996 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-57c774564c-j4ql5" Jul 14 17:26:44.324807 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:44.324782 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\"" Jul 14 17:26:44.336070 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:44.336048 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-849fcc9b5c-xqb2d"] Jul 14 17:26:44.336189 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:44.336131 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-849fcc9b5c-xqb2d" Jul 14 17:26:44.338813 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:44.338797 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\"" Jul 14 17:26:44.338911 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:44.338826 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\"" Jul 14 17:26:44.338976 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:44.338916 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\"" Jul 14 17:26:44.339286 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:44.339267 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\"" Jul 14 17:26:44.341597 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:44.341579 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 17:26:44.397813 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:44.397767 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-69cb5\" (UniqueName: \"kubernetes.io/projected/6c683605-7d77-4962-b29c-abb2e35ac252-kube-api-access-69cb5\") pod \"managed-serviceaccount-addon-agent-9c945d444-zp4f4\" (UID: \"6c683605-7d77-4962-b29c-abb2e35ac252\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-9c945d444-zp4f4" Jul 14 17:26:44.397989 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:44.397940 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0f57e94d-cace-4645-a5cb-47f7dd6dc854-registry-tls\") pod \"image-registry-899c5876f-m6hqz\" (UID: \"0f57e94d-cace-4645-a5cb-47f7dd6dc854\") " pod="openshift-image-registry/image-registry-899c5876f-m6hqz" Jul 14 17:26:44.398057 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:44.397989 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/6c683605-7d77-4962-b29c-abb2e35ac252-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-9c945d444-zp4f4\" (UID: \"6c683605-7d77-4962-b29c-abb2e35ac252\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-9c945d444-zp4f4" Jul 14 17:26:44.398057 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:44.398033 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/f60de25a-6c7c-41f4-87ce-de3f4eca5c3a-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-hznkp\" (UID: \"f60de25a-6c7c-41f4-87ce-de3f4eca5c3a\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-hznkp" Jul 14 17:26:44.400755 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:44.400732 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0f57e94d-cace-4645-a5cb-47f7dd6dc854-registry-tls\") pod \"image-registry-899c5876f-m6hqz\" (UID: \"0f57e94d-cace-4645-a5cb-47f7dd6dc854\") " pod="openshift-image-registry/image-registry-899c5876f-m6hqz" Jul 14 17:26:44.400886 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:44.400767 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/f60de25a-6c7c-41f4-87ce-de3f4eca5c3a-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-hznkp\" (UID: \"f60de25a-6c7c-41f4-87ce-de3f4eca5c3a\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-hznkp" Jul 14 17:26:44.413573 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:44.413543 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 17:26:44.498710 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:44.498668 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j72tg\" (UniqueName: \"kubernetes.io/projected/f980d702-991f-400f-8278-45e8afe2eafa-kube-api-access-j72tg\") pod \"cluster-proxy-proxy-agent-849fcc9b5c-xqb2d\" (UID: \"f980d702-991f-400f-8278-45e8afe2eafa\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-849fcc9b5c-xqb2d" Jul 14 17:26:44.498877 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:44.498805 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-px4bk\" (UniqueName: \"kubernetes.io/projected/7d18d4bc-2176-4687-bf14-04e801465bf7-kube-api-access-px4bk\") pod \"klusterlet-addon-workmgr-57c774564c-j4ql5\" (UID: \"7d18d4bc-2176-4687-bf14-04e801465bf7\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-57c774564c-j4ql5" Jul 14 17:26:44.498877 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:44.498837 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/f980d702-991f-400f-8278-45e8afe2eafa-hub\") pod \"cluster-proxy-proxy-agent-849fcc9b5c-xqb2d\" (UID: \"f980d702-991f-400f-8278-45e8afe2eafa\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-849fcc9b5c-xqb2d" Jul 14 17:26:44.498967 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:44.498877 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/f980d702-991f-400f-8278-45e8afe2eafa-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-849fcc9b5c-xqb2d\" (UID: \"f980d702-991f-400f-8278-45e8afe2eafa\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-849fcc9b5c-xqb2d" Jul 14 17:26:44.498967 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:44.498910 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/6c683605-7d77-4962-b29c-abb2e35ac252-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-9c945d444-zp4f4\" (UID: \"6c683605-7d77-4962-b29c-abb2e35ac252\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-9c945d444-zp4f4" Jul 14 17:26:44.499040 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:44.498968 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9a20f557-1033-431a-8986-88c97723b31c-metrics-certs\") pod \"router-default-5484d54d6d-2b7v2\" (UID: \"9a20f557-1033-431a-8986-88c97723b31c\") " pod="openshift-ingress/router-default-5484d54d6d-2b7v2" Jul 14 17:26:44.499040 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:44.498998 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7d18d4bc-2176-4687-bf14-04e801465bf7-tmp\") pod \"klusterlet-addon-workmgr-57c774564c-j4ql5\" (UID: \"7d18d4bc-2176-4687-bf14-04e801465bf7\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-57c774564c-j4ql5" Jul 14 17:26:44.499040 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:44.499024 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/7d18d4bc-2176-4687-bf14-04e801465bf7-klusterlet-config\") pod \"klusterlet-addon-workmgr-57c774564c-j4ql5\" (UID: \"7d18d4bc-2176-4687-bf14-04e801465bf7\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-57c774564c-j4ql5" Jul 14 17:26:44.499276 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:44.499056 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/f980d702-991f-400f-8278-45e8afe2eafa-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-849fcc9b5c-xqb2d\" (UID: \"f980d702-991f-400f-8278-45e8afe2eafa\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-849fcc9b5c-xqb2d" Jul 14 17:26:44.499276 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:44.499102 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/f980d702-991f-400f-8278-45e8afe2eafa-ca\") pod \"cluster-proxy-proxy-agent-849fcc9b5c-xqb2d\" (UID: \"f980d702-991f-400f-8278-45e8afe2eafa\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-849fcc9b5c-xqb2d" Jul 14 17:26:44.499276 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:44.499146 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/f980d702-991f-400f-8278-45e8afe2eafa-additional-service-ca\") pod \"cluster-proxy-proxy-agent-849fcc9b5c-xqb2d\" (UID: \"f980d702-991f-400f-8278-45e8afe2eafa\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-849fcc9b5c-xqb2d" Jul 14 17:26:44.499276 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:44.499196 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-69cb5\" (UniqueName: \"kubernetes.io/projected/6c683605-7d77-4962-b29c-abb2e35ac252-kube-api-access-69cb5\") pod \"managed-serviceaccount-addon-agent-9c945d444-zp4f4\" (UID: \"6c683605-7d77-4962-b29c-abb2e35ac252\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-9c945d444-zp4f4" Jul 14 17:26:44.499276 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:44.499224 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9a20f557-1033-431a-8986-88c97723b31c-service-ca-bundle\") pod \"router-default-5484d54d6d-2b7v2\" (UID: \"9a20f557-1033-431a-8986-88c97723b31c\") " pod="openshift-ingress/router-default-5484d54d6d-2b7v2" Jul 14 17:26:44.499985 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:44.499958 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9a20f557-1033-431a-8986-88c97723b31c-service-ca-bundle\") pod \"router-default-5484d54d6d-2b7v2\" (UID: \"9a20f557-1033-431a-8986-88c97723b31c\") " pod="openshift-ingress/router-default-5484d54d6d-2b7v2" Jul 14 17:26:44.501823 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:44.501803 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/6c683605-7d77-4962-b29c-abb2e35ac252-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-9c945d444-zp4f4\" (UID: \"6c683605-7d77-4962-b29c-abb2e35ac252\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-9c945d444-zp4f4" Jul 14 17:26:44.501920 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:44.501865 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9a20f557-1033-431a-8986-88c97723b31c-metrics-certs\") pod \"router-default-5484d54d6d-2b7v2\" (UID: \"9a20f557-1033-431a-8986-88c97723b31c\") " pod="openshift-ingress/router-default-5484d54d6d-2b7v2" Jul 14 17:26:44.509060 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:44.508999 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-69cb5\" (UniqueName: \"kubernetes.io/projected/6c683605-7d77-4962-b29c-abb2e35ac252-kube-api-access-69cb5\") pod \"managed-serviceaccount-addon-agent-9c945d444-zp4f4\" (UID: \"6c683605-7d77-4962-b29c-abb2e35ac252\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-9c945d444-zp4f4" Jul 14 17:26:44.513071 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:44.513041 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 17:26:44.580389 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:44.580287 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-cv7gf\"" Jul 14 17:26:44.588004 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:44.587972 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-hznkp" Jul 14 17:26:44.591960 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:44.591938 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-smpv7\"" Jul 14 17:26:44.599973 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:44.599954 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-899c5876f-m6hqz" Jul 14 17:26:44.600218 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:44.600201 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-px4bk\" (UniqueName: \"kubernetes.io/projected/7d18d4bc-2176-4687-bf14-04e801465bf7-kube-api-access-px4bk\") pod \"klusterlet-addon-workmgr-57c774564c-j4ql5\" (UID: \"7d18d4bc-2176-4687-bf14-04e801465bf7\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-57c774564c-j4ql5" Jul 14 17:26:44.600280 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:44.600228 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/f980d702-991f-400f-8278-45e8afe2eafa-hub\") pod \"cluster-proxy-proxy-agent-849fcc9b5c-xqb2d\" (UID: \"f980d702-991f-400f-8278-45e8afe2eafa\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-849fcc9b5c-xqb2d" Jul 14 17:26:44.600280 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:44.600262 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/f980d702-991f-400f-8278-45e8afe2eafa-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-849fcc9b5c-xqb2d\" (UID: \"f980d702-991f-400f-8278-45e8afe2eafa\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-849fcc9b5c-xqb2d" Jul 14 17:26:44.600398 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:44.600299 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d1d42aeb-1ff1-42fd-a566-fea29b751242-metrics-tls\") pod \"dns-default-r7tpq\" (UID: \"d1d42aeb-1ff1-42fd-a566-fea29b751242\") " pod="openshift-dns/dns-default-r7tpq" Jul 14 17:26:44.600398 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:44.600342 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7d18d4bc-2176-4687-bf14-04e801465bf7-tmp\") pod \"klusterlet-addon-workmgr-57c774564c-j4ql5\" (UID: \"7d18d4bc-2176-4687-bf14-04e801465bf7\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-57c774564c-j4ql5" Jul 14 17:26:44.600398 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:44.600370 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/7d18d4bc-2176-4687-bf14-04e801465bf7-klusterlet-config\") pod \"klusterlet-addon-workmgr-57c774564c-j4ql5\" (UID: \"7d18d4bc-2176-4687-bf14-04e801465bf7\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-57c774564c-j4ql5" Jul 14 17:26:44.601123 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:44.600398 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/f980d702-991f-400f-8278-45e8afe2eafa-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-849fcc9b5c-xqb2d\" (UID: \"f980d702-991f-400f-8278-45e8afe2eafa\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-849fcc9b5c-xqb2d" Jul 14 17:26:44.601123 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:44.600424 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/f980d702-991f-400f-8278-45e8afe2eafa-ca\") pod \"cluster-proxy-proxy-agent-849fcc9b5c-xqb2d\" (UID: \"f980d702-991f-400f-8278-45e8afe2eafa\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-849fcc9b5c-xqb2d" Jul 14 17:26:44.601123 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:44.600456 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/f980d702-991f-400f-8278-45e8afe2eafa-additional-service-ca\") pod \"cluster-proxy-proxy-agent-849fcc9b5c-xqb2d\" (UID: \"f980d702-991f-400f-8278-45e8afe2eafa\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-849fcc9b5c-xqb2d" Jul 14 17:26:44.601123 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:44.600510 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j72tg\" (UniqueName: \"kubernetes.io/projected/f980d702-991f-400f-8278-45e8afe2eafa-kube-api-access-j72tg\") pod \"cluster-proxy-proxy-agent-849fcc9b5c-xqb2d\" (UID: \"f980d702-991f-400f-8278-45e8afe2eafa\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-849fcc9b5c-xqb2d" Jul 14 17:26:44.601123 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:44.600725 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7d18d4bc-2176-4687-bf14-04e801465bf7-tmp\") pod \"klusterlet-addon-workmgr-57c774564c-j4ql5\" (UID: \"7d18d4bc-2176-4687-bf14-04e801465bf7\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-57c774564c-j4ql5" Jul 14 17:26:44.601925 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:44.601260 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/f980d702-991f-400f-8278-45e8afe2eafa-additional-service-ca\") pod \"cluster-proxy-proxy-agent-849fcc9b5c-xqb2d\" (UID: \"f980d702-991f-400f-8278-45e8afe2eafa\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-849fcc9b5c-xqb2d" Jul 14 17:26:44.603465 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:44.603442 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d1d42aeb-1ff1-42fd-a566-fea29b751242-metrics-tls\") pod \"dns-default-r7tpq\" (UID: \"d1d42aeb-1ff1-42fd-a566-fea29b751242\") " pod="openshift-dns/dns-default-r7tpq" Jul 14 17:26:44.603557 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:44.603537 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/f980d702-991f-400f-8278-45e8afe2eafa-hub\") pod \"cluster-proxy-proxy-agent-849fcc9b5c-xqb2d\" (UID: \"f980d702-991f-400f-8278-45e8afe2eafa\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-849fcc9b5c-xqb2d" Jul 14 17:26:44.603871 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:44.603843 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/7d18d4bc-2176-4687-bf14-04e801465bf7-klusterlet-config\") pod \"klusterlet-addon-workmgr-57c774564c-j4ql5\" (UID: \"7d18d4bc-2176-4687-bf14-04e801465bf7\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-57c774564c-j4ql5" Jul 14 17:26:44.603951 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:44.603923 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/f980d702-991f-400f-8278-45e8afe2eafa-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-849fcc9b5c-xqb2d\" (UID: \"f980d702-991f-400f-8278-45e8afe2eafa\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-849fcc9b5c-xqb2d" Jul 14 17:26:44.604011 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:44.603982 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/f980d702-991f-400f-8278-45e8afe2eafa-ca\") pod \"cluster-proxy-proxy-agent-849fcc9b5c-xqb2d\" (UID: \"f980d702-991f-400f-8278-45e8afe2eafa\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-849fcc9b5c-xqb2d" Jul 14 17:26:44.604628 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:44.604608 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/f980d702-991f-400f-8278-45e8afe2eafa-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-849fcc9b5c-xqb2d\" (UID: \"f980d702-991f-400f-8278-45e8afe2eafa\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-849fcc9b5c-xqb2d" Jul 14 17:26:44.609408 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:44.609391 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j72tg\" (UniqueName: \"kubernetes.io/projected/f980d702-991f-400f-8278-45e8afe2eafa-kube-api-access-j72tg\") pod \"cluster-proxy-proxy-agent-849fcc9b5c-xqb2d\" (UID: \"f980d702-991f-400f-8278-45e8afe2eafa\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-849fcc9b5c-xqb2d" Jul 14 17:26:44.609598 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:44.609575 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-px4bk\" (UniqueName: \"kubernetes.io/projected/7d18d4bc-2176-4687-bf14-04e801465bf7-kube-api-access-px4bk\") pod \"klusterlet-addon-workmgr-57c774564c-j4ql5\" (UID: \"7d18d4bc-2176-4687-bf14-04e801465bf7\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-57c774564c-j4ql5" Jul 14 17:26:44.613533 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:44.613511 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 17:26:44.624702 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:44.624678 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-t9wnw\"" Jul 14 17:26:44.624793 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:44.624769 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-9c945d444-zp4f4" Jul 14 17:26:44.633391 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:44.633374 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-5484d54d6d-2b7v2" Jul 14 17:26:44.635943 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:44.635917 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-57c774564c-j4ql5" Jul 14 17:26:44.645737 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:44.645716 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-849fcc9b5c-xqb2d" Jul 14 17:26:44.711883 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:44.711811 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 17:26:44.719176 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:44.719148 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-6ft2z\"" Jul 14 17:26:44.727429 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:44.727406 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-r7tpq" Jul 14 17:26:44.779932 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:44.779885 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 17:26:45.001548 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:45.001269 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 17:26:45.095885 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:45.095855 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 17:26:45.162690 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:45.162480 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-c9lb7"] Jul 14 17:26:45.166371 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:26:45.166219 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod91eea036_14a4_466b_9006_5c3f7e104bf4.slice/crio-60b14f3f91555c5cc0dbf46a6eec9f24dc245f6cd953ef58fa76f3f16b71adc7 WatchSource:0}: Error finding container 60b14f3f91555c5cc0dbf46a6eec9f24dc245f6cd953ef58fa76f3f16b71adc7: Status 404 returned error can't find the container with id 60b14f3f91555c5cc0dbf46a6eec9f24dc245f6cd953ef58fa76f3f16b71adc7 Jul 14 17:26:45.194965 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:45.194940 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-7prlr"] Jul 14 17:26:45.200744 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:45.200630 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-5484d54d6d-2b7v2"] Jul 14 17:26:45.204708 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:26:45.204687 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9a20f557_1033_431a_8986_88c97723b31c.slice/crio-fb81f751df20af8e8054dede971b9dd4f2429db52ce3210fafb6b373eceda838 WatchSource:0}: Error finding container fb81f751df20af8e8054dede971b9dd4f2429db52ce3210fafb6b373eceda838: Status 404 returned error can't find the container with id fb81f751df20af8e8054dede971b9dd4f2429db52ce3210fafb6b373eceda838 Jul 14 17:26:45.251831 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:45.251800 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-849fcc9b5c-xqb2d"] Jul 14 17:26:45.265782 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:26:45.265751 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf980d702_991f_400f_8278_45e8afe2eafa.slice/crio-096676142e14eadda02b249f1a94db1655b1e3fb61fa5779c9c4e7782667f5f5 WatchSource:0}: Error finding container 096676142e14eadda02b249f1a94db1655b1e3fb61fa5779c9c4e7782667f5f5: Status 404 returned error can't find the container with id 096676142e14eadda02b249f1a94db1655b1e3fb61fa5779c9c4e7782667f5f5 Jul 14 17:26:45.324587 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:45.324553 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 17:26:45.376144 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:45.376108 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 17:26:45.414503 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:45.414475 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-57c774564c-j4ql5"] Jul 14 17:26:45.415479 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:45.415460 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-9c945d444-zp4f4"] Jul 14 17:26:45.417688 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:26:45.417662 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod6c683605_7d77_4962_b29c_abb2e35ac252.slice/crio-302650b93de89a286291ff90d6858b6a315f5cb8854c65fe73ca22e1af499c3a WatchSource:0}: Error finding container 302650b93de89a286291ff90d6858b6a315f5cb8854c65fe73ca22e1af499c3a: Status 404 returned error can't find the container with id 302650b93de89a286291ff90d6858b6a315f5cb8854c65fe73ca22e1af499c3a Jul 14 17:26:45.417993 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:26:45.417905 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7d18d4bc_2176_4687_bf14_04e801465bf7.slice/crio-6b30c9d0d435031ac8b9794454302738f9262891b0967b5e56f1271eb20a6e70 WatchSource:0}: Error finding container 6b30c9d0d435031ac8b9794454302738f9262891b0967b5e56f1271eb20a6e70: Status 404 returned error can't find the container with id 6b30c9d0d435031ac8b9794454302738f9262891b0967b5e56f1271eb20a6e70 Jul 14 17:26:45.418108 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:45.418073 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-899c5876f-m6hqz"] Jul 14 17:26:45.420628 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:26:45.420608 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0f57e94d_cace_4645_a5cb_47f7dd6dc854.slice/crio-bdba82a0dec01234157b744501786123de3ce6dd204331888fbb6bd55bea5cb1 WatchSource:0}: Error finding container bdba82a0dec01234157b744501786123de3ce6dd204331888fbb6bd55bea5cb1: Status 404 returned error can't find the container with id bdba82a0dec01234157b744501786123de3ce6dd204331888fbb6bd55bea5cb1 Jul 14 17:26:45.480221 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:45.480192 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-hznkp"] Jul 14 17:26:45.482977 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:45.482876 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-r7tpq"] Jul 14 17:26:45.483452 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:26:45.483289 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf60de25a_6c7c_41f4_87ce_de3f4eca5c3a.slice/crio-72c1cea04b13d359756ec8c5347a10cee492c1e7c7124d7b7f3d0c41ac646df5 WatchSource:0}: Error finding container 72c1cea04b13d359756ec8c5347a10cee492c1e7c7124d7b7f3d0c41ac646df5: Status 404 returned error can't find the container with id 72c1cea04b13d359756ec8c5347a10cee492c1e7c7124d7b7f3d0c41ac646df5 Jul 14 17:26:45.484357 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:45.484315 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-vjlpd"] Jul 14 17:26:45.485725 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:26:45.485707 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5e75c85a_a73f_4890_854a_a8d3baff770b.slice/crio-2f8fb7507b8021d59018c498c6a958bbf3bd01d6ed747184cb86b2d88165359b WatchSource:0}: Error finding container 2f8fb7507b8021d59018c498c6a958bbf3bd01d6ed747184cb86b2d88165359b: Status 404 returned error can't find the container with id 2f8fb7507b8021d59018c498c6a958bbf3bd01d6ed747184cb86b2d88165359b Jul 14 17:26:45.486717 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:26:45.486702 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd1d42aeb_1ff1_42fd_a566_fea29b751242.slice/crio-3cef0f565320e37552081ff932e7a084571b5e98b895052f9b757a369de56bb7 WatchSource:0}: Error finding container 3cef0f565320e37552081ff932e7a084571b5e98b895052f9b757a369de56bb7: Status 404 returned error can't find the container with id 3cef0f565320e37552081ff932e7a084571b5e98b895052f9b757a369de56bb7 Jul 14 17:26:45.714282 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:45.714247 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/e9d1e6ea-2ff1-4ea8-aee5-8f7bac1dcb0f-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-85r72\" (UID: \"e9d1e6ea-2ff1-4ea8-aee5-8f7bac1dcb0f\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-85r72" Jul 14 17:26:45.714937 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:45.714882 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-9c945d444-zp4f4" event={"ID":"6c683605-7d77-4962-b29c-abb2e35ac252","Type":"ContainerStarted","Data":"302650b93de89a286291ff90d6858b6a315f5cb8854c65fe73ca22e1af499c3a"} Jul 14 17:26:45.716534 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:45.716498 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-hznkp" event={"ID":"f60de25a-6c7c-41f4-87ce-de3f4eca5c3a","Type":"ContainerStarted","Data":"72c1cea04b13d359756ec8c5347a10cee492c1e7c7124d7b7f3d0c41ac646df5"} Jul 14 17:26:45.717205 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:45.717181 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/e9d1e6ea-2ff1-4ea8-aee5-8f7bac1dcb0f-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-85r72\" (UID: \"e9d1e6ea-2ff1-4ea8-aee5-8f7bac1dcb0f\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-85r72" Jul 14 17:26:45.717955 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:45.717935 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-849fcc9b5c-xqb2d" event={"ID":"f980d702-991f-400f-8278-45e8afe2eafa","Type":"ContainerStarted","Data":"096676142e14eadda02b249f1a94db1655b1e3fb61fa5779c9c4e7782667f5f5"} Jul 14 17:26:45.719254 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:45.719230 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-c9lb7" event={"ID":"91eea036-14a4-466b-9006-5c3f7e104bf4","Type":"ContainerStarted","Data":"60b14f3f91555c5cc0dbf46a6eec9f24dc245f6cd953ef58fa76f3f16b71adc7"} Jul 14 17:26:45.721638 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:45.721615 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-vjlpd" event={"ID":"5e75c85a-a73f-4890-854a-a8d3baff770b","Type":"ContainerStarted","Data":"2d9ffefbf723ae9a5063a1dbca1366c12038deeff22a9daa67c9f58220381577"} Jul 14 17:26:45.721744 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:45.721659 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-vjlpd" event={"ID":"5e75c85a-a73f-4890-854a-a8d3baff770b","Type":"ContainerStarted","Data":"2f8fb7507b8021d59018c498c6a958bbf3bd01d6ed747184cb86b2d88165359b"} Jul 14 17:26:45.721744 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:45.721713 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-vjlpd" Jul 14 17:26:45.723453 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:45.723413 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-899c5876f-m6hqz" event={"ID":"0f57e94d-cace-4645-a5cb-47f7dd6dc854","Type":"ContainerStarted","Data":"394c7a98fc58023c09c4f07a1614622270d0ee3fcb2e6c82dc8b0d094641f273"} Jul 14 17:26:45.723551 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:45.723454 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-899c5876f-m6hqz" event={"ID":"0f57e94d-cace-4645-a5cb-47f7dd6dc854","Type":"ContainerStarted","Data":"bdba82a0dec01234157b744501786123de3ce6dd204331888fbb6bd55bea5cb1"} Jul 14 17:26:45.723551 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:45.723495 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-899c5876f-m6hqz" Jul 14 17:26:45.725253 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:45.725187 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-5484d54d6d-2b7v2" event={"ID":"9a20f557-1033-431a-8986-88c97723b31c","Type":"ContainerStarted","Data":"9ebfed2f8ea2dc10bba0c8385a700de4ad6355b9617873ba0cb221d507aa8430"} Jul 14 17:26:45.725253 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:45.725227 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-5484d54d6d-2b7v2" event={"ID":"9a20f557-1033-431a-8986-88c97723b31c","Type":"ContainerStarted","Data":"fb81f751df20af8e8054dede971b9dd4f2429db52ce3210fafb6b373eceda838"} Jul 14 17:26:45.727537 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:45.727513 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-7tgt2" event={"ID":"a616b344-63a5-4f64-a433-f2be1e21e745","Type":"ContainerStarted","Data":"92faa90fcac69298a7ee7639afee3df1ea0da6c2d4ef064e693927911206da1d"} Jul 14 17:26:45.728690 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:45.728667 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-r7tpq" event={"ID":"d1d42aeb-1ff1-42fd-a566-fea29b751242","Type":"ContainerStarted","Data":"3cef0f565320e37552081ff932e7a084571b5e98b895052f9b757a369de56bb7"} Jul 14 17:26:45.729897 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:45.729872 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-57c774564c-j4ql5" event={"ID":"7d18d4bc-2176-4687-bf14-04e801465bf7","Type":"ContainerStarted","Data":"6b30c9d0d435031ac8b9794454302738f9262891b0967b5e56f1271eb20a6e70"} Jul 14 17:26:45.731175 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:45.731151 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-7prlr" event={"ID":"029a166f-0530-4669-9095-ebe6f46b9d8c","Type":"ContainerStarted","Data":"3a5c896be160c30f089a58a4a03ed4bd4497ac0f3532414cf062b16cd0f2ad83"} Jul 14 17:26:45.736474 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:45.736428 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-vjlpd" podStartSLOduration=67.736410975 podStartE2EDuration="1m7.736410975s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 17:25:38 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 17:26:45.735670248 +0000 UTC m=+68.114784201" watchObservedRunningTime="2026-07-14 17:26:45.736410975 +0000 UTC m=+68.115524924" Jul 14 17:26:45.753729 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:45.753653 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-7tgt2" podStartSLOduration=17.723782655 podStartE2EDuration="24.753641185s" totalImagesPullingTime="7.02985853s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-14 17:26:21 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 17:26:45.752840894 +0000 UTC m=+68.131954847" watchObservedRunningTime="2026-07-14 17:26:45.753641185 +0000 UTC m=+68.132755136" Jul 14 17:26:45.771175 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:45.771115 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-5484d54d6d-2b7v2" podStartSLOduration=66.771097169 podStartE2EDuration="1m6.771097169s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 17:25:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 17:26:45.769625505 +0000 UTC m=+68.148739460" watchObservedRunningTime="2026-07-14 17:26:45.771097169 +0000 UTC m=+68.150211125" Jul 14 17:26:45.793511 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:45.793456 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-899c5876f-m6hqz" podStartSLOduration=67.793440487 podStartE2EDuration="1m7.793440487s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 17:25:38 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 17:26:45.792898158 +0000 UTC m=+68.172012120" watchObservedRunningTime="2026-07-14 17:26:45.793440487 +0000 UTC m=+68.172554439" Jul 14 17:26:45.899783 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:45.899747 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-5std2\"" Jul 14 17:26:45.907878 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:45.907849 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6cf856758c-85r72" Jul 14 17:26:46.139723 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:46.139701 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-6cf856758c-85r72"] Jul 14 17:26:46.142199 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:26:46.142171 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode9d1e6ea_2ff1_4ea8_aee5_8f7bac1dcb0f.slice/crio-1231a2f7292414181d740b256e50d836002e76a9634feb3fe056a4bdccc5ddf0 WatchSource:0}: Error finding container 1231a2f7292414181d740b256e50d836002e76a9634feb3fe056a4bdccc5ddf0: Status 404 returned error can't find the container with id 1231a2f7292414181d740b256e50d836002e76a9634feb3fe056a4bdccc5ddf0 Jul 14 17:26:46.634013 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:46.633945 2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-5484d54d6d-2b7v2" Jul 14 17:26:46.637490 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:46.637141 2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-5484d54d6d-2b7v2" Jul 14 17:26:46.764580 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:46.764540 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-7prlr" event={"ID":"029a166f-0530-4669-9095-ebe6f46b9d8c","Type":"ContainerStarted","Data":"ab5f1477e7ee5f0badf7af5d0831c54923c48aa164bfc547e849e567fa80b230"} Jul 14 17:26:46.764773 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:46.764612 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-7prlr" event={"ID":"029a166f-0530-4669-9095-ebe6f46b9d8c","Type":"ContainerStarted","Data":"158e939287f1b18df3b72a187b63b4e40816f2ef458ad5cc18b045825fedb233"} Jul 14 17:26:46.777857 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:46.777826 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-6cf856758c-85r72" event={"ID":"e9d1e6ea-2ff1-4ea8-aee5-8f7bac1dcb0f","Type":"ContainerStarted","Data":"1231a2f7292414181d740b256e50d836002e76a9634feb3fe056a4bdccc5ddf0"} Jul 14 17:26:46.779675 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:46.778757 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-5484d54d6d-2b7v2" Jul 14 17:26:46.779809 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:46.779740 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-5484d54d6d-2b7v2" Jul 14 17:26:46.783173 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:46.782422 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-7prlr" podStartSLOduration=67.942928213 podStartE2EDuration="1m8.78240399s" totalImagesPullingTime="839.475777ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 17:25:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 17:26:46.780411503 +0000 UTC m=+69.159525455" watchObservedRunningTime="2026-07-14 17:26:46.78240399 +0000 UTC m=+69.161517945" Jul 14 17:26:46.903664 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:46.903560 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 17:26:46.957839 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:46.957781 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 17:26:55.371587 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:55.371548 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 17:26:55.472298 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:55.472264 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 17:26:56.811158 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:56.811087 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 17:26:56.839319 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:56.839043 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-r7tpq" event={"ID":"d1d42aeb-1ff1-42fd-a566-fea29b751242","Type":"ContainerStarted","Data":"684ec8d081c93d03f71bed4a54e021edfa6c4f8317662147d89d8b7bb9c10564"} Jul 14 17:26:56.839319 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:56.839131 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-r7tpq" event={"ID":"d1d42aeb-1ff1-42fd-a566-fea29b751242","Type":"ContainerStarted","Data":"4f7bcbb4990537f0b94d51b8420fccc14fd72cbce3ebc7ab6d628324eb7261b3"} Jul 14 17:26:56.839319 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:56.839307 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-r7tpq" Jul 14 17:26:56.842738 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:56.841236 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-57c774564c-j4ql5" event={"ID":"7d18d4bc-2176-4687-bf14-04e801465bf7","Type":"ContainerStarted","Data":"3cbdb10775cb3b2cbeba6ff73466a2593f0585865bee78a56609397363feb5ba"} Jul 14 17:26:56.843949 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:56.842896 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-57c774564c-j4ql5" Jul 14 17:26:56.844637 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:56.844522 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-57c774564c-j4ql5" Jul 14 17:26:56.846161 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:56.846123 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-6cf856758c-85r72" event={"ID":"e9d1e6ea-2ff1-4ea8-aee5-8f7bac1dcb0f","Type":"ContainerStarted","Data":"e85e7ae12c92f7ecf8240354bd0871b6bc8838a76cb37273f6690cbac9eebda2"} Jul 14 17:26:56.849148 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:56.848905 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-9c945d444-zp4f4" event={"ID":"6c683605-7d77-4962-b29c-abb2e35ac252","Type":"ContainerStarted","Data":"811904e43eee3edf85cd375b2b90cf51c097d016166b8a42b2110fb7749b1219"} Jul 14 17:26:56.850772 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:56.850749 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-hznkp" event={"ID":"f60de25a-6c7c-41f4-87ce-de3f4eca5c3a","Type":"ContainerStarted","Data":"b0b2beefaa9c986fb7dfbd7523955567ccf625a3b25598a2f3ea9fe89b6d179f"} Jul 14 17:26:56.853228 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:56.853208 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-849fcc9b5c-xqb2d" event={"ID":"f980d702-991f-400f-8278-45e8afe2eafa","Type":"ContainerStarted","Data":"88abbd559999e14b293243864df26c92bb20eeb2963c89657365c5d1ae3ef809"} Jul 14 17:26:56.853312 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:56.853245 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-849fcc9b5c-xqb2d" event={"ID":"f980d702-991f-400f-8278-45e8afe2eafa","Type":"ContainerStarted","Data":"ad995e78b8a248046dfc74ba7bc7663cf54aa6dd95d9e20614353215ca0983c1"} Jul 14 17:26:56.855430 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:56.855387 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-c9lb7" event={"ID":"91eea036-14a4-466b-9006-5c3f7e104bf4","Type":"ContainerStarted","Data":"6b7cd64d58ebf33365801053a7372903cdf054b1945d5f58eb630350e8bc5516"} Jul 14 17:26:56.860956 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:56.860909 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-r7tpq" podStartSLOduration=34.383161282 podStartE2EDuration="44.860891505s" totalImagesPullingTime="10.477730223s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 17:26:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 17:26:56.858912323 +0000 UTC m=+79.238026279" watchObservedRunningTime="2026-07-14 17:26:56.860891505 +0000 UTC m=+79.240005458" Jul 14 17:26:56.900245 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:56.900140 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-c9lb7" podStartSLOduration=67.534096809 podStartE2EDuration="1m18.900124085s" totalImagesPullingTime="11.366027276s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-14 17:25:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 17:26:56.899030195 +0000 UTC m=+79.278144148" watchObservedRunningTime="2026-07-14 17:26:56.900124085 +0000 UTC m=+79.279238036" Jul 14 17:26:56.900638 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:56.900596 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-9c945d444-zp4f4" podStartSLOduration=1.775038185 podStartE2EDuration="12.900582751s" totalImagesPullingTime="11.125544566s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 17:26:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 17:26:56.880975377 +0000 UTC m=+79.260089332" watchObservedRunningTime="2026-07-14 17:26:56.900582751 +0000 UTC m=+79.279696705" Jul 14 17:26:56.915867 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:56.915823 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-hznkp" podStartSLOduration=66.868239504 podStartE2EDuration="1m17.915808989s" totalImagesPullingTime="11.047569485s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 17:25:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 17:26:56.914574738 +0000 UTC m=+79.293688691" watchObservedRunningTime="2026-07-14 17:26:56.915808989 +0000 UTC m=+79.294922950" Jul 14 17:26:56.942475 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:56.939226 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-6cf856758c-85r72" podStartSLOduration=34.116892671 podStartE2EDuration="43.939207545s" totalImagesPullingTime="9.822314874s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 17:26:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 17:26:56.937411423 +0000 UTC m=+79.316525368" watchObservedRunningTime="2026-07-14 17:26:56.939207545 +0000 UTC m=+79.318321499" Jul 14 17:26:56.955754 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:56.955686 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-57c774564c-j4ql5" podStartSLOduration=1.840340741 podStartE2EDuration="12.955668288s" totalImagesPullingTime="11.115327547s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 17:26:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 17:26:56.955549914 +0000 UTC m=+79.334663868" watchObservedRunningTime="2026-07-14 17:26:56.955668288 +0000 UTC m=+79.334782241" Jul 14 17:26:57.379106 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:57.379064 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 17:26:57.383225 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:57.383206 2552 scope.go:117] "RemoveContainer" containerID="34aca4f196f91657ae4cd45a630d5cf4594966e98a999f6736ff2c8a184f3aa3" Jul 14 17:26:57.479547 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:57.479516 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 17:26:57.634305 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:57.634225 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 17:26:57.861263 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:57.861237 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-gnw2z_b3c71861-4db9-4850-a44b-6f5d44a94235/console-operator/2.log" Jul 14 17:26:57.861678 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:57.861355 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7866497494-gnw2z" event={"ID":"b3c71861-4db9-4850-a44b-6f5d44a94235","Type":"ContainerStarted","Data":"09301fc0f92766773d05c1a366e5acf45b358681e23716547c6010be9f4cd89d"} Jul 14 17:26:57.861678 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:57.861652 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-7866497494-gnw2z" Jul 14 17:26:57.863762 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:57.863736 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-849fcc9b5c-xqb2d" event={"ID":"f980d702-991f-400f-8278-45e8afe2eafa","Type":"ContainerStarted","Data":"4d1f2c5e2e48b416cae28b697be4c0490bf4f5f12a900929f5d65a35d93f53c2"} Jul 14 17:26:57.866826 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:57.866801 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-7866497494-gnw2z" Jul 14 17:26:57.878876 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:57.878828 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-7866497494-gnw2z" podStartSLOduration=61.499500644 podStartE2EDuration="1m8.878811091s" totalImagesPullingTime="7.379310447s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 17:25:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 17:26:57.877118687 +0000 UTC m=+80.256232640" watchObservedRunningTime="2026-07-14 17:26:57.878811091 +0000 UTC m=+80.257925051" Jul 14 17:26:57.913001 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:57.912906 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-849fcc9b5c-xqb2d" podStartSLOduration=2.6452612909999997 podStartE2EDuration="13.91289027s" totalImagesPullingTime="11.267628979s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 17:26:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 17:26:57.911063476 +0000 UTC m=+80.290177429" watchObservedRunningTime="2026-07-14 17:26:57.91289027 +0000 UTC m=+80.292004252" Jul 14 17:26:58.044145 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:58.044111 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 17:26:58.141242 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:58.141175 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 17:26:58.240903 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:58.240873 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 17:26:58.341753 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:58.341702 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 17:26:58.720389 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:58.720352 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 17:26:58.933232 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:58.933193 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 17:26:58.993346 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:58.993228 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 17:26:59.341937 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:59.341835 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 17:26:59.392511 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:59.392484 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 17:26:59.531284 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:59.531244 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 17:26:59.727450 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:59.727423 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 17:26:59.829073 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:26:59.829047 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 17:27:00.141818 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:27:00.141635 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 17:27:00.205741 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:27:00.205705 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 17:27:00.331553 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:27:00.331522 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 17:27:00.439019 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:27:00.438929 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 17:27:00.495474 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:27:00.495443 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 17:27:01.545496 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:27:01.545465 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 17:27:01.601494 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:27:01.601455 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 17:27:03.655603 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:27:03.655563 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 17:27:03.978029 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:27:03.977996 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 17:27:04.031513 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:27:04.031485 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 17:27:04.604685 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:27:04.604649 2552 patch_prober.go:28] interesting pod/image-registry-899c5876f-m6hqz container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jul 14 17:27:04.604825 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:27:04.604711 2552 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-899c5876f-m6hqz" podUID="0f57e94d-cace-4645-a5cb-47f7dd6dc854" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 14 17:27:05.274492 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:27:05.274456 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 17:27:05.421764 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:27:05.421732 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 17:27:05.523459 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:27:05.523425 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 17:27:05.572758 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:27:05.572672 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-5rbv7"] Jul 14 17:27:05.577496 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:27:05.577469 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-5rbv7" Jul 14 17:27:05.580695 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:27:05.580668 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-zfrgx\"" Jul 14 17:27:05.581176 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:27:05.581157 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 14 17:27:05.581399 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:27:05.581384 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 14 17:27:05.581922 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:27:05.581901 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 14 17:27:05.582473 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:27:05.582425 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 14 17:27:05.600834 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:27:05.600804 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 17:27:05.675185 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:27:05.675154 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 17:27:05.680157 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:27:05.680138 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/a30f0afb-84e8-44c9-b76f-ff620c6a36b7-node-exporter-accelerators-collector-config\") pod \"node-exporter-5rbv7\" (UID: \"a30f0afb-84e8-44c9-b76f-ff620c6a36b7\") " pod="openshift-monitoring/node-exporter-5rbv7" Jul 14 17:27:05.680258 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:27:05.680176 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a30f0afb-84e8-44c9-b76f-ff620c6a36b7-metrics-client-ca\") pod \"node-exporter-5rbv7\" (UID: \"a30f0afb-84e8-44c9-b76f-ff620c6a36b7\") " pod="openshift-monitoring/node-exporter-5rbv7" Jul 14 17:27:05.680258 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:27:05.680205 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a30f0afb-84e8-44c9-b76f-ff620c6a36b7-sys\") pod \"node-exporter-5rbv7\" (UID: \"a30f0afb-84e8-44c9-b76f-ff620c6a36b7\") " pod="openshift-monitoring/node-exporter-5rbv7" Jul 14 17:27:05.680357 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:27:05.680268 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/a30f0afb-84e8-44c9-b76f-ff620c6a36b7-node-exporter-wtmp\") pod \"node-exporter-5rbv7\" (UID: \"a30f0afb-84e8-44c9-b76f-ff620c6a36b7\") " pod="openshift-monitoring/node-exporter-5rbv7" Jul 14 17:27:05.680357 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:27:05.680345 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/a30f0afb-84e8-44c9-b76f-ff620c6a36b7-node-exporter-tls\") pod \"node-exporter-5rbv7\" (UID: \"a30f0afb-84e8-44c9-b76f-ff620c6a36b7\") " pod="openshift-monitoring/node-exporter-5rbv7" Jul 14 17:27:05.680445 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:27:05.680402 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/a30f0afb-84e8-44c9-b76f-ff620c6a36b7-root\") pod \"node-exporter-5rbv7\" (UID: \"a30f0afb-84e8-44c9-b76f-ff620c6a36b7\") " pod="openshift-monitoring/node-exporter-5rbv7" Jul 14 17:27:05.680492 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:27:05.680454 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c5pd7\" (UniqueName: \"kubernetes.io/projected/a30f0afb-84e8-44c9-b76f-ff620c6a36b7-kube-api-access-c5pd7\") pod \"node-exporter-5rbv7\" (UID: \"a30f0afb-84e8-44c9-b76f-ff620c6a36b7\") " pod="openshift-monitoring/node-exporter-5rbv7" Jul 14 17:27:05.680528 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:27:05.680491 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a30f0afb-84e8-44c9-b76f-ff620c6a36b7-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-5rbv7\" (UID: \"a30f0afb-84e8-44c9-b76f-ff620c6a36b7\") " pod="openshift-monitoring/node-exporter-5rbv7" Jul 14 17:27:05.680528 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:27:05.680520 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/a30f0afb-84e8-44c9-b76f-ff620c6a36b7-node-exporter-textfile\") pod \"node-exporter-5rbv7\" (UID: \"a30f0afb-84e8-44c9-b76f-ff620c6a36b7\") " pod="openshift-monitoring/node-exporter-5rbv7" Jul 14 17:27:05.781835 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:27:05.781796 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a30f0afb-84e8-44c9-b76f-ff620c6a36b7-sys\") pod \"node-exporter-5rbv7\" (UID: \"a30f0afb-84e8-44c9-b76f-ff620c6a36b7\") " pod="openshift-monitoring/node-exporter-5rbv7" Jul 14 17:27:05.781835 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:27:05.781837 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/a30f0afb-84e8-44c9-b76f-ff620c6a36b7-node-exporter-wtmp\") pod \"node-exporter-5rbv7\" (UID: \"a30f0afb-84e8-44c9-b76f-ff620c6a36b7\") " pod="openshift-monitoring/node-exporter-5rbv7" Jul 14 17:27:05.782064 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:27:05.781881 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/a30f0afb-84e8-44c9-b76f-ff620c6a36b7-node-exporter-tls\") pod \"node-exporter-5rbv7\" (UID: \"a30f0afb-84e8-44c9-b76f-ff620c6a36b7\") " pod="openshift-monitoring/node-exporter-5rbv7" Jul 14 17:27:05.782064 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:27:05.781910 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/a30f0afb-84e8-44c9-b76f-ff620c6a36b7-root\") pod \"node-exporter-5rbv7\" (UID: \"a30f0afb-84e8-44c9-b76f-ff620c6a36b7\") " pod="openshift-monitoring/node-exporter-5rbv7" Jul 14 17:27:05.782064 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:27:05.781918 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a30f0afb-84e8-44c9-b76f-ff620c6a36b7-sys\") pod \"node-exporter-5rbv7\" (UID: \"a30f0afb-84e8-44c9-b76f-ff620c6a36b7\") " pod="openshift-monitoring/node-exporter-5rbv7" Jul 14 17:27:05.782064 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:27:05.781935 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c5pd7\" (UniqueName: \"kubernetes.io/projected/a30f0afb-84e8-44c9-b76f-ff620c6a36b7-kube-api-access-c5pd7\") pod \"node-exporter-5rbv7\" (UID: \"a30f0afb-84e8-44c9-b76f-ff620c6a36b7\") " pod="openshift-monitoring/node-exporter-5rbv7" Jul 14 17:27:05.782064 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:27:05.781993 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a30f0afb-84e8-44c9-b76f-ff620c6a36b7-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-5rbv7\" (UID: \"a30f0afb-84e8-44c9-b76f-ff620c6a36b7\") " pod="openshift-monitoring/node-exporter-5rbv7" Jul 14 17:27:05.782064 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:27:05.782002 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/a30f0afb-84e8-44c9-b76f-ff620c6a36b7-node-exporter-wtmp\") pod \"node-exporter-5rbv7\" (UID: \"a30f0afb-84e8-44c9-b76f-ff620c6a36b7\") " pod="openshift-monitoring/node-exporter-5rbv7" Jul 14 17:27:05.782064 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:27:05.782031 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/a30f0afb-84e8-44c9-b76f-ff620c6a36b7-node-exporter-textfile\") pod \"node-exporter-5rbv7\" (UID: \"a30f0afb-84e8-44c9-b76f-ff620c6a36b7\") " pod="openshift-monitoring/node-exporter-5rbv7" Jul 14 17:27:05.782064 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:27:05.782033 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/a30f0afb-84e8-44c9-b76f-ff620c6a36b7-root\") pod \"node-exporter-5rbv7\" (UID: \"a30f0afb-84e8-44c9-b76f-ff620c6a36b7\") " pod="openshift-monitoring/node-exporter-5rbv7" Jul 14 17:27:05.782064 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:27:05.782062 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/a30f0afb-84e8-44c9-b76f-ff620c6a36b7-node-exporter-accelerators-collector-config\") pod \"node-exporter-5rbv7\" (UID: \"a30f0afb-84e8-44c9-b76f-ff620c6a36b7\") " pod="openshift-monitoring/node-exporter-5rbv7" Jul 14 17:27:05.782515 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:27:05.782131 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a30f0afb-84e8-44c9-b76f-ff620c6a36b7-metrics-client-ca\") pod \"node-exporter-5rbv7\" (UID: \"a30f0afb-84e8-44c9-b76f-ff620c6a36b7\") " pod="openshift-monitoring/node-exporter-5rbv7" Jul 14 17:27:05.782515 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:27:05.782443 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/a30f0afb-84e8-44c9-b76f-ff620c6a36b7-node-exporter-textfile\") pod \"node-exporter-5rbv7\" (UID: \"a30f0afb-84e8-44c9-b76f-ff620c6a36b7\") " pod="openshift-monitoring/node-exporter-5rbv7" Jul 14 17:27:05.782786 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:27:05.782758 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/a30f0afb-84e8-44c9-b76f-ff620c6a36b7-node-exporter-accelerators-collector-config\") pod \"node-exporter-5rbv7\" (UID: \"a30f0afb-84e8-44c9-b76f-ff620c6a36b7\") " pod="openshift-monitoring/node-exporter-5rbv7" Jul 14 17:27:05.782786 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:27:05.782776 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a30f0afb-84e8-44c9-b76f-ff620c6a36b7-metrics-client-ca\") pod \"node-exporter-5rbv7\" (UID: \"a30f0afb-84e8-44c9-b76f-ff620c6a36b7\") " pod="openshift-monitoring/node-exporter-5rbv7" Jul 14 17:27:05.784340 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:27:05.784310 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a30f0afb-84e8-44c9-b76f-ff620c6a36b7-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-5rbv7\" (UID: \"a30f0afb-84e8-44c9-b76f-ff620c6a36b7\") " pod="openshift-monitoring/node-exporter-5rbv7" Jul 14 17:27:05.784525 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:27:05.784504 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/a30f0afb-84e8-44c9-b76f-ff620c6a36b7-node-exporter-tls\") pod \"node-exporter-5rbv7\" (UID: \"a30f0afb-84e8-44c9-b76f-ff620c6a36b7\") " pod="openshift-monitoring/node-exporter-5rbv7" Jul 14 17:27:05.789757 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:27:05.789737 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c5pd7\" (UniqueName: \"kubernetes.io/projected/a30f0afb-84e8-44c9-b76f-ff620c6a36b7-kube-api-access-c5pd7\") pod \"node-exporter-5rbv7\" (UID: \"a30f0afb-84e8-44c9-b76f-ff620c6a36b7\") " pod="openshift-monitoring/node-exporter-5rbv7" Jul 14 17:27:05.889549 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:27:05.889471 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-5rbv7" Jul 14 17:27:05.900237 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:27:05.900209 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda30f0afb_84e8_44c9_b76f_ff620c6a36b7.slice/crio-21492e7089a0072f4853939cdb7487c28c54dce623f57511e0f26ee7686f591d WatchSource:0}: Error finding container 21492e7089a0072f4853939cdb7487c28c54dce623f57511e0f26ee7686f591d: Status 404 returned error can't find the container with id 21492e7089a0072f4853939cdb7487c28c54dce623f57511e0f26ee7686f591d Jul 14 17:27:06.602251 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:27:06.602154 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 17:27:06.686147 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:27:06.686083 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 17:27:06.784197 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:27:06.784163 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-899c5876f-m6hqz" Jul 14 17:27:06.866114 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:27:06.866038 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-r7tpq" Jul 14 17:27:06.901096 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:27:06.901065 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-5rbv7" event={"ID":"a30f0afb-84e8-44c9-b76f-ff620c6a36b7","Type":"ContainerStarted","Data":"21492e7089a0072f4853939cdb7487c28c54dce623f57511e0f26ee7686f591d"} Jul 14 17:27:07.248991 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:27:07.248959 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 17:27:07.327452 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:27:07.327422 2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-899c5876f-m6hqz"] Jul 14 17:27:07.467125 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:27:07.467079 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 17:27:07.531958 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:27:07.531931 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 17:27:07.906611 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:27:07.906521 2552 generic.go:356] "Generic (PLEG): container finished" podID="a30f0afb-84e8-44c9-b76f-ff620c6a36b7" containerID="bd0e4f084f94e340f8b127f73441b91f0b4860a388a6b7a537f5d4b051d4dca9" exitCode=0 Jul 14 17:27:07.906611 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:27:07.906558 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-5rbv7" event={"ID":"a30f0afb-84e8-44c9-b76f-ff620c6a36b7","Type":"ContainerDied","Data":"bd0e4f084f94e340f8b127f73441b91f0b4860a388a6b7a537f5d4b051d4dca9"} Jul 14 17:27:08.476755 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:27:08.476720 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 17:27:08.578010 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:27:08.577982 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 17:27:08.629720 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:27:08.629687 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 17:27:08.885078 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:27:08.884999 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 17:27:08.912892 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:27:08.912859 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-5rbv7" event={"ID":"a30f0afb-84e8-44c9-b76f-ff620c6a36b7","Type":"ContainerStarted","Data":"5a0927b751b3fac59a1b0d1e244ac5697bee4832f0a1a798c0706f4a0bf3162c"} Jul 14 17:27:08.913216 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:27:08.912917 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-5rbv7" event={"ID":"a30f0afb-84e8-44c9-b76f-ff620c6a36b7","Type":"ContainerStarted","Data":"79f2e95a152f58f180be0101d97c11d4e1e564e8e553a03771bd7cd995609e53"} Jul 14 17:27:08.937139 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:27:08.937098 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-5rbv7" podStartSLOduration=2.795763142 podStartE2EDuration="3.937080799s" totalImagesPullingTime="1.07357885s" totalInitContainerRuntime="67.738807ms" isStatefulPod=true podCreationTimestamp="2026-07-14 17:27:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 17:27:08.934620605 +0000 UTC m=+91.313734558" watchObservedRunningTime="2026-07-14 17:27:08.937080799 +0000 UTC m=+91.316194750" Jul 14 17:27:10.294216 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:27:10.294180 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 17:27:10.375294 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:27:10.375250 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 17:27:10.463197 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:27:10.463165 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 17:27:10.563651 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:27:10.563556 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 17:27:10.621975 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:27:10.621923 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 17:27:11.741537 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:27:11.741501 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 17:27:14.195589 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:27:14.195552 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 17:27:14.296295 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:27:14.296254 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 17:27:14.942139 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:27:14.942104 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 17:27:14.994519 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:27:14.994486 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 17:27:16.109406 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:27:16.109375 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 17:27:16.162593 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:27:16.162557 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 17:27:16.780549 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:27:16.780520 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-vjlpd" Jul 14 17:27:16.878503 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:27:16.878421 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 17:27:19.453750 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:27:19.453717 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 17:27:19.554232 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:27:19.554194 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 17:27:21.744200 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:27:21.744162 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 17:27:21.799113 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:27:21.799075 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 17:27:23.266877 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:27:23.266839 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 17:27:23.369605 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:27:23.369568 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 17:27:23.981466 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:27:23.981436 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 17:27:24.030596 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:27:24.030569 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 17:27:28.765083 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:27:28.765047 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 17:27:28.824023 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:27:28.823998 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 17:27:30.977039 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:27:30.976998 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 17:27:31.231396 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:27:31.231306 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 17:27:31.289427 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:27:31.289391 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 17:27:32.000439 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:27:32.000407 2552 generic.go:356] "Generic (PLEG): container finished" podID="e0e19152-87b3-4e28-9739-36d5639e5eb1" containerID="8a0cbdb34cb6f89b15c4b673046eb4903da0a9c4927e1d2f2e776e5775587eb1" exitCode=0 Jul 14 17:27:32.000860 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:27:32.000480 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-wzm2l" event={"ID":"e0e19152-87b3-4e28-9739-36d5639e5eb1","Type":"ContainerDied","Data":"8a0cbdb34cb6f89b15c4b673046eb4903da0a9c4927e1d2f2e776e5775587eb1"} Jul 14 17:27:32.000860 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:27:32.000787 2552 scope.go:117] "RemoveContainer" containerID="8a0cbdb34cb6f89b15c4b673046eb4903da0a9c4927e1d2f2e776e5775587eb1" Jul 14 17:27:32.349301 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:27:32.349218 2552 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-899c5876f-m6hqz" podUID="0f57e94d-cace-4645-a5cb-47f7dd6dc854" containerName="registry" containerID="cri-o://394c7a98fc58023c09c4f07a1614622270d0ee3fcb2e6c82dc8b0d094641f273" gracePeriod=30 Jul 14 17:27:32.607188 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:27:32.607134 2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-899c5876f-m6hqz" Jul 14 17:27:32.710597 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:27:32.710569 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/0f57e94d-cace-4645-a5cb-47f7dd6dc854-registry-certificates\") pod \"0f57e94d-cace-4645-a5cb-47f7dd6dc854\" (UID: \"0f57e94d-cace-4645-a5cb-47f7dd6dc854\") " Jul 14 17:27:32.710738 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:27:32.710615 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/0f57e94d-cace-4645-a5cb-47f7dd6dc854-ca-trust-extracted\") pod \"0f57e94d-cace-4645-a5cb-47f7dd6dc854\" (UID: \"0f57e94d-cace-4645-a5cb-47f7dd6dc854\") " Jul 14 17:27:32.710738 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:27:32.710638 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-65699\" (UniqueName: \"kubernetes.io/projected/0f57e94d-cace-4645-a5cb-47f7dd6dc854-kube-api-access-65699\") pod \"0f57e94d-cace-4645-a5cb-47f7dd6dc854\" (UID: \"0f57e94d-cace-4645-a5cb-47f7dd6dc854\") " Jul 14 17:27:32.710738 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:27:32.710671 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/0f57e94d-cace-4645-a5cb-47f7dd6dc854-trusted-ca\") pod \"0f57e94d-cace-4645-a5cb-47f7dd6dc854\" (UID: \"0f57e94d-cace-4645-a5cb-47f7dd6dc854\") " Jul 14 17:27:32.710738 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:27:32.710690 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/0f57e94d-cace-4645-a5cb-47f7dd6dc854-bound-sa-token\") pod \"0f57e94d-cace-4645-a5cb-47f7dd6dc854\" (UID: \"0f57e94d-cace-4645-a5cb-47f7dd6dc854\") " Jul 14 17:27:32.710738 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:27:32.710708 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0f57e94d-cace-4645-a5cb-47f7dd6dc854-registry-tls\") pod \"0f57e94d-cace-4645-a5cb-47f7dd6dc854\" (UID: \"0f57e94d-cace-4645-a5cb-47f7dd6dc854\") " Jul 14 17:27:32.710979 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:27:32.710742 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/0f57e94d-cace-4645-a5cb-47f7dd6dc854-image-registry-private-configuration\") pod \"0f57e94d-cace-4645-a5cb-47f7dd6dc854\" (UID: \"0f57e94d-cace-4645-a5cb-47f7dd6dc854\") " Jul 14 17:27:32.710979 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:27:32.710779 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/0f57e94d-cace-4645-a5cb-47f7dd6dc854-installation-pull-secrets\") pod \"0f57e94d-cace-4645-a5cb-47f7dd6dc854\" (UID: \"0f57e94d-cace-4645-a5cb-47f7dd6dc854\") " Jul 14 17:27:32.711193 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:27:32.711158 2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0f57e94d-cace-4645-a5cb-47f7dd6dc854-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "0f57e94d-cace-4645-a5cb-47f7dd6dc854" (UID: "0f57e94d-cace-4645-a5cb-47f7dd6dc854"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 14 17:27:32.711413 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:27:32.711285 2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0f57e94d-cace-4645-a5cb-47f7dd6dc854-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "0f57e94d-cace-4645-a5cb-47f7dd6dc854" (UID: "0f57e94d-cace-4645-a5cb-47f7dd6dc854"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 14 17:27:32.713353 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:27:32.713289 2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0f57e94d-cace-4645-a5cb-47f7dd6dc854-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "0f57e94d-cace-4645-a5cb-47f7dd6dc854" (UID: "0f57e94d-cace-4645-a5cb-47f7dd6dc854"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 14 17:27:32.713473 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:27:32.713447 2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0f57e94d-cace-4645-a5cb-47f7dd6dc854-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "0f57e94d-cace-4645-a5cb-47f7dd6dc854" (UID: "0f57e94d-cace-4645-a5cb-47f7dd6dc854"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 14 17:27:32.713585 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:27:32.713562 2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0f57e94d-cace-4645-a5cb-47f7dd6dc854-kube-api-access-65699" (OuterVolumeSpecName: "kube-api-access-65699") pod "0f57e94d-cace-4645-a5cb-47f7dd6dc854" (UID: "0f57e94d-cace-4645-a5cb-47f7dd6dc854"). InnerVolumeSpecName "kube-api-access-65699". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 14 17:27:32.713660 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:27:32.713638 2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0f57e94d-cace-4645-a5cb-47f7dd6dc854-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "0f57e94d-cace-4645-a5cb-47f7dd6dc854" (UID: "0f57e94d-cace-4645-a5cb-47f7dd6dc854"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 14 17:27:32.713721 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:27:32.713677 2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0f57e94d-cace-4645-a5cb-47f7dd6dc854-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "0f57e94d-cace-4645-a5cb-47f7dd6dc854" (UID: "0f57e94d-cace-4645-a5cb-47f7dd6dc854"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 14 17:27:32.719709 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:27:32.719688 2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0f57e94d-cace-4645-a5cb-47f7dd6dc854-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "0f57e94d-cace-4645-a5cb-47f7dd6dc854" (UID: "0f57e94d-cace-4645-a5cb-47f7dd6dc854"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 14 17:27:32.811930 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:27:32.811906 2552 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/0f57e94d-cace-4645-a5cb-47f7dd6dc854-installation-pull-secrets\") on node \"ip-10-0-139-16.ec2.internal\" DevicePath \"\"" Jul 14 17:27:32.811930 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:27:32.811929 2552 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/0f57e94d-cace-4645-a5cb-47f7dd6dc854-registry-certificates\") on node \"ip-10-0-139-16.ec2.internal\" DevicePath \"\"" Jul 14 17:27:32.812062 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:27:32.811940 2552 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/0f57e94d-cace-4645-a5cb-47f7dd6dc854-ca-trust-extracted\") on node \"ip-10-0-139-16.ec2.internal\" DevicePath \"\"" Jul 14 17:27:32.812062 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:27:32.811949 2552 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-65699\" (UniqueName: \"kubernetes.io/projected/0f57e94d-cace-4645-a5cb-47f7dd6dc854-kube-api-access-65699\") on node \"ip-10-0-139-16.ec2.internal\" DevicePath \"\"" Jul 14 17:27:32.812062 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:27:32.811958 2552 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/0f57e94d-cace-4645-a5cb-47f7dd6dc854-trusted-ca\") on node \"ip-10-0-139-16.ec2.internal\" DevicePath \"\"" Jul 14 17:27:32.812062 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:27:32.811967 2552 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/0f57e94d-cace-4645-a5cb-47f7dd6dc854-bound-sa-token\") on node \"ip-10-0-139-16.ec2.internal\" DevicePath \"\"" Jul 14 17:27:32.812062 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:27:32.811974 2552 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0f57e94d-cace-4645-a5cb-47f7dd6dc854-registry-tls\") on node \"ip-10-0-139-16.ec2.internal\" DevicePath \"\"" Jul 14 17:27:32.812062 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:27:32.811982 2552 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/0f57e94d-cace-4645-a5cb-47f7dd6dc854-image-registry-private-configuration\") on node \"ip-10-0-139-16.ec2.internal\" DevicePath \"\"" Jul 14 17:27:33.005680 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:27:33.005646 2552 generic.go:356] "Generic (PLEG): container finished" podID="0f57e94d-cace-4645-a5cb-47f7dd6dc854" containerID="394c7a98fc58023c09c4f07a1614622270d0ee3fcb2e6c82dc8b0d094641f273" exitCode=0 Jul 14 17:27:33.006103 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:27:33.005694 2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-899c5876f-m6hqz" Jul 14 17:27:33.006103 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:27:33.005733 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-899c5876f-m6hqz" event={"ID":"0f57e94d-cace-4645-a5cb-47f7dd6dc854","Type":"ContainerDied","Data":"394c7a98fc58023c09c4f07a1614622270d0ee3fcb2e6c82dc8b0d094641f273"} Jul 14 17:27:33.006103 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:27:33.005777 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-899c5876f-m6hqz" event={"ID":"0f57e94d-cace-4645-a5cb-47f7dd6dc854","Type":"ContainerDied","Data":"bdba82a0dec01234157b744501786123de3ce6dd204331888fbb6bd55bea5cb1"} Jul 14 17:27:33.006103 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:27:33.005796 2552 scope.go:117] "RemoveContainer" containerID="394c7a98fc58023c09c4f07a1614622270d0ee3fcb2e6c82dc8b0d094641f273" Jul 14 17:27:33.007823 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:27:33.007800 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-wzm2l" event={"ID":"e0e19152-87b3-4e28-9739-36d5639e5eb1","Type":"ContainerStarted","Data":"3e0cddc7eda6703a73612e046c4bd9004afbbd4e781207ddd47aef62d5a2d713"} Jul 14 17:27:33.014178 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:27:33.014161 2552 scope.go:117] "RemoveContainer" containerID="394c7a98fc58023c09c4f07a1614622270d0ee3fcb2e6c82dc8b0d094641f273" Jul 14 17:27:33.014456 ip-10-0-139-16 kubenswrapper[2552]: E0714 17:27:33.014435 2552 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"394c7a98fc58023c09c4f07a1614622270d0ee3fcb2e6c82dc8b0d094641f273\": container with ID starting with 394c7a98fc58023c09c4f07a1614622270d0ee3fcb2e6c82dc8b0d094641f273 not found: ID does not exist" containerID="394c7a98fc58023c09c4f07a1614622270d0ee3fcb2e6c82dc8b0d094641f273" Jul 14 17:27:33.014533 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:27:33.014467 2552 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"394c7a98fc58023c09c4f07a1614622270d0ee3fcb2e6c82dc8b0d094641f273"} err="failed to get container status \"394c7a98fc58023c09c4f07a1614622270d0ee3fcb2e6c82dc8b0d094641f273\": rpc error: code = NotFound desc = could not find container \"394c7a98fc58023c09c4f07a1614622270d0ee3fcb2e6c82dc8b0d094641f273\": container with ID starting with 394c7a98fc58023c09c4f07a1614622270d0ee3fcb2e6c82dc8b0d094641f273 not found: ID does not exist" Jul 14 17:27:33.038948 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:27:33.038911 2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-899c5876f-m6hqz"] Jul 14 17:27:33.040872 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:27:33.040843 2552 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-899c5876f-m6hqz"] Jul 14 17:27:34.387396 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:27:34.387364 2552 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0f57e94d-cace-4645-a5cb-47f7dd6dc854" path="/var/lib/kubelet/pods/0f57e94d-cace-4645-a5cb-47f7dd6dc854/volumes" Jul 14 17:27:38.983028 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:27:38.982996 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 17:27:39.082553 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:27:39.082510 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 17:27:40.932829 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:27:40.932792 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 17:27:41.034386 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:27:41.034353 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 17:27:46.208700 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:27:46.208644 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 17:27:46.309671 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:27:46.309631 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 17:27:52.080197 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:27:52.080159 2552 generic.go:356] "Generic (PLEG): container finished" podID="5a0f3a9b-3347-43e5-910b-229e446543ad" containerID="82015b6fd02ed184f8a339973d1960a3506abbaea10df507cfe3f5b652345bee" exitCode=0 Jul 14 17:27:52.080595 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:27:52.080213 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-68d9dd94cf-dq264" event={"ID":"5a0f3a9b-3347-43e5-910b-229e446543ad","Type":"ContainerDied","Data":"82015b6fd02ed184f8a339973d1960a3506abbaea10df507cfe3f5b652345bee"} Jul 14 17:27:52.080595 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:27:52.080537 2552 scope.go:117] "RemoveContainer" containerID="82015b6fd02ed184f8a339973d1960a3506abbaea10df507cfe3f5b652345bee" Jul 14 17:27:53.085681 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:27:53.085643 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-68d9dd94cf-dq264" event={"ID":"5a0f3a9b-3347-43e5-910b-229e446543ad","Type":"ContainerStarted","Data":"afba92f290aff8cdb1b1183457c63c5e6c193c72a4d9e380fbb258d14a646e07"} Jul 14 17:27:53.984809 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:27:53.984775 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 17:27:54.040923 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:27:54.040896 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 17:27:57.102458 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:27:57.102424 2552 generic.go:356] "Generic (PLEG): container finished" podID="62900e1e-659d-4c6e-9e31-2933f84ebc70" containerID="be235381990de68e2d729070148123ea99cc85d9723c025a4bef45f16a6cf479" exitCode=0 Jul 14 17:27:57.102856 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:27:57.102495 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-6xn2k" event={"ID":"62900e1e-659d-4c6e-9e31-2933f84ebc70","Type":"ContainerDied","Data":"be235381990de68e2d729070148123ea99cc85d9723c025a4bef45f16a6cf479"} Jul 14 17:27:57.102856 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:27:57.102812 2552 scope.go:117] "RemoveContainer" containerID="be235381990de68e2d729070148123ea99cc85d9723c025a4bef45f16a6cf479" Jul 14 17:27:58.107764 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:27:58.107726 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-6xn2k" event={"ID":"62900e1e-659d-4c6e-9e31-2933f84ebc70","Type":"ContainerStarted","Data":"46a4e9eea81759f5c8f0cc0f96005f7fc983e2030ff67daa199994a534cc9358"} Jul 14 17:28:24.746508 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:28:24.746465 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 17:28:25.316837 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:28:25.316792 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 17:28:34.522811 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:28:34.522713 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 17:28:34.578447 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:28:34.578415 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 17:28:34.656899 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:28:34.656869 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 17:28:34.711118 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:28:34.711090 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 17:28:35.252947 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:28:35.252907 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 17:28:35.354977 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:28:35.354942 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 17:28:45.433347 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:28:45.433297 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 17:28:45.533459 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:28:45.533432 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 17:28:45.583804 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:28:45.583779 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 17:29:22.929794 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:29:22.929761 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 17:29:22.979684 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:29:22.979650 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 17:29:23.109282 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:29:23.109250 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 17:29:39.990819 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:29:39.990784 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 17:29:40.047888 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:29:40.047852 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 17:29:43.837465 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:29:43.837421 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 17:29:43.888007 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:29:43.887978 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 17:29:51.989202 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:29:51.989169 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 17:29:52.042640 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:29:52.042603 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 17:29:54.684076 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:29:54.684037 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 17:29:54.743595 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:29:54.743556 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 17:29:54.844079 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:29:54.844050 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 17:29:55.598664 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:29:55.598631 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 17:30:08.989893 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:30:08.989783 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 17:30:09.090624 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:30:09.090591 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 17:30:38.031429 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:30:38.031391 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-gnw2z_b3c71861-4db9-4850-a44b-6f5d44a94235/console-operator/2.log" Jul 14 17:30:38.031915 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:30:38.031656 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-gnw2z_b3c71861-4db9-4850-a44b-6f5d44a94235/console-operator/2.log" Jul 14 17:30:38.037185 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:30:38.037165 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cwprj_d3492336-881b-4f13-8d3a-b4d4ec05ad3c/ovn-acl-logging/0.log" Jul 14 17:30:38.037342 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:30:38.037185 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cwprj_d3492336-881b-4f13-8d3a-b4d4ec05ad3c/ovn-acl-logging/0.log" Jul 14 17:30:38.042129 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:30:38.042103 2552 kubelet.go:1648] "Image garbage collection succeeded" Jul 14 17:30:52.678668 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:30:52.678632 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 17:30:54.510722 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:30:54.510677 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 17:30:59.478788 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:30:59.478751 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 17:31:13.152440 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:31:13.152388 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 17:31:13.204520 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:31:13.204473 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 17:31:19.348246 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:31:19.348199 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 17:31:20.144220 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:31:20.144184 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 17:31:22.942764 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:31:22.942729 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 17:31:22.993967 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:31:22.993936 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 17:31:24.907094 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:31:24.907029 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 17:31:25.003508 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:31:25.003476 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 17:31:25.331366 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:31:25.331309 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 17:31:25.424396 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:31:25.424363 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 17:31:26.918963 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:31:26.918925 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 17:31:27.335192 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:31:27.335161 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 17:31:29.951669 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:31:29.951628 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 17:31:30.011050 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:31:30.010969 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 17:31:32.111242 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:31:32.111212 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 17:31:32.170723 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:31:32.170688 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 17:31:35.718475 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:31:35.718446 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 17:31:41.544129 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:31:41.544086 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 17:31:41.641423 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:31:41.641388 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 17:31:46.637120 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:31:46.637082 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 17:31:46.736126 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:31:46.736095 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 17:31:49.116040 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:31:49.116005 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 17:32:01.381522 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:32:01.381487 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 17:32:01.472240 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:32:01.472208 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 17:32:02.899946 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:32:02.899898 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 17:32:02.994433 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:32:02.994396 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 17:32:03.476395 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:32:03.476356 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 17:32:03.855707 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:32:03.855629 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7f54d68b84-rtrt4"] Jul 14 17:32:03.855995 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:32:03.855981 2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0f57e94d-cace-4645-a5cb-47f7dd6dc854" containerName="registry" Jul 14 17:32:03.856059 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:32:03.855996 2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="0f57e94d-cace-4645-a5cb-47f7dd6dc854" containerName="registry" Jul 14 17:32:03.856140 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:32:03.856063 2552 memory_manager.go:368] "RemoveStaleState removing state" podUID="0f57e94d-cace-4645-a5cb-47f7dd6dc854" containerName="registry" Jul 14 17:32:03.859101 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:32:03.859080 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-7f54d68b84-rtrt4" Jul 14 17:32:03.862098 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:32:03.862075 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jul 14 17:32:03.862233 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:32:03.862122 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-4xg4v\"" Jul 14 17:32:03.862233 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:32:03.862141 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jul 14 17:32:03.862465 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:32:03.862448 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jul 14 17:32:03.862523 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:32:03.862501 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jul 14 17:32:03.875698 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:32:03.875665 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7f54d68b84-rtrt4"] Jul 14 17:32:03.895740 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:32:03.895706 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 17:32:03.964200 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:32:03.964170 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/cf97b0cc-a58a-428e-a4c1-c1168c8f2d80-manifests\") pod \"opendatahub-operator-controller-manager-7f54d68b84-rtrt4\" (UID: \"cf97b0cc-a58a-428e-a4c1-c1168c8f2d80\") " pod="opendatahub/opendatahub-operator-controller-manager-7f54d68b84-rtrt4" Jul 14 17:32:03.964200 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:32:03.964214 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/cf97b0cc-a58a-428e-a4c1-c1168c8f2d80-tmp\") pod \"opendatahub-operator-controller-manager-7f54d68b84-rtrt4\" (UID: \"cf97b0cc-a58a-428e-a4c1-c1168c8f2d80\") " pod="opendatahub/opendatahub-operator-controller-manager-7f54d68b84-rtrt4" Jul 14 17:32:03.964672 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:32:03.964237 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/cf97b0cc-a58a-428e-a4c1-c1168c8f2d80-webhook-cert\") pod \"opendatahub-operator-controller-manager-7f54d68b84-rtrt4\" (UID: \"cf97b0cc-a58a-428e-a4c1-c1168c8f2d80\") " pod="opendatahub/opendatahub-operator-controller-manager-7f54d68b84-rtrt4" Jul 14 17:32:03.964672 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:32:03.964309 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/cf97b0cc-a58a-428e-a4c1-c1168c8f2d80-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7f54d68b84-rtrt4\" (UID: \"cf97b0cc-a58a-428e-a4c1-c1168c8f2d80\") " pod="opendatahub/opendatahub-operator-controller-manager-7f54d68b84-rtrt4" Jul 14 17:32:03.964672 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:32:03.964372 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l6hzr\" (UniqueName: \"kubernetes.io/projected/cf97b0cc-a58a-428e-a4c1-c1168c8f2d80-kube-api-access-l6hzr\") pod \"opendatahub-operator-controller-manager-7f54d68b84-rtrt4\" (UID: \"cf97b0cc-a58a-428e-a4c1-c1168c8f2d80\") " pod="opendatahub/opendatahub-operator-controller-manager-7f54d68b84-rtrt4" Jul 14 17:32:03.980962 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:32:03.980935 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 17:32:04.065650 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:32:04.065616 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/cf97b0cc-a58a-428e-a4c1-c1168c8f2d80-manifests\") pod \"opendatahub-operator-controller-manager-7f54d68b84-rtrt4\" (UID: \"cf97b0cc-a58a-428e-a4c1-c1168c8f2d80\") " pod="opendatahub/opendatahub-operator-controller-manager-7f54d68b84-rtrt4" Jul 14 17:32:04.065829 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:32:04.065660 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/cf97b0cc-a58a-428e-a4c1-c1168c8f2d80-tmp\") pod \"opendatahub-operator-controller-manager-7f54d68b84-rtrt4\" (UID: \"cf97b0cc-a58a-428e-a4c1-c1168c8f2d80\") " pod="opendatahub/opendatahub-operator-controller-manager-7f54d68b84-rtrt4" Jul 14 17:32:04.065829 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:32:04.065684 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/cf97b0cc-a58a-428e-a4c1-c1168c8f2d80-webhook-cert\") pod \"opendatahub-operator-controller-manager-7f54d68b84-rtrt4\" (UID: \"cf97b0cc-a58a-428e-a4c1-c1168c8f2d80\") " pod="opendatahub/opendatahub-operator-controller-manager-7f54d68b84-rtrt4" Jul 14 17:32:04.065829 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:32:04.065708 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/cf97b0cc-a58a-428e-a4c1-c1168c8f2d80-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7f54d68b84-rtrt4\" (UID: \"cf97b0cc-a58a-428e-a4c1-c1168c8f2d80\") " pod="opendatahub/opendatahub-operator-controller-manager-7f54d68b84-rtrt4" Jul 14 17:32:04.065829 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:32:04.065724 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l6hzr\" (UniqueName: \"kubernetes.io/projected/cf97b0cc-a58a-428e-a4c1-c1168c8f2d80-kube-api-access-l6hzr\") pod \"opendatahub-operator-controller-manager-7f54d68b84-rtrt4\" (UID: \"cf97b0cc-a58a-428e-a4c1-c1168c8f2d80\") " pod="opendatahub/opendatahub-operator-controller-manager-7f54d68b84-rtrt4" Jul 14 17:32:04.066093 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:32:04.066068 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/cf97b0cc-a58a-428e-a4c1-c1168c8f2d80-manifests\") pod \"opendatahub-operator-controller-manager-7f54d68b84-rtrt4\" (UID: \"cf97b0cc-a58a-428e-a4c1-c1168c8f2d80\") " pod="opendatahub/opendatahub-operator-controller-manager-7f54d68b84-rtrt4" Jul 14 17:32:04.068018 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:32:04.067992 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/cf97b0cc-a58a-428e-a4c1-c1168c8f2d80-tmp\") pod \"opendatahub-operator-controller-manager-7f54d68b84-rtrt4\" (UID: \"cf97b0cc-a58a-428e-a4c1-c1168c8f2d80\") " pod="opendatahub/opendatahub-operator-controller-manager-7f54d68b84-rtrt4" Jul 14 17:32:04.068229 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:32:04.068207 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/cf97b0cc-a58a-428e-a4c1-c1168c8f2d80-webhook-cert\") pod \"opendatahub-operator-controller-manager-7f54d68b84-rtrt4\" (UID: \"cf97b0cc-a58a-428e-a4c1-c1168c8f2d80\") " pod="opendatahub/opendatahub-operator-controller-manager-7f54d68b84-rtrt4" Jul 14 17:32:04.068359 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:32:04.068342 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/cf97b0cc-a58a-428e-a4c1-c1168c8f2d80-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7f54d68b84-rtrt4\" (UID: \"cf97b0cc-a58a-428e-a4c1-c1168c8f2d80\") " pod="opendatahub/opendatahub-operator-controller-manager-7f54d68b84-rtrt4" Jul 14 17:32:04.075282 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:32:04.075258 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l6hzr\" (UniqueName: \"kubernetes.io/projected/cf97b0cc-a58a-428e-a4c1-c1168c8f2d80-kube-api-access-l6hzr\") pod \"opendatahub-operator-controller-manager-7f54d68b84-rtrt4\" (UID: \"cf97b0cc-a58a-428e-a4c1-c1168c8f2d80\") " pod="opendatahub/opendatahub-operator-controller-manager-7f54d68b84-rtrt4" Jul 14 17:32:04.077484 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:32:04.077456 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 17:32:04.171303 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:32:04.171218 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-7f54d68b84-rtrt4" Jul 14 17:32:04.177701 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:32:04.177676 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 17:32:04.277822 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:32:04.277790 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 17:32:04.323211 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:32:04.323181 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7f54d68b84-rtrt4"] Jul 14 17:32:04.326659 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:32:04.326635 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcf97b0cc_a58a_428e_a4c1_c1168c8f2d80.slice/crio-2def30e85682f3fbe12ad6c05aa362a115d72ec161a442d4912a7e0165a3030a WatchSource:0}: Error finding container 2def30e85682f3fbe12ad6c05aa362a115d72ec161a442d4912a7e0165a3030a: Status 404 returned error can't find the container with id 2def30e85682f3fbe12ad6c05aa362a115d72ec161a442d4912a7e0165a3030a Jul 14 17:32:04.328583 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:32:04.328565 2552 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 14 17:32:04.378056 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:32:04.378027 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 17:32:04.478206 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:32:04.478175 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 17:32:05.029117 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:32:05.029079 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7f54d68b84-rtrt4" event={"ID":"cf97b0cc-a58a-428e-a4c1-c1168c8f2d80","Type":"ContainerStarted","Data":"2def30e85682f3fbe12ad6c05aa362a115d72ec161a442d4912a7e0165a3030a"} Jul 14 17:32:08.044293 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:32:08.044252 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7f54d68b84-rtrt4" event={"ID":"cf97b0cc-a58a-428e-a4c1-c1168c8f2d80","Type":"ContainerStarted","Data":"939a4020f6fff7cccc3a63f1f3b94fe8f10becb9a24f954aa3021947642b10e6"} Jul 14 17:32:09.050059 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:32:09.050023 2552 generic.go:356] "Generic (PLEG): container finished" podID="cf97b0cc-a58a-428e-a4c1-c1168c8f2d80" containerID="939a4020f6fff7cccc3a63f1f3b94fe8f10becb9a24f954aa3021947642b10e6" exitCode=0 Jul 14 17:32:09.050459 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:32:09.050081 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7f54d68b84-rtrt4" event={"ID":"cf97b0cc-a58a-428e-a4c1-c1168c8f2d80","Type":"ContainerDied","Data":"939a4020f6fff7cccc3a63f1f3b94fe8f10becb9a24f954aa3021947642b10e6"} Jul 14 17:32:10.056351 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:32:10.056296 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7f54d68b84-rtrt4" event={"ID":"cf97b0cc-a58a-428e-a4c1-c1168c8f2d80","Type":"ContainerStarted","Data":"b4f83048cf464d34a6b566654b7483d8f254ac565b79e0ee9a4c56e1b9ed8a64"} Jul 14 17:32:10.056759 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:32:10.056391 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-7f54d68b84-rtrt4" Jul 14 17:32:10.080322 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:32:10.080276 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-7f54d68b84-rtrt4" podStartSLOduration=2.667731936 podStartE2EDuration="7.080259658s" totalImagesPullingTime="3.332789483s" totalInitContainerRuntime="1.079738239s" isStatefulPod=false podCreationTimestamp="2026-07-14 17:32:03 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 17:32:10.077602192 +0000 UTC m=+392.456716143" watchObservedRunningTime="2026-07-14 17:32:10.080259658 +0000 UTC m=+392.459373611" Jul 14 17:32:21.062838 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:32:21.062806 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-7f54d68b84-rtrt4" Jul 14 17:32:21.792495 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:32:21.792450 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 17:32:21.892139 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:32:21.892108 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 17:32:23.293008 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:32:23.292971 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 17:32:23.408987 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:32:23.408943 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 17:32:23.769249 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:32:23.769217 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 17:32:23.851497 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:32:23.851452 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-6dfddfddb9-xqn5r"] Jul 14 17:32:23.861087 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:32:23.861061 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-6dfddfddb9-xqn5r" Jul 14 17:32:23.864105 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:32:23.864084 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" Jul 14 17:32:23.864230 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:32:23.864114 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" Jul 14 17:32:23.875276 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:32:23.875250 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-6dfddfddb9-xqn5r"] Jul 14 17:32:23.903835 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:32:23.903806 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 17:32:23.922494 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:32:23.922466 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/74153627-7131-4e58-9aa9-446a2d6d4f4d-tls-certs\") pod \"kube-auth-proxy-6dfddfddb9-xqn5r\" (UID: \"74153627-7131-4e58-9aa9-446a2d6d4f4d\") " pod="openshift-ingress/kube-auth-proxy-6dfddfddb9-xqn5r" Jul 14 17:32:23.922631 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:32:23.922509 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/74153627-7131-4e58-9aa9-446a2d6d4f4d-tmp\") pod \"kube-auth-proxy-6dfddfddb9-xqn5r\" (UID: \"74153627-7131-4e58-9aa9-446a2d6d4f4d\") " pod="openshift-ingress/kube-auth-proxy-6dfddfddb9-xqn5r" Jul 14 17:32:23.922670 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:32:23.922623 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tz57v\" (UniqueName: \"kubernetes.io/projected/74153627-7131-4e58-9aa9-446a2d6d4f4d-kube-api-access-tz57v\") pod \"kube-auth-proxy-6dfddfddb9-xqn5r\" (UID: \"74153627-7131-4e58-9aa9-446a2d6d4f4d\") " pod="openshift-ingress/kube-auth-proxy-6dfddfddb9-xqn5r" Jul 14 17:32:24.003046 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:32:24.003011 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-sjtz5"] Jul 14 17:32:24.005473 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:32:24.005456 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-sjtz5" Jul 14 17:32:24.008099 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:32:24.008069 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\"" Jul 14 17:32:24.008197 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:32:24.008171 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-xvggk\"" Jul 14 17:32:24.013384 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:32:24.013354 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 17:32:24.019405 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:32:24.019348 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-sjtz5"] Jul 14 17:32:24.024200 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:32:24.024056 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tz57v\" (UniqueName: \"kubernetes.io/projected/74153627-7131-4e58-9aa9-446a2d6d4f4d-kube-api-access-tz57v\") pod \"kube-auth-proxy-6dfddfddb9-xqn5r\" (UID: \"74153627-7131-4e58-9aa9-446a2d6d4f4d\") " pod="openshift-ingress/kube-auth-proxy-6dfddfddb9-xqn5r" Jul 14 17:32:24.024200 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:32:24.024119 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/74153627-7131-4e58-9aa9-446a2d6d4f4d-tls-certs\") pod \"kube-auth-proxy-6dfddfddb9-xqn5r\" (UID: \"74153627-7131-4e58-9aa9-446a2d6d4f4d\") " pod="openshift-ingress/kube-auth-proxy-6dfddfddb9-xqn5r" Jul 14 17:32:24.024200 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:32:24.024156 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/74153627-7131-4e58-9aa9-446a2d6d4f4d-tmp\") pod \"kube-auth-proxy-6dfddfddb9-xqn5r\" (UID: \"74153627-7131-4e58-9aa9-446a2d6d4f4d\") " pod="openshift-ingress/kube-auth-proxy-6dfddfddb9-xqn5r" Jul 14 17:32:24.028137 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:32:24.028115 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/74153627-7131-4e58-9aa9-446a2d6d4f4d-tls-certs\") pod \"kube-auth-proxy-6dfddfddb9-xqn5r\" (UID: \"74153627-7131-4e58-9aa9-446a2d6d4f4d\") " pod="openshift-ingress/kube-auth-proxy-6dfddfddb9-xqn5r" Jul 14 17:32:24.029686 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:32:24.029641 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/74153627-7131-4e58-9aa9-446a2d6d4f4d-tmp\") pod \"kube-auth-proxy-6dfddfddb9-xqn5r\" (UID: \"74153627-7131-4e58-9aa9-446a2d6d4f4d\") " pod="openshift-ingress/kube-auth-proxy-6dfddfddb9-xqn5r" Jul 14 17:32:24.033977 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:32:24.033943 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tz57v\" (UniqueName: \"kubernetes.io/projected/74153627-7131-4e58-9aa9-446a2d6d4f4d-kube-api-access-tz57v\") pod \"kube-auth-proxy-6dfddfddb9-xqn5r\" (UID: \"74153627-7131-4e58-9aa9-446a2d6d4f4d\") " pod="openshift-ingress/kube-auth-proxy-6dfddfddb9-xqn5r" Jul 14 17:32:24.099815 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:32:24.099773 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 17:32:24.125124 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:32:24.125085 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9m6cj\" (UniqueName: \"kubernetes.io/projected/2c067f3c-5c27-4a8e-aead-45a8c3833e28-kube-api-access-9m6cj\") pod \"odh-model-controller-7998c67dc4-sjtz5\" (UID: \"2c067f3c-5c27-4a8e-aead-45a8c3833e28\") " pod="opendatahub/odh-model-controller-7998c67dc4-sjtz5" Jul 14 17:32:24.125298 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:32:24.125269 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2c067f3c-5c27-4a8e-aead-45a8c3833e28-cert\") pod \"odh-model-controller-7998c67dc4-sjtz5\" (UID: \"2c067f3c-5c27-4a8e-aead-45a8c3833e28\") " pod="opendatahub/odh-model-controller-7998c67dc4-sjtz5" Jul 14 17:32:24.171020 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:32:24.170984 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-6dfddfddb9-xqn5r" Jul 14 17:32:24.200772 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:32:24.200238 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 17:32:24.226837 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:32:24.226794 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2c067f3c-5c27-4a8e-aead-45a8c3833e28-cert\") pod \"odh-model-controller-7998c67dc4-sjtz5\" (UID: \"2c067f3c-5c27-4a8e-aead-45a8c3833e28\") " pod="opendatahub/odh-model-controller-7998c67dc4-sjtz5" Jul 14 17:32:24.227061 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:32:24.227026 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9m6cj\" (UniqueName: \"kubernetes.io/projected/2c067f3c-5c27-4a8e-aead-45a8c3833e28-kube-api-access-9m6cj\") pod \"odh-model-controller-7998c67dc4-sjtz5\" (UID: \"2c067f3c-5c27-4a8e-aead-45a8c3833e28\") " pod="opendatahub/odh-model-controller-7998c67dc4-sjtz5" Jul 14 17:32:24.227744 ip-10-0-139-16 kubenswrapper[2552]: E0714 17:32:24.227717 2552 secret.go:189] Couldn't get secret opendatahub/odh-model-controller-webhook-cert: secret "odh-model-controller-webhook-cert" not found Jul 14 17:32:24.227955 ip-10-0-139-16 kubenswrapper[2552]: E0714 17:32:24.227941 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2c067f3c-5c27-4a8e-aead-45a8c3833e28-cert podName:2c067f3c-5c27-4a8e-aead-45a8c3833e28 nodeName:}" failed. No retries permitted until 2026-07-14 17:32:24.7278977 +0000 UTC m=+407.107011635 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/2c067f3c-5c27-4a8e-aead-45a8c3833e28-cert") pod "odh-model-controller-7998c67dc4-sjtz5" (UID: "2c067f3c-5c27-4a8e-aead-45a8c3833e28") : secret "odh-model-controller-webhook-cert" not found Jul 14 17:32:24.241866 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:32:24.241306 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9m6cj\" (UniqueName: \"kubernetes.io/projected/2c067f3c-5c27-4a8e-aead-45a8c3833e28-kube-api-access-9m6cj\") pod \"odh-model-controller-7998c67dc4-sjtz5\" (UID: \"2c067f3c-5c27-4a8e-aead-45a8c3833e28\") " pod="opendatahub/odh-model-controller-7998c67dc4-sjtz5" Jul 14 17:32:24.315795 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:32:24.315657 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-6dfddfddb9-xqn5r"] Jul 14 17:32:24.319297 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:32:24.319242 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod74153627_7131_4e58_9aa9_446a2d6d4f4d.slice/crio-a8bd6074d88dbd9bd1fb21138f54374a8aed5f9a5d69aec5c2386c7794b63f88 WatchSource:0}: Error finding container a8bd6074d88dbd9bd1fb21138f54374a8aed5f9a5d69aec5c2386c7794b63f88: Status 404 returned error can't find the container with id a8bd6074d88dbd9bd1fb21138f54374a8aed5f9a5d69aec5c2386c7794b63f88 Jul 14 17:32:24.376551 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:32:24.376519 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 17:32:24.731745 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:32:24.731715 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2c067f3c-5c27-4a8e-aead-45a8c3833e28-cert\") pod \"odh-model-controller-7998c67dc4-sjtz5\" (UID: \"2c067f3c-5c27-4a8e-aead-45a8c3833e28\") " pod="opendatahub/odh-model-controller-7998c67dc4-sjtz5" Jul 14 17:32:24.734135 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:32:24.734106 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2c067f3c-5c27-4a8e-aead-45a8c3833e28-cert\") pod \"odh-model-controller-7998c67dc4-sjtz5\" (UID: \"2c067f3c-5c27-4a8e-aead-45a8c3833e28\") " pod="opendatahub/odh-model-controller-7998c67dc4-sjtz5" Jul 14 17:32:24.916275 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:32:24.916246 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-sjtz5" Jul 14 17:32:24.927061 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:32:24.927029 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-xfdmk"] Jul 14 17:32:24.929872 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:32:24.929847 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-xfdmk" Jul 14 17:32:24.935048 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:32:24.934991 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 17:32:24.935553 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:32:24.935536 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jul 14 17:32:24.936355 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:32:24.935913 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\"" Jul 14 17:32:24.936355 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:32:24.935939 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-zq6vk\"" Jul 14 17:32:24.936355 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:32:24.936070 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\"" Jul 14 17:32:24.936355 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:32:24.936174 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\"" Jul 14 17:32:24.946774 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:32:24.946755 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-xfdmk"] Jul 14 17:32:25.028504 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:32:25.028383 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 17:32:25.045938 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:32:25.039374 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/6f546650-9207-4a07-9bf8-8aa1b39fac12-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-xfdmk\" (UID: \"6f546650-9207-4a07-9bf8-8aa1b39fac12\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-xfdmk" Jul 14 17:32:25.045938 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:32:25.039417 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dl2cw\" (UniqueName: \"kubernetes.io/projected/6f546650-9207-4a07-9bf8-8aa1b39fac12-kube-api-access-dl2cw\") pod \"istiod-openshift-gateway-7574459656-xfdmk\" (UID: \"6f546650-9207-4a07-9bf8-8aa1b39fac12\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-xfdmk" Jul 14 17:32:25.045938 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:32:25.039457 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/6f546650-9207-4a07-9bf8-8aa1b39fac12-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-xfdmk\" (UID: \"6f546650-9207-4a07-9bf8-8aa1b39fac12\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-xfdmk" Jul 14 17:32:25.045938 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:32:25.039497 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/6f546650-9207-4a07-9bf8-8aa1b39fac12-local-certs\") pod \"istiod-openshift-gateway-7574459656-xfdmk\" (UID: \"6f546650-9207-4a07-9bf8-8aa1b39fac12\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-xfdmk" Jul 14 17:32:25.045938 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:32:25.039523 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/6f546650-9207-4a07-9bf8-8aa1b39fac12-cacerts\") pod \"istiod-openshift-gateway-7574459656-xfdmk\" (UID: \"6f546650-9207-4a07-9bf8-8aa1b39fac12\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-xfdmk" Jul 14 17:32:25.045938 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:32:25.039573 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/6f546650-9207-4a07-9bf8-8aa1b39fac12-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-xfdmk\" (UID: \"6f546650-9207-4a07-9bf8-8aa1b39fac12\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-xfdmk" Jul 14 17:32:25.045938 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:32:25.039616 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6f546650-9207-4a07-9bf8-8aa1b39fac12-istio-token\") pod \"istiod-openshift-gateway-7574459656-xfdmk\" (UID: \"6f546650-9207-4a07-9bf8-8aa1b39fac12\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-xfdmk" Jul 14 17:32:25.088730 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:32:25.088473 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-sjtz5"] Jul 14 17:32:25.119149 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:32:25.119066 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-sjtz5" event={"ID":"2c067f3c-5c27-4a8e-aead-45a8c3833e28","Type":"ContainerStarted","Data":"fe32e2451e71266bc3a086e0c5101385e4c6919411a0534175a68f4fa865f644"} Jul 14 17:32:25.120449 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:32:25.120422 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-6dfddfddb9-xqn5r" event={"ID":"74153627-7131-4e58-9aa9-446a2d6d4f4d","Type":"ContainerStarted","Data":"a8bd6074d88dbd9bd1fb21138f54374a8aed5f9a5d69aec5c2386c7794b63f88"} Jul 14 17:32:25.140506 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:32:25.140474 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/6f546650-9207-4a07-9bf8-8aa1b39fac12-local-certs\") pod \"istiod-openshift-gateway-7574459656-xfdmk\" (UID: \"6f546650-9207-4a07-9bf8-8aa1b39fac12\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-xfdmk" Jul 14 17:32:25.140613 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:32:25.140517 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/6f546650-9207-4a07-9bf8-8aa1b39fac12-cacerts\") pod \"istiod-openshift-gateway-7574459656-xfdmk\" (UID: \"6f546650-9207-4a07-9bf8-8aa1b39fac12\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-xfdmk" Jul 14 17:32:25.140613 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:32:25.140567 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/6f546650-9207-4a07-9bf8-8aa1b39fac12-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-xfdmk\" (UID: \"6f546650-9207-4a07-9bf8-8aa1b39fac12\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-xfdmk" Jul 14 17:32:25.140613 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:32:25.140605 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6f546650-9207-4a07-9bf8-8aa1b39fac12-istio-token\") pod \"istiod-openshift-gateway-7574459656-xfdmk\" (UID: \"6f546650-9207-4a07-9bf8-8aa1b39fac12\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-xfdmk" Jul 14 17:32:25.140766 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:32:25.140669 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/6f546650-9207-4a07-9bf8-8aa1b39fac12-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-xfdmk\" (UID: \"6f546650-9207-4a07-9bf8-8aa1b39fac12\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-xfdmk" Jul 14 17:32:25.140766 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:32:25.140693 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dl2cw\" (UniqueName: \"kubernetes.io/projected/6f546650-9207-4a07-9bf8-8aa1b39fac12-kube-api-access-dl2cw\") pod \"istiod-openshift-gateway-7574459656-xfdmk\" (UID: \"6f546650-9207-4a07-9bf8-8aa1b39fac12\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-xfdmk" Jul 14 17:32:25.140766 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:32:25.140723 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/6f546650-9207-4a07-9bf8-8aa1b39fac12-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-xfdmk\" (UID: \"6f546650-9207-4a07-9bf8-8aa1b39fac12\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-xfdmk" Jul 14 17:32:25.141843 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:32:25.141816 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/6f546650-9207-4a07-9bf8-8aa1b39fac12-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-xfdmk\" (UID: \"6f546650-9207-4a07-9bf8-8aa1b39fac12\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-xfdmk" Jul 14 17:32:25.144636 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:32:25.144613 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/6f546650-9207-4a07-9bf8-8aa1b39fac12-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-xfdmk\" (UID: \"6f546650-9207-4a07-9bf8-8aa1b39fac12\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-xfdmk" Jul 14 17:32:25.144976 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:32:25.144952 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/6f546650-9207-4a07-9bf8-8aa1b39fac12-cacerts\") pod \"istiod-openshift-gateway-7574459656-xfdmk\" (UID: \"6f546650-9207-4a07-9bf8-8aa1b39fac12\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-xfdmk" Jul 14 17:32:25.145275 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:32:25.145222 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/6f546650-9207-4a07-9bf8-8aa1b39fac12-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-xfdmk\" (UID: \"6f546650-9207-4a07-9bf8-8aa1b39fac12\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-xfdmk" Jul 14 17:32:25.145275 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:32:25.145229 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/6f546650-9207-4a07-9bf8-8aa1b39fac12-local-certs\") pod \"istiod-openshift-gateway-7574459656-xfdmk\" (UID: \"6f546650-9207-4a07-9bf8-8aa1b39fac12\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-xfdmk" Jul 14 17:32:25.150845 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:32:25.150792 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dl2cw\" (UniqueName: \"kubernetes.io/projected/6f546650-9207-4a07-9bf8-8aa1b39fac12-kube-api-access-dl2cw\") pod \"istiod-openshift-gateway-7574459656-xfdmk\" (UID: \"6f546650-9207-4a07-9bf8-8aa1b39fac12\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-xfdmk" Jul 14 17:32:25.151919 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:32:25.151898 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6f546650-9207-4a07-9bf8-8aa1b39fac12-istio-token\") pod \"istiod-openshift-gateway-7574459656-xfdmk\" (UID: \"6f546650-9207-4a07-9bf8-8aa1b39fac12\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-xfdmk" Jul 14 17:32:25.245362 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:32:25.245304 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-xfdmk" Jul 14 17:32:25.265085 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:32:25.264988 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 17:32:25.393560 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:32:25.393524 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-xfdmk"] Jul 14 17:32:25.396662 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:32:25.396627 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6f546650_9207_4a07_9bf8_8aa1b39fac12.slice/crio-17c074c5e89bada90da526dc867c5dcf6bfff3eb30fe93faa625acabe100dc10 WatchSource:0}: Error finding container 17c074c5e89bada90da526dc867c5dcf6bfff3eb30fe93faa625acabe100dc10: Status 404 returned error can't find the container with id 17c074c5e89bada90da526dc867c5dcf6bfff3eb30fe93faa625acabe100dc10 Jul 14 17:32:25.986752 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:32:25.986716 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 17:32:26.128288 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:32:26.128246 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-xfdmk" event={"ID":"6f546650-9207-4a07-9bf8-8aa1b39fac12","Type":"ContainerStarted","Data":"17c074c5e89bada90da526dc867c5dcf6bfff3eb30fe93faa625acabe100dc10"} Jul 14 17:32:29.145798 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:32:29.145768 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-6dfddfddb9-xqn5r" event={"ID":"74153627-7131-4e58-9aa9-446a2d6d4f4d","Type":"ContainerStarted","Data":"6a99250326239e131b706374bc82038a7c69f9349369a7b3952d5c7b636966f1"} Jul 14 17:32:29.147341 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:32:29.147307 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-sjtz5" event={"ID":"2c067f3c-5c27-4a8e-aead-45a8c3833e28","Type":"ContainerStarted","Data":"13398d4d4fb2b044a95d774d1587d59a1758b8926866e0b5ecee9fa66c4e6184"} Jul 14 17:32:29.147461 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:32:29.147380 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-7998c67dc4-sjtz5" Jul 14 17:32:29.163001 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:32:29.162954 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-6dfddfddb9-xqn5r" podStartSLOduration=1.889951632 podStartE2EDuration="6.162939592s" totalImagesPullingTime="4.27298796s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 17:32:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 17:32:29.161147141 +0000 UTC m=+411.540261093" watchObservedRunningTime="2026-07-14 17:32:29.162939592 +0000 UTC m=+411.542053544" Jul 14 17:32:29.178907 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:32:29.178856 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/odh-model-controller-7998c67dc4-sjtz5" podStartSLOduration=2.654307755 podStartE2EDuration="6.178842044s" totalImagesPullingTime="3.524534289s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 17:32:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 17:32:29.176275576 +0000 UTC m=+411.555389532" watchObservedRunningTime="2026-07-14 17:32:29.178842044 +0000 UTC m=+411.557955992" Jul 14 17:32:32.067430 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:32:32.067369 2552 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 14 17:32:32.067748 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:32:32.067475 2552 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 14 17:32:32.161957 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:32:32.161925 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-xfdmk" event={"ID":"6f546650-9207-4a07-9bf8-8aa1b39fac12","Type":"ContainerStarted","Data":"75c129ae032e3aabc7bf6a10d0e90320c7fa36aed0ccf21846b3048ecdc33d26"} Jul 14 17:32:32.162137 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:32:32.162016 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-7574459656-xfdmk" Jul 14 17:32:32.186654 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:32:32.186602 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-7574459656-xfdmk" podStartSLOduration=1.519035342 podStartE2EDuration="8.18658782s" totalImagesPullingTime="6.667552478s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 17:32:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 17:32:32.183881573 +0000 UTC m=+414.562995519" watchObservedRunningTime="2026-07-14 17:32:32.18658782 +0000 UTC m=+414.565701772" Jul 14 17:32:33.173973 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:32:33.173915 2552 patch_prober.go:28] interesting pod/istiod-openshift-gateway-7574459656-xfdmk container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Jul 14 17:32:33.174643 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:32:33.174598 2552 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-7574459656-xfdmk" podUID="6f546650-9207-4a07-9bf8-8aa1b39fac12" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 14 17:32:33.417119 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:32:33.417084 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 17:32:33.553712 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:32:33.553681 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-548557588-qzxnw"] Jul 14 17:32:33.556178 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:32:33.556157 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-548557588-qzxnw" Jul 14 17:32:33.560474 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:32:33.560434 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-95f6x\"" Jul 14 17:32:33.565556 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:32:33.565531 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 17:32:33.577408 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:32:33.577388 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-548557588-qzxnw"] Jul 14 17:32:33.651566 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:32:33.651518 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 17:32:33.720115 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:32:33.720081 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1af36c8e-537c-4ac2-ac13-158d1355387f-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-548557588-qzxnw\" (UID: \"1af36c8e-537c-4ac2-ac13-158d1355387f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-548557588-qzxnw" Jul 14 17:32:33.720270 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:32:33.720123 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1af36c8e-537c-4ac2-ac13-158d1355387f-istio-data\") pod \"data-science-gateway-data-science-gateway-class-548557588-qzxnw\" (UID: \"1af36c8e-537c-4ac2-ac13-158d1355387f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-548557588-qzxnw" Jul 14 17:32:33.720270 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:32:33.720156 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1af36c8e-537c-4ac2-ac13-158d1355387f-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-548557588-qzxnw\" (UID: \"1af36c8e-537c-4ac2-ac13-158d1355387f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-548557588-qzxnw" Jul 14 17:32:33.720270 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:32:33.720222 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1af36c8e-537c-4ac2-ac13-158d1355387f-istio-token\") pod \"data-science-gateway-data-science-gateway-class-548557588-qzxnw\" (UID: \"1af36c8e-537c-4ac2-ac13-158d1355387f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-548557588-qzxnw" Jul 14 17:32:33.720270 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:32:33.720250 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4tgcf\" (UniqueName: \"kubernetes.io/projected/1af36c8e-537c-4ac2-ac13-158d1355387f-kube-api-access-4tgcf\") pod \"data-science-gateway-data-science-gateway-class-548557588-qzxnw\" (UID: \"1af36c8e-537c-4ac2-ac13-158d1355387f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-548557588-qzxnw" Jul 14 17:32:33.720270 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:32:33.720270 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1af36c8e-537c-4ac2-ac13-158d1355387f-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-548557588-qzxnw\" (UID: \"1af36c8e-537c-4ac2-ac13-158d1355387f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-548557588-qzxnw" Jul 14 17:32:33.720502 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:32:33.720310 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1af36c8e-537c-4ac2-ac13-158d1355387f-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-548557588-qzxnw\" (UID: \"1af36c8e-537c-4ac2-ac13-158d1355387f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-548557588-qzxnw" Jul 14 17:32:33.720502 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:32:33.720380 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1af36c8e-537c-4ac2-ac13-158d1355387f-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-548557588-qzxnw\" (UID: \"1af36c8e-537c-4ac2-ac13-158d1355387f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-548557588-qzxnw" Jul 14 17:32:33.720502 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:32:33.720409 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1af36c8e-537c-4ac2-ac13-158d1355387f-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-548557588-qzxnw\" (UID: \"1af36c8e-537c-4ac2-ac13-158d1355387f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-548557588-qzxnw" Jul 14 17:32:33.821476 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:32:33.821387 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1af36c8e-537c-4ac2-ac13-158d1355387f-istio-token\") pod \"data-science-gateway-data-science-gateway-class-548557588-qzxnw\" (UID: \"1af36c8e-537c-4ac2-ac13-158d1355387f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-548557588-qzxnw" Jul 14 17:32:33.821698 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:32:33.821678 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4tgcf\" (UniqueName: \"kubernetes.io/projected/1af36c8e-537c-4ac2-ac13-158d1355387f-kube-api-access-4tgcf\") pod \"data-science-gateway-data-science-gateway-class-548557588-qzxnw\" (UID: \"1af36c8e-537c-4ac2-ac13-158d1355387f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-548557588-qzxnw" Jul 14 17:32:33.821809 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:32:33.821795 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1af36c8e-537c-4ac2-ac13-158d1355387f-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-548557588-qzxnw\" (UID: \"1af36c8e-537c-4ac2-ac13-158d1355387f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-548557588-qzxnw" Jul 14 17:32:33.821913 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:32:33.821901 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1af36c8e-537c-4ac2-ac13-158d1355387f-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-548557588-qzxnw\" (UID: \"1af36c8e-537c-4ac2-ac13-158d1355387f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-548557588-qzxnw" Jul 14 17:32:33.822798 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:32:33.822770 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1af36c8e-537c-4ac2-ac13-158d1355387f-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-548557588-qzxnw\" (UID: \"1af36c8e-537c-4ac2-ac13-158d1355387f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-548557588-qzxnw" Jul 14 17:32:33.823219 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:32:33.823200 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1af36c8e-537c-4ac2-ac13-158d1355387f-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-548557588-qzxnw\" (UID: \"1af36c8e-537c-4ac2-ac13-158d1355387f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-548557588-qzxnw" Jul 14 17:32:33.823462 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:32:33.823016 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1af36c8e-537c-4ac2-ac13-158d1355387f-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-548557588-qzxnw\" (UID: \"1af36c8e-537c-4ac2-ac13-158d1355387f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-548557588-qzxnw" Jul 14 17:32:33.823618 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:32:33.823504 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1af36c8e-537c-4ac2-ac13-158d1355387f-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-548557588-qzxnw\" (UID: \"1af36c8e-537c-4ac2-ac13-158d1355387f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-548557588-qzxnw" Jul 14 17:32:33.823708 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:32:33.822794 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1af36c8e-537c-4ac2-ac13-158d1355387f-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-548557588-qzxnw\" (UID: \"1af36c8e-537c-4ac2-ac13-158d1355387f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-548557588-qzxnw" Jul 14 17:32:33.823792 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:32:33.823527 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1af36c8e-537c-4ac2-ac13-158d1355387f-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-548557588-qzxnw\" (UID: \"1af36c8e-537c-4ac2-ac13-158d1355387f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-548557588-qzxnw" Jul 14 17:32:33.823919 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:32:33.823901 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1af36c8e-537c-4ac2-ac13-158d1355387f-istio-data\") pod \"data-science-gateway-data-science-gateway-class-548557588-qzxnw\" (UID: \"1af36c8e-537c-4ac2-ac13-158d1355387f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-548557588-qzxnw" Jul 14 17:32:33.824303 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:32:33.824279 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1af36c8e-537c-4ac2-ac13-158d1355387f-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-548557588-qzxnw\" (UID: \"1af36c8e-537c-4ac2-ac13-158d1355387f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-548557588-qzxnw" Jul 14 17:32:33.824411 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:32:33.824244 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1af36c8e-537c-4ac2-ac13-158d1355387f-istio-data\") pod \"data-science-gateway-data-science-gateway-class-548557588-qzxnw\" (UID: \"1af36c8e-537c-4ac2-ac13-158d1355387f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-548557588-qzxnw" Jul 14 17:32:33.824508 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:32:33.824488 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1af36c8e-537c-4ac2-ac13-158d1355387f-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-548557588-qzxnw\" (UID: \"1af36c8e-537c-4ac2-ac13-158d1355387f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-548557588-qzxnw" Jul 14 17:32:33.827500 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:32:33.827476 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1af36c8e-537c-4ac2-ac13-158d1355387f-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-548557588-qzxnw\" (UID: \"1af36c8e-537c-4ac2-ac13-158d1355387f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-548557588-qzxnw" Jul 14 17:32:33.837583 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:32:33.837516 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1af36c8e-537c-4ac2-ac13-158d1355387f-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-548557588-qzxnw\" (UID: \"1af36c8e-537c-4ac2-ac13-158d1355387f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-548557588-qzxnw" Jul 14 17:32:33.840771 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:32:33.840747 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4tgcf\" (UniqueName: \"kubernetes.io/projected/1af36c8e-537c-4ac2-ac13-158d1355387f-kube-api-access-4tgcf\") pod \"data-science-gateway-data-science-gateway-class-548557588-qzxnw\" (UID: \"1af36c8e-537c-4ac2-ac13-158d1355387f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-548557588-qzxnw" Jul 14 17:32:33.841218 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:32:33.841185 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1af36c8e-537c-4ac2-ac13-158d1355387f-istio-token\") pod \"data-science-gateway-data-science-gateway-class-548557588-qzxnw\" (UID: \"1af36c8e-537c-4ac2-ac13-158d1355387f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-548557588-qzxnw" Jul 14 17:32:33.867987 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:32:33.867962 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-548557588-qzxnw" Jul 14 17:32:34.006229 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:32:34.006202 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-548557588-qzxnw"] Jul 14 17:32:34.008500 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:32:34.008473 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1af36c8e_537c_4ac2_ac13_158d1355387f.slice/crio-3259f5de12b2400eebfd9d85cc8dd94d0f25f29cdd64bb1bb790eceb8a4383f9 WatchSource:0}: Error finding container 3259f5de12b2400eebfd9d85cc8dd94d0f25f29cdd64bb1bb790eceb8a4383f9: Status 404 returned error can't find the container with id 3259f5de12b2400eebfd9d85cc8dd94d0f25f29cdd64bb1bb790eceb8a4383f9 Jul 14 17:32:34.008823 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:32:34.008796 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 17:32:34.177029 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:32:34.176952 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-548557588-qzxnw" event={"ID":"1af36c8e-537c-4ac2-ac13-158d1355387f","Type":"ContainerStarted","Data":"3259f5de12b2400eebfd9d85cc8dd94d0f25f29cdd64bb1bb790eceb8a4383f9"} Jul 14 17:32:34.244499 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:32:34.244468 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 17:32:34.553766 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:32:34.553164 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 17:32:34.636220 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:32:34.634663 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-mb6zl"] Jul 14 17:32:34.637607 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:32:34.637584 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-mb6zl" Jul 14 17:32:34.642151 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:32:34.642126 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-qv9zs\"" Jul 14 17:32:34.642425 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:32:34.642409 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\"" Jul 14 17:32:34.659843 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:32:34.659818 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-mb6zl"] Jul 14 17:32:34.681846 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:32:34.681795 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 17:32:34.734109 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:32:34.734078 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-whfwz\" (UniqueName: \"kubernetes.io/projected/2b0ae02a-da46-4ba3-a091-d4e0ded190e2-kube-api-access-whfwz\") pod \"kserve-controller-manager-d6f4b65b8-mb6zl\" (UID: \"2b0ae02a-da46-4ba3-a091-d4e0ded190e2\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-mb6zl" Jul 14 17:32:34.734250 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:32:34.734147 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2b0ae02a-da46-4ba3-a091-d4e0ded190e2-cert\") pod \"kserve-controller-manager-d6f4b65b8-mb6zl\" (UID: \"2b0ae02a-da46-4ba3-a091-d4e0ded190e2\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-mb6zl" Jul 14 17:32:34.835226 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:32:34.835143 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2b0ae02a-da46-4ba3-a091-d4e0ded190e2-cert\") pod \"kserve-controller-manager-d6f4b65b8-mb6zl\" (UID: \"2b0ae02a-da46-4ba3-a091-d4e0ded190e2\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-mb6zl" Jul 14 17:32:34.835406 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:32:34.835245 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-whfwz\" (UniqueName: \"kubernetes.io/projected/2b0ae02a-da46-4ba3-a091-d4e0ded190e2-kube-api-access-whfwz\") pod \"kserve-controller-manager-d6f4b65b8-mb6zl\" (UID: \"2b0ae02a-da46-4ba3-a091-d4e0ded190e2\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-mb6zl" Jul 14 17:32:34.835406 ip-10-0-139-16 kubenswrapper[2552]: E0714 17:32:34.835277 2552 secret.go:189] Couldn't get secret opendatahub/kserve-webhook-server-cert: secret "kserve-webhook-server-cert" not found Jul 14 17:32:34.835525 ip-10-0-139-16 kubenswrapper[2552]: E0714 17:32:34.835439 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2b0ae02a-da46-4ba3-a091-d4e0ded190e2-cert podName:2b0ae02a-da46-4ba3-a091-d4e0ded190e2 nodeName:}" failed. No retries permitted until 2026-07-14 17:32:35.335416389 +0000 UTC m=+417.714530322 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/2b0ae02a-da46-4ba3-a091-d4e0ded190e2-cert") pod "kserve-controller-manager-d6f4b65b8-mb6zl" (UID: "2b0ae02a-da46-4ba3-a091-d4e0ded190e2") : secret "kserve-webhook-server-cert" not found Jul 14 17:32:34.857065 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:32:34.857031 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-whfwz\" (UniqueName: \"kubernetes.io/projected/2b0ae02a-da46-4ba3-a091-d4e0ded190e2-kube-api-access-whfwz\") pod \"kserve-controller-manager-d6f4b65b8-mb6zl\" (UID: \"2b0ae02a-da46-4ba3-a091-d4e0ded190e2\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-mb6zl" Jul 14 17:32:34.978252 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:32:34.978217 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 17:32:35.084992 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:32:35.084947 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 17:32:35.319303 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:32:35.319275 2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-xfdmk"] Jul 14 17:32:35.320160 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:32:35.319523 2552 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/istiod-openshift-gateway-7574459656-xfdmk" podUID="6f546650-9207-4a07-9bf8-8aa1b39fac12" containerName="discovery" containerID="cri-o://75c129ae032e3aabc7bf6a10d0e90320c7fa36aed0ccf21846b3048ecdc33d26" gracePeriod=30 Jul 14 17:32:35.320528 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:32:35.320448 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-7574459656-xfdmk" Jul 14 17:32:35.341772 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:32:35.341744 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2b0ae02a-da46-4ba3-a091-d4e0ded190e2-cert\") pod \"kserve-controller-manager-d6f4b65b8-mb6zl\" (UID: \"2b0ae02a-da46-4ba3-a091-d4e0ded190e2\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-mb6zl" Jul 14 17:32:35.344300 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:32:35.344280 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2b0ae02a-da46-4ba3-a091-d4e0ded190e2-cert\") pod \"kserve-controller-manager-d6f4b65b8-mb6zl\" (UID: \"2b0ae02a-da46-4ba3-a091-d4e0ded190e2\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-mb6zl" Jul 14 17:32:35.551820 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:32:35.551786 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-mb6zl" Jul 14 17:32:35.843487 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:32:35.843447 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 17:32:35.979042 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:32:35.978989 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 17:32:36.101254 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:32:36.101171 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 17:32:36.190690 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:32:36.190655 2552 generic.go:356] "Generic (PLEG): container finished" podID="6f546650-9207-4a07-9bf8-8aa1b39fac12" containerID="75c129ae032e3aabc7bf6a10d0e90320c7fa36aed0ccf21846b3048ecdc33d26" exitCode=0 Jul 14 17:32:36.190868 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:32:36.190737 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-xfdmk" event={"ID":"6f546650-9207-4a07-9bf8-8aa1b39fac12","Type":"ContainerDied","Data":"75c129ae032e3aabc7bf6a10d0e90320c7fa36aed0ccf21846b3048ecdc33d26"} Jul 14 17:32:36.522122 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:32:36.522096 2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-xfdmk" Jul 14 17:32:36.571060 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:32:36.571023 2552 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 14 17:32:36.571191 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:32:36.571106 2552 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 14 17:32:36.571191 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:32:36.571149 2552 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 14 17:32:36.654919 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:32:36.654897 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/6f546650-9207-4a07-9bf8-8aa1b39fac12-istio-csr-dns-cert\") pod \"6f546650-9207-4a07-9bf8-8aa1b39fac12\" (UID: \"6f546650-9207-4a07-9bf8-8aa1b39fac12\") " Jul 14 17:32:36.655062 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:32:36.654930 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/6f546650-9207-4a07-9bf8-8aa1b39fac12-local-certs\") pod \"6f546650-9207-4a07-9bf8-8aa1b39fac12\" (UID: \"6f546650-9207-4a07-9bf8-8aa1b39fac12\") " Jul 14 17:32:36.655062 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:32:36.654978 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dl2cw\" (UniqueName: \"kubernetes.io/projected/6f546650-9207-4a07-9bf8-8aa1b39fac12-kube-api-access-dl2cw\") pod \"6f546650-9207-4a07-9bf8-8aa1b39fac12\" (UID: \"6f546650-9207-4a07-9bf8-8aa1b39fac12\") " Jul 14 17:32:36.655062 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:32:36.655010 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/6f546650-9207-4a07-9bf8-8aa1b39fac12-istio-kubeconfig\") pod \"6f546650-9207-4a07-9bf8-8aa1b39fac12\" (UID: \"6f546650-9207-4a07-9bf8-8aa1b39fac12\") " Jul 14 17:32:36.655062 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:32:36.655052 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6f546650-9207-4a07-9bf8-8aa1b39fac12-istio-token\") pod \"6f546650-9207-4a07-9bf8-8aa1b39fac12\" (UID: \"6f546650-9207-4a07-9bf8-8aa1b39fac12\") " Jul 14 17:32:36.655267 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:32:36.655092 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/6f546650-9207-4a07-9bf8-8aa1b39fac12-istio-csr-ca-configmap\") pod \"6f546650-9207-4a07-9bf8-8aa1b39fac12\" (UID: \"6f546650-9207-4a07-9bf8-8aa1b39fac12\") " Jul 14 17:32:36.655267 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:32:36.655127 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/6f546650-9207-4a07-9bf8-8aa1b39fac12-cacerts\") pod \"6f546650-9207-4a07-9bf8-8aa1b39fac12\" (UID: \"6f546650-9207-4a07-9bf8-8aa1b39fac12\") " Jul 14 17:32:36.655700 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:32:36.655644 2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6f546650-9207-4a07-9bf8-8aa1b39fac12-istio-csr-ca-configmap" (OuterVolumeSpecName: "istio-csr-ca-configmap") pod "6f546650-9207-4a07-9bf8-8aa1b39fac12" (UID: "6f546650-9207-4a07-9bf8-8aa1b39fac12"). InnerVolumeSpecName "istio-csr-ca-configmap". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 14 17:32:36.657625 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:32:36.657596 2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6f546650-9207-4a07-9bf8-8aa1b39fac12-local-certs" (OuterVolumeSpecName: "local-certs") pod "6f546650-9207-4a07-9bf8-8aa1b39fac12" (UID: "6f546650-9207-4a07-9bf8-8aa1b39fac12"). InnerVolumeSpecName "local-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 14 17:32:36.657718 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:32:36.657628 2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6f546650-9207-4a07-9bf8-8aa1b39fac12-kube-api-access-dl2cw" (OuterVolumeSpecName: "kube-api-access-dl2cw") pod "6f546650-9207-4a07-9bf8-8aa1b39fac12" (UID: "6f546650-9207-4a07-9bf8-8aa1b39fac12"). InnerVolumeSpecName "kube-api-access-dl2cw". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 14 17:32:36.657718 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:32:36.657621 2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6f546650-9207-4a07-9bf8-8aa1b39fac12-cacerts" (OuterVolumeSpecName: "cacerts") pod "6f546650-9207-4a07-9bf8-8aa1b39fac12" (UID: "6f546650-9207-4a07-9bf8-8aa1b39fac12"). InnerVolumeSpecName "cacerts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 14 17:32:36.657718 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:32:36.657629 2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6f546650-9207-4a07-9bf8-8aa1b39fac12-istio-csr-dns-cert" (OuterVolumeSpecName: "istio-csr-dns-cert") pod "6f546650-9207-4a07-9bf8-8aa1b39fac12" (UID: "6f546650-9207-4a07-9bf8-8aa1b39fac12"). InnerVolumeSpecName "istio-csr-dns-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 14 17:32:36.658031 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:32:36.658011 2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6f546650-9207-4a07-9bf8-8aa1b39fac12-istio-kubeconfig" (OuterVolumeSpecName: "istio-kubeconfig") pod "6f546650-9207-4a07-9bf8-8aa1b39fac12" (UID: "6f546650-9207-4a07-9bf8-8aa1b39fac12"). InnerVolumeSpecName "istio-kubeconfig". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 14 17:32:36.658210 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:32:36.658186 2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6f546650-9207-4a07-9bf8-8aa1b39fac12-istio-token" (OuterVolumeSpecName: "istio-token") pod "6f546650-9207-4a07-9bf8-8aa1b39fac12" (UID: "6f546650-9207-4a07-9bf8-8aa1b39fac12"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 14 17:32:36.666703 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:32:36.666683 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-mb6zl"] Jul 14 17:32:36.669905 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:32:36.669868 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2b0ae02a_da46_4ba3_a091_d4e0ded190e2.slice/crio-84ce0e42378bb7f3bb14b8b8c44c7ea1d5a21999aaa2bed2b53103e76cbac2d5 WatchSource:0}: Error finding container 84ce0e42378bb7f3bb14b8b8c44c7ea1d5a21999aaa2bed2b53103e76cbac2d5: Status 404 returned error can't find the container with id 84ce0e42378bb7f3bb14b8b8c44c7ea1d5a21999aaa2bed2b53103e76cbac2d5 Jul 14 17:32:36.756075 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:32:36.756003 2552 reconciler_common.go:299] "Volume detached for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/6f546650-9207-4a07-9bf8-8aa1b39fac12-istio-csr-dns-cert\") on node \"ip-10-0-139-16.ec2.internal\" DevicePath \"\"" Jul 14 17:32:36.756075 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:32:36.756027 2552 reconciler_common.go:299] "Volume detached for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/6f546650-9207-4a07-9bf8-8aa1b39fac12-local-certs\") on node \"ip-10-0-139-16.ec2.internal\" DevicePath \"\"" Jul 14 17:32:36.756075 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:32:36.756037 2552 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dl2cw\" (UniqueName: \"kubernetes.io/projected/6f546650-9207-4a07-9bf8-8aa1b39fac12-kube-api-access-dl2cw\") on node \"ip-10-0-139-16.ec2.internal\" DevicePath \"\"" Jul 14 17:32:36.756075 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:32:36.756047 2552 reconciler_common.go:299] "Volume detached for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/6f546650-9207-4a07-9bf8-8aa1b39fac12-istio-kubeconfig\") on node \"ip-10-0-139-16.ec2.internal\" DevicePath \"\"" Jul 14 17:32:36.756075 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:32:36.756055 2552 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6f546650-9207-4a07-9bf8-8aa1b39fac12-istio-token\") on node \"ip-10-0-139-16.ec2.internal\" DevicePath \"\"" Jul 14 17:32:36.756075 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:32:36.756065 2552 reconciler_common.go:299] "Volume detached for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/6f546650-9207-4a07-9bf8-8aa1b39fac12-istio-csr-ca-configmap\") on node \"ip-10-0-139-16.ec2.internal\" DevicePath \"\"" Jul 14 17:32:36.756075 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:32:36.756074 2552 reconciler_common.go:299] "Volume detached for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/6f546650-9207-4a07-9bf8-8aa1b39fac12-cacerts\") on node \"ip-10-0-139-16.ec2.internal\" DevicePath \"\"" Jul 14 17:32:37.196922 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:32:37.196840 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-548557588-qzxnw" event={"ID":"1af36c8e-537c-4ac2-ac13-158d1355387f","Type":"ContainerStarted","Data":"6ddc3ca2630ed21ace7ef1adf183229089b05270b1b50de15e051389064bf678"} Jul 14 17:32:37.198065 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:32:37.198037 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-mb6zl" event={"ID":"2b0ae02a-da46-4ba3-a091-d4e0ded190e2","Type":"ContainerStarted","Data":"84ce0e42378bb7f3bb14b8b8c44c7ea1d5a21999aaa2bed2b53103e76cbac2d5"} Jul 14 17:32:37.199280 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:32:37.199257 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-xfdmk" event={"ID":"6f546650-9207-4a07-9bf8-8aa1b39fac12","Type":"ContainerDied","Data":"17c074c5e89bada90da526dc867c5dcf6bfff3eb30fe93faa625acabe100dc10"} Jul 14 17:32:37.199444 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:32:37.199289 2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-xfdmk" Jul 14 17:32:37.199444 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:32:37.199300 2552 scope.go:117] "RemoveContainer" containerID="75c129ae032e3aabc7bf6a10d0e90320c7fa36aed0ccf21846b3048ecdc33d26" Jul 14 17:32:37.220779 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:32:37.220736 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-548557588-qzxnw" podStartSLOduration=1.660440513 podStartE2EDuration="4.220721905s" totalImagesPullingTime="2.560281392s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 17:32:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 17:32:37.218828162 +0000 UTC m=+419.597942113" watchObservedRunningTime="2026-07-14 17:32:37.220721905 +0000 UTC m=+419.599835930" Jul 14 17:32:37.232475 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:32:37.232448 2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-xfdmk"] Jul 14 17:32:37.236972 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:32:37.236950 2552 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-xfdmk"] Jul 14 17:32:37.868581 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:32:37.868543 2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-548557588-qzxnw" Jul 14 17:32:37.869879 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:32:37.869847 2552 patch_prober.go:28] interesting pod/data-science-gateway-data-science-gateway-class-548557588-qzxnw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.29:15021/healthz/ready\": dial tcp 10.132.0.29:15021: connect: connection refused" start-of-body= Jul 14 17:32:37.870003 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:32:37.869904 2552 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-548557588-qzxnw" podUID="1af36c8e-537c-4ac2-ac13-158d1355387f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.29:15021/healthz/ready\": dial tcp 10.132.0.29:15021: connect: connection refused" Jul 14 17:32:38.388210 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:32:38.388181 2552 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6f546650-9207-4a07-9bf8-8aa1b39fac12" path="/var/lib/kubelet/pods/6f546650-9207-4a07-9bf8-8aa1b39fac12/volumes" Jul 14 17:32:38.700933 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:32:38.700852 2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-548557588-qzxnw"] Jul 14 17:32:38.869270 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:32:38.869234 2552 patch_prober.go:28] interesting pod/data-science-gateway-data-science-gateway-class-548557588-qzxnw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.29:15021/healthz/ready\": dial tcp 10.132.0.29:15021: connect: connection refused" start-of-body= Jul 14 17:32:38.869731 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:32:38.869299 2552 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-548557588-qzxnw" podUID="1af36c8e-537c-4ac2-ac13-158d1355387f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.29:15021/healthz/ready\": dial tcp 10.132.0.29:15021: connect: connection refused" Jul 14 17:32:39.869317 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:32:39.869282 2552 patch_prober.go:28] interesting pod/data-science-gateway-data-science-gateway-class-548557588-qzxnw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.29:15021/healthz/ready\": dial tcp 10.132.0.29:15021: connect: connection refused" start-of-body= Jul 14 17:32:39.869717 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:32:39.869365 2552 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-548557588-qzxnw" podUID="1af36c8e-537c-4ac2-ac13-158d1355387f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.29:15021/healthz/ready\": dial tcp 10.132.0.29:15021: connect: connection refused" Jul 14 17:32:40.154006 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:32:40.153928 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-7998c67dc4-sjtz5" Jul 14 17:32:40.216952 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:32:40.216915 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-mb6zl" event={"ID":"2b0ae02a-da46-4ba3-a091-d4e0ded190e2","Type":"ContainerStarted","Data":"2f5a821c7580f1a1c699d53dc502e368ded02f5c7876ecff7c1b2e649cf5a923"} Jul 14 17:32:40.217125 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:32:40.217075 2552 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-548557588-qzxnw" podUID="1af36c8e-537c-4ac2-ac13-158d1355387f" containerName="istio-proxy" containerID="cri-o://6ddc3ca2630ed21ace7ef1adf183229089b05270b1b50de15e051389064bf678" gracePeriod=30 Jul 14 17:32:40.217186 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:32:40.217144 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-mb6zl" Jul 14 17:32:40.250745 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:32:40.250700 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-d6f4b65b8-mb6zl" podStartSLOduration=3.539949387 podStartE2EDuration="6.250685695s" totalImagesPullingTime="2.710736308s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 17:32:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 17:32:40.248979342 +0000 UTC m=+422.628093307" watchObservedRunningTime="2026-07-14 17:32:40.250685695 +0000 UTC m=+422.629799667" Jul 14 17:32:45.472997 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:32:45.472972 2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-548557588-qzxnw" Jul 14 17:32:45.629842 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:32:45.629752 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1af36c8e-537c-4ac2-ac13-158d1355387f-istio-podinfo\") pod \"1af36c8e-537c-4ac2-ac13-158d1355387f\" (UID: \"1af36c8e-537c-4ac2-ac13-158d1355387f\") " Jul 14 17:32:45.629842 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:32:45.629795 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1af36c8e-537c-4ac2-ac13-158d1355387f-istio-envoy\") pod \"1af36c8e-537c-4ac2-ac13-158d1355387f\" (UID: \"1af36c8e-537c-4ac2-ac13-158d1355387f\") " Jul 14 17:32:45.629842 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:32:45.629820 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1af36c8e-537c-4ac2-ac13-158d1355387f-istio-data\") pod \"1af36c8e-537c-4ac2-ac13-158d1355387f\" (UID: \"1af36c8e-537c-4ac2-ac13-158d1355387f\") " Jul 14 17:32:45.630099 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:32:45.629863 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1af36c8e-537c-4ac2-ac13-158d1355387f-workload-certs\") pod \"1af36c8e-537c-4ac2-ac13-158d1355387f\" (UID: \"1af36c8e-537c-4ac2-ac13-158d1355387f\") " Jul 14 17:32:45.630099 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:32:45.629911 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1af36c8e-537c-4ac2-ac13-158d1355387f-credential-socket\") pod \"1af36c8e-537c-4ac2-ac13-158d1355387f\" (UID: \"1af36c8e-537c-4ac2-ac13-158d1355387f\") " Jul 14 17:32:45.630099 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:32:45.629953 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1af36c8e-537c-4ac2-ac13-158d1355387f-istiod-ca-cert\") pod \"1af36c8e-537c-4ac2-ac13-158d1355387f\" (UID: \"1af36c8e-537c-4ac2-ac13-158d1355387f\") " Jul 14 17:32:45.630099 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:32:45.629998 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1af36c8e-537c-4ac2-ac13-158d1355387f-istio-token\") pod \"1af36c8e-537c-4ac2-ac13-158d1355387f\" (UID: \"1af36c8e-537c-4ac2-ac13-158d1355387f\") " Jul 14 17:32:45.630099 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:32:45.630020 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1af36c8e-537c-4ac2-ac13-158d1355387f-workload-socket\") pod \"1af36c8e-537c-4ac2-ac13-158d1355387f\" (UID: \"1af36c8e-537c-4ac2-ac13-158d1355387f\") " Jul 14 17:32:45.630099 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:32:45.630045 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4tgcf\" (UniqueName: \"kubernetes.io/projected/1af36c8e-537c-4ac2-ac13-158d1355387f-kube-api-access-4tgcf\") pod \"1af36c8e-537c-4ac2-ac13-158d1355387f\" (UID: \"1af36c8e-537c-4ac2-ac13-158d1355387f\") " Jul 14 17:32:45.630737 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:32:45.630501 2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1af36c8e-537c-4ac2-ac13-158d1355387f-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "1af36c8e-537c-4ac2-ac13-158d1355387f" (UID: "1af36c8e-537c-4ac2-ac13-158d1355387f"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 14 17:32:45.630737 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:32:45.630508 2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1af36c8e-537c-4ac2-ac13-158d1355387f-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "1af36c8e-537c-4ac2-ac13-158d1355387f" (UID: "1af36c8e-537c-4ac2-ac13-158d1355387f"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 14 17:32:45.630737 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:32:45.630689 2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1af36c8e-537c-4ac2-ac13-158d1355387f-istio-data" (OuterVolumeSpecName: "istio-data") pod "1af36c8e-537c-4ac2-ac13-158d1355387f" (UID: "1af36c8e-537c-4ac2-ac13-158d1355387f"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 14 17:32:45.630956 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:32:45.630742 2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1af36c8e-537c-4ac2-ac13-158d1355387f-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "1af36c8e-537c-4ac2-ac13-158d1355387f" (UID: "1af36c8e-537c-4ac2-ac13-158d1355387f"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 14 17:32:45.630956 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:32:45.630813 2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1af36c8e-537c-4ac2-ac13-158d1355387f-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "1af36c8e-537c-4ac2-ac13-158d1355387f" (UID: "1af36c8e-537c-4ac2-ac13-158d1355387f"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 14 17:32:45.632588 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:32:45.632567 2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1af36c8e-537c-4ac2-ac13-158d1355387f-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "1af36c8e-537c-4ac2-ac13-158d1355387f" (UID: "1af36c8e-537c-4ac2-ac13-158d1355387f"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 14 17:32:45.632705 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:32:45.632606 2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1af36c8e-537c-4ac2-ac13-158d1355387f-kube-api-access-4tgcf" (OuterVolumeSpecName: "kube-api-access-4tgcf") pod "1af36c8e-537c-4ac2-ac13-158d1355387f" (UID: "1af36c8e-537c-4ac2-ac13-158d1355387f"). InnerVolumeSpecName "kube-api-access-4tgcf". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 14 17:32:45.633017 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:32:45.632996 2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/1af36c8e-537c-4ac2-ac13-158d1355387f-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "1af36c8e-537c-4ac2-ac13-158d1355387f" (UID: "1af36c8e-537c-4ac2-ac13-158d1355387f"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 14 17:32:45.633017 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:32:45.633003 2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1af36c8e-537c-4ac2-ac13-158d1355387f-istio-token" (OuterVolumeSpecName: "istio-token") pod "1af36c8e-537c-4ac2-ac13-158d1355387f" (UID: "1af36c8e-537c-4ac2-ac13-158d1355387f"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 14 17:32:45.731209 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:32:45.731171 2552 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1af36c8e-537c-4ac2-ac13-158d1355387f-istiod-ca-cert\") on node \"ip-10-0-139-16.ec2.internal\" DevicePath \"\"" Jul 14 17:32:45.731209 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:32:45.731196 2552 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1af36c8e-537c-4ac2-ac13-158d1355387f-istio-token\") on node \"ip-10-0-139-16.ec2.internal\" DevicePath \"\"" Jul 14 17:32:45.731209 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:32:45.731206 2552 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1af36c8e-537c-4ac2-ac13-158d1355387f-workload-socket\") on node \"ip-10-0-139-16.ec2.internal\" DevicePath \"\"" Jul 14 17:32:45.731209 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:32:45.731216 2552 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4tgcf\" (UniqueName: \"kubernetes.io/projected/1af36c8e-537c-4ac2-ac13-158d1355387f-kube-api-access-4tgcf\") on node \"ip-10-0-139-16.ec2.internal\" DevicePath \"\"" Jul 14 17:32:45.731480 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:32:45.731225 2552 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1af36c8e-537c-4ac2-ac13-158d1355387f-istio-podinfo\") on node \"ip-10-0-139-16.ec2.internal\" DevicePath \"\"" Jul 14 17:32:45.731480 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:32:45.731233 2552 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1af36c8e-537c-4ac2-ac13-158d1355387f-istio-envoy\") on node \"ip-10-0-139-16.ec2.internal\" DevicePath \"\"" Jul 14 17:32:45.731480 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:32:45.731240 2552 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1af36c8e-537c-4ac2-ac13-158d1355387f-istio-data\") on node \"ip-10-0-139-16.ec2.internal\" DevicePath \"\"" Jul 14 17:32:45.731480 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:32:45.731248 2552 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1af36c8e-537c-4ac2-ac13-158d1355387f-workload-certs\") on node \"ip-10-0-139-16.ec2.internal\" DevicePath \"\"" Jul 14 17:32:45.731480 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:32:45.731255 2552 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1af36c8e-537c-4ac2-ac13-158d1355387f-credential-socket\") on node \"ip-10-0-139-16.ec2.internal\" DevicePath \"\"" Jul 14 17:32:46.245201 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:32:46.245168 2552 generic.go:356] "Generic (PLEG): container finished" podID="1af36c8e-537c-4ac2-ac13-158d1355387f" containerID="6ddc3ca2630ed21ace7ef1adf183229089b05270b1b50de15e051389064bf678" exitCode=0 Jul 14 17:32:46.245400 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:32:46.245213 2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-548557588-qzxnw" Jul 14 17:32:46.245400 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:32:46.245265 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-548557588-qzxnw" event={"ID":"1af36c8e-537c-4ac2-ac13-158d1355387f","Type":"ContainerDied","Data":"6ddc3ca2630ed21ace7ef1adf183229089b05270b1b50de15e051389064bf678"} Jul 14 17:32:46.245400 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:32:46.245311 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-548557588-qzxnw" event={"ID":"1af36c8e-537c-4ac2-ac13-158d1355387f","Type":"ContainerDied","Data":"3259f5de12b2400eebfd9d85cc8dd94d0f25f29cdd64bb1bb790eceb8a4383f9"} Jul 14 17:32:46.245400 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:32:46.245351 2552 scope.go:117] "RemoveContainer" containerID="6ddc3ca2630ed21ace7ef1adf183229089b05270b1b50de15e051389064bf678" Jul 14 17:32:46.254534 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:32:46.254512 2552 scope.go:117] "RemoveContainer" containerID="6ddc3ca2630ed21ace7ef1adf183229089b05270b1b50de15e051389064bf678" Jul 14 17:32:46.254775 ip-10-0-139-16 kubenswrapper[2552]: E0714 17:32:46.254757 2552 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6ddc3ca2630ed21ace7ef1adf183229089b05270b1b50de15e051389064bf678\": container with ID starting with 6ddc3ca2630ed21ace7ef1adf183229089b05270b1b50de15e051389064bf678 not found: ID does not exist" containerID="6ddc3ca2630ed21ace7ef1adf183229089b05270b1b50de15e051389064bf678" Jul 14 17:32:46.254830 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:32:46.254788 2552 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6ddc3ca2630ed21ace7ef1adf183229089b05270b1b50de15e051389064bf678"} err="failed to get container status \"6ddc3ca2630ed21ace7ef1adf183229089b05270b1b50de15e051389064bf678\": rpc error: code = NotFound desc = could not find container \"6ddc3ca2630ed21ace7ef1adf183229089b05270b1b50de15e051389064bf678\": container with ID starting with 6ddc3ca2630ed21ace7ef1adf183229089b05270b1b50de15e051389064bf678 not found: ID does not exist" Jul 14 17:32:46.266722 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:32:46.266699 2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-548557588-qzxnw"] Jul 14 17:32:46.274391 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:32:46.272198 2552 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-548557588-qzxnw"] Jul 14 17:32:46.387833 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:32:46.387797 2552 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1af36c8e-537c-4ac2-ac13-158d1355387f" path="/var/lib/kubelet/pods/1af36c8e-537c-4ac2-ac13-158d1355387f/volumes" Jul 14 17:33:11.227628 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:33:11.227553 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-mb6zl" Jul 14 17:33:14.695554 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:33:14.695522 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 17:33:24.694041 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:33:24.694001 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 17:33:24.790527 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:33:24.790494 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 17:33:24.822439 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:33:24.822407 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-frxkb"] Jul 14 17:33:24.822722 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:33:24.822709 2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6f546650-9207-4a07-9bf8-8aa1b39fac12" containerName="discovery" Jul 14 17:33:24.822786 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:33:24.822724 2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="6f546650-9207-4a07-9bf8-8aa1b39fac12" containerName="discovery" Jul 14 17:33:24.822786 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:33:24.822745 2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1af36c8e-537c-4ac2-ac13-158d1355387f" containerName="istio-proxy" Jul 14 17:33:24.822786 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:33:24.822751 2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="1af36c8e-537c-4ac2-ac13-158d1355387f" containerName="istio-proxy" Jul 14 17:33:24.822885 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:33:24.822798 2552 memory_manager.go:368] "RemoveStaleState removing state" podUID="6f546650-9207-4a07-9bf8-8aa1b39fac12" containerName="discovery" Jul 14 17:33:24.822885 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:33:24.822807 2552 memory_manager.go:368] "RemoveStaleState removing state" podUID="1af36c8e-537c-4ac2-ac13-158d1355387f" containerName="istio-proxy" Jul 14 17:33:24.830949 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:33:24.830927 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-frxkb" Jul 14 17:33:24.835416 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:33:24.835385 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jul 14 17:33:24.835657 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:33:24.835636 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-catalog-dockercfg-bbv9v\"" Jul 14 17:33:24.835953 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:33:24.835932 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jul 14 17:33:24.837265 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:33:24.837246 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-frxkb"] Jul 14 17:33:24.954597 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:33:24.954516 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lfvp5\" (UniqueName: \"kubernetes.io/projected/bf962252-006f-46a8-bdbf-9377641d3e35-kube-api-access-lfvp5\") pod \"kuadrant-operator-catalog-frxkb\" (UID: \"bf962252-006f-46a8-bdbf-9377641d3e35\") " pod="kuadrant-system/kuadrant-operator-catalog-frxkb" Jul 14 17:33:25.054947 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:33:25.054909 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lfvp5\" (UniqueName: \"kubernetes.io/projected/bf962252-006f-46a8-bdbf-9377641d3e35-kube-api-access-lfvp5\") pod \"kuadrant-operator-catalog-frxkb\" (UID: \"bf962252-006f-46a8-bdbf-9377641d3e35\") " pod="kuadrant-system/kuadrant-operator-catalog-frxkb" Jul 14 17:33:25.063703 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:33:25.063670 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lfvp5\" (UniqueName: \"kubernetes.io/projected/bf962252-006f-46a8-bdbf-9377641d3e35-kube-api-access-lfvp5\") pod \"kuadrant-operator-catalog-frxkb\" (UID: \"bf962252-006f-46a8-bdbf-9377641d3e35\") " pod="kuadrant-system/kuadrant-operator-catalog-frxkb" Jul 14 17:33:25.148838 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:33:25.148808 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-frxkb" Jul 14 17:33:25.175137 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:33:25.175111 2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-frxkb"] Jul 14 17:33:25.278659 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:33:25.278627 2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-frxkb"] Jul 14 17:33:25.282059 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:33:25.282024 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbf962252_006f_46a8_bdbf_9377641d3e35.slice/crio-fd645f1edc685d456732cbe74d3177e3ffd358d352ff9c0aadaada898e7730d6 WatchSource:0}: Error finding container fd645f1edc685d456732cbe74d3177e3ffd358d352ff9c0aadaada898e7730d6: Status 404 returned error can't find the container with id fd645f1edc685d456732cbe74d3177e3ffd358d352ff9c0aadaada898e7730d6 Jul 14 17:33:25.386162 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:33:25.386127 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-t79zt"] Jul 14 17:33:25.388903 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:33:25.388886 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-t79zt" Jul 14 17:33:25.397920 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:33:25.397889 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-t79zt"] Jul 14 17:33:25.411833 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:33:25.411805 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-frxkb" event={"ID":"bf962252-006f-46a8-bdbf-9377641d3e35","Type":"ContainerStarted","Data":"fd645f1edc685d456732cbe74d3177e3ffd358d352ff9c0aadaada898e7730d6"} Jul 14 17:33:25.459554 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:33:25.459516 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xv6g6\" (UniqueName: \"kubernetes.io/projected/a122f0fa-fe4a-47d6-842f-280a7cd439c9-kube-api-access-xv6g6\") pod \"kuadrant-operator-catalog-t79zt\" (UID: \"a122f0fa-fe4a-47d6-842f-280a7cd439c9\") " pod="kuadrant-system/kuadrant-operator-catalog-t79zt" Jul 14 17:33:25.550908 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:33:25.550833 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 17:33:25.560698 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:33:25.560673 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xv6g6\" (UniqueName: \"kubernetes.io/projected/a122f0fa-fe4a-47d6-842f-280a7cd439c9-kube-api-access-xv6g6\") pod \"kuadrant-operator-catalog-t79zt\" (UID: \"a122f0fa-fe4a-47d6-842f-280a7cd439c9\") " pod="kuadrant-system/kuadrant-operator-catalog-t79zt" Jul 14 17:33:25.568608 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:33:25.568592 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xv6g6\" (UniqueName: \"kubernetes.io/projected/a122f0fa-fe4a-47d6-842f-280a7cd439c9-kube-api-access-xv6g6\") pod \"kuadrant-operator-catalog-t79zt\" (UID: \"a122f0fa-fe4a-47d6-842f-280a7cd439c9\") " pod="kuadrant-system/kuadrant-operator-catalog-t79zt" Jul 14 17:33:25.698632 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:33:25.698605 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-t79zt" Jul 14 17:33:25.824730 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:33:25.824704 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-t79zt"] Jul 14 17:33:25.826650 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:33:25.826610 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda122f0fa_fe4a_47d6_842f_280a7cd439c9.slice/crio-756a11e938759b30cf40b9ff5968a34f22e66e57aa93043b26711e05ee2baa01 WatchSource:0}: Error finding container 756a11e938759b30cf40b9ff5968a34f22e66e57aa93043b26711e05ee2baa01: Status 404 returned error can't find the container with id 756a11e938759b30cf40b9ff5968a34f22e66e57aa93043b26711e05ee2baa01 Jul 14 17:33:26.417272 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:33:26.417239 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-t79zt" event={"ID":"a122f0fa-fe4a-47d6-842f-280a7cd439c9","Type":"ContainerStarted","Data":"756a11e938759b30cf40b9ff5968a34f22e66e57aa93043b26711e05ee2baa01"} Jul 14 17:33:28.428271 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:33:28.428232 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-frxkb" event={"ID":"bf962252-006f-46a8-bdbf-9377641d3e35","Type":"ContainerStarted","Data":"818ff83b12e95828a3dbcb2093c5d0938d51bac211f1022dbce64903f368c2ac"} Jul 14 17:33:28.428772 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:33:28.428262 2552 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-catalog-frxkb" podUID="bf962252-006f-46a8-bdbf-9377641d3e35" containerName="registry-server" containerID="cri-o://818ff83b12e95828a3dbcb2093c5d0938d51bac211f1022dbce64903f368c2ac" gracePeriod=2 Jul 14 17:33:28.429717 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:33:28.429694 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-t79zt" event={"ID":"a122f0fa-fe4a-47d6-842f-280a7cd439c9","Type":"ContainerStarted","Data":"89b6dace25ded1a1a2e5277d4093786d8dd472ddf89724ed54fe545cf825e95a"} Jul 14 17:33:28.445205 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:33:28.445164 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-frxkb" podStartSLOduration=1.787721959 podStartE2EDuration="4.445150694s" totalImagesPullingTime="2.657428735s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 17:33:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 17:33:28.443789552 +0000 UTC m=+470.822903516" watchObservedRunningTime="2026-07-14 17:33:28.445150694 +0000 UTC m=+470.824264645" Jul 14 17:33:28.459476 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:33:28.459435 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-t79zt" podStartSLOduration=1.349595235 podStartE2EDuration="3.4594233s" totalImagesPullingTime="2.109828065s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 17:33:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 17:33:28.458008497 +0000 UTC m=+470.837122449" watchObservedRunningTime="2026-07-14 17:33:28.4594233 +0000 UTC m=+470.838537252" Jul 14 17:33:28.671871 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:33:28.671849 2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-frxkb" Jul 14 17:33:28.789586 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:33:28.789556 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lfvp5\" (UniqueName: \"kubernetes.io/projected/bf962252-006f-46a8-bdbf-9377641d3e35-kube-api-access-lfvp5\") pod \"bf962252-006f-46a8-bdbf-9377641d3e35\" (UID: \"bf962252-006f-46a8-bdbf-9377641d3e35\") " Jul 14 17:33:28.791682 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:33:28.791654 2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bf962252-006f-46a8-bdbf-9377641d3e35-kube-api-access-lfvp5" (OuterVolumeSpecName: "kube-api-access-lfvp5") pod "bf962252-006f-46a8-bdbf-9377641d3e35" (UID: "bf962252-006f-46a8-bdbf-9377641d3e35"). InnerVolumeSpecName "kube-api-access-lfvp5". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 14 17:33:28.890505 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:33:28.890478 2552 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lfvp5\" (UniqueName: \"kubernetes.io/projected/bf962252-006f-46a8-bdbf-9377641d3e35-kube-api-access-lfvp5\") on node \"ip-10-0-139-16.ec2.internal\" DevicePath \"\"" Jul 14 17:33:29.435222 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:33:29.435190 2552 generic.go:356] "Generic (PLEG): container finished" podID="bf962252-006f-46a8-bdbf-9377641d3e35" containerID="818ff83b12e95828a3dbcb2093c5d0938d51bac211f1022dbce64903f368c2ac" exitCode=0 Jul 14 17:33:29.435695 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:33:29.435229 2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-frxkb" Jul 14 17:33:29.435695 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:33:29.435275 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-frxkb" event={"ID":"bf962252-006f-46a8-bdbf-9377641d3e35","Type":"ContainerDied","Data":"818ff83b12e95828a3dbcb2093c5d0938d51bac211f1022dbce64903f368c2ac"} Jul 14 17:33:29.435695 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:33:29.435347 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-frxkb" event={"ID":"bf962252-006f-46a8-bdbf-9377641d3e35","Type":"ContainerDied","Data":"fd645f1edc685d456732cbe74d3177e3ffd358d352ff9c0aadaada898e7730d6"} Jul 14 17:33:29.435695 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:33:29.435380 2552 scope.go:117] "RemoveContainer" containerID="818ff83b12e95828a3dbcb2093c5d0938d51bac211f1022dbce64903f368c2ac" Jul 14 17:33:29.446454 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:33:29.446430 2552 scope.go:117] "RemoveContainer" containerID="818ff83b12e95828a3dbcb2093c5d0938d51bac211f1022dbce64903f368c2ac" Jul 14 17:33:29.446767 ip-10-0-139-16 kubenswrapper[2552]: E0714 17:33:29.446735 2552 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"818ff83b12e95828a3dbcb2093c5d0938d51bac211f1022dbce64903f368c2ac\": container with ID starting with 818ff83b12e95828a3dbcb2093c5d0938d51bac211f1022dbce64903f368c2ac not found: ID does not exist" containerID="818ff83b12e95828a3dbcb2093c5d0938d51bac211f1022dbce64903f368c2ac" Jul 14 17:33:29.446829 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:33:29.446779 2552 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"818ff83b12e95828a3dbcb2093c5d0938d51bac211f1022dbce64903f368c2ac"} err="failed to get container status \"818ff83b12e95828a3dbcb2093c5d0938d51bac211f1022dbce64903f368c2ac\": rpc error: code = NotFound desc = could not find container \"818ff83b12e95828a3dbcb2093c5d0938d51bac211f1022dbce64903f368c2ac\": container with ID starting with 818ff83b12e95828a3dbcb2093c5d0938d51bac211f1022dbce64903f368c2ac not found: ID does not exist" Jul 14 17:33:29.462385 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:33:29.462360 2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-frxkb"] Jul 14 17:33:29.468586 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:33:29.468566 2552 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-frxkb"] Jul 14 17:33:30.388033 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:33:30.387992 2552 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bf962252-006f-46a8-bdbf-9377641d3e35" path="/var/lib/kubelet/pods/bf962252-006f-46a8-bdbf-9377641d3e35/volumes" Jul 14 17:33:35.699200 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:33:35.699166 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-catalog-t79zt" Jul 14 17:33:35.699604 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:33:35.699225 2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kuadrant-system/kuadrant-operator-catalog-t79zt" Jul 14 17:33:35.721732 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:33:35.721708 2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kuadrant-system/kuadrant-operator-catalog-t79zt" Jul 14 17:33:36.486661 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:33:36.486630 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-catalog-t79zt" Jul 14 17:33:39.086527 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:33:39.086478 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 17:33:39.234908 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:33:39.234882 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 17:33:39.834129 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:33:39.834092 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 17:33:39.934136 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:33:39.934090 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 17:33:49.787437 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:33:49.787401 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 17:33:49.889112 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:33:49.889079 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 17:33:49.989420 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:33:49.989384 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 17:33:54.013016 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:33:54.012973 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 17:33:56.656014 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:33:56.655979 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-kp9dq"] Jul 14 17:33:56.656389 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:33:56.656285 2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bf962252-006f-46a8-bdbf-9377641d3e35" containerName="registry-server" Jul 14 17:33:56.656389 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:33:56.656296 2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="bf962252-006f-46a8-bdbf-9377641d3e35" containerName="registry-server" Jul 14 17:33:56.656389 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:33:56.656386 2552 memory_manager.go:368] "RemoveStaleState removing state" podUID="bf962252-006f-46a8-bdbf-9377641d3e35" containerName="registry-server" Jul 14 17:33:56.660397 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:33:56.660377 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-kp9dq" Jul 14 17:33:56.664174 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:33:56.664154 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\"" Jul 14 17:33:56.664273 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:33:56.664181 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-sjghd\"" Jul 14 17:33:56.679308 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:33:56.679286 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-kp9dq"] Jul 14 17:33:56.710146 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:33:56.710120 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s6xpt\" (UniqueName: \"kubernetes.io/projected/c031b503-06a2-4cd3-8d09-6ff2c9b9f022-kube-api-access-s6xpt\") pod \"dns-operator-controller-manager-864dd78c4c-kp9dq\" (UID: \"c031b503-06a2-4cd3-8d09-6ff2c9b9f022\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-kp9dq" Jul 14 17:33:56.811318 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:33:56.811285 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s6xpt\" (UniqueName: \"kubernetes.io/projected/c031b503-06a2-4cd3-8d09-6ff2c9b9f022-kube-api-access-s6xpt\") pod \"dns-operator-controller-manager-864dd78c4c-kp9dq\" (UID: \"c031b503-06a2-4cd3-8d09-6ff2c9b9f022\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-kp9dq" Jul 14 17:33:56.819913 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:33:56.819889 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s6xpt\" (UniqueName: \"kubernetes.io/projected/c031b503-06a2-4cd3-8d09-6ff2c9b9f022-kube-api-access-s6xpt\") pod \"dns-operator-controller-manager-864dd78c4c-kp9dq\" (UID: \"c031b503-06a2-4cd3-8d09-6ff2c9b9f022\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-kp9dq" Jul 14 17:33:56.970309 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:33:56.970281 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-kp9dq" Jul 14 17:33:57.111591 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:33:57.111531 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-kp9dq"] Jul 14 17:33:57.554396 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:33:57.554363 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-kp9dq" event={"ID":"c031b503-06a2-4cd3-8d09-6ff2c9b9f022","Type":"ContainerStarted","Data":"276d710d43333391d1801ed40de861ccfc3e76eea2c7f965024a635cc2a4a278"} Jul 14 17:33:58.260617 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:33:58.260566 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 17:34:00.100740 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:34:00.100701 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-lwrpc"] Jul 14 17:34:00.104398 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:34:00.104376 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-lwrpc" Jul 14 17:34:00.107032 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:34:00.107013 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-tbbxc\"" Jul 14 17:34:00.113805 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:34:00.113782 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-lwrpc"] Jul 14 17:34:00.132642 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:34:00.132611 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2flwb\" (UniqueName: \"kubernetes.io/projected/01fed35d-69fc-4e29-86b3-765feb1d78c9-kube-api-access-2flwb\") pod \"limitador-operator-controller-manager-859d7b78bd-lwrpc\" (UID: \"01fed35d-69fc-4e29-86b3-765feb1d78c9\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-lwrpc" Jul 14 17:34:00.233742 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:34:00.233712 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2flwb\" (UniqueName: \"kubernetes.io/projected/01fed35d-69fc-4e29-86b3-765feb1d78c9-kube-api-access-2flwb\") pod \"limitador-operator-controller-manager-859d7b78bd-lwrpc\" (UID: \"01fed35d-69fc-4e29-86b3-765feb1d78c9\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-lwrpc" Jul 14 17:34:00.246565 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:34:00.246494 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2flwb\" (UniqueName: \"kubernetes.io/projected/01fed35d-69fc-4e29-86b3-765feb1d78c9-kube-api-access-2flwb\") pod \"limitador-operator-controller-manager-859d7b78bd-lwrpc\" (UID: \"01fed35d-69fc-4e29-86b3-765feb1d78c9\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-lwrpc" Jul 14 17:34:00.415154 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:34:00.415125 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-lwrpc" Jul 14 17:34:00.541241 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:34:00.541216 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-lwrpc"] Jul 14 17:34:00.543672 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:34:00.543644 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod01fed35d_69fc_4e29_86b3_765feb1d78c9.slice/crio-864715f0d3c484d1a459448c5167c9de1abd46123adfb7076579d7a8ff7b3c74 WatchSource:0}: Error finding container 864715f0d3c484d1a459448c5167c9de1abd46123adfb7076579d7a8ff7b3c74: Status 404 returned error can't find the container with id 864715f0d3c484d1a459448c5167c9de1abd46123adfb7076579d7a8ff7b3c74 Jul 14 17:34:00.569657 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:34:00.569627 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-lwrpc" event={"ID":"01fed35d-69fc-4e29-86b3-765feb1d78c9","Type":"ContainerStarted","Data":"864715f0d3c484d1a459448c5167c9de1abd46123adfb7076579d7a8ff7b3c74"} Jul 14 17:34:00.571033 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:34:00.571011 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-kp9dq" event={"ID":"c031b503-06a2-4cd3-8d09-6ff2c9b9f022","Type":"ContainerStarted","Data":"5973a9f6290fbab4fa21c13888cd0cc2be971a5c9375a981d23839391a487427"} Jul 14 17:34:00.571161 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:34:00.571145 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-kp9dq" Jul 14 17:34:00.721840 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:34:00.721804 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 17:34:00.831186 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:34:00.831100 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 17:34:02.048876 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:34:02.048838 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 17:34:03.592064 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:34:03.592022 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-lwrpc" event={"ID":"01fed35d-69fc-4e29-86b3-765feb1d78c9","Type":"ContainerStarted","Data":"acf4c16ceb3795aa7da33ec7004ee5f25ccab0fecd55ec8b6e29f868f952744e"} Jul 14 17:34:03.592451 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:34:03.592106 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-lwrpc" Jul 14 17:34:03.634734 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:34:03.634683 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-kp9dq" podStartSLOduration=4.758728466 podStartE2EDuration="7.634666874s" totalImagesPullingTime="2.875938408s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 17:33:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 17:34:00.60052053 +0000 UTC m=+502.979634486" watchObservedRunningTime="2026-07-14 17:34:03.634666874 +0000 UTC m=+506.013780826" Jul 14 17:34:03.634904 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:34:03.634766 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-lwrpc" podStartSLOduration=1.601464006 podStartE2EDuration="3.634760555s" totalImagesPullingTime="2.033296549s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 17:34:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 17:34:03.633387163 +0000 UTC m=+506.012501117" watchObservedRunningTime="2026-07-14 17:34:03.634760555 +0000 UTC m=+506.013874507" Jul 14 17:34:05.114649 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:34:05.114612 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-6qmrv"] Jul 14 17:34:05.118066 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:34:05.118048 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-6qmrv" Jul 14 17:34:05.121713 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:34:05.121693 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-kkk56\"" Jul 14 17:34:05.132857 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:34:05.132836 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-6qmrv"] Jul 14 17:34:05.173866 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:34:05.173838 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jljlq\" (UniqueName: \"kubernetes.io/projected/c624f9e0-e945-4f64-8bd3-b223b7c0605b-kube-api-access-jljlq\") pod \"kuadrant-operator-controller-manager-8684c9ff49-6qmrv\" (UID: \"c624f9e0-e945-4f64-8bd3-b223b7c0605b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-6qmrv" Jul 14 17:34:05.174026 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:34:05.173878 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/c624f9e0-e945-4f64-8bd3-b223b7c0605b-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-6qmrv\" (UID: \"c624f9e0-e945-4f64-8bd3-b223b7c0605b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-6qmrv" Jul 14 17:34:05.222788 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:34:05.222754 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 17:34:05.274849 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:34:05.274821 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jljlq\" (UniqueName: \"kubernetes.io/projected/c624f9e0-e945-4f64-8bd3-b223b7c0605b-kube-api-access-jljlq\") pod \"kuadrant-operator-controller-manager-8684c9ff49-6qmrv\" (UID: \"c624f9e0-e945-4f64-8bd3-b223b7c0605b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-6qmrv" Jul 14 17:34:05.274980 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:34:05.274867 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/c624f9e0-e945-4f64-8bd3-b223b7c0605b-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-6qmrv\" (UID: \"c624f9e0-e945-4f64-8bd3-b223b7c0605b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-6qmrv" Jul 14 17:34:05.275284 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:34:05.275266 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/c624f9e0-e945-4f64-8bd3-b223b7c0605b-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-6qmrv\" (UID: \"c624f9e0-e945-4f64-8bd3-b223b7c0605b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-6qmrv" Jul 14 17:34:05.283393 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:34:05.283371 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jljlq\" (UniqueName: \"kubernetes.io/projected/c624f9e0-e945-4f64-8bd3-b223b7c0605b-kube-api-access-jljlq\") pod \"kuadrant-operator-controller-manager-8684c9ff49-6qmrv\" (UID: \"c624f9e0-e945-4f64-8bd3-b223b7c0605b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-6qmrv" Jul 14 17:34:05.428537 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:34:05.428445 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-6qmrv" Jul 14 17:34:05.571367 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:34:05.571343 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-6qmrv"] Jul 14 17:34:05.573570 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:34:05.573545 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc624f9e0_e945_4f64_8bd3_b223b7c0605b.slice/crio-e59914d84c91375e5f6630af478ea8e1be98ee9a64f58e7301d7444ea7a3b6cb WatchSource:0}: Error finding container e59914d84c91375e5f6630af478ea8e1be98ee9a64f58e7301d7444ea7a3b6cb: Status 404 returned error can't find the container with id e59914d84c91375e5f6630af478ea8e1be98ee9a64f58e7301d7444ea7a3b6cb Jul 14 17:34:05.601952 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:34:05.601920 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-6qmrv" event={"ID":"c624f9e0-e945-4f64-8bd3-b223b7c0605b","Type":"ContainerStarted","Data":"e59914d84c91375e5f6630af478ea8e1be98ee9a64f58e7301d7444ea7a3b6cb"} Jul 14 17:34:05.608815 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:34:05.608791 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 17:34:05.921007 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:34:05.920968 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 17:34:08.335020 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:34:08.334989 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-7lg8t"] Jul 14 17:34:08.338280 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:34:08.338264 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-7lg8t" Jul 14 17:34:08.340903 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:34:08.340881 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-mg5vf\"" Jul 14 17:34:08.348533 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:34:08.348367 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-7lg8t"] Jul 14 17:34:08.403750 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:34:08.403706 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gklhx\" (UniqueName: \"kubernetes.io/projected/578c2ea1-4395-42a4-ac6a-aa1bfb847ee9-kube-api-access-gklhx\") pod \"authorino-operator-75cc8d5cb7-7lg8t\" (UID: \"578c2ea1-4395-42a4-ac6a-aa1bfb847ee9\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-7lg8t" Jul 14 17:34:08.504759 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:34:08.504725 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gklhx\" (UniqueName: \"kubernetes.io/projected/578c2ea1-4395-42a4-ac6a-aa1bfb847ee9-kube-api-access-gklhx\") pod \"authorino-operator-75cc8d5cb7-7lg8t\" (UID: \"578c2ea1-4395-42a4-ac6a-aa1bfb847ee9\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-7lg8t" Jul 14 17:34:08.513743 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:34:08.513719 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gklhx\" (UniqueName: \"kubernetes.io/projected/578c2ea1-4395-42a4-ac6a-aa1bfb847ee9-kube-api-access-gklhx\") pod \"authorino-operator-75cc8d5cb7-7lg8t\" (UID: \"578c2ea1-4395-42a4-ac6a-aa1bfb847ee9\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-7lg8t" Jul 14 17:34:08.640451 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:34:08.640359 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 17:34:08.648913 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:34:08.648885 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-7lg8t" Jul 14 17:34:08.832315 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:34:08.832285 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-7lg8t"] Jul 14 17:34:08.834775 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:34:08.834746 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod578c2ea1_4395_42a4_ac6a_aa1bfb847ee9.slice/crio-40e1d5930dceec9164aa3b06c7994cd54c0653ca0475ea6d3dc3e5f2dc1189db WatchSource:0}: Error finding container 40e1d5930dceec9164aa3b06c7994cd54c0653ca0475ea6d3dc3e5f2dc1189db: Status 404 returned error can't find the container with id 40e1d5930dceec9164aa3b06c7994cd54c0653ca0475ea6d3dc3e5f2dc1189db Jul 14 17:34:09.625513 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:34:09.625431 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-7lg8t" event={"ID":"578c2ea1-4395-42a4-ac6a-aa1bfb847ee9","Type":"ContainerStarted","Data":"40e1d5930dceec9164aa3b06c7994cd54c0653ca0475ea6d3dc3e5f2dc1189db"} Jul 14 17:34:10.010118 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:34:10.010055 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 17:34:10.110611 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:34:10.110557 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 17:34:11.583897 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:34:11.583864 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-kp9dq" Jul 14 17:34:12.642409 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:34:12.642308 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-7lg8t" event={"ID":"578c2ea1-4395-42a4-ac6a-aa1bfb847ee9","Type":"ContainerStarted","Data":"80e547f594ee912548ec028063e6b29a007005babc79f845c3a332f76a58fb45"} Jul 14 17:34:12.642810 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:34:12.642469 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-7lg8t" Jul 14 17:34:12.644004 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:34:12.643979 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-6qmrv" event={"ID":"c624f9e0-e945-4f64-8bd3-b223b7c0605b","Type":"ContainerStarted","Data":"a05da223ff9c3c479612d49c86efb5b2cf8774e5539d1a2793591e1fd4261a5f"} Jul 14 17:34:12.644119 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:34:12.644103 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-6qmrv" Jul 14 17:34:12.659454 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:34:12.659413 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-75cc8d5cb7-7lg8t" podStartSLOduration=1.147135649 podStartE2EDuration="4.659399864s" totalImagesPullingTime="3.512264215s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 17:34:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 17:34:12.657567247 +0000 UTC m=+515.036681190" watchObservedRunningTime="2026-07-14 17:34:12.659399864 +0000 UTC m=+515.038513816" Jul 14 17:34:12.675200 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:34:12.675157 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-6qmrv" podStartSLOduration=0.891761817 podStartE2EDuration="7.67514501s" totalImagesPullingTime="6.783383193s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 17:34:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 17:34:12.673573001 +0000 UTC m=+515.052686954" watchObservedRunningTime="2026-07-14 17:34:12.67514501 +0000 UTC m=+515.054258961" Jul 14 17:34:13.883761 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:34:13.883726 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 17:34:13.970216 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:34:13.970181 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 17:34:14.599412 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:34:14.599377 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-lwrpc" Jul 14 17:34:15.213572 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:34:15.213538 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-48sq8"] Jul 14 17:34:15.217023 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:34:15.217006 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-48sq8" Jul 14 17:34:15.220242 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:34:15.220211 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-wbl4l\"" Jul 14 17:34:15.220404 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:34:15.220274 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\"" Jul 14 17:34:15.220404 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:34:15.220273 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\"" Jul 14 17:34:15.227301 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:34:15.227279 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-48sq8"] Jul 14 17:34:15.246895 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:34:15.246865 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 17:34:15.263925 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:34:15.263898 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/8f4d41a0-b4cd-49ef-ae7d-c33708d00839-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-48sq8\" (UID: \"8f4d41a0-b4cd-49ef-ae7d-c33708d00839\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-48sq8" Jul 14 17:34:15.264036 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:34:15.263930 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/8f4d41a0-b4cd-49ef-ae7d-c33708d00839-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-48sq8\" (UID: \"8f4d41a0-b4cd-49ef-ae7d-c33708d00839\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-48sq8" Jul 14 17:34:15.264036 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:34:15.263974 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cqv8j\" (UniqueName: \"kubernetes.io/projected/8f4d41a0-b4cd-49ef-ae7d-c33708d00839-kube-api-access-cqv8j\") pod \"kuadrant-console-plugin-66b5774985-48sq8\" (UID: \"8f4d41a0-b4cd-49ef-ae7d-c33708d00839\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-48sq8" Jul 14 17:34:15.364436 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:34:15.364405 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/8f4d41a0-b4cd-49ef-ae7d-c33708d00839-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-48sq8\" (UID: \"8f4d41a0-b4cd-49ef-ae7d-c33708d00839\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-48sq8" Jul 14 17:34:15.364436 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:34:15.364439 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/8f4d41a0-b4cd-49ef-ae7d-c33708d00839-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-48sq8\" (UID: \"8f4d41a0-b4cd-49ef-ae7d-c33708d00839\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-48sq8" Jul 14 17:34:15.364649 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:34:15.364628 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cqv8j\" (UniqueName: \"kubernetes.io/projected/8f4d41a0-b4cd-49ef-ae7d-c33708d00839-kube-api-access-cqv8j\") pod \"kuadrant-console-plugin-66b5774985-48sq8\" (UID: \"8f4d41a0-b4cd-49ef-ae7d-c33708d00839\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-48sq8" Jul 14 17:34:15.365133 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:34:15.365114 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/8f4d41a0-b4cd-49ef-ae7d-c33708d00839-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-48sq8\" (UID: \"8f4d41a0-b4cd-49ef-ae7d-c33708d00839\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-48sq8" Jul 14 17:34:15.366950 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:34:15.366928 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/8f4d41a0-b4cd-49ef-ae7d-c33708d00839-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-48sq8\" (UID: \"8f4d41a0-b4cd-49ef-ae7d-c33708d00839\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-48sq8" Jul 14 17:34:15.375630 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:34:15.375606 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cqv8j\" (UniqueName: \"kubernetes.io/projected/8f4d41a0-b4cd-49ef-ae7d-c33708d00839-kube-api-access-cqv8j\") pod \"kuadrant-console-plugin-66b5774985-48sq8\" (UID: \"8f4d41a0-b4cd-49ef-ae7d-c33708d00839\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-48sq8" Jul 14 17:34:15.385296 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:34:15.385270 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 17:34:15.527184 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:34:15.527108 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-48sq8" Jul 14 17:34:15.667518 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:34:15.660644 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-48sq8"] Jul 14 17:34:16.668291 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:34:16.668255 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-48sq8" event={"ID":"8f4d41a0-b4cd-49ef-ae7d-c33708d00839","Type":"ContainerStarted","Data":"90329fbfe510db9db117506cf5347da6f362adb33429bc99d8cd2ad14f3df932"} Jul 14 17:34:17.211117 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:34:17.211045 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 17:34:17.311079 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:34:17.311034 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 17:34:23.650960 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:34:23.650931 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-7lg8t" Jul 14 17:34:23.651459 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:34:23.651009 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-6qmrv" Jul 14 17:34:25.453778 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:34:25.453740 2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-6qmrv"] Jul 14 17:34:25.454239 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:34:25.453970 2552 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-6qmrv" podUID="c624f9e0-e945-4f64-8bd3-b223b7c0605b" containerName="manager" containerID="cri-o://a05da223ff9c3c479612d49c86efb5b2cf8774e5539d1a2793591e1fd4261a5f" gracePeriod=2 Jul 14 17:34:25.465783 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:34:25.465704 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-qm7ww"] Jul 14 17:34:25.471574 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:34:25.471530 2552 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-6qmrv"] Jul 14 17:34:25.471726 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:34:25.471703 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-qm7ww" Jul 14 17:34:25.473552 ip-10-0-139-16 kubenswrapper[2552]: E0714 17:34:25.473501 2552 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"c624f9e0-e945-4f64-8bd3-b223b7c0605b\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Initialized\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Ready\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"observedGeneration\\\":2}}\" for pod \"kuadrant-system\"/\"kuadrant-operator-controller-manager-8684c9ff49-6qmrv\": pods \"kuadrant-operator-controller-manager-8684c9ff49-6qmrv\" not found" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-6qmrv" Jul 14 17:34:25.485672 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:34:25.485615 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-qm7ww"] Jul 14 17:34:25.487922 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:34:25.487842 2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-lwrpc"] Jul 14 17:34:25.488133 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:34:25.488061 2552 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-lwrpc" podUID="01fed35d-69fc-4e29-86b3-765feb1d78c9" containerName="manager" containerID="cri-o://acf4c16ceb3795aa7da33ec7004ee5f25ccab0fecd55ec8b6e29f868f952744e" gracePeriod=2 Jul 14 17:34:25.490006 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:34:25.489980 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-ph6l8"] Jul 14 17:34:25.490530 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:34:25.490512 2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c624f9e0-e945-4f64-8bd3-b223b7c0605b" containerName="manager" Jul 14 17:34:25.490660 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:34:25.490648 2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="c624f9e0-e945-4f64-8bd3-b223b7c0605b" containerName="manager" Jul 14 17:34:25.490850 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:34:25.490838 2552 memory_manager.go:368] "RemoveStaleState removing state" podUID="c624f9e0-e945-4f64-8bd3-b223b7c0605b" containerName="manager" Jul 14 17:34:25.495471 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:34:25.495271 2552 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-lwrpc"] Jul 14 17:34:25.495571 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:34:25.495442 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-ph6l8" Jul 14 17:34:25.505194 ip-10-0-139-16 kubenswrapper[2552]: E0714 17:34:25.505162 2552 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-6qmrv\" is forbidden: User \"system:node:ip-10-0-139-16.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-139-16.ec2.internal' and this object" podUID="c624f9e0-e945-4f64-8bd3-b223b7c0605b" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-6qmrv" Jul 14 17:34:25.515814 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:34:25.515765 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-ph6l8"] Jul 14 17:34:25.537420 ip-10-0-139-16 kubenswrapper[2552]: E0714 17:34:25.537369 2552 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-6qmrv\" is forbidden: User \"system:node:ip-10-0-139-16.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-139-16.ec2.internal' and this object" podUID="c624f9e0-e945-4f64-8bd3-b223b7c0605b" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-6qmrv" Jul 14 17:34:25.539430 ip-10-0-139-16 kubenswrapper[2552]: E0714 17:34:25.539397 2552 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-lwrpc\" is forbidden: User \"system:node:ip-10-0-139-16.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-139-16.ec2.internal' and this object" podUID="01fed35d-69fc-4e29-86b3-765feb1d78c9" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-lwrpc" Jul 14 17:34:25.557543 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:34:25.557514 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/984061e4-220f-4872-9d0f-b94f1dfa5aca-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-ph6l8\" (UID: \"984061e4-220f-4872-9d0f-b94f1dfa5aca\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-ph6l8" Jul 14 17:34:25.557678 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:34:25.557606 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-htgvt\" (UniqueName: \"kubernetes.io/projected/984061e4-220f-4872-9d0f-b94f1dfa5aca-kube-api-access-htgvt\") pod \"kuadrant-operator-controller-manager-8684c9ff49-ph6l8\" (UID: \"984061e4-220f-4872-9d0f-b94f1dfa5aca\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-ph6l8" Jul 14 17:34:25.557678 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:34:25.557634 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w98j7\" (UniqueName: \"kubernetes.io/projected/aafb0a2a-9e3a-4324-bf64-acd88d56ec1c-kube-api-access-w98j7\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-qm7ww\" (UID: \"aafb0a2a-9e3a-4324-bf64-acd88d56ec1c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-qm7ww" Jul 14 17:34:25.557678 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:34:25.557664 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/aafb0a2a-9e3a-4324-bf64-acd88d56ec1c-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-qm7ww\" (UID: \"aafb0a2a-9e3a-4324-bf64-acd88d56ec1c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-qm7ww" Jul 14 17:34:25.646036 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:34:25.645998 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 17:34:25.658159 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:34:25.658128 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-htgvt\" (UniqueName: \"kubernetes.io/projected/984061e4-220f-4872-9d0f-b94f1dfa5aca-kube-api-access-htgvt\") pod \"kuadrant-operator-controller-manager-8684c9ff49-ph6l8\" (UID: \"984061e4-220f-4872-9d0f-b94f1dfa5aca\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-ph6l8" Jul 14 17:34:25.658159 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:34:25.658167 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w98j7\" (UniqueName: \"kubernetes.io/projected/aafb0a2a-9e3a-4324-bf64-acd88d56ec1c-kube-api-access-w98j7\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-qm7ww\" (UID: \"aafb0a2a-9e3a-4324-bf64-acd88d56ec1c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-qm7ww" Jul 14 17:34:25.658391 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:34:25.658195 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/aafb0a2a-9e3a-4324-bf64-acd88d56ec1c-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-qm7ww\" (UID: \"aafb0a2a-9e3a-4324-bf64-acd88d56ec1c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-qm7ww" Jul 14 17:34:25.658391 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:34:25.658272 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/984061e4-220f-4872-9d0f-b94f1dfa5aca-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-ph6l8\" (UID: \"984061e4-220f-4872-9d0f-b94f1dfa5aca\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-ph6l8" Jul 14 17:34:25.658672 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:34:25.658635 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/984061e4-220f-4872-9d0f-b94f1dfa5aca-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-ph6l8\" (UID: \"984061e4-220f-4872-9d0f-b94f1dfa5aca\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-ph6l8" Jul 14 17:34:25.658786 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:34:25.658669 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/aafb0a2a-9e3a-4324-bf64-acd88d56ec1c-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-qm7ww\" (UID: \"aafb0a2a-9e3a-4324-bf64-acd88d56ec1c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-qm7ww" Jul 14 17:34:25.667738 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:34:25.667716 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-htgvt\" (UniqueName: \"kubernetes.io/projected/984061e4-220f-4872-9d0f-b94f1dfa5aca-kube-api-access-htgvt\") pod \"kuadrant-operator-controller-manager-8684c9ff49-ph6l8\" (UID: \"984061e4-220f-4872-9d0f-b94f1dfa5aca\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-ph6l8" Jul 14 17:34:25.671409 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:34:25.671391 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w98j7\" (UniqueName: \"kubernetes.io/projected/aafb0a2a-9e3a-4324-bf64-acd88d56ec1c-kube-api-access-w98j7\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-qm7ww\" (UID: \"aafb0a2a-9e3a-4324-bf64-acd88d56ec1c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-qm7ww" Jul 14 17:34:25.764506 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:34:25.764463 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 17:34:25.874715 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:34:25.874683 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-qm7ww" Jul 14 17:34:25.882454 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:34:25.882430 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-ph6l8" Jul 14 17:34:28.144820 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:34:28.144779 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 17:34:28.244820 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:34:28.244780 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 17:34:30.968008 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:34:30.967683 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 17:34:31.073148 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:34:31.073110 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 17:34:34.511262 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:34:34.511221 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 17:34:34.610555 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:34:34.610516 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 17:34:38.715553 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:34:38.715131 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-qm7ww"] Jul 14 17:34:38.719199 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:34:38.719175 2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-lwrpc" Jul 14 17:34:38.720078 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:34:38.720053 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaafb0a2a_9e3a_4324_bf64_acd88d56ec1c.slice/crio-a98405d5087261772f6ced5fb27acc6943cf7aca22478f8ebfe8cf5b449981a2 WatchSource:0}: Error finding container a98405d5087261772f6ced5fb27acc6943cf7aca22478f8ebfe8cf5b449981a2: Status 404 returned error can't find the container with id a98405d5087261772f6ced5fb27acc6943cf7aca22478f8ebfe8cf5b449981a2 Jul 14 17:34:38.721530 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:34:38.721507 2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-6qmrv" Jul 14 17:34:38.721624 ip-10-0-139-16 kubenswrapper[2552]: E0714 17:34:38.721605 2552 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-lwrpc\" is forbidden: User \"system:node:ip-10-0-139-16.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-139-16.ec2.internal' and this object" podUID="01fed35d-69fc-4e29-86b3-765feb1d78c9" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-lwrpc" Jul 14 17:34:38.723632 ip-10-0-139-16 kubenswrapper[2552]: E0714 17:34:38.723596 2552 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-6qmrv\" is forbidden: User \"system:node:ip-10-0-139-16.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-139-16.ec2.internal' and this object" podUID="c624f9e0-e945-4f64-8bd3-b223b7c0605b" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-6qmrv" Jul 14 17:34:38.725534 ip-10-0-139-16 kubenswrapper[2552]: E0714 17:34:38.725502 2552 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-lwrpc\" is forbidden: User \"system:node:ip-10-0-139-16.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-139-16.ec2.internal' and this object" podUID="01fed35d-69fc-4e29-86b3-765feb1d78c9" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-lwrpc" Jul 14 17:34:38.739355 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:34:38.739319 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-ph6l8"] Jul 14 17:34:38.741226 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:34:38.741204 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod984061e4_220f_4872_9d0f_b94f1dfa5aca.slice/crio-0759093c560ee9d1ecfaef212cddbacc1f664647b7fec0f8c1070fec4db4cabe WatchSource:0}: Error finding container 0759093c560ee9d1ecfaef212cddbacc1f664647b7fec0f8c1070fec4db4cabe: Status 404 returned error can't find the container with id 0759093c560ee9d1ecfaef212cddbacc1f664647b7fec0f8c1070fec4db4cabe Jul 14 17:34:38.788291 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:34:38.788268 2552 generic.go:356] "Generic (PLEG): container finished" podID="01fed35d-69fc-4e29-86b3-765feb1d78c9" containerID="acf4c16ceb3795aa7da33ec7004ee5f25ccab0fecd55ec8b6e29f868f952744e" exitCode=0 Jul 14 17:34:38.788396 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:34:38.788340 2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-lwrpc" Jul 14 17:34:38.788396 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:34:38.788385 2552 scope.go:117] "RemoveContainer" containerID="acf4c16ceb3795aa7da33ec7004ee5f25ccab0fecd55ec8b6e29f868f952744e" Jul 14 17:34:38.789796 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:34:38.789773 2552 generic.go:356] "Generic (PLEG): container finished" podID="c624f9e0-e945-4f64-8bd3-b223b7c0605b" containerID="a05da223ff9c3c479612d49c86efb5b2cf8774e5539d1a2793591e1fd4261a5f" exitCode=0 Jul 14 17:34:38.789900 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:34:38.789887 2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-6qmrv" Jul 14 17:34:38.790623 ip-10-0-139-16 kubenswrapper[2552]: E0714 17:34:38.790597 2552 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-6qmrv\" is forbidden: User \"system:node:ip-10-0-139-16.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-139-16.ec2.internal' and this object" podUID="c624f9e0-e945-4f64-8bd3-b223b7c0605b" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-6qmrv" Jul 14 17:34:38.791917 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:34:38.791877 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-ph6l8" event={"ID":"984061e4-220f-4872-9d0f-b94f1dfa5aca","Type":"ContainerStarted","Data":"0759093c560ee9d1ecfaef212cddbacc1f664647b7fec0f8c1070fec4db4cabe"} Jul 14 17:34:38.792869 ip-10-0-139-16 kubenswrapper[2552]: E0714 17:34:38.792784 2552 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-lwrpc\" is forbidden: User \"system:node:ip-10-0-139-16.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-139-16.ec2.internal' and this object" podUID="01fed35d-69fc-4e29-86b3-765feb1d78c9" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-lwrpc" Jul 14 17:34:38.793891 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:34:38.793868 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-qm7ww" event={"ID":"aafb0a2a-9e3a-4324-bf64-acd88d56ec1c","Type":"ContainerStarted","Data":"32c4d9473b91188a42594d76c0a8b43c7228b8e8d089f9a0670ec3f2bef30a32"} Jul 14 17:34:38.794000 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:34:38.793915 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-qm7ww" event={"ID":"aafb0a2a-9e3a-4324-bf64-acd88d56ec1c","Type":"ContainerStarted","Data":"a98405d5087261772f6ced5fb27acc6943cf7aca22478f8ebfe8cf5b449981a2"} Jul 14 17:34:38.794000 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:34:38.793973 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-qm7ww" Jul 14 17:34:38.801403 ip-10-0-139-16 kubenswrapper[2552]: E0714 17:34:38.795259 2552 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-6qmrv\" is forbidden: User \"system:node:ip-10-0-139-16.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-139-16.ec2.internal' and this object" podUID="c624f9e0-e945-4f64-8bd3-b223b7c0605b" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-6qmrv" Jul 14 17:34:38.801403 ip-10-0-139-16 kubenswrapper[2552]: E0714 17:34:38.797644 2552 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-lwrpc\" is forbidden: User \"system:node:ip-10-0-139-16.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-139-16.ec2.internal' and this object" podUID="01fed35d-69fc-4e29-86b3-765feb1d78c9" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-lwrpc" Jul 14 17:34:38.801403 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:34:38.798684 2552 scope.go:117] "RemoveContainer" containerID="acf4c16ceb3795aa7da33ec7004ee5f25ccab0fecd55ec8b6e29f868f952744e" Jul 14 17:34:38.801403 ip-10-0-139-16 kubenswrapper[2552]: E0714 17:34:38.799026 2552 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"acf4c16ceb3795aa7da33ec7004ee5f25ccab0fecd55ec8b6e29f868f952744e\": container with ID starting with acf4c16ceb3795aa7da33ec7004ee5f25ccab0fecd55ec8b6e29f868f952744e not found: ID does not exist" containerID="acf4c16ceb3795aa7da33ec7004ee5f25ccab0fecd55ec8b6e29f868f952744e" Jul 14 17:34:38.801403 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:34:38.799056 2552 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"acf4c16ceb3795aa7da33ec7004ee5f25ccab0fecd55ec8b6e29f868f952744e"} err="failed to get container status \"acf4c16ceb3795aa7da33ec7004ee5f25ccab0fecd55ec8b6e29f868f952744e\": rpc error: code = NotFound desc = could not find container \"acf4c16ceb3795aa7da33ec7004ee5f25ccab0fecd55ec8b6e29f868f952744e\": container with ID starting with acf4c16ceb3795aa7da33ec7004ee5f25ccab0fecd55ec8b6e29f868f952744e not found: ID does not exist" Jul 14 17:34:38.801403 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:34:38.799089 2552 scope.go:117] "RemoveContainer" containerID="a05da223ff9c3c479612d49c86efb5b2cf8774e5539d1a2793591e1fd4261a5f" Jul 14 17:34:38.801403 ip-10-0-139-16 kubenswrapper[2552]: E0714 17:34:38.799709 2552 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-lwrpc\" is forbidden: User \"system:node:ip-10-0-139-16.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-139-16.ec2.internal' and this object" podUID="01fed35d-69fc-4e29-86b3-765feb1d78c9" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-lwrpc" Jul 14 17:34:38.801403 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:34:38.799825 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-48sq8" event={"ID":"8f4d41a0-b4cd-49ef-ae7d-c33708d00839","Type":"ContainerStarted","Data":"46573311c53c93fb313d87b9261566024c0f9add6882b45b9c7eb9d46ab9bbda"} Jul 14 17:34:38.809251 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:34:38.809230 2552 scope.go:117] "RemoveContainer" containerID="a05da223ff9c3c479612d49c86efb5b2cf8774e5539d1a2793591e1fd4261a5f" Jul 14 17:34:38.809536 ip-10-0-139-16 kubenswrapper[2552]: E0714 17:34:38.809506 2552 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a05da223ff9c3c479612d49c86efb5b2cf8774e5539d1a2793591e1fd4261a5f\": container with ID starting with a05da223ff9c3c479612d49c86efb5b2cf8774e5539d1a2793591e1fd4261a5f not found: ID does not exist" containerID="a05da223ff9c3c479612d49c86efb5b2cf8774e5539d1a2793591e1fd4261a5f" Jul 14 17:34:38.809594 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:34:38.809535 2552 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a05da223ff9c3c479612d49c86efb5b2cf8774e5539d1a2793591e1fd4261a5f"} err="failed to get container status \"a05da223ff9c3c479612d49c86efb5b2cf8774e5539d1a2793591e1fd4261a5f\": rpc error: code = NotFound desc = could not find container \"a05da223ff9c3c479612d49c86efb5b2cf8774e5539d1a2793591e1fd4261a5f\": container with ID starting with a05da223ff9c3c479612d49c86efb5b2cf8774e5539d1a2793591e1fd4261a5f not found: ID does not exist" Jul 14 17:34:38.820039 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:34:38.820004 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-qm7ww" podStartSLOduration=13.819992683 podStartE2EDuration="13.819992683s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 17:34:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 17:34:38.819395426 +0000 UTC m=+541.198509375" watchObservedRunningTime="2026-07-14 17:34:38.819992683 +0000 UTC m=+541.199106638" Jul 14 17:34:38.821609 ip-10-0-139-16 kubenswrapper[2552]: E0714 17:34:38.821585 2552 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-6qmrv\" is forbidden: User \"system:node:ip-10-0-139-16.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-139-16.ec2.internal' and this object" podUID="c624f9e0-e945-4f64-8bd3-b223b7c0605b" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-6qmrv" Jul 14 17:34:38.823734 ip-10-0-139-16 kubenswrapper[2552]: E0714 17:34:38.823713 2552 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-6qmrv\" is forbidden: User \"system:node:ip-10-0-139-16.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-139-16.ec2.internal' and this object" podUID="c624f9e0-e945-4f64-8bd3-b223b7c0605b" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-6qmrv" Jul 14 17:34:38.825836 ip-10-0-139-16 kubenswrapper[2552]: E0714 17:34:38.825816 2552 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-lwrpc\" is forbidden: User \"system:node:ip-10-0-139-16.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-139-16.ec2.internal' and this object" podUID="01fed35d-69fc-4e29-86b3-765feb1d78c9" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-lwrpc" Jul 14 17:34:38.842113 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:34:38.842070 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-48sq8" podStartSLOduration=0.881643801 podStartE2EDuration="23.842058133s" totalImagesPullingTime="22.960414332s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 17:34:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 17:34:38.840842578 +0000 UTC m=+541.219956555" watchObservedRunningTime="2026-07-14 17:34:38.842058133 +0000 UTC m=+541.221172085" Jul 14 17:34:38.880981 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:34:38.880957 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/c624f9e0-e945-4f64-8bd3-b223b7c0605b-extensions-socket-volume\") pod \"c624f9e0-e945-4f64-8bd3-b223b7c0605b\" (UID: \"c624f9e0-e945-4f64-8bd3-b223b7c0605b\") " Jul 14 17:34:38.881097 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:34:38.880995 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jljlq\" (UniqueName: \"kubernetes.io/projected/c624f9e0-e945-4f64-8bd3-b223b7c0605b-kube-api-access-jljlq\") pod \"c624f9e0-e945-4f64-8bd3-b223b7c0605b\" (UID: \"c624f9e0-e945-4f64-8bd3-b223b7c0605b\") " Jul 14 17:34:38.881097 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:34:38.881073 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2flwb\" (UniqueName: \"kubernetes.io/projected/01fed35d-69fc-4e29-86b3-765feb1d78c9-kube-api-access-2flwb\") pod \"01fed35d-69fc-4e29-86b3-765feb1d78c9\" (UID: \"01fed35d-69fc-4e29-86b3-765feb1d78c9\") " Jul 14 17:34:38.881563 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:34:38.881532 2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c624f9e0-e945-4f64-8bd3-b223b7c0605b-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "c624f9e0-e945-4f64-8bd3-b223b7c0605b" (UID: "c624f9e0-e945-4f64-8bd3-b223b7c0605b"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 14 17:34:38.883298 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:34:38.883273 2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c624f9e0-e945-4f64-8bd3-b223b7c0605b-kube-api-access-jljlq" (OuterVolumeSpecName: "kube-api-access-jljlq") pod "c624f9e0-e945-4f64-8bd3-b223b7c0605b" (UID: "c624f9e0-e945-4f64-8bd3-b223b7c0605b"). InnerVolumeSpecName "kube-api-access-jljlq". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 14 17:34:38.883427 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:34:38.883374 2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/01fed35d-69fc-4e29-86b3-765feb1d78c9-kube-api-access-2flwb" (OuterVolumeSpecName: "kube-api-access-2flwb") pod "01fed35d-69fc-4e29-86b3-765feb1d78c9" (UID: "01fed35d-69fc-4e29-86b3-765feb1d78c9"). InnerVolumeSpecName "kube-api-access-2flwb". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 14 17:34:38.982045 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:34:38.982009 2552 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/c624f9e0-e945-4f64-8bd3-b223b7c0605b-extensions-socket-volume\") on node \"ip-10-0-139-16.ec2.internal\" DevicePath \"\"" Jul 14 17:34:38.982045 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:34:38.982040 2552 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jljlq\" (UniqueName: \"kubernetes.io/projected/c624f9e0-e945-4f64-8bd3-b223b7c0605b-kube-api-access-jljlq\") on node \"ip-10-0-139-16.ec2.internal\" DevicePath \"\"" Jul 14 17:34:38.982226 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:34:38.982053 2552 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2flwb\" (UniqueName: \"kubernetes.io/projected/01fed35d-69fc-4e29-86b3-765feb1d78c9-kube-api-access-2flwb\") on node \"ip-10-0-139-16.ec2.internal\" DevicePath \"\"" Jul 14 17:34:39.104271 ip-10-0-139-16 kubenswrapper[2552]: E0714 17:34:39.104241 2552 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-6qmrv\" is forbidden: User \"system:node:ip-10-0-139-16.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-139-16.ec2.internal' and this object" podUID="c624f9e0-e945-4f64-8bd3-b223b7c0605b" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-6qmrv" Jul 14 17:34:39.106461 ip-10-0-139-16 kubenswrapper[2552]: E0714 17:34:39.106438 2552 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-lwrpc\" is forbidden: User \"system:node:ip-10-0-139-16.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-139-16.ec2.internal' and this object" podUID="01fed35d-69fc-4e29-86b3-765feb1d78c9" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-lwrpc" Jul 14 17:34:39.108703 ip-10-0-139-16 kubenswrapper[2552]: E0714 17:34:39.108665 2552 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-6qmrv\" is forbidden: User \"system:node:ip-10-0-139-16.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-139-16.ec2.internal' and this object" podUID="c624f9e0-e945-4f64-8bd3-b223b7c0605b" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-6qmrv" Jul 14 17:34:39.110539 ip-10-0-139-16 kubenswrapper[2552]: E0714 17:34:39.110518 2552 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-lwrpc\" is forbidden: User \"system:node:ip-10-0-139-16.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-139-16.ec2.internal' and this object" podUID="01fed35d-69fc-4e29-86b3-765feb1d78c9" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-lwrpc" Jul 14 17:34:39.808411 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:34:39.808305 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-ph6l8" event={"ID":"984061e4-220f-4872-9d0f-b94f1dfa5aca","Type":"ContainerStarted","Data":"65ce3e5b25fedff86f3c3a381108d417c44968cd328927fb18c71b1e1a4528a0"} Jul 14 17:34:39.808822 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:34:39.808553 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-ph6l8" Jul 14 17:34:39.811100 ip-10-0-139-16 kubenswrapper[2552]: E0714 17:34:39.811073 2552 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-lwrpc\" is forbidden: User \"system:node:ip-10-0-139-16.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-139-16.ec2.internal' and this object" podUID="01fed35d-69fc-4e29-86b3-765feb1d78c9" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-lwrpc" Jul 14 17:34:39.832008 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:34:39.831956 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-ph6l8" podStartSLOduration=14.831943281000001 podStartE2EDuration="14.831943281s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 17:34:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 17:34:39.829769854 +0000 UTC m=+542.208883808" watchObservedRunningTime="2026-07-14 17:34:39.831943281 +0000 UTC m=+542.211057233" Jul 14 17:34:39.833441 ip-10-0-139-16 kubenswrapper[2552]: E0714 17:34:39.833419 2552 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-6qmrv\" is forbidden: User \"system:node:ip-10-0-139-16.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-139-16.ec2.internal' and this object" podUID="c624f9e0-e945-4f64-8bd3-b223b7c0605b" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-6qmrv" Jul 14 17:34:40.388380 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:34:40.388345 2552 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="01fed35d-69fc-4e29-86b3-765feb1d78c9" path="/var/lib/kubelet/pods/01fed35d-69fc-4e29-86b3-765feb1d78c9/volumes" Jul 14 17:34:40.388802 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:34:40.388781 2552 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c624f9e0-e945-4f64-8bd3-b223b7c0605b" path="/var/lib/kubelet/pods/c624f9e0-e945-4f64-8bd3-b223b7c0605b/volumes" Jul 14 17:34:43.330761 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:34:43.330729 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 17:34:43.433851 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:34:43.433808 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 17:34:45.939386 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:34:45.939351 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 17:34:46.039551 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:34:46.039513 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 17:34:49.164151 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:34:49.164116 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 17:34:49.263655 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:34:49.263625 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 17:34:49.810757 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:34:49.810725 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-qm7ww" Jul 14 17:34:49.869299 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:34:49.869264 2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-ph6l8"] Jul 14 17:34:49.869601 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:34:49.869571 2552 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-ph6l8" podUID="984061e4-220f-4872-9d0f-b94f1dfa5aca" containerName="manager" containerID="cri-o://65ce3e5b25fedff86f3c3a381108d417c44968cd328927fb18c71b1e1a4528a0" gracePeriod=10 Jul 14 17:34:49.871346 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:34:49.871311 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-ph6l8" Jul 14 17:34:50.101601 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:34:50.101576 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-xsbwg"] Jul 14 17:34:50.101919 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:34:50.101908 2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="01fed35d-69fc-4e29-86b3-765feb1d78c9" containerName="manager" Jul 14 17:34:50.101960 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:34:50.101921 2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="01fed35d-69fc-4e29-86b3-765feb1d78c9" containerName="manager" Jul 14 17:34:50.102001 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:34:50.101992 2552 memory_manager.go:368] "RemoveStaleState removing state" podUID="01fed35d-69fc-4e29-86b3-765feb1d78c9" containerName="manager" Jul 14 17:34:50.104686 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:34:50.104666 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-xsbwg" Jul 14 17:34:50.118111 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:34:50.118090 2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-ph6l8" Jul 14 17:34:50.118849 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:34:50.118828 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-xsbwg"] Jul 14 17:34:50.276089 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:34:50.276056 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/984061e4-220f-4872-9d0f-b94f1dfa5aca-extensions-socket-volume\") pod \"984061e4-220f-4872-9d0f-b94f1dfa5aca\" (UID: \"984061e4-220f-4872-9d0f-b94f1dfa5aca\") " Jul 14 17:34:50.276499 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:34:50.276119 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-htgvt\" (UniqueName: \"kubernetes.io/projected/984061e4-220f-4872-9d0f-b94f1dfa5aca-kube-api-access-htgvt\") pod \"984061e4-220f-4872-9d0f-b94f1dfa5aca\" (UID: \"984061e4-220f-4872-9d0f-b94f1dfa5aca\") " Jul 14 17:34:50.276499 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:34:50.276250 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/94fa4717-c5a5-4982-9ab9-aa06ff65b270-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-xsbwg\" (UID: \"94fa4717-c5a5-4982-9ab9-aa06ff65b270\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-xsbwg" Jul 14 17:34:50.276499 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:34:50.276285 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9cgqm\" (UniqueName: \"kubernetes.io/projected/94fa4717-c5a5-4982-9ab9-aa06ff65b270-kube-api-access-9cgqm\") pod \"kuadrant-operator-controller-manager-86878c769f-xsbwg\" (UID: \"94fa4717-c5a5-4982-9ab9-aa06ff65b270\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-xsbwg" Jul 14 17:34:50.276499 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:34:50.276444 2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/984061e4-220f-4872-9d0f-b94f1dfa5aca-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "984061e4-220f-4872-9d0f-b94f1dfa5aca" (UID: "984061e4-220f-4872-9d0f-b94f1dfa5aca"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 14 17:34:50.278116 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:34:50.278091 2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/984061e4-220f-4872-9d0f-b94f1dfa5aca-kube-api-access-htgvt" (OuterVolumeSpecName: "kube-api-access-htgvt") pod "984061e4-220f-4872-9d0f-b94f1dfa5aca" (UID: "984061e4-220f-4872-9d0f-b94f1dfa5aca"). InnerVolumeSpecName "kube-api-access-htgvt". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 14 17:34:50.377229 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:34:50.377157 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/94fa4717-c5a5-4982-9ab9-aa06ff65b270-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-xsbwg\" (UID: \"94fa4717-c5a5-4982-9ab9-aa06ff65b270\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-xsbwg" Jul 14 17:34:50.377229 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:34:50.377216 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9cgqm\" (UniqueName: \"kubernetes.io/projected/94fa4717-c5a5-4982-9ab9-aa06ff65b270-kube-api-access-9cgqm\") pod \"kuadrant-operator-controller-manager-86878c769f-xsbwg\" (UID: \"94fa4717-c5a5-4982-9ab9-aa06ff65b270\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-xsbwg" Jul 14 17:34:50.377405 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:34:50.377297 2552 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-htgvt\" (UniqueName: \"kubernetes.io/projected/984061e4-220f-4872-9d0f-b94f1dfa5aca-kube-api-access-htgvt\") on node \"ip-10-0-139-16.ec2.internal\" DevicePath \"\"" Jul 14 17:34:50.377405 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:34:50.377313 2552 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/984061e4-220f-4872-9d0f-b94f1dfa5aca-extensions-socket-volume\") on node \"ip-10-0-139-16.ec2.internal\" DevicePath \"\"" Jul 14 17:34:50.377551 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:34:50.377535 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/94fa4717-c5a5-4982-9ab9-aa06ff65b270-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-xsbwg\" (UID: \"94fa4717-c5a5-4982-9ab9-aa06ff65b270\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-xsbwg" Jul 14 17:34:50.388554 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:34:50.388531 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9cgqm\" (UniqueName: \"kubernetes.io/projected/94fa4717-c5a5-4982-9ab9-aa06ff65b270-kube-api-access-9cgqm\") pod \"kuadrant-operator-controller-manager-86878c769f-xsbwg\" (UID: \"94fa4717-c5a5-4982-9ab9-aa06ff65b270\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-xsbwg" Jul 14 17:34:50.424735 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:34:50.424713 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-xsbwg" Jul 14 17:34:50.557781 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:34:50.557748 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-xsbwg"] Jul 14 17:34:50.561213 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:34:50.561192 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod94fa4717_c5a5_4982_9ab9_aa06ff65b270.slice/crio-3a39280d81f6115d7d7ad527f536afeaaa056471ca24d703d594bcc63da818b9 WatchSource:0}: Error finding container 3a39280d81f6115d7d7ad527f536afeaaa056471ca24d703d594bcc63da818b9: Status 404 returned error can't find the container with id 3a39280d81f6115d7d7ad527f536afeaaa056471ca24d703d594bcc63da818b9 Jul 14 17:34:50.861752 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:34:50.861691 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-xsbwg" event={"ID":"94fa4717-c5a5-4982-9ab9-aa06ff65b270","Type":"ContainerStarted","Data":"f57c05933faa77f4191803c43b0ce0355a3ae00357aad09577d2b765c23bf93a"} Jul 14 17:34:50.861752 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:34:50.861756 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-xsbwg" event={"ID":"94fa4717-c5a5-4982-9ab9-aa06ff65b270","Type":"ContainerStarted","Data":"3a39280d81f6115d7d7ad527f536afeaaa056471ca24d703d594bcc63da818b9"} Jul 14 17:34:50.862007 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:34:50.861784 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-xsbwg" Jul 14 17:34:50.863159 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:34:50.863134 2552 generic.go:356] "Generic (PLEG): container finished" podID="984061e4-220f-4872-9d0f-b94f1dfa5aca" containerID="65ce3e5b25fedff86f3c3a381108d417c44968cd328927fb18c71b1e1a4528a0" exitCode=0 Jul 14 17:34:50.863293 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:34:50.863170 2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-ph6l8" Jul 14 17:34:50.863293 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:34:50.863219 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-ph6l8" event={"ID":"984061e4-220f-4872-9d0f-b94f1dfa5aca","Type":"ContainerDied","Data":"65ce3e5b25fedff86f3c3a381108d417c44968cd328927fb18c71b1e1a4528a0"} Jul 14 17:34:50.863293 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:34:50.863276 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-ph6l8" event={"ID":"984061e4-220f-4872-9d0f-b94f1dfa5aca","Type":"ContainerDied","Data":"0759093c560ee9d1ecfaef212cddbacc1f664647b7fec0f8c1070fec4db4cabe"} Jul 14 17:34:50.863493 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:34:50.863307 2552 scope.go:117] "RemoveContainer" containerID="65ce3e5b25fedff86f3c3a381108d417c44968cd328927fb18c71b1e1a4528a0" Jul 14 17:34:50.872758 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:34:50.872587 2552 scope.go:117] "RemoveContainer" containerID="65ce3e5b25fedff86f3c3a381108d417c44968cd328927fb18c71b1e1a4528a0" Jul 14 17:34:50.872879 ip-10-0-139-16 kubenswrapper[2552]: E0714 17:34:50.872860 2552 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"65ce3e5b25fedff86f3c3a381108d417c44968cd328927fb18c71b1e1a4528a0\": container with ID starting with 65ce3e5b25fedff86f3c3a381108d417c44968cd328927fb18c71b1e1a4528a0 not found: ID does not exist" containerID="65ce3e5b25fedff86f3c3a381108d417c44968cd328927fb18c71b1e1a4528a0" Jul 14 17:34:50.872941 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:34:50.872889 2552 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"65ce3e5b25fedff86f3c3a381108d417c44968cd328927fb18c71b1e1a4528a0"} err="failed to get container status \"65ce3e5b25fedff86f3c3a381108d417c44968cd328927fb18c71b1e1a4528a0\": rpc error: code = NotFound desc = could not find container \"65ce3e5b25fedff86f3c3a381108d417c44968cd328927fb18c71b1e1a4528a0\": container with ID starting with 65ce3e5b25fedff86f3c3a381108d417c44968cd328927fb18c71b1e1a4528a0 not found: ID does not exist" Jul 14 17:34:50.885896 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:34:50.885851 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-xsbwg" podStartSLOduration=0.885838448 podStartE2EDuration="885.838448ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 17:34:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 17:34:50.883288985 +0000 UTC m=+553.262402937" watchObservedRunningTime="2026-07-14 17:34:50.885838448 +0000 UTC m=+553.264952400" Jul 14 17:34:50.898408 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:34:50.898385 2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-ph6l8"] Jul 14 17:34:50.903480 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:34:50.903458 2552 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-ph6l8"] Jul 14 17:34:52.387884 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:34:52.387851 2552 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="984061e4-220f-4872-9d0f-b94f1dfa5aca" path="/var/lib/kubelet/pods/984061e4-220f-4872-9d0f-b94f1dfa5aca/volumes" Jul 14 17:34:52.807043 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:34:52.807009 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 17:34:53.085582 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:34:53.085493 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 17:34:54.271062 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:34:54.271026 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 17:34:54.322709 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:34:54.322668 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 17:34:56.108458 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:34:56.108423 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 17:34:58.049170 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:34:58.049133 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 17:34:58.150833 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:34:58.150796 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 17:34:58.679994 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:34:58.679960 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 17:34:58.781655 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:34:58.781622 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 17:35:01.871945 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:35:01.871915 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-xsbwg" Jul 14 17:35:01.926013 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:35:01.925970 2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-qm7ww"] Jul 14 17:35:01.926275 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:35:01.926247 2552 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-qm7ww" podUID="aafb0a2a-9e3a-4324-bf64-acd88d56ec1c" containerName="manager" containerID="cri-o://32c4d9473b91188a42594d76c0a8b43c7228b8e8d089f9a0670ec3f2bef30a32" gracePeriod=10 Jul 14 17:35:02.707018 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:35:02.706984 2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-qm7ww" Jul 14 17:35:02.758896 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:35:02.758860 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 17:35:02.772491 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:35:02.772455 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/aafb0a2a-9e3a-4324-bf64-acd88d56ec1c-extensions-socket-volume\") pod \"aafb0a2a-9e3a-4324-bf64-acd88d56ec1c\" (UID: \"aafb0a2a-9e3a-4324-bf64-acd88d56ec1c\") " Jul 14 17:35:02.772614 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:35:02.772537 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-w98j7\" (UniqueName: \"kubernetes.io/projected/aafb0a2a-9e3a-4324-bf64-acd88d56ec1c-kube-api-access-w98j7\") pod \"aafb0a2a-9e3a-4324-bf64-acd88d56ec1c\" (UID: \"aafb0a2a-9e3a-4324-bf64-acd88d56ec1c\") " Jul 14 17:35:02.772882 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:35:02.772859 2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/aafb0a2a-9e3a-4324-bf64-acd88d56ec1c-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "aafb0a2a-9e3a-4324-bf64-acd88d56ec1c" (UID: "aafb0a2a-9e3a-4324-bf64-acd88d56ec1c"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 14 17:35:02.774539 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:35:02.774520 2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/aafb0a2a-9e3a-4324-bf64-acd88d56ec1c-kube-api-access-w98j7" (OuterVolumeSpecName: "kube-api-access-w98j7") pod "aafb0a2a-9e3a-4324-bf64-acd88d56ec1c" (UID: "aafb0a2a-9e3a-4324-bf64-acd88d56ec1c"). InnerVolumeSpecName "kube-api-access-w98j7". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 14 17:35:02.863147 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:35:02.863067 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 17:35:02.873261 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:35:02.873234 2552 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/aafb0a2a-9e3a-4324-bf64-acd88d56ec1c-extensions-socket-volume\") on node \"ip-10-0-139-16.ec2.internal\" DevicePath \"\"" Jul 14 17:35:02.873261 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:35:02.873259 2552 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-w98j7\" (UniqueName: \"kubernetes.io/projected/aafb0a2a-9e3a-4324-bf64-acd88d56ec1c-kube-api-access-w98j7\") on node \"ip-10-0-139-16.ec2.internal\" DevicePath \"\"" Jul 14 17:35:02.928901 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:35:02.928866 2552 generic.go:356] "Generic (PLEG): container finished" podID="aafb0a2a-9e3a-4324-bf64-acd88d56ec1c" containerID="32c4d9473b91188a42594d76c0a8b43c7228b8e8d089f9a0670ec3f2bef30a32" exitCode=0 Jul 14 17:35:02.929072 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:35:02.928918 2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-qm7ww" Jul 14 17:35:02.929072 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:35:02.928922 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-qm7ww" event={"ID":"aafb0a2a-9e3a-4324-bf64-acd88d56ec1c","Type":"ContainerDied","Data":"32c4d9473b91188a42594d76c0a8b43c7228b8e8d089f9a0670ec3f2bef30a32"} Jul 14 17:35:02.929072 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:35:02.928974 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-qm7ww" event={"ID":"aafb0a2a-9e3a-4324-bf64-acd88d56ec1c","Type":"ContainerDied","Data":"a98405d5087261772f6ced5fb27acc6943cf7aca22478f8ebfe8cf5b449981a2"} Jul 14 17:35:02.929072 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:35:02.928997 2552 scope.go:117] "RemoveContainer" containerID="32c4d9473b91188a42594d76c0a8b43c7228b8e8d089f9a0670ec3f2bef30a32" Jul 14 17:35:02.938220 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:35:02.938202 2552 scope.go:117] "RemoveContainer" containerID="32c4d9473b91188a42594d76c0a8b43c7228b8e8d089f9a0670ec3f2bef30a32" Jul 14 17:35:02.938532 ip-10-0-139-16 kubenswrapper[2552]: E0714 17:35:02.938513 2552 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"32c4d9473b91188a42594d76c0a8b43c7228b8e8d089f9a0670ec3f2bef30a32\": container with ID starting with 32c4d9473b91188a42594d76c0a8b43c7228b8e8d089f9a0670ec3f2bef30a32 not found: ID does not exist" containerID="32c4d9473b91188a42594d76c0a8b43c7228b8e8d089f9a0670ec3f2bef30a32" Jul 14 17:35:02.938621 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:35:02.938545 2552 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"32c4d9473b91188a42594d76c0a8b43c7228b8e8d089f9a0670ec3f2bef30a32"} err="failed to get container status \"32c4d9473b91188a42594d76c0a8b43c7228b8e8d089f9a0670ec3f2bef30a32\": rpc error: code = NotFound desc = could not find container \"32c4d9473b91188a42594d76c0a8b43c7228b8e8d089f9a0670ec3f2bef30a32\": container with ID starting with 32c4d9473b91188a42594d76c0a8b43c7228b8e8d089f9a0670ec3f2bef30a32 not found: ID does not exist" Jul 14 17:35:02.958610 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:35:02.958579 2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-qm7ww"] Jul 14 17:35:02.965740 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:35:02.965720 2552 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-qm7ww"] Jul 14 17:35:03.145151 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:35:03.145066 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 17:35:03.244674 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:35:03.244637 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 17:35:04.388179 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:35:04.388147 2552 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="aafb0a2a-9e3a-4324-bf64-acd88d56ec1c" path="/var/lib/kubelet/pods/aafb0a2a-9e3a-4324-bf64-acd88d56ec1c/volumes" Jul 14 17:35:06.250766 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:35:06.250736 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-2mfg8"] Jul 14 17:35:06.251217 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:35:06.251136 2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="984061e4-220f-4872-9d0f-b94f1dfa5aca" containerName="manager" Jul 14 17:35:06.251217 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:35:06.251148 2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="984061e4-220f-4872-9d0f-b94f1dfa5aca" containerName="manager" Jul 14 17:35:06.251217 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:35:06.251160 2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="aafb0a2a-9e3a-4324-bf64-acd88d56ec1c" containerName="manager" Jul 14 17:35:06.251217 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:35:06.251165 2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="aafb0a2a-9e3a-4324-bf64-acd88d56ec1c" containerName="manager" Jul 14 17:35:06.251373 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:35:06.251223 2552 memory_manager.go:368] "RemoveStaleState removing state" podUID="984061e4-220f-4872-9d0f-b94f1dfa5aca" containerName="manager" Jul 14 17:35:06.251373 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:35:06.251237 2552 memory_manager.go:368] "RemoveStaleState removing state" podUID="aafb0a2a-9e3a-4324-bf64-acd88d56ec1c" containerName="manager" Jul 14 17:35:06.273702 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:35:06.273664 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 17:35:06.378535 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:35:06.378502 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-2mfg8"] Jul 14 17:35:06.378698 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:35:06.378614 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-2mfg8" Jul 14 17:35:06.381663 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:35:06.381593 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-5j2x5\"" Jul 14 17:35:06.381663 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:35:06.381593 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jul 14 17:35:06.405265 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:35:06.405236 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/22e7ffc4-a033-449e-9329-aef67ebb6bef-istio-envoy\") pod \"maas-default-gateway-openshift-default-5896d4dd49-2mfg8\" (UID: \"22e7ffc4-a033-449e-9329-aef67ebb6bef\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-2mfg8" Jul 14 17:35:06.405404 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:35:06.405285 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/22e7ffc4-a033-449e-9329-aef67ebb6bef-credential-socket\") pod \"maas-default-gateway-openshift-default-5896d4dd49-2mfg8\" (UID: \"22e7ffc4-a033-449e-9329-aef67ebb6bef\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-2mfg8" Jul 14 17:35:06.405404 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:35:06.405373 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/22e7ffc4-a033-449e-9329-aef67ebb6bef-workload-certs\") pod \"maas-default-gateway-openshift-default-5896d4dd49-2mfg8\" (UID: \"22e7ffc4-a033-449e-9329-aef67ebb6bef\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-2mfg8" Jul 14 17:35:06.405506 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:35:06.405402 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fbpcs\" (UniqueName: \"kubernetes.io/projected/22e7ffc4-a033-449e-9329-aef67ebb6bef-kube-api-access-fbpcs\") pod \"maas-default-gateway-openshift-default-5896d4dd49-2mfg8\" (UID: \"22e7ffc4-a033-449e-9329-aef67ebb6bef\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-2mfg8" Jul 14 17:35:06.405506 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:35:06.405427 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/22e7ffc4-a033-449e-9329-aef67ebb6bef-workload-socket\") pod \"maas-default-gateway-openshift-default-5896d4dd49-2mfg8\" (UID: \"22e7ffc4-a033-449e-9329-aef67ebb6bef\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-2mfg8" Jul 14 17:35:06.405506 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:35:06.405472 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/22e7ffc4-a033-449e-9329-aef67ebb6bef-istio-data\") pod \"maas-default-gateway-openshift-default-5896d4dd49-2mfg8\" (UID: \"22e7ffc4-a033-449e-9329-aef67ebb6bef\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-2mfg8" Jul 14 17:35:06.405630 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:35:06.405503 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/22e7ffc4-a033-449e-9329-aef67ebb6bef-istio-token\") pod \"maas-default-gateway-openshift-default-5896d4dd49-2mfg8\" (UID: \"22e7ffc4-a033-449e-9329-aef67ebb6bef\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-2mfg8" Jul 14 17:35:06.405630 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:35:06.405532 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/22e7ffc4-a033-449e-9329-aef67ebb6bef-istio-podinfo\") pod \"maas-default-gateway-openshift-default-5896d4dd49-2mfg8\" (UID: \"22e7ffc4-a033-449e-9329-aef67ebb6bef\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-2mfg8" Jul 14 17:35:06.405630 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:35:06.405572 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/22e7ffc4-a033-449e-9329-aef67ebb6bef-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-5896d4dd49-2mfg8\" (UID: \"22e7ffc4-a033-449e-9329-aef67ebb6bef\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-2mfg8" Jul 14 17:35:06.506646 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:35:06.506564 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/22e7ffc4-a033-449e-9329-aef67ebb6bef-workload-certs\") pod \"maas-default-gateway-openshift-default-5896d4dd49-2mfg8\" (UID: \"22e7ffc4-a033-449e-9329-aef67ebb6bef\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-2mfg8" Jul 14 17:35:06.506646 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:35:06.506616 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fbpcs\" (UniqueName: \"kubernetes.io/projected/22e7ffc4-a033-449e-9329-aef67ebb6bef-kube-api-access-fbpcs\") pod \"maas-default-gateway-openshift-default-5896d4dd49-2mfg8\" (UID: \"22e7ffc4-a033-449e-9329-aef67ebb6bef\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-2mfg8" Jul 14 17:35:06.506646 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:35:06.506644 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/22e7ffc4-a033-449e-9329-aef67ebb6bef-workload-socket\") pod \"maas-default-gateway-openshift-default-5896d4dd49-2mfg8\" (UID: \"22e7ffc4-a033-449e-9329-aef67ebb6bef\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-2mfg8" Jul 14 17:35:06.506921 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:35:06.506669 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/22e7ffc4-a033-449e-9329-aef67ebb6bef-istio-data\") pod \"maas-default-gateway-openshift-default-5896d4dd49-2mfg8\" (UID: \"22e7ffc4-a033-449e-9329-aef67ebb6bef\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-2mfg8" Jul 14 17:35:06.506921 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:35:06.506698 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/22e7ffc4-a033-449e-9329-aef67ebb6bef-istio-token\") pod \"maas-default-gateway-openshift-default-5896d4dd49-2mfg8\" (UID: \"22e7ffc4-a033-449e-9329-aef67ebb6bef\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-2mfg8" Jul 14 17:35:06.506921 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:35:06.506725 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/22e7ffc4-a033-449e-9329-aef67ebb6bef-istio-podinfo\") pod \"maas-default-gateway-openshift-default-5896d4dd49-2mfg8\" (UID: \"22e7ffc4-a033-449e-9329-aef67ebb6bef\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-2mfg8" Jul 14 17:35:06.507059 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:35:06.506957 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/22e7ffc4-a033-449e-9329-aef67ebb6bef-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-5896d4dd49-2mfg8\" (UID: \"22e7ffc4-a033-449e-9329-aef67ebb6bef\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-2mfg8" Jul 14 17:35:06.507059 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:35:06.506976 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/22e7ffc4-a033-449e-9329-aef67ebb6bef-workload-certs\") pod \"maas-default-gateway-openshift-default-5896d4dd49-2mfg8\" (UID: \"22e7ffc4-a033-449e-9329-aef67ebb6bef\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-2mfg8" Jul 14 17:35:06.507059 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:35:06.507038 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/22e7ffc4-a033-449e-9329-aef67ebb6bef-istio-envoy\") pod \"maas-default-gateway-openshift-default-5896d4dd49-2mfg8\" (UID: \"22e7ffc4-a033-449e-9329-aef67ebb6bef\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-2mfg8" Jul 14 17:35:06.507059 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:35:06.507049 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/22e7ffc4-a033-449e-9329-aef67ebb6bef-workload-socket\") pod \"maas-default-gateway-openshift-default-5896d4dd49-2mfg8\" (UID: \"22e7ffc4-a033-449e-9329-aef67ebb6bef\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-2mfg8" Jul 14 17:35:06.507210 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:35:06.507105 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/22e7ffc4-a033-449e-9329-aef67ebb6bef-credential-socket\") pod \"maas-default-gateway-openshift-default-5896d4dd49-2mfg8\" (UID: \"22e7ffc4-a033-449e-9329-aef67ebb6bef\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-2mfg8" Jul 14 17:35:06.507210 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:35:06.507144 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/22e7ffc4-a033-449e-9329-aef67ebb6bef-istio-data\") pod \"maas-default-gateway-openshift-default-5896d4dd49-2mfg8\" (UID: \"22e7ffc4-a033-449e-9329-aef67ebb6bef\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-2mfg8" Jul 14 17:35:06.507412 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:35:06.507394 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/22e7ffc4-a033-449e-9329-aef67ebb6bef-credential-socket\") pod \"maas-default-gateway-openshift-default-5896d4dd49-2mfg8\" (UID: \"22e7ffc4-a033-449e-9329-aef67ebb6bef\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-2mfg8" Jul 14 17:35:06.508009 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:35:06.507982 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/22e7ffc4-a033-449e-9329-aef67ebb6bef-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-5896d4dd49-2mfg8\" (UID: \"22e7ffc4-a033-449e-9329-aef67ebb6bef\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-2mfg8" Jul 14 17:35:06.509247 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:35:06.509221 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/22e7ffc4-a033-449e-9329-aef67ebb6bef-istio-envoy\") pod \"maas-default-gateway-openshift-default-5896d4dd49-2mfg8\" (UID: \"22e7ffc4-a033-449e-9329-aef67ebb6bef\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-2mfg8" Jul 14 17:35:06.509557 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:35:06.509540 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/22e7ffc4-a033-449e-9329-aef67ebb6bef-istio-podinfo\") pod \"maas-default-gateway-openshift-default-5896d4dd49-2mfg8\" (UID: \"22e7ffc4-a033-449e-9329-aef67ebb6bef\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-2mfg8" Jul 14 17:35:06.515256 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:35:06.515231 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/22e7ffc4-a033-449e-9329-aef67ebb6bef-istio-token\") pod \"maas-default-gateway-openshift-default-5896d4dd49-2mfg8\" (UID: \"22e7ffc4-a033-449e-9329-aef67ebb6bef\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-2mfg8" Jul 14 17:35:06.515814 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:35:06.515791 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fbpcs\" (UniqueName: \"kubernetes.io/projected/22e7ffc4-a033-449e-9329-aef67ebb6bef-kube-api-access-fbpcs\") pod \"maas-default-gateway-openshift-default-5896d4dd49-2mfg8\" (UID: \"22e7ffc4-a033-449e-9329-aef67ebb6bef\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-2mfg8" Jul 14 17:35:06.585764 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:35:06.585731 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 17:35:06.691032 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:35:06.690995 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-2mfg8" Jul 14 17:35:06.897233 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:35:06.897152 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-2mfg8"] Jul 14 17:35:06.899520 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:35:06.899489 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod22e7ffc4_a033_449e_9329_aef67ebb6bef.slice/crio-5ae72b81a537d3ff2666a06b00cb6f39a7cedbefaa56cd7e521029899681b6a5 WatchSource:0}: Error finding container 5ae72b81a537d3ff2666a06b00cb6f39a7cedbefaa56cd7e521029899681b6a5: Status 404 returned error can't find the container with id 5ae72b81a537d3ff2666a06b00cb6f39a7cedbefaa56cd7e521029899681b6a5 Jul 14 17:35:06.901718 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:35:06.901684 2552 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 14 17:35:06.901782 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:35:06.901753 2552 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 14 17:35:06.901829 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:35:06.901781 2552 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 14 17:35:06.951048 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:35:06.951019 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-2mfg8" event={"ID":"22e7ffc4-a033-449e-9329-aef67ebb6bef","Type":"ContainerStarted","Data":"5ae72b81a537d3ff2666a06b00cb6f39a7cedbefaa56cd7e521029899681b6a5"} Jul 14 17:35:07.958376 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:35:07.958319 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-2mfg8" event={"ID":"22e7ffc4-a033-449e-9329-aef67ebb6bef","Type":"ContainerStarted","Data":"e5f76d37ea1bb647cd0f916090e40baec33962813fda885249451ffa3e0a0e97"} Jul 14 17:35:07.978653 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:35:07.978611 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-2mfg8" podStartSLOduration=1.978595899 podStartE2EDuration="1.978595899s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 17:35:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 17:35:07.978355812 +0000 UTC m=+570.357469765" watchObservedRunningTime="2026-07-14 17:35:07.978595899 +0000 UTC m=+570.357709919" Jul 14 17:35:08.691286 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:35:08.691257 2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-2mfg8" Jul 14 17:35:08.695954 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:35:08.695930 2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-2mfg8" Jul 14 17:35:08.963467 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:35:08.963440 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-2mfg8" Jul 14 17:35:08.964259 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:35:08.964242 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-2mfg8" Jul 14 17:35:19.326145 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:35:19.326112 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-dr4rz"] Jul 14 17:35:19.326732 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:35:19.326224 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 17:35:19.354439 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:35:19.354410 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-dr4rz"] Jul 14 17:35:19.354583 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:35:19.354525 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-dr4rz" Jul 14 17:35:19.358715 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:35:19.358691 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" Jul 14 17:35:19.418930 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:35:19.418890 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bxqzs\" (UniqueName: \"kubernetes.io/projected/14f5543e-9a48-4336-82f5-940b3b56e7aa-kube-api-access-bxqzs\") pod \"limitador-limitador-64c94fd64f-dr4rz\" (UID: \"14f5543e-9a48-4336-82f5-940b3b56e7aa\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-dr4rz" Jul 14 17:35:19.419142 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:35:19.418956 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/14f5543e-9a48-4336-82f5-940b3b56e7aa-config-file\") pod \"limitador-limitador-64c94fd64f-dr4rz\" (UID: \"14f5543e-9a48-4336-82f5-940b3b56e7aa\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-dr4rz" Jul 14 17:35:19.421854 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:35:19.421828 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-dr4rz"] Jul 14 17:35:19.464274 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:35:19.464245 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 17:35:19.519712 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:35:19.519663 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bxqzs\" (UniqueName: \"kubernetes.io/projected/14f5543e-9a48-4336-82f5-940b3b56e7aa-kube-api-access-bxqzs\") pod \"limitador-limitador-64c94fd64f-dr4rz\" (UID: \"14f5543e-9a48-4336-82f5-940b3b56e7aa\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-dr4rz" Jul 14 17:35:19.519895 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:35:19.519718 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/14f5543e-9a48-4336-82f5-940b3b56e7aa-config-file\") pod \"limitador-limitador-64c94fd64f-dr4rz\" (UID: \"14f5543e-9a48-4336-82f5-940b3b56e7aa\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-dr4rz" Jul 14 17:35:19.520551 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:35:19.520530 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/14f5543e-9a48-4336-82f5-940b3b56e7aa-config-file\") pod \"limitador-limitador-64c94fd64f-dr4rz\" (UID: \"14f5543e-9a48-4336-82f5-940b3b56e7aa\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-dr4rz" Jul 14 17:35:19.535504 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:35:19.535479 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bxqzs\" (UniqueName: \"kubernetes.io/projected/14f5543e-9a48-4336-82f5-940b3b56e7aa-kube-api-access-bxqzs\") pod \"limitador-limitador-64c94fd64f-dr4rz\" (UID: \"14f5543e-9a48-4336-82f5-940b3b56e7aa\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-dr4rz" Jul 14 17:35:19.560993 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:35:19.560947 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 17:35:19.665433 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:35:19.665349 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-dr4rz" Jul 14 17:35:19.812467 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:35:19.812445 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-dr4rz"] Jul 14 17:35:19.814635 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:35:19.814609 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod14f5543e_9a48_4336_82f5_940b3b56e7aa.slice/crio-0298f1191c6c1d3efa5811ae735f5b513a5aa855ddef26e26aa38da9e90f5993 WatchSource:0}: Error finding container 0298f1191c6c1d3efa5811ae735f5b513a5aa855ddef26e26aa38da9e90f5993: Status 404 returned error can't find the container with id 0298f1191c6c1d3efa5811ae735f5b513a5aa855ddef26e26aa38da9e90f5993 Jul 14 17:35:20.023850 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:35:20.023815 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-dr4rz" event={"ID":"14f5543e-9a48-4336-82f5-940b3b56e7aa","Type":"ContainerStarted","Data":"0298f1191c6c1d3efa5811ae735f5b513a5aa855ddef26e26aa38da9e90f5993"} Jul 14 17:35:20.240977 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:35:20.240942 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 17:35:20.341411 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:35:20.341273 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 17:35:20.532227 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:35:20.532192 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 17:35:20.596606 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:35:20.596513 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 17:35:24.049601 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:35:24.049563 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-dr4rz" event={"ID":"14f5543e-9a48-4336-82f5-940b3b56e7aa","Type":"ContainerStarted","Data":"1b5d97e26007ef5442a6b0f2bfdec1d6509bfc7117d363aefd5a29d52f4eab23"} Jul 14 17:35:24.050149 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:35:24.049624 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-dr4rz" Jul 14 17:35:24.065083 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:35:24.065032 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-64c94fd64f-dr4rz" podStartSLOduration=1.632616206 podStartE2EDuration="5.065013435s" totalImagesPullingTime="3.432397229s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 17:35:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 17:35:24.064508965 +0000 UTC m=+586.443622914" watchObservedRunningTime="2026-07-14 17:35:24.065013435 +0000 UTC m=+586.444127388" Jul 14 17:35:34.156589 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:35:34.156549 2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-dr4rz"] Jul 14 17:35:34.157043 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:35:34.156765 2552 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-64c94fd64f-dr4rz" podUID="14f5543e-9a48-4336-82f5-940b3b56e7aa" containerName="limitador" containerID="cri-o://1b5d97e26007ef5442a6b0f2bfdec1d6509bfc7117d363aefd5a29d52f4eab23" gracePeriod=30 Jul 14 17:35:34.157600 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:35:34.157411 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-dr4rz" Jul 14 17:35:34.722269 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:35:34.722213 2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-dr4rz" Jul 14 17:35:34.762595 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:35:34.762562 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bxqzs\" (UniqueName: \"kubernetes.io/projected/14f5543e-9a48-4336-82f5-940b3b56e7aa-kube-api-access-bxqzs\") pod \"14f5543e-9a48-4336-82f5-940b3b56e7aa\" (UID: \"14f5543e-9a48-4336-82f5-940b3b56e7aa\") " Jul 14 17:35:34.762725 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:35:34.762669 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/14f5543e-9a48-4336-82f5-940b3b56e7aa-config-file\") pod \"14f5543e-9a48-4336-82f5-940b3b56e7aa\" (UID: \"14f5543e-9a48-4336-82f5-940b3b56e7aa\") " Jul 14 17:35:34.763000 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:35:34.762979 2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/14f5543e-9a48-4336-82f5-940b3b56e7aa-config-file" (OuterVolumeSpecName: "config-file") pod "14f5543e-9a48-4336-82f5-940b3b56e7aa" (UID: "14f5543e-9a48-4336-82f5-940b3b56e7aa"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 14 17:35:34.764506 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:35:34.764485 2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/14f5543e-9a48-4336-82f5-940b3b56e7aa-kube-api-access-bxqzs" (OuterVolumeSpecName: "kube-api-access-bxqzs") pod "14f5543e-9a48-4336-82f5-940b3b56e7aa" (UID: "14f5543e-9a48-4336-82f5-940b3b56e7aa"). InnerVolumeSpecName "kube-api-access-bxqzs". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 14 17:35:34.863949 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:35:34.863922 2552 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/14f5543e-9a48-4336-82f5-940b3b56e7aa-config-file\") on node \"ip-10-0-139-16.ec2.internal\" DevicePath \"\"" Jul 14 17:35:34.863949 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:35:34.863948 2552 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bxqzs\" (UniqueName: \"kubernetes.io/projected/14f5543e-9a48-4336-82f5-940b3b56e7aa-kube-api-access-bxqzs\") on node \"ip-10-0-139-16.ec2.internal\" DevicePath \"\"" Jul 14 17:35:35.108706 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:35:35.108612 2552 generic.go:356] "Generic (PLEG): container finished" podID="14f5543e-9a48-4336-82f5-940b3b56e7aa" containerID="1b5d97e26007ef5442a6b0f2bfdec1d6509bfc7117d363aefd5a29d52f4eab23" exitCode=0 Jul 14 17:35:35.108706 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:35:35.108670 2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-dr4rz" Jul 14 17:35:35.108916 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:35:35.108695 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-dr4rz" event={"ID":"14f5543e-9a48-4336-82f5-940b3b56e7aa","Type":"ContainerDied","Data":"1b5d97e26007ef5442a6b0f2bfdec1d6509bfc7117d363aefd5a29d52f4eab23"} Jul 14 17:35:35.108916 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:35:35.108783 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-dr4rz" event={"ID":"14f5543e-9a48-4336-82f5-940b3b56e7aa","Type":"ContainerDied","Data":"0298f1191c6c1d3efa5811ae735f5b513a5aa855ddef26e26aa38da9e90f5993"} Jul 14 17:35:35.108916 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:35:35.108810 2552 scope.go:117] "RemoveContainer" containerID="1b5d97e26007ef5442a6b0f2bfdec1d6509bfc7117d363aefd5a29d52f4eab23" Jul 14 17:35:35.117920 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:35:35.117893 2552 scope.go:117] "RemoveContainer" containerID="1b5d97e26007ef5442a6b0f2bfdec1d6509bfc7117d363aefd5a29d52f4eab23" Jul 14 17:35:35.118158 ip-10-0-139-16 kubenswrapper[2552]: E0714 17:35:35.118140 2552 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1b5d97e26007ef5442a6b0f2bfdec1d6509bfc7117d363aefd5a29d52f4eab23\": container with ID starting with 1b5d97e26007ef5442a6b0f2bfdec1d6509bfc7117d363aefd5a29d52f4eab23 not found: ID does not exist" containerID="1b5d97e26007ef5442a6b0f2bfdec1d6509bfc7117d363aefd5a29d52f4eab23" Jul 14 17:35:35.118206 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:35:35.118168 2552 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1b5d97e26007ef5442a6b0f2bfdec1d6509bfc7117d363aefd5a29d52f4eab23"} err="failed to get container status \"1b5d97e26007ef5442a6b0f2bfdec1d6509bfc7117d363aefd5a29d52f4eab23\": rpc error: code = NotFound desc = could not find container \"1b5d97e26007ef5442a6b0f2bfdec1d6509bfc7117d363aefd5a29d52f4eab23\": container with ID starting with 1b5d97e26007ef5442a6b0f2bfdec1d6509bfc7117d363aefd5a29d52f4eab23 not found: ID does not exist" Jul 14 17:35:35.129629 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:35:35.129608 2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-dr4rz"] Jul 14 17:35:35.135222 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:35:35.135202 2552 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-dr4rz"] Jul 14 17:35:35.660519 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:35:35.660471 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 17:35:35.759815 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:35:35.759783 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 17:35:36.206630 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:35:36.206597 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-g6lfc"] Jul 14 17:35:36.206961 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:35:36.206949 2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="14f5543e-9a48-4336-82f5-940b3b56e7aa" containerName="limitador" Jul 14 17:35:36.207011 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:35:36.206963 2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="14f5543e-9a48-4336-82f5-940b3b56e7aa" containerName="limitador" Jul 14 17:35:36.207043 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:35:36.207029 2552 memory_manager.go:368] "RemoveStaleState removing state" podUID="14f5543e-9a48-4336-82f5-940b3b56e7aa" containerName="limitador" Jul 14 17:35:36.208962 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:35:36.208944 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-g6lfc" Jul 14 17:35:36.212259 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:35:36.212242 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"default-dockercfg-scvzv\"" Jul 14 17:35:36.212366 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:35:36.212343 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"postgres-creds\"" Jul 14 17:35:36.213518 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:35:36.213502 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\"" Jul 14 17:35:36.213578 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:35:36.213512 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\"" Jul 14 17:35:36.241154 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:35:36.241134 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-g6lfc"] Jul 14 17:35:36.256169 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:35:36.256141 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 17:35:36.275964 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:35:36.275933 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/e60a6d1d-4529-46f3-8556-cf25512cc582-data\") pod \"postgres-69fb4594cf-g6lfc\" (UID: \"e60a6d1d-4529-46f3-8556-cf25512cc582\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-g6lfc" Jul 14 17:35:36.276085 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:35:36.276026 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ldvdd\" (UniqueName: \"kubernetes.io/projected/e60a6d1d-4529-46f3-8556-cf25512cc582-kube-api-access-ldvdd\") pod \"postgres-69fb4594cf-g6lfc\" (UID: \"e60a6d1d-4529-46f3-8556-cf25512cc582\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-g6lfc" Jul 14 17:35:36.376501 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:35:36.376457 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ldvdd\" (UniqueName: \"kubernetes.io/projected/e60a6d1d-4529-46f3-8556-cf25512cc582-kube-api-access-ldvdd\") pod \"postgres-69fb4594cf-g6lfc\" (UID: \"e60a6d1d-4529-46f3-8556-cf25512cc582\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-g6lfc" Jul 14 17:35:36.376659 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:35:36.376555 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/e60a6d1d-4529-46f3-8556-cf25512cc582-data\") pod \"postgres-69fb4594cf-g6lfc\" (UID: \"e60a6d1d-4529-46f3-8556-cf25512cc582\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-g6lfc" Jul 14 17:35:36.376924 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:35:36.376906 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/e60a6d1d-4529-46f3-8556-cf25512cc582-data\") pod \"postgres-69fb4594cf-g6lfc\" (UID: \"e60a6d1d-4529-46f3-8556-cf25512cc582\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-g6lfc" Jul 14 17:35:36.389252 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:35:36.389219 2552 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="14f5543e-9a48-4336-82f5-940b3b56e7aa" path="/var/lib/kubelet/pods/14f5543e-9a48-4336-82f5-940b3b56e7aa/volumes" Jul 14 17:35:36.389546 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:35:36.389525 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ldvdd\" (UniqueName: \"kubernetes.io/projected/e60a6d1d-4529-46f3-8556-cf25512cc582-kube-api-access-ldvdd\") pod \"postgres-69fb4594cf-g6lfc\" (UID: \"e60a6d1d-4529-46f3-8556-cf25512cc582\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-g6lfc" Jul 14 17:35:36.519320 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:35:36.519291 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-g6lfc" Jul 14 17:35:36.650535 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:35:36.650381 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-g6lfc"] Jul 14 17:35:36.653215 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:35:36.653181 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode60a6d1d_4529_46f3_8556_cf25512cc582.slice/crio-55680b316a1d160b5eac1803003042ba802d052c31b94730c2e63894cf7184df WatchSource:0}: Error finding container 55680b316a1d160b5eac1803003042ba802d052c31b94730c2e63894cf7184df: Status 404 returned error can't find the container with id 55680b316a1d160b5eac1803003042ba802d052c31b94730c2e63894cf7184df Jul 14 17:35:36.844776 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:35:36.844694 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 17:35:37.121014 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:35:37.120936 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-g6lfc" event={"ID":"e60a6d1d-4529-46f3-8556-cf25512cc582","Type":"ContainerStarted","Data":"55680b316a1d160b5eac1803003042ba802d052c31b94730c2e63894cf7184df"} Jul 14 17:35:38.071443 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:35:38.071413 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-gnw2z_b3c71861-4db9-4850-a44b-6f5d44a94235/console-operator/2.log" Jul 14 17:35:38.075634 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:35:38.075606 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-gnw2z_b3c71861-4db9-4850-a44b-6f5d44a94235/console-operator/2.log" Jul 14 17:35:38.081548 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:35:38.081508 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cwprj_d3492336-881b-4f13-8d3a-b4d4ec05ad3c/ovn-acl-logging/0.log" Jul 14 17:35:38.085292 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:35:38.085270 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cwprj_d3492336-881b-4f13-8d3a-b4d4ec05ad3c/ovn-acl-logging/0.log" Jul 14 17:35:41.294040 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:35:41.294004 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 17:35:41.821416 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:35:41.821393 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"postgres-creds\"" Jul 14 17:35:42.155665 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:35:42.155578 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-g6lfc" event={"ID":"e60a6d1d-4529-46f3-8556-cf25512cc582","Type":"ContainerStarted","Data":"717a9c9236c6f23973dbf8cf2480a81b0c089af4a1fc88911d8ea4af3a113363"} Jul 14 17:35:42.155827 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:35:42.155710 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-g6lfc" Jul 14 17:35:42.173116 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:35:42.173070 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/postgres-69fb4594cf-g6lfc" podStartSLOduration=1.009310623 podStartE2EDuration="6.17305644s" totalImagesPullingTime="5.163745817s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 17:35:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 17:35:42.171720386 +0000 UTC m=+604.550834338" watchObservedRunningTime="2026-07-14 17:35:42.17305644 +0000 UTC m=+604.552170391" Jul 14 17:35:48.189422 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:35:48.189397 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-g6lfc" Jul 14 17:35:48.512166 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:35:48.512134 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 17:35:49.551084 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:35:49.551050 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 17:35:55.230547 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:35:55.230511 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 17:35:55.239113 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:35:55.239087 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-6cc98657d9-8wllf"] Jul 14 17:35:55.242509 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:35:55.242490 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6cc98657d9-8wllf" Jul 14 17:35:55.245119 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:35:55.245090 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\"" Jul 14 17:35:55.245119 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:35:55.245113 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" Jul 14 17:35:55.245268 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:35:55.245134 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-n4qdt\"" Jul 14 17:35:55.251616 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:35:55.251594 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-6cc98657d9-8wllf"] Jul 14 17:35:55.348671 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:35:55.348638 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sk7c2\" (UniqueName: \"kubernetes.io/projected/e8fa717e-c2fe-4bb3-bd6e-bb0a2ce42868-kube-api-access-sk7c2\") pod \"maas-controller-6cc98657d9-8wllf\" (UID: \"e8fa717e-c2fe-4bb3-bd6e-bb0a2ce42868\") " pod="opendatahub/maas-controller-6cc98657d9-8wllf" Jul 14 17:35:55.348838 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:35:55.348687 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e8fa717e-c2fe-4bb3-bd6e-bb0a2ce42868-webhook-cert\") pod \"maas-controller-6cc98657d9-8wllf\" (UID: \"e8fa717e-c2fe-4bb3-bd6e-bb0a2ce42868\") " pod="opendatahub/maas-controller-6cc98657d9-8wllf" Jul 14 17:35:55.420062 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:35:55.420029 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-556ffcbcb6-mbzd7"] Jul 14 17:35:55.422783 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:35:55.422760 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-556ffcbcb6-mbzd7" Jul 14 17:35:55.432475 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:35:55.432450 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-556ffcbcb6-mbzd7"] Jul 14 17:35:55.450187 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:35:55.450157 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sk7c2\" (UniqueName: \"kubernetes.io/projected/e8fa717e-c2fe-4bb3-bd6e-bb0a2ce42868-kube-api-access-sk7c2\") pod \"maas-controller-6cc98657d9-8wllf\" (UID: \"e8fa717e-c2fe-4bb3-bd6e-bb0a2ce42868\") " pod="opendatahub/maas-controller-6cc98657d9-8wllf" Jul 14 17:35:55.450320 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:35:55.450272 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e8fa717e-c2fe-4bb3-bd6e-bb0a2ce42868-webhook-cert\") pod \"maas-controller-6cc98657d9-8wllf\" (UID: \"e8fa717e-c2fe-4bb3-bd6e-bb0a2ce42868\") " pod="opendatahub/maas-controller-6cc98657d9-8wllf" Jul 14 17:35:55.452809 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:35:55.452784 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e8fa717e-c2fe-4bb3-bd6e-bb0a2ce42868-webhook-cert\") pod \"maas-controller-6cc98657d9-8wllf\" (UID: \"e8fa717e-c2fe-4bb3-bd6e-bb0a2ce42868\") " pod="opendatahub/maas-controller-6cc98657d9-8wllf" Jul 14 17:35:55.457520 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:35:55.457496 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sk7c2\" (UniqueName: \"kubernetes.io/projected/e8fa717e-c2fe-4bb3-bd6e-bb0a2ce42868-kube-api-access-sk7c2\") pod \"maas-controller-6cc98657d9-8wllf\" (UID: \"e8fa717e-c2fe-4bb3-bd6e-bb0a2ce42868\") " pod="opendatahub/maas-controller-6cc98657d9-8wllf" Jul 14 17:35:55.551362 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:35:55.551267 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ck6qs\" (UniqueName: \"kubernetes.io/projected/8338e15c-7498-48ff-89cc-0f2a398fc1bf-kube-api-access-ck6qs\") pod \"maas-controller-556ffcbcb6-mbzd7\" (UID: \"8338e15c-7498-48ff-89cc-0f2a398fc1bf\") " pod="opendatahub/maas-controller-556ffcbcb6-mbzd7" Jul 14 17:35:55.551362 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:35:55.551299 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/8338e15c-7498-48ff-89cc-0f2a398fc1bf-webhook-cert\") pod \"maas-controller-556ffcbcb6-mbzd7\" (UID: \"8338e15c-7498-48ff-89cc-0f2a398fc1bf\") " pod="opendatahub/maas-controller-556ffcbcb6-mbzd7" Jul 14 17:35:55.554529 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:35:55.554505 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6cc98657d9-8wllf" Jul 14 17:35:55.651866 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:35:55.651830 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ck6qs\" (UniqueName: \"kubernetes.io/projected/8338e15c-7498-48ff-89cc-0f2a398fc1bf-kube-api-access-ck6qs\") pod \"maas-controller-556ffcbcb6-mbzd7\" (UID: \"8338e15c-7498-48ff-89cc-0f2a398fc1bf\") " pod="opendatahub/maas-controller-556ffcbcb6-mbzd7" Jul 14 17:35:55.652017 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:35:55.651885 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/8338e15c-7498-48ff-89cc-0f2a398fc1bf-webhook-cert\") pod \"maas-controller-556ffcbcb6-mbzd7\" (UID: \"8338e15c-7498-48ff-89cc-0f2a398fc1bf\") " pod="opendatahub/maas-controller-556ffcbcb6-mbzd7" Jul 14 17:35:55.654309 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:35:55.654281 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/8338e15c-7498-48ff-89cc-0f2a398fc1bf-webhook-cert\") pod \"maas-controller-556ffcbcb6-mbzd7\" (UID: \"8338e15c-7498-48ff-89cc-0f2a398fc1bf\") " pod="opendatahub/maas-controller-556ffcbcb6-mbzd7" Jul 14 17:35:55.661654 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:35:55.661628 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ck6qs\" (UniqueName: \"kubernetes.io/projected/8338e15c-7498-48ff-89cc-0f2a398fc1bf-kube-api-access-ck6qs\") pod \"maas-controller-556ffcbcb6-mbzd7\" (UID: \"8338e15c-7498-48ff-89cc-0f2a398fc1bf\") " pod="opendatahub/maas-controller-556ffcbcb6-mbzd7" Jul 14 17:35:55.688241 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:35:55.687189 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-6cc98657d9-8wllf"] Jul 14 17:35:55.690732 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:35:55.690707 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode8fa717e_c2fe_4bb3_bd6e_bb0a2ce42868.slice/crio-16c2793ffab49fcfe0946b2478e473de2245f8bee935138d195045145db4ed5f WatchSource:0}: Error finding container 16c2793ffab49fcfe0946b2478e473de2245f8bee935138d195045145db4ed5f: Status 404 returned error can't find the container with id 16c2793ffab49fcfe0946b2478e473de2245f8bee935138d195045145db4ed5f Jul 14 17:35:55.733437 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:35:55.733413 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-556ffcbcb6-mbzd7" Jul 14 17:35:55.860891 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:35:55.860863 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-556ffcbcb6-mbzd7"] Jul 14 17:35:55.862704 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:35:55.862681 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8338e15c_7498_48ff_89cc_0f2a398fc1bf.slice/crio-548a6b3ab802ecb80919803520b039c83ea0be43a6ed9d834cc8adcbd691981b WatchSource:0}: Error finding container 548a6b3ab802ecb80919803520b039c83ea0be43a6ed9d834cc8adcbd691981b: Status 404 returned error can't find the container with id 548a6b3ab802ecb80919803520b039c83ea0be43a6ed9d834cc8adcbd691981b Jul 14 17:35:56.222310 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:35:56.222273 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6cc98657d9-8wllf" event={"ID":"e8fa717e-c2fe-4bb3-bd6e-bb0a2ce42868","Type":"ContainerStarted","Data":"16c2793ffab49fcfe0946b2478e473de2245f8bee935138d195045145db4ed5f"} Jul 14 17:35:56.223474 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:35:56.223453 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-556ffcbcb6-mbzd7" event={"ID":"8338e15c-7498-48ff-89cc-0f2a398fc1bf","Type":"ContainerStarted","Data":"548a6b3ab802ecb80919803520b039c83ea0be43a6ed9d834cc8adcbd691981b"} Jul 14 17:35:57.260034 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:35:57.259985 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 17:35:58.700183 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:35:58.700065 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 17:35:59.182966 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:35:59.182928 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 17:35:59.245901 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:35:59.245866 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-556ffcbcb6-mbzd7" event={"ID":"8338e15c-7498-48ff-89cc-0f2a398fc1bf","Type":"ContainerStarted","Data":"4494d7dbe49759163f4623e152522b9da6a1d0ffdef5d09c37c190c3f415a821"} Jul 14 17:35:59.246081 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:35:59.246030 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-556ffcbcb6-mbzd7" Jul 14 17:35:59.247466 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:35:59.247442 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6cc98657d9-8wllf" event={"ID":"e8fa717e-c2fe-4bb3-bd6e-bb0a2ce42868","Type":"ContainerStarted","Data":"7cba640ecf22e507b69ead81882e12f75c68607da7bcfe27d9ed58ca46740037"} Jul 14 17:35:59.247578 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:35:59.247502 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-6cc98657d9-8wllf" Jul 14 17:35:59.266722 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:35:59.266680 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-556ffcbcb6-mbzd7" podStartSLOduration=1.617209806 podStartE2EDuration="4.266667373s" totalImagesPullingTime="2.649457567s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 17:35:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 17:35:59.265498912 +0000 UTC m=+621.644612873" watchObservedRunningTime="2026-07-14 17:35:59.266667373 +0000 UTC m=+621.645781321" Jul 14 17:35:59.288172 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:35:59.288116 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-6cc98657d9-8wllf" podStartSLOduration=1.456594758 podStartE2EDuration="4.288097984s" totalImagesPullingTime="2.831503226s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 17:35:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 17:35:59.285177644 +0000 UTC m=+621.664291596" watchObservedRunningTime="2026-07-14 17:35:59.288097984 +0000 UTC m=+621.667211938" Jul 14 17:36:10.254889 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:36:10.254809 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-6cc98657d9-8wllf" Jul 14 17:36:10.254889 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:36:10.254886 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-556ffcbcb6-mbzd7" Jul 14 17:36:10.313306 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:36:10.313271 2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-6cc98657d9-8wllf"] Jul 14 17:36:10.313523 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:36:10.313477 2552 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-6cc98657d9-8wllf" podUID="e8fa717e-c2fe-4bb3-bd6e-bb0a2ce42868" containerName="manager" containerID="cri-o://7cba640ecf22e507b69ead81882e12f75c68607da7bcfe27d9ed58ca46740037" gracePeriod=30 Jul 14 17:36:10.568020 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:36:10.567994 2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6cc98657d9-8wllf" Jul 14 17:36:10.689578 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:36:10.689543 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sk7c2\" (UniqueName: \"kubernetes.io/projected/e8fa717e-c2fe-4bb3-bd6e-bb0a2ce42868-kube-api-access-sk7c2\") pod \"e8fa717e-c2fe-4bb3-bd6e-bb0a2ce42868\" (UID: \"e8fa717e-c2fe-4bb3-bd6e-bb0a2ce42868\") " Jul 14 17:36:10.689578 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:36:10.689577 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e8fa717e-c2fe-4bb3-bd6e-bb0a2ce42868-webhook-cert\") pod \"e8fa717e-c2fe-4bb3-bd6e-bb0a2ce42868\" (UID: \"e8fa717e-c2fe-4bb3-bd6e-bb0a2ce42868\") " Jul 14 17:36:10.691745 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:36:10.691718 2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e8fa717e-c2fe-4bb3-bd6e-bb0a2ce42868-kube-api-access-sk7c2" (OuterVolumeSpecName: "kube-api-access-sk7c2") pod "e8fa717e-c2fe-4bb3-bd6e-bb0a2ce42868" (UID: "e8fa717e-c2fe-4bb3-bd6e-bb0a2ce42868"). InnerVolumeSpecName "kube-api-access-sk7c2". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 14 17:36:10.691857 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:36:10.691801 2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e8fa717e-c2fe-4bb3-bd6e-bb0a2ce42868-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "e8fa717e-c2fe-4bb3-bd6e-bb0a2ce42868" (UID: "e8fa717e-c2fe-4bb3-bd6e-bb0a2ce42868"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 14 17:36:10.791097 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:36:10.791065 2552 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sk7c2\" (UniqueName: \"kubernetes.io/projected/e8fa717e-c2fe-4bb3-bd6e-bb0a2ce42868-kube-api-access-sk7c2\") on node \"ip-10-0-139-16.ec2.internal\" DevicePath \"\"" Jul 14 17:36:10.791097 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:36:10.791094 2552 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e8fa717e-c2fe-4bb3-bd6e-bb0a2ce42868-webhook-cert\") on node \"ip-10-0-139-16.ec2.internal\" DevicePath \"\"" Jul 14 17:36:11.305913 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:36:11.305876 2552 generic.go:356] "Generic (PLEG): container finished" podID="e8fa717e-c2fe-4bb3-bd6e-bb0a2ce42868" containerID="7cba640ecf22e507b69ead81882e12f75c68607da7bcfe27d9ed58ca46740037" exitCode=0 Jul 14 17:36:11.306281 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:36:11.305925 2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6cc98657d9-8wllf" Jul 14 17:36:11.306281 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:36:11.305926 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6cc98657d9-8wllf" event={"ID":"e8fa717e-c2fe-4bb3-bd6e-bb0a2ce42868","Type":"ContainerDied","Data":"7cba640ecf22e507b69ead81882e12f75c68607da7bcfe27d9ed58ca46740037"} Jul 14 17:36:11.306281 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:36:11.306049 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6cc98657d9-8wllf" event={"ID":"e8fa717e-c2fe-4bb3-bd6e-bb0a2ce42868","Type":"ContainerDied","Data":"16c2793ffab49fcfe0946b2478e473de2245f8bee935138d195045145db4ed5f"} Jul 14 17:36:11.306281 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:36:11.306077 2552 scope.go:117] "RemoveContainer" containerID="7cba640ecf22e507b69ead81882e12f75c68607da7bcfe27d9ed58ca46740037" Jul 14 17:36:11.316973 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:36:11.316735 2552 scope.go:117] "RemoveContainer" containerID="7cba640ecf22e507b69ead81882e12f75c68607da7bcfe27d9ed58ca46740037" Jul 14 17:36:11.317243 ip-10-0-139-16 kubenswrapper[2552]: E0714 17:36:11.317185 2552 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7cba640ecf22e507b69ead81882e12f75c68607da7bcfe27d9ed58ca46740037\": container with ID starting with 7cba640ecf22e507b69ead81882e12f75c68607da7bcfe27d9ed58ca46740037 not found: ID does not exist" containerID="7cba640ecf22e507b69ead81882e12f75c68607da7bcfe27d9ed58ca46740037" Jul 14 17:36:11.317243 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:36:11.317217 2552 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7cba640ecf22e507b69ead81882e12f75c68607da7bcfe27d9ed58ca46740037"} err="failed to get container status \"7cba640ecf22e507b69ead81882e12f75c68607da7bcfe27d9ed58ca46740037\": rpc error: code = NotFound desc = could not find container \"7cba640ecf22e507b69ead81882e12f75c68607da7bcfe27d9ed58ca46740037\": container with ID starting with 7cba640ecf22e507b69ead81882e12f75c68607da7bcfe27d9ed58ca46740037 not found: ID does not exist" Jul 14 17:36:11.327616 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:36:11.327594 2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-6cc98657d9-8wllf"] Jul 14 17:36:11.330840 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:36:11.330819 2552 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-6cc98657d9-8wllf"] Jul 14 17:36:12.388983 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:36:12.388951 2552 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e8fa717e-c2fe-4bb3-bd6e-bb0a2ce42868" path="/var/lib/kubelet/pods/e8fa717e-c2fe-4bb3-bd6e-bb0a2ce42868/volumes" Jul 14 17:36:29.428894 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:36:29.428848 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 17:36:29.515875 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:36:29.515844 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 17:36:29.987690 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:36:29.987657 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 17:36:30.083713 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:36:30.083683 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-6df6d6cbc5-x67lq"] Jul 14 17:36:30.084111 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:36:30.084097 2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e8fa717e-c2fe-4bb3-bd6e-bb0a2ce42868" containerName="manager" Jul 14 17:36:30.084160 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:36:30.084114 2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="e8fa717e-c2fe-4bb3-bd6e-bb0a2ce42868" containerName="manager" Jul 14 17:36:30.084195 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:36:30.084176 2552 memory_manager.go:368] "RemoveStaleState removing state" podUID="e8fa717e-c2fe-4bb3-bd6e-bb0a2ce42868" containerName="manager" Jul 14 17:36:30.086935 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:36:30.086917 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-6df6d6cbc5-x67lq" Jul 14 17:36:30.089618 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:36:30.089594 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-ggvwm\"" Jul 14 17:36:30.089708 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:36:30.089632 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-serving-cert\"" Jul 14 17:36:30.097948 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:36:30.097927 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-6df6d6cbc5-x67lq"] Jul 14 17:36:30.142385 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:36:30.142359 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/798a9402-509e-4d58-9191-6d4a87205cc7-openshift-service-ca\") pod \"maas-api-6df6d6cbc5-x67lq\" (UID: \"798a9402-509e-4d58-9191-6d4a87205cc7\") " pod="odh-ai-gateway-infra/maas-api-6df6d6cbc5-x67lq" Jul 14 17:36:30.142523 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:36:30.142403 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/798a9402-509e-4d58-9191-6d4a87205cc7-maas-api-tls\") pod \"maas-api-6df6d6cbc5-x67lq\" (UID: \"798a9402-509e-4d58-9191-6d4a87205cc7\") " pod="odh-ai-gateway-infra/maas-api-6df6d6cbc5-x67lq" Jul 14 17:36:30.142523 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:36:30.142425 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7djz8\" (UniqueName: \"kubernetes.io/projected/798a9402-509e-4d58-9191-6d4a87205cc7-kube-api-access-7djz8\") pod \"maas-api-6df6d6cbc5-x67lq\" (UID: \"798a9402-509e-4d58-9191-6d4a87205cc7\") " pod="odh-ai-gateway-infra/maas-api-6df6d6cbc5-x67lq" Jul 14 17:36:30.177833 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:36:30.177798 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 17:36:30.243157 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:36:30.243081 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/798a9402-509e-4d58-9191-6d4a87205cc7-openshift-service-ca\") pod \"maas-api-6df6d6cbc5-x67lq\" (UID: \"798a9402-509e-4d58-9191-6d4a87205cc7\") " pod="odh-ai-gateway-infra/maas-api-6df6d6cbc5-x67lq" Jul 14 17:36:30.243157 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:36:30.243130 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/798a9402-509e-4d58-9191-6d4a87205cc7-maas-api-tls\") pod \"maas-api-6df6d6cbc5-x67lq\" (UID: \"798a9402-509e-4d58-9191-6d4a87205cc7\") " pod="odh-ai-gateway-infra/maas-api-6df6d6cbc5-x67lq" Jul 14 17:36:30.243157 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:36:30.243159 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7djz8\" (UniqueName: \"kubernetes.io/projected/798a9402-509e-4d58-9191-6d4a87205cc7-kube-api-access-7djz8\") pod \"maas-api-6df6d6cbc5-x67lq\" (UID: \"798a9402-509e-4d58-9191-6d4a87205cc7\") " pod="odh-ai-gateway-infra/maas-api-6df6d6cbc5-x67lq" Jul 14 17:36:30.243829 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:36:30.243807 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/798a9402-509e-4d58-9191-6d4a87205cc7-openshift-service-ca\") pod \"maas-api-6df6d6cbc5-x67lq\" (UID: \"798a9402-509e-4d58-9191-6d4a87205cc7\") " pod="odh-ai-gateway-infra/maas-api-6df6d6cbc5-x67lq" Jul 14 17:36:30.245671 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:36:30.245650 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/798a9402-509e-4d58-9191-6d4a87205cc7-maas-api-tls\") pod \"maas-api-6df6d6cbc5-x67lq\" (UID: \"798a9402-509e-4d58-9191-6d4a87205cc7\") " pod="odh-ai-gateway-infra/maas-api-6df6d6cbc5-x67lq" Jul 14 17:36:30.251889 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:36:30.251864 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7djz8\" (UniqueName: \"kubernetes.io/projected/798a9402-509e-4d58-9191-6d4a87205cc7-kube-api-access-7djz8\") pod \"maas-api-6df6d6cbc5-x67lq\" (UID: \"798a9402-509e-4d58-9191-6d4a87205cc7\") " pod="odh-ai-gateway-infra/maas-api-6df6d6cbc5-x67lq" Jul 14 17:36:30.397764 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:36:30.397736 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-6df6d6cbc5-x67lq" Jul 14 17:36:30.535607 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:36:30.535527 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-6df6d6cbc5-x67lq"] Jul 14 17:36:30.538924 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:36:30.538898 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod798a9402_509e_4d58_9191_6d4a87205cc7.slice/crio-a362b409e0fd742a190b5d58be1c5d6a31f07122c694bf59216d51db247321bc WatchSource:0}: Error finding container a362b409e0fd742a190b5d58be1c5d6a31f07122c694bf59216d51db247321bc: Status 404 returned error can't find the container with id a362b409e0fd742a190b5d58be1c5d6a31f07122c694bf59216d51db247321bc Jul 14 17:36:30.557094 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:36:30.557071 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 17:36:30.655655 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:36:30.655620 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 17:36:30.687222 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:36:30.687188 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-f9b8d9b9b-xvclx"] Jul 14 17:36:30.690525 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:36:30.690505 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-f9b8d9b9b-xvclx" Jul 14 17:36:30.693139 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:36:30.693121 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\"" Jul 14 17:36:30.693227 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:36:30.693171 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-tbbcn\"" Jul 14 17:36:30.703509 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:36:30.703486 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-f9b8d9b9b-xvclx"] Jul 14 17:36:30.734125 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:36:30.734099 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-74584bb9f8-d6jgb"] Jul 14 17:36:30.736675 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:36:30.736655 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-74584bb9f8-d6jgb" Jul 14 17:36:30.746632 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:36:30.746610 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-74584bb9f8-d6jgb"] Jul 14 17:36:30.746908 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:36:30.746887 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3c4cb565-7bf8-40e7-830f-52b1e50dfa6f-plugins-config-volume\") pod \"payload-processing-f9b8d9b9b-xvclx\" (UID: \"3c4cb565-7bf8-40e7-830f-52b1e50dfa6f\") " pod="openshift-ingress/payload-processing-f9b8d9b9b-xvclx" Jul 14 17:36:30.746971 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:36:30.746921 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4508bbbe-c5a9-4879-a440-b1f0cf3c81bd-plugins-config-volume\") pod \"payload-pre-processing-74584bb9f8-d6jgb\" (UID: \"4508bbbe-c5a9-4879-a440-b1f0cf3c81bd\") " pod="openshift-ingress/payload-pre-processing-74584bb9f8-d6jgb" Jul 14 17:36:30.746971 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:36:30.746943 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hqm6h\" (UniqueName: \"kubernetes.io/projected/3c4cb565-7bf8-40e7-830f-52b1e50dfa6f-kube-api-access-hqm6h\") pod \"payload-processing-f9b8d9b9b-xvclx\" (UID: \"3c4cb565-7bf8-40e7-830f-52b1e50dfa6f\") " pod="openshift-ingress/payload-processing-f9b8d9b9b-xvclx" Jul 14 17:36:30.747091 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:36:30.747074 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xrdwh\" (UniqueName: \"kubernetes.io/projected/4508bbbe-c5a9-4879-a440-b1f0cf3c81bd-kube-api-access-xrdwh\") pod \"payload-pre-processing-74584bb9f8-d6jgb\" (UID: \"4508bbbe-c5a9-4879-a440-b1f0cf3c81bd\") " pod="openshift-ingress/payload-pre-processing-74584bb9f8-d6jgb" Jul 14 17:36:30.848217 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:36:30.848123 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3c4cb565-7bf8-40e7-830f-52b1e50dfa6f-plugins-config-volume\") pod \"payload-processing-f9b8d9b9b-xvclx\" (UID: \"3c4cb565-7bf8-40e7-830f-52b1e50dfa6f\") " pod="openshift-ingress/payload-processing-f9b8d9b9b-xvclx" Jul 14 17:36:30.848217 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:36:30.848175 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4508bbbe-c5a9-4879-a440-b1f0cf3c81bd-plugins-config-volume\") pod \"payload-pre-processing-74584bb9f8-d6jgb\" (UID: \"4508bbbe-c5a9-4879-a440-b1f0cf3c81bd\") " pod="openshift-ingress/payload-pre-processing-74584bb9f8-d6jgb" Jul 14 17:36:30.848217 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:36:30.848203 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hqm6h\" (UniqueName: \"kubernetes.io/projected/3c4cb565-7bf8-40e7-830f-52b1e50dfa6f-kube-api-access-hqm6h\") pod \"payload-processing-f9b8d9b9b-xvclx\" (UID: \"3c4cb565-7bf8-40e7-830f-52b1e50dfa6f\") " pod="openshift-ingress/payload-processing-f9b8d9b9b-xvclx" Jul 14 17:36:30.848530 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:36:30.848292 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xrdwh\" (UniqueName: \"kubernetes.io/projected/4508bbbe-c5a9-4879-a440-b1f0cf3c81bd-kube-api-access-xrdwh\") pod \"payload-pre-processing-74584bb9f8-d6jgb\" (UID: \"4508bbbe-c5a9-4879-a440-b1f0cf3c81bd\") " pod="openshift-ingress/payload-pre-processing-74584bb9f8-d6jgb" Jul 14 17:36:30.849120 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:36:30.849094 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4508bbbe-c5a9-4879-a440-b1f0cf3c81bd-plugins-config-volume\") pod \"payload-pre-processing-74584bb9f8-d6jgb\" (UID: \"4508bbbe-c5a9-4879-a440-b1f0cf3c81bd\") " pod="openshift-ingress/payload-pre-processing-74584bb9f8-d6jgb" Jul 14 17:36:30.849207 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:36:30.849094 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3c4cb565-7bf8-40e7-830f-52b1e50dfa6f-plugins-config-volume\") pod \"payload-processing-f9b8d9b9b-xvclx\" (UID: \"3c4cb565-7bf8-40e7-830f-52b1e50dfa6f\") " pod="openshift-ingress/payload-processing-f9b8d9b9b-xvclx" Jul 14 17:36:30.856630 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:36:30.856602 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hqm6h\" (UniqueName: \"kubernetes.io/projected/3c4cb565-7bf8-40e7-830f-52b1e50dfa6f-kube-api-access-hqm6h\") pod \"payload-processing-f9b8d9b9b-xvclx\" (UID: \"3c4cb565-7bf8-40e7-830f-52b1e50dfa6f\") " pod="openshift-ingress/payload-processing-f9b8d9b9b-xvclx" Jul 14 17:36:30.856728 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:36:30.856672 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xrdwh\" (UniqueName: \"kubernetes.io/projected/4508bbbe-c5a9-4879-a440-b1f0cf3c81bd-kube-api-access-xrdwh\") pod \"payload-pre-processing-74584bb9f8-d6jgb\" (UID: \"4508bbbe-c5a9-4879-a440-b1f0cf3c81bd\") " pod="openshift-ingress/payload-pre-processing-74584bb9f8-d6jgb" Jul 14 17:36:31.001396 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:36:31.001361 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-f9b8d9b9b-xvclx" Jul 14 17:36:31.048800 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:36:31.048766 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-74584bb9f8-d6jgb" Jul 14 17:36:31.154497 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:36:31.154463 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-f9b8d9b9b-xvclx"] Jul 14 17:36:31.158624 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:36:31.158598 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3c4cb565_7bf8_40e7_830f_52b1e50dfa6f.slice/crio-4391ff5acc9bfbfe02f858b226b653fcfe0ac8be35ee9f77d4d96dc49f01f409 WatchSource:0}: Error finding container 4391ff5acc9bfbfe02f858b226b653fcfe0ac8be35ee9f77d4d96dc49f01f409: Status 404 returned error can't find the container with id 4391ff5acc9bfbfe02f858b226b653fcfe0ac8be35ee9f77d4d96dc49f01f409 Jul 14 17:36:31.199876 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:36:31.199853 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-74584bb9f8-d6jgb"] Jul 14 17:36:31.201833 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:36:31.201808 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4508bbbe_c5a9_4879_a440_b1f0cf3c81bd.slice/crio-ac61227255211451df4a4dbb30ca563ab0de5506074d34c8dc90e293da292c97 WatchSource:0}: Error finding container ac61227255211451df4a4dbb30ca563ab0de5506074d34c8dc90e293da292c97: Status 404 returned error can't find the container with id ac61227255211451df4a4dbb30ca563ab0de5506074d34c8dc90e293da292c97 Jul 14 17:36:31.409974 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:36:31.409892 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-74584bb9f8-d6jgb" event={"ID":"4508bbbe-c5a9-4879-a440-b1f0cf3c81bd","Type":"ContainerStarted","Data":"ac61227255211451df4a4dbb30ca563ab0de5506074d34c8dc90e293da292c97"} Jul 14 17:36:31.410939 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:36:31.410917 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-f9b8d9b9b-xvclx" event={"ID":"3c4cb565-7bf8-40e7-830f-52b1e50dfa6f","Type":"ContainerStarted","Data":"4391ff5acc9bfbfe02f858b226b653fcfe0ac8be35ee9f77d4d96dc49f01f409"} Jul 14 17:36:31.412066 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:36:31.412048 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-6df6d6cbc5-x67lq" event={"ID":"798a9402-509e-4d58-9191-6d4a87205cc7","Type":"ContainerStarted","Data":"a362b409e0fd742a190b5d58be1c5d6a31f07122c694bf59216d51db247321bc"} Jul 14 17:36:33.429487 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:36:33.429425 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-f9b8d9b9b-xvclx" Jul 14 17:36:33.445582 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:36:33.445529 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-f9b8d9b9b-xvclx" podStartSLOduration=1.280397026 podStartE2EDuration="3.445514197s" totalImagesPullingTime="2.165117171s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 17:36:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 17:36:33.443850218 +0000 UTC m=+655.822964162" watchObservedRunningTime="2026-07-14 17:36:33.445514197 +0000 UTC m=+655.824628148" Jul 14 17:36:34.437984 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:36:34.437945 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-74584bb9f8-d6jgb" event={"ID":"4508bbbe-c5a9-4879-a440-b1f0cf3c81bd","Type":"ContainerStarted","Data":"b62c2d3a4513b410508bfc3493814393e7f4df08c8c788448cc0a7679221b007"} Jul 14 17:36:34.438500 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:36:34.438045 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-74584bb9f8-d6jgb" Jul 14 17:36:34.439636 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:36:34.439603 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-f9b8d9b9b-xvclx" event={"ID":"3c4cb565-7bf8-40e7-830f-52b1e50dfa6f","Type":"ContainerStarted","Data":"9a75ace30152f9a7f57a74a65944b99c0218df2d00c8ed06997ecb3853c228f9"} Jul 14 17:36:34.441149 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:36:34.441118 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-6df6d6cbc5-x67lq" event={"ID":"798a9402-509e-4d58-9191-6d4a87205cc7","Type":"ContainerStarted","Data":"be8b594cc14bb10b15bb23c1683541e3175040bc71d68c259f8aa97f01ba7b70"} Jul 14 17:36:34.441292 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:36:34.441251 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-6df6d6cbc5-x67lq" Jul 14 17:36:34.454763 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:36:34.454718 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-74584bb9f8-d6jgb" podStartSLOduration=2.334642213 podStartE2EDuration="4.454703699s" totalImagesPullingTime="2.120061486s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 17:36:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 17:36:34.453590548 +0000 UTC m=+656.832704499" watchObservedRunningTime="2026-07-14 17:36:34.454703699 +0000 UTC m=+656.833817650" Jul 14 17:36:34.469125 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:36:34.469091 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-6df6d6cbc5-x67lq" podStartSLOduration=1.685301028 podStartE2EDuration="4.469078158s" totalImagesPullingTime="2.78377713s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 17:36:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 17:36:34.469035573 +0000 UTC m=+656.848149522" watchObservedRunningTime="2026-07-14 17:36:34.469078158 +0000 UTC m=+656.848192110" Jul 14 17:36:39.105758 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:36:39.105723 2552 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-5896d4dd49-2mfg8 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.41:15021/healthz/ready\": read tcp 10.132.0.2:50952->10.132.0.41:15021: read: connection reset by peer" start-of-body= Jul 14 17:36:39.106153 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:36:39.105806 2552 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-2mfg8" podUID="22e7ffc4-a033-449e-9329-aef67ebb6bef" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.41:15021/healthz/ready\": read tcp 10.132.0.2:50952->10.132.0.41:15021: read: connection reset by peer" Jul 14 17:36:39.466114 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:36:39.466080 2552 generic.go:356] "Generic (PLEG): container finished" podID="22e7ffc4-a033-449e-9329-aef67ebb6bef" containerID="e5f76d37ea1bb647cd0f916090e40baec33962813fda885249451ffa3e0a0e97" exitCode=0 Jul 14 17:36:39.466271 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:36:39.466145 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-2mfg8" event={"ID":"22e7ffc4-a033-449e-9329-aef67ebb6bef","Type":"ContainerDied","Data":"e5f76d37ea1bb647cd0f916090e40baec33962813fda885249451ffa3e0a0e97"} Jul 14 17:36:39.466535 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:36:39.466522 2552 scope.go:117] "RemoveContainer" containerID="e5f76d37ea1bb647cd0f916090e40baec33962813fda885249451ffa3e0a0e97" Jul 14 17:36:39.467453 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:36:39.467428 2552 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 14 17:36:39.467510 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:36:39.467491 2552 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 14 17:36:39.467555 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:36:39.467521 2552 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 14 17:36:40.451521 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:36:40.451492 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-6df6d6cbc5-x67lq" Jul 14 17:36:40.473391 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:36:40.473357 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-2mfg8" event={"ID":"22e7ffc4-a033-449e-9329-aef67ebb6bef","Type":"ContainerStarted","Data":"ab576768c19b8536f330599c855b36a3df031f93e44d7c135e28536cded1170d"} Jul 14 17:36:40.692611 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:36:40.692172 2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-2mfg8" Jul 14 17:36:40.692611 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:36:40.692286 2552 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-5896d4dd49-2mfg8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.41:15021/healthz/ready\": dial tcp 10.132.0.41:15021: connect: connection refused" start-of-body= Jul 14 17:36:40.692611 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:36:40.692354 2552 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-2mfg8" podUID="22e7ffc4-a033-449e-9329-aef67ebb6bef" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.41:15021/healthz/ready\": dial tcp 10.132.0.41:15021: connect: connection refused" Jul 14 17:36:41.447689 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:36:41.447656 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 17:36:41.645716 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:36:41.645679 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 17:36:41.691897 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:36:41.691863 2552 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-5896d4dd49-2mfg8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.41:15021/healthz/ready\": dial tcp 10.132.0.41:15021: connect: connection refused" start-of-body= Jul 14 17:36:41.692055 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:36:41.691940 2552 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-2mfg8" podUID="22e7ffc4-a033-449e-9329-aef67ebb6bef" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.41:15021/healthz/ready\": dial tcp 10.132.0.41:15021: connect: connection refused" Jul 14 17:36:42.692395 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:36:42.692356 2552 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-5896d4dd49-2mfg8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.41:15021/healthz/ready\": dial tcp 10.132.0.41:15021: connect: connection refused" start-of-body= Jul 14 17:36:42.692884 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:36:42.692421 2552 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-2mfg8" podUID="22e7ffc4-a033-449e-9329-aef67ebb6bef" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.41:15021/healthz/ready\": dial tcp 10.132.0.41:15021: connect: connection refused" Jul 14 17:36:43.691346 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:36:43.691298 2552 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-5896d4dd49-2mfg8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.41:15021/healthz/ready\": dial tcp 10.132.0.41:15021: connect: connection refused" start-of-body= Jul 14 17:36:43.691623 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:36:43.691592 2552 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-2mfg8" podUID="22e7ffc4-a033-449e-9329-aef67ebb6bef" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.41:15021/healthz/ready\": dial tcp 10.132.0.41:15021: connect: connection refused" Jul 14 17:36:44.695689 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:36:44.695661 2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-2mfg8" Jul 14 17:36:44.696053 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:36:44.696031 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-2mfg8" Jul 14 17:36:44.696751 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:36:44.696733 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-2mfg8" Jul 14 17:36:45.448521 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:36:45.448473 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-f9b8d9b9b-xvclx" Jul 14 17:36:45.448724 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:36:45.448656 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-74584bb9f8-d6jgb" Jul 14 17:36:59.392864 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:36:59.392826 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-9bbdx"] Jul 14 17:36:59.397465 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:36:59.397443 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-9bbdx" Jul 14 17:36:59.400432 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:36:59.400405 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jul 14 17:36:59.400561 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:36:59.400405 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jul 14 17:36:59.401724 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:36:59.401704 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\"" Jul 14 17:36:59.401828 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:36:59.401704 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-w8snq\"" Jul 14 17:36:59.405586 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:36:59.405553 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-9bbdx"] Jul 14 17:36:59.419024 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:36:59.418979 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 17:36:59.511208 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:36:59.511173 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/69154cb6-3596-4f8d-b0e6-cdd08c9005e5-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-9bbdx\" (UID: \"69154cb6-3596-4f8d-b0e6-cdd08c9005e5\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-9bbdx" Jul 14 17:36:59.511413 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:36:59.511301 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/69154cb6-3596-4f8d-b0e6-cdd08c9005e5-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-9bbdx\" (UID: \"69154cb6-3596-4f8d-b0e6-cdd08c9005e5\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-9bbdx" Jul 14 17:36:59.511413 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:36:59.511377 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/69154cb6-3596-4f8d-b0e6-cdd08c9005e5-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-9bbdx\" (UID: \"69154cb6-3596-4f8d-b0e6-cdd08c9005e5\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-9bbdx" Jul 14 17:36:59.511501 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:36:59.511429 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/69154cb6-3596-4f8d-b0e6-cdd08c9005e5-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-9bbdx\" (UID: \"69154cb6-3596-4f8d-b0e6-cdd08c9005e5\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-9bbdx" Jul 14 17:36:59.511536 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:36:59.511496 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sjz2t\" (UniqueName: \"kubernetes.io/projected/69154cb6-3596-4f8d-b0e6-cdd08c9005e5-kube-api-access-sjz2t\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-9bbdx\" (UID: \"69154cb6-3596-4f8d-b0e6-cdd08c9005e5\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-9bbdx" Jul 14 17:36:59.511570 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:36:59.511551 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/69154cb6-3596-4f8d-b0e6-cdd08c9005e5-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-9bbdx\" (UID: \"69154cb6-3596-4f8d-b0e6-cdd08c9005e5\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-9bbdx" Jul 14 17:36:59.612934 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:36:59.612896 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/69154cb6-3596-4f8d-b0e6-cdd08c9005e5-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-9bbdx\" (UID: \"69154cb6-3596-4f8d-b0e6-cdd08c9005e5\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-9bbdx" Jul 14 17:36:59.613098 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:36:59.612958 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/69154cb6-3596-4f8d-b0e6-cdd08c9005e5-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-9bbdx\" (UID: \"69154cb6-3596-4f8d-b0e6-cdd08c9005e5\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-9bbdx" Jul 14 17:36:59.613098 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:36:59.612974 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/69154cb6-3596-4f8d-b0e6-cdd08c9005e5-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-9bbdx\" (UID: \"69154cb6-3596-4f8d-b0e6-cdd08c9005e5\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-9bbdx" Jul 14 17:36:59.613098 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:36:59.612993 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/69154cb6-3596-4f8d-b0e6-cdd08c9005e5-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-9bbdx\" (UID: \"69154cb6-3596-4f8d-b0e6-cdd08c9005e5\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-9bbdx" Jul 14 17:36:59.613098 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:36:59.613014 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/69154cb6-3596-4f8d-b0e6-cdd08c9005e5-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-9bbdx\" (UID: \"69154cb6-3596-4f8d-b0e6-cdd08c9005e5\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-9bbdx" Jul 14 17:36:59.613098 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:36:59.613038 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sjz2t\" (UniqueName: \"kubernetes.io/projected/69154cb6-3596-4f8d-b0e6-cdd08c9005e5-kube-api-access-sjz2t\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-9bbdx\" (UID: \"69154cb6-3596-4f8d-b0e6-cdd08c9005e5\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-9bbdx" Jul 14 17:36:59.613403 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:36:59.613378 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/69154cb6-3596-4f8d-b0e6-cdd08c9005e5-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-9bbdx\" (UID: \"69154cb6-3596-4f8d-b0e6-cdd08c9005e5\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-9bbdx" Jul 14 17:36:59.613403 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:36:59.613396 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/69154cb6-3596-4f8d-b0e6-cdd08c9005e5-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-9bbdx\" (UID: \"69154cb6-3596-4f8d-b0e6-cdd08c9005e5\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-9bbdx" Jul 14 17:36:59.613513 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:36:59.613444 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/69154cb6-3596-4f8d-b0e6-cdd08c9005e5-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-9bbdx\" (UID: \"69154cb6-3596-4f8d-b0e6-cdd08c9005e5\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-9bbdx" Jul 14 17:36:59.615313 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:36:59.615288 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/69154cb6-3596-4f8d-b0e6-cdd08c9005e5-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-9bbdx\" (UID: \"69154cb6-3596-4f8d-b0e6-cdd08c9005e5\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-9bbdx" Jul 14 17:36:59.615586 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:36:59.615569 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/69154cb6-3596-4f8d-b0e6-cdd08c9005e5-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-9bbdx\" (UID: \"69154cb6-3596-4f8d-b0e6-cdd08c9005e5\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-9bbdx" Jul 14 17:36:59.621120 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:36:59.621093 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sjz2t\" (UniqueName: \"kubernetes.io/projected/69154cb6-3596-4f8d-b0e6-cdd08c9005e5-kube-api-access-sjz2t\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-9bbdx\" (UID: \"69154cb6-3596-4f8d-b0e6-cdd08c9005e5\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-9bbdx" Jul 14 17:36:59.710146 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:36:59.710120 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-9bbdx" Jul 14 17:36:59.848765 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:36:59.848739 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-9bbdx"] Jul 14 17:36:59.851296 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:36:59.851259 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod69154cb6_3596_4f8d_b0e6_cdd08c9005e5.slice/crio-d22b699354c2939c5c9c0f08915cf8b812a13641d624fa739f09494ed4220640 WatchSource:0}: Error finding container d22b699354c2939c5c9c0f08915cf8b812a13641d624fa739f09494ed4220640: Status 404 returned error can't find the container with id d22b699354c2939c5c9c0f08915cf8b812a13641d624fa739f09494ed4220640 Jul 14 17:37:00.572371 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:37:00.572302 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-9bbdx" event={"ID":"69154cb6-3596-4f8d-b0e6-cdd08c9005e5","Type":"ContainerStarted","Data":"d22b699354c2939c5c9c0f08915cf8b812a13641d624fa739f09494ed4220640"} Jul 14 17:37:01.579919 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:37:01.579886 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-9bbdx" event={"ID":"69154cb6-3596-4f8d-b0e6-cdd08c9005e5","Type":"ContainerStarted","Data":"f940c5e3baafa105f41a17de12b2655caf9b6e9af1cae4f2aa9c9e9c4f8d7570"} Jul 14 17:37:01.598615 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:37:01.598556 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-9bbdx" podStartSLOduration=1.275375193 podStartE2EDuration="2.598541737s" totalImagesPullingTime="1.323166544s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 17:36:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 17:37:01.596516358 +0000 UTC m=+683.975630310" watchObservedRunningTime="2026-07-14 17:37:01.598541737 +0000 UTC m=+683.977655689" Jul 14 17:37:09.710701 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:37:09.710662 2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-9bbdx" Jul 14 17:37:09.711077 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:37:09.710732 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-9bbdx" Jul 14 17:37:09.723227 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:37:09.723202 2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-9bbdx" Jul 14 17:37:10.638142 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:37:10.638107 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-9bbdx" Jul 14 17:37:14.481735 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:37:14.481695 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-gk5p2"] Jul 14 17:37:14.487165 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:37:14.487140 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-gk5p2" Jul 14 17:37:14.490261 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:37:14.490241 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\"" Jul 14 17:37:14.499115 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:37:14.499092 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-gk5p2"] Jul 14 17:37:14.514208 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:37:14.514176 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 17:37:14.543371 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:37:14.543350 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a4ff6801-75ad-4082-8db2-4bd025467345-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-gk5p2\" (UID: \"a4ff6801-75ad-4082-8db2-4bd025467345\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-gk5p2" Jul 14 17:37:14.543474 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:37:14.543389 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a4ff6801-75ad-4082-8db2-4bd025467345-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-gk5p2\" (UID: \"a4ff6801-75ad-4082-8db2-4bd025467345\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-gk5p2" Jul 14 17:37:14.543474 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:37:14.543410 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a4ff6801-75ad-4082-8db2-4bd025467345-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-gk5p2\" (UID: \"a4ff6801-75ad-4082-8db2-4bd025467345\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-gk5p2" Jul 14 17:37:14.543474 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:37:14.543435 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a4ff6801-75ad-4082-8db2-4bd025467345-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-gk5p2\" (UID: \"a4ff6801-75ad-4082-8db2-4bd025467345\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-gk5p2" Jul 14 17:37:14.543474 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:37:14.543449 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8xs4s\" (UniqueName: \"kubernetes.io/projected/a4ff6801-75ad-4082-8db2-4bd025467345-kube-api-access-8xs4s\") pod \"e2e-distinct-simulated-kserve-59975d69f9-gk5p2\" (UID: \"a4ff6801-75ad-4082-8db2-4bd025467345\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-gk5p2" Jul 14 17:37:14.543632 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:37:14.543537 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a4ff6801-75ad-4082-8db2-4bd025467345-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-gk5p2\" (UID: \"a4ff6801-75ad-4082-8db2-4bd025467345\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-gk5p2" Jul 14 17:37:14.644688 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:37:14.644660 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a4ff6801-75ad-4082-8db2-4bd025467345-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-gk5p2\" (UID: \"a4ff6801-75ad-4082-8db2-4bd025467345\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-gk5p2" Jul 14 17:37:14.644878 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:37:14.644714 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a4ff6801-75ad-4082-8db2-4bd025467345-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-gk5p2\" (UID: \"a4ff6801-75ad-4082-8db2-4bd025467345\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-gk5p2" Jul 14 17:37:14.644878 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:37:14.644743 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a4ff6801-75ad-4082-8db2-4bd025467345-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-gk5p2\" (UID: \"a4ff6801-75ad-4082-8db2-4bd025467345\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-gk5p2" Jul 14 17:37:14.644878 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:37:14.644775 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a4ff6801-75ad-4082-8db2-4bd025467345-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-gk5p2\" (UID: \"a4ff6801-75ad-4082-8db2-4bd025467345\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-gk5p2" Jul 14 17:37:14.644878 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:37:14.644797 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8xs4s\" (UniqueName: \"kubernetes.io/projected/a4ff6801-75ad-4082-8db2-4bd025467345-kube-api-access-8xs4s\") pod \"e2e-distinct-simulated-kserve-59975d69f9-gk5p2\" (UID: \"a4ff6801-75ad-4082-8db2-4bd025467345\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-gk5p2" Jul 14 17:37:14.644878 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:37:14.644833 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a4ff6801-75ad-4082-8db2-4bd025467345-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-gk5p2\" (UID: \"a4ff6801-75ad-4082-8db2-4bd025467345\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-gk5p2" Jul 14 17:37:14.645142 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:37:14.645107 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a4ff6801-75ad-4082-8db2-4bd025467345-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-gk5p2\" (UID: \"a4ff6801-75ad-4082-8db2-4bd025467345\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-gk5p2" Jul 14 17:37:14.645202 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:37:14.645157 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a4ff6801-75ad-4082-8db2-4bd025467345-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-gk5p2\" (UID: \"a4ff6801-75ad-4082-8db2-4bd025467345\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-gk5p2" Jul 14 17:37:14.645259 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:37:14.645224 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a4ff6801-75ad-4082-8db2-4bd025467345-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-gk5p2\" (UID: \"a4ff6801-75ad-4082-8db2-4bd025467345\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-gk5p2" Jul 14 17:37:14.647193 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:37:14.647168 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a4ff6801-75ad-4082-8db2-4bd025467345-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-gk5p2\" (UID: \"a4ff6801-75ad-4082-8db2-4bd025467345\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-gk5p2" Jul 14 17:37:14.647703 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:37:14.647682 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a4ff6801-75ad-4082-8db2-4bd025467345-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-gk5p2\" (UID: \"a4ff6801-75ad-4082-8db2-4bd025467345\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-gk5p2" Jul 14 17:37:14.652422 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:37:14.652405 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8xs4s\" (UniqueName: \"kubernetes.io/projected/a4ff6801-75ad-4082-8db2-4bd025467345-kube-api-access-8xs4s\") pod \"e2e-distinct-simulated-kserve-59975d69f9-gk5p2\" (UID: \"a4ff6801-75ad-4082-8db2-4bd025467345\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-gk5p2" Jul 14 17:37:14.799258 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:37:14.799172 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-gk5p2" Jul 14 17:37:14.954355 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:37:14.954310 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-gk5p2"] Jul 14 17:37:14.956446 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:37:14.956418 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda4ff6801_75ad_4082_8db2_4bd025467345.slice/crio-81dd7076c5cfa803ad1f387d732643b39fde084d138a08704072ea95a7109389 WatchSource:0}: Error finding container 81dd7076c5cfa803ad1f387d732643b39fde084d138a08704072ea95a7109389: Status 404 returned error can't find the container with id 81dd7076c5cfa803ad1f387d732643b39fde084d138a08704072ea95a7109389 Jul 14 17:37:14.957903 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:37:14.957883 2552 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 14 17:37:15.655818 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:37:15.655785 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-gk5p2" event={"ID":"a4ff6801-75ad-4082-8db2-4bd025467345","Type":"ContainerStarted","Data":"b87e80653a9a9a0f92dc5b4f769b2e5ad2f654fc9f6c5968da4595dd66312ae6"} Jul 14 17:37:15.656214 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:37:15.655845 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-gk5p2" event={"ID":"a4ff6801-75ad-4082-8db2-4bd025467345","Type":"ContainerStarted","Data":"81dd7076c5cfa803ad1f387d732643b39fde084d138a08704072ea95a7109389"} Jul 14 17:37:15.677940 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:37:15.677887 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-gk5p2" podStartSLOduration=1.432904804 podStartE2EDuration="1.677869286s" totalImagesPullingTime="244.964482ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 17:37:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 17:37:15.67752454 +0000 UTC m=+698.056638515" watchObservedRunningTime="2026-07-14 17:37:15.677869286 +0000 UTC m=+698.056983239" Jul 14 17:37:19.792700 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:37:19.792661 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 17:37:24.800414 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:37:24.800376 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-gk5p2" Jul 14 17:37:24.800903 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:37:24.800500 2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-gk5p2" Jul 14 17:37:24.812545 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:37:24.812519 2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-gk5p2" Jul 14 17:37:25.726292 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:37:25.726266 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-gk5p2" Jul 14 17:37:43.689114 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:37:43.689029 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbh9xd5"] Jul 14 17:37:43.693638 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:37:43.693615 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbh9xd5" Jul 14 17:37:43.696379 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:37:43.696358 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\"" Jul 14 17:37:43.701210 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:37:43.701182 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbh9xd5"] Jul 14 17:37:43.720434 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:37:43.720396 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 17:37:43.798140 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:37:43.798106 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-85kkb\" (UniqueName: \"kubernetes.io/projected/d1825f28-d458-4672-b58f-76aaaaeae76b-kube-api-access-85kkb\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbh9xd5\" (UID: \"d1825f28-d458-4672-b58f-76aaaaeae76b\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbh9xd5" Jul 14 17:37:43.798140 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:37:43.798144 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d1825f28-d458-4672-b58f-76aaaaeae76b-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbh9xd5\" (UID: \"d1825f28-d458-4672-b58f-76aaaaeae76b\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbh9xd5" Jul 14 17:37:43.798427 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:37:43.798169 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d1825f28-d458-4672-b58f-76aaaaeae76b-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbh9xd5\" (UID: \"d1825f28-d458-4672-b58f-76aaaaeae76b\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbh9xd5" Jul 14 17:37:43.798427 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:37:43.798269 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d1825f28-d458-4672-b58f-76aaaaeae76b-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbh9xd5\" (UID: \"d1825f28-d458-4672-b58f-76aaaaeae76b\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbh9xd5" Jul 14 17:37:43.798427 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:37:43.798313 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d1825f28-d458-4672-b58f-76aaaaeae76b-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbh9xd5\" (UID: \"d1825f28-d458-4672-b58f-76aaaaeae76b\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbh9xd5" Jul 14 17:37:43.798572 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:37:43.798426 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d1825f28-d458-4672-b58f-76aaaaeae76b-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbh9xd5\" (UID: \"d1825f28-d458-4672-b58f-76aaaaeae76b\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbh9xd5" Jul 14 17:37:43.899868 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:37:43.899834 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-85kkb\" (UniqueName: \"kubernetes.io/projected/d1825f28-d458-4672-b58f-76aaaaeae76b-kube-api-access-85kkb\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbh9xd5\" (UID: \"d1825f28-d458-4672-b58f-76aaaaeae76b\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbh9xd5" Jul 14 17:37:43.899868 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:37:43.899873 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d1825f28-d458-4672-b58f-76aaaaeae76b-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbh9xd5\" (UID: \"d1825f28-d458-4672-b58f-76aaaaeae76b\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbh9xd5" Jul 14 17:37:43.900095 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:37:43.899900 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d1825f28-d458-4672-b58f-76aaaaeae76b-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbh9xd5\" (UID: \"d1825f28-d458-4672-b58f-76aaaaeae76b\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbh9xd5" Jul 14 17:37:43.900095 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:37:43.899940 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d1825f28-d458-4672-b58f-76aaaaeae76b-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbh9xd5\" (UID: \"d1825f28-d458-4672-b58f-76aaaaeae76b\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbh9xd5" Jul 14 17:37:43.900095 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:37:43.899958 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d1825f28-d458-4672-b58f-76aaaaeae76b-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbh9xd5\" (UID: \"d1825f28-d458-4672-b58f-76aaaaeae76b\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbh9xd5" Jul 14 17:37:43.900095 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:37:43.899985 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d1825f28-d458-4672-b58f-76aaaaeae76b-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbh9xd5\" (UID: \"d1825f28-d458-4672-b58f-76aaaaeae76b\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbh9xd5" Jul 14 17:37:43.900306 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:37:43.900295 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d1825f28-d458-4672-b58f-76aaaaeae76b-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbh9xd5\" (UID: \"d1825f28-d458-4672-b58f-76aaaaeae76b\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbh9xd5" Jul 14 17:37:43.900396 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:37:43.900364 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d1825f28-d458-4672-b58f-76aaaaeae76b-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbh9xd5\" (UID: \"d1825f28-d458-4672-b58f-76aaaaeae76b\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbh9xd5" Jul 14 17:37:43.900456 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:37:43.900436 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d1825f28-d458-4672-b58f-76aaaaeae76b-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbh9xd5\" (UID: \"d1825f28-d458-4672-b58f-76aaaaeae76b\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbh9xd5" Jul 14 17:37:43.902211 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:37:43.902189 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d1825f28-d458-4672-b58f-76aaaaeae76b-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbh9xd5\" (UID: \"d1825f28-d458-4672-b58f-76aaaaeae76b\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbh9xd5" Jul 14 17:37:43.902473 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:37:43.902456 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d1825f28-d458-4672-b58f-76aaaaeae76b-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbh9xd5\" (UID: \"d1825f28-d458-4672-b58f-76aaaaeae76b\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbh9xd5" Jul 14 17:37:43.907507 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:37:43.907485 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-85kkb\" (UniqueName: \"kubernetes.io/projected/d1825f28-d458-4672-b58f-76aaaaeae76b-kube-api-access-85kkb\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbh9xd5\" (UID: \"d1825f28-d458-4672-b58f-76aaaaeae76b\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbh9xd5" Jul 14 17:37:44.007209 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:37:44.007177 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbh9xd5" Jul 14 17:37:44.144190 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:37:44.144160 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbh9xd5"] Jul 14 17:37:44.145866 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:37:44.145841 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd1825f28_d458_4672_b58f_76aaaaeae76b.slice/crio-97674c2ec2065d7edac8a0107d8fd4c5d854041bb6c2501b3c5ddf1797cc35d7 WatchSource:0}: Error finding container 97674c2ec2065d7edac8a0107d8fd4c5d854041bb6c2501b3c5ddf1797cc35d7: Status 404 returned error can't find the container with id 97674c2ec2065d7edac8a0107d8fd4c5d854041bb6c2501b3c5ddf1797cc35d7 Jul 14 17:37:44.810110 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:37:44.810069 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbh9xd5" event={"ID":"d1825f28-d458-4672-b58f-76aaaaeae76b","Type":"ContainerStarted","Data":"bd11c8e67da1cea8772be9c4578a3629d5c90ffdff47e4227c9c812e3fe5c060"} Jul 14 17:37:44.810524 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:37:44.810126 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbh9xd5" event={"ID":"d1825f28-d458-4672-b58f-76aaaaeae76b","Type":"ContainerStarted","Data":"97674c2ec2065d7edac8a0107d8fd4c5d854041bb6c2501b3c5ddf1797cc35d7"} Jul 14 17:37:44.831450 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:37:44.831388 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbh9xd5" podStartSLOduration=1.619000024 podStartE2EDuration="1.83137435s" totalImagesPullingTime="212.374326ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 17:37:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 17:37:44.829053774 +0000 UTC m=+727.208167736" watchObservedRunningTime="2026-07-14 17:37:44.83137435 +0000 UTC m=+727.210488349" Jul 14 17:37:54.007867 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:37:54.007835 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbh9xd5" Jul 14 17:37:54.008420 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:37:54.007896 2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbh9xd5" Jul 14 17:37:54.020059 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:37:54.020030 2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbh9xd5" Jul 14 17:37:54.877161 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:37:54.874795 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbh9xd5" Jul 14 17:38:05.219652 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:38:05.219618 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 17:38:26.716070 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:38:26.716030 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 17:38:54.952680 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:38:54.952636 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 17:39:30.045674 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:39:30.045635 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 17:39:30.135405 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:39:30.135370 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 17:39:31.258558 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:39:31.258527 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 17:39:31.354472 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:39:31.354441 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 17:40:38.111244 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:40:38.111170 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-gnw2z_b3c71861-4db9-4850-a44b-6f5d44a94235/console-operator/2.log" Jul 14 17:40:38.120133 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:40:38.120103 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cwprj_d3492336-881b-4f13-8d3a-b4d4ec05ad3c/ovn-acl-logging/0.log" Jul 14 17:40:38.121823 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:40:38.121806 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-gnw2z_b3c71861-4db9-4850-a44b-6f5d44a94235/console-operator/2.log" Jul 14 17:40:38.127107 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:40:38.127088 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cwprj_d3492336-881b-4f13-8d3a-b4d4ec05ad3c/ovn-acl-logging/0.log" Jul 14 17:40:42.124250 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:40:42.124214 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 17:40:47.153889 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:40:47.153854 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 17:40:47.256262 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:40:47.256228 2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-556ffcbcb6-mbzd7"] Jul 14 17:40:47.256484 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:40:47.256456 2552 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-556ffcbcb6-mbzd7" podUID="8338e15c-7498-48ff-89cc-0f2a398fc1bf" containerName="manager" containerID="cri-o://4494d7dbe49759163f4623e152522b9da6a1d0ffdef5d09c37c190c3f415a821" gracePeriod=30 Jul 14 17:40:47.514965 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:40:47.514941 2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-556ffcbcb6-mbzd7" Jul 14 17:40:47.653713 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:40:47.653685 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/8338e15c-7498-48ff-89cc-0f2a398fc1bf-webhook-cert\") pod \"8338e15c-7498-48ff-89cc-0f2a398fc1bf\" (UID: \"8338e15c-7498-48ff-89cc-0f2a398fc1bf\") " Jul 14 17:40:47.653901 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:40:47.653736 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ck6qs\" (UniqueName: \"kubernetes.io/projected/8338e15c-7498-48ff-89cc-0f2a398fc1bf-kube-api-access-ck6qs\") pod \"8338e15c-7498-48ff-89cc-0f2a398fc1bf\" (UID: \"8338e15c-7498-48ff-89cc-0f2a398fc1bf\") " Jul 14 17:40:47.655864 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:40:47.655817 2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8338e15c-7498-48ff-89cc-0f2a398fc1bf-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "8338e15c-7498-48ff-89cc-0f2a398fc1bf" (UID: "8338e15c-7498-48ff-89cc-0f2a398fc1bf"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 14 17:40:47.655864 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:40:47.655829 2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8338e15c-7498-48ff-89cc-0f2a398fc1bf-kube-api-access-ck6qs" (OuterVolumeSpecName: "kube-api-access-ck6qs") pod "8338e15c-7498-48ff-89cc-0f2a398fc1bf" (UID: "8338e15c-7498-48ff-89cc-0f2a398fc1bf"). InnerVolumeSpecName "kube-api-access-ck6qs". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 14 17:40:47.721962 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:40:47.721927 2552 generic.go:356] "Generic (PLEG): container finished" podID="8338e15c-7498-48ff-89cc-0f2a398fc1bf" containerID="4494d7dbe49759163f4623e152522b9da6a1d0ffdef5d09c37c190c3f415a821" exitCode=0 Jul 14 17:40:47.722099 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:40:47.721968 2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-556ffcbcb6-mbzd7" Jul 14 17:40:47.722099 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:40:47.721996 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-556ffcbcb6-mbzd7" event={"ID":"8338e15c-7498-48ff-89cc-0f2a398fc1bf","Type":"ContainerDied","Data":"4494d7dbe49759163f4623e152522b9da6a1d0ffdef5d09c37c190c3f415a821"} Jul 14 17:40:47.722099 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:40:47.722044 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-556ffcbcb6-mbzd7" event={"ID":"8338e15c-7498-48ff-89cc-0f2a398fc1bf","Type":"ContainerDied","Data":"548a6b3ab802ecb80919803520b039c83ea0be43a6ed9d834cc8adcbd691981b"} Jul 14 17:40:47.722099 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:40:47.722067 2552 scope.go:117] "RemoveContainer" containerID="4494d7dbe49759163f4623e152522b9da6a1d0ffdef5d09c37c190c3f415a821" Jul 14 17:40:47.731078 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:40:47.731056 2552 scope.go:117] "RemoveContainer" containerID="4494d7dbe49759163f4623e152522b9da6a1d0ffdef5d09c37c190c3f415a821" Jul 14 17:40:47.731435 ip-10-0-139-16 kubenswrapper[2552]: E0714 17:40:47.731312 2552 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4494d7dbe49759163f4623e152522b9da6a1d0ffdef5d09c37c190c3f415a821\": container with ID starting with 4494d7dbe49759163f4623e152522b9da6a1d0ffdef5d09c37c190c3f415a821 not found: ID does not exist" containerID="4494d7dbe49759163f4623e152522b9da6a1d0ffdef5d09c37c190c3f415a821" Jul 14 17:40:47.731479 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:40:47.731446 2552 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4494d7dbe49759163f4623e152522b9da6a1d0ffdef5d09c37c190c3f415a821"} err="failed to get container status \"4494d7dbe49759163f4623e152522b9da6a1d0ffdef5d09c37c190c3f415a821\": rpc error: code = NotFound desc = could not find container \"4494d7dbe49759163f4623e152522b9da6a1d0ffdef5d09c37c190c3f415a821\": container with ID starting with 4494d7dbe49759163f4623e152522b9da6a1d0ffdef5d09c37c190c3f415a821 not found: ID does not exist" Jul 14 17:40:47.743108 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:40:47.743088 2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-556ffcbcb6-mbzd7"] Jul 14 17:40:47.746170 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:40:47.746147 2552 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-556ffcbcb6-mbzd7"] Jul 14 17:40:47.754561 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:40:47.754541 2552 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/8338e15c-7498-48ff-89cc-0f2a398fc1bf-webhook-cert\") on node \"ip-10-0-139-16.ec2.internal\" DevicePath \"\"" Jul 14 17:40:47.754643 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:40:47.754564 2552 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ck6qs\" (UniqueName: \"kubernetes.io/projected/8338e15c-7498-48ff-89cc-0f2a398fc1bf-kube-api-access-ck6qs\") on node \"ip-10-0-139-16.ec2.internal\" DevicePath \"\"" Jul 14 17:40:48.388824 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:40:48.388786 2552 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8338e15c-7498-48ff-89cc-0f2a398fc1bf" path="/var/lib/kubelet/pods/8338e15c-7498-48ff-89cc-0f2a398fc1bf/volumes" Jul 14 17:40:48.441995 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:40:48.441960 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 17:40:48.548669 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:40:48.548637 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-556ffcbcb6-jlfj5"] Jul 14 17:40:48.549032 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:40:48.549021 2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8338e15c-7498-48ff-89cc-0f2a398fc1bf" containerName="manager" Jul 14 17:40:48.549079 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:40:48.549034 2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="8338e15c-7498-48ff-89cc-0f2a398fc1bf" containerName="manager" Jul 14 17:40:48.549120 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:40:48.549112 2552 memory_manager.go:368] "RemoveStaleState removing state" podUID="8338e15c-7498-48ff-89cc-0f2a398fc1bf" containerName="manager" Jul 14 17:40:48.553510 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:40:48.553491 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-556ffcbcb6-jlfj5" Jul 14 17:40:48.556120 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:40:48.556099 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" Jul 14 17:40:48.556273 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:40:48.556250 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\"" Jul 14 17:40:48.556419 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:40:48.556311 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-n4qdt\"" Jul 14 17:40:48.560744 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:40:48.560720 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-556ffcbcb6-jlfj5"] Jul 14 17:40:48.662410 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:40:48.662311 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/0b5f6905-9a33-4e7d-8209-e87a91dbbb24-webhook-cert\") pod \"maas-controller-556ffcbcb6-jlfj5\" (UID: \"0b5f6905-9a33-4e7d-8209-e87a91dbbb24\") " pod="opendatahub/maas-controller-556ffcbcb6-jlfj5" Jul 14 17:40:48.662410 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:40:48.662366 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cj597\" (UniqueName: \"kubernetes.io/projected/0b5f6905-9a33-4e7d-8209-e87a91dbbb24-kube-api-access-cj597\") pod \"maas-controller-556ffcbcb6-jlfj5\" (UID: \"0b5f6905-9a33-4e7d-8209-e87a91dbbb24\") " pod="opendatahub/maas-controller-556ffcbcb6-jlfj5" Jul 14 17:40:48.763664 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:40:48.763619 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/0b5f6905-9a33-4e7d-8209-e87a91dbbb24-webhook-cert\") pod \"maas-controller-556ffcbcb6-jlfj5\" (UID: \"0b5f6905-9a33-4e7d-8209-e87a91dbbb24\") " pod="opendatahub/maas-controller-556ffcbcb6-jlfj5" Jul 14 17:40:48.763841 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:40:48.763677 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cj597\" (UniqueName: \"kubernetes.io/projected/0b5f6905-9a33-4e7d-8209-e87a91dbbb24-kube-api-access-cj597\") pod \"maas-controller-556ffcbcb6-jlfj5\" (UID: \"0b5f6905-9a33-4e7d-8209-e87a91dbbb24\") " pod="opendatahub/maas-controller-556ffcbcb6-jlfj5" Jul 14 17:40:48.766133 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:40:48.766108 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/0b5f6905-9a33-4e7d-8209-e87a91dbbb24-webhook-cert\") pod \"maas-controller-556ffcbcb6-jlfj5\" (UID: \"0b5f6905-9a33-4e7d-8209-e87a91dbbb24\") " pod="opendatahub/maas-controller-556ffcbcb6-jlfj5" Jul 14 17:40:48.771897 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:40:48.771874 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cj597\" (UniqueName: \"kubernetes.io/projected/0b5f6905-9a33-4e7d-8209-e87a91dbbb24-kube-api-access-cj597\") pod \"maas-controller-556ffcbcb6-jlfj5\" (UID: \"0b5f6905-9a33-4e7d-8209-e87a91dbbb24\") " pod="opendatahub/maas-controller-556ffcbcb6-jlfj5" Jul 14 17:40:48.864965 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:40:48.864924 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-556ffcbcb6-jlfj5" Jul 14 17:40:49.002567 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:40:49.002535 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-556ffcbcb6-jlfj5"] Jul 14 17:40:49.006903 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:40:49.006864 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0b5f6905_9a33_4e7d_8209_e87a91dbbb24.slice/crio-c0443a9ba47b8fb5e6780a983d7a49eb3606c2faa7e48546657c855e76e6ea67 WatchSource:0}: Error finding container c0443a9ba47b8fb5e6780a983d7a49eb3606c2faa7e48546657c855e76e6ea67: Status 404 returned error can't find the container with id c0443a9ba47b8fb5e6780a983d7a49eb3606c2faa7e48546657c855e76e6ea67 Jul 14 17:40:49.734305 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:40:49.734269 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-556ffcbcb6-jlfj5" event={"ID":"0b5f6905-9a33-4e7d-8209-e87a91dbbb24","Type":"ContainerStarted","Data":"36288b086c15daaf45756f8e08af9c32cd1644313e0d0a07f7da908101c32e29"} Jul 14 17:40:49.734795 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:40:49.734351 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-556ffcbcb6-jlfj5" event={"ID":"0b5f6905-9a33-4e7d-8209-e87a91dbbb24","Type":"ContainerStarted","Data":"c0443a9ba47b8fb5e6780a983d7a49eb3606c2faa7e48546657c855e76e6ea67"} Jul 14 17:40:49.734795 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:40:49.734455 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-556ffcbcb6-jlfj5" Jul 14 17:40:49.750869 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:40:49.750821 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-556ffcbcb6-jlfj5" podStartSLOduration=1.3578962749999999 podStartE2EDuration="1.750805644s" totalImagesPullingTime="392.909369ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 17:40:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 17:40:49.749669814 +0000 UTC m=+912.128783765" watchObservedRunningTime="2026-07-14 17:40:49.750805644 +0000 UTC m=+912.129919587" Jul 14 17:41:00.742733 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:41:00.742698 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-556ffcbcb6-jlfj5" Jul 14 17:41:26.928527 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:41:26.928490 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 17:41:29.986414 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:41:29.986379 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 17:41:32.814678 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:41:32.814646 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 17:41:32.876708 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:41:32.876678 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 17:41:32.957176 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:41:32.957142 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 17:41:33.054827 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:41:33.054791 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 17:41:33.177657 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:41:33.177567 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 17:41:40.088830 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:41:40.088789 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 17:41:40.145298 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:41:40.145264 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 17:42:07.767764 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:42:07.767680 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 17:42:33.477210 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:42:33.477170 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 17:42:33.579630 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:42:33.579591 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 17:45:00.141480 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:45:00.141404 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29734185-dbvhb"] Jul 14 17:45:00.145138 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:45:00.145116 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29734185-dbvhb" Jul 14 17:45:00.148456 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:45:00.148433 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-9rnpk\"" Jul 14 17:45:00.154904 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:45:00.154884 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29734185-dbvhb" Jul 14 17:45:00.163551 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:45:00.163527 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29734185-dbvhb"] Jul 14 17:45:00.501849 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:45:00.501824 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29734185-dbvhb"] Jul 14 17:45:00.504180 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:45:00.504152 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3cf0d3ea_31a7_4d45_adaf_fa92cf4c671d.slice/crio-3b47a02a10f08e79cd21afe99d6b995b904b6862b2675c29d0447f8b15ff51c6 WatchSource:0}: Error finding container 3b47a02a10f08e79cd21afe99d6b995b904b6862b2675c29d0447f8b15ff51c6: Status 404 returned error can't find the container with id 3b47a02a10f08e79cd21afe99d6b995b904b6862b2675c29d0447f8b15ff51c6 Jul 14 17:45:00.506504 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:45:00.506487 2552 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 14 17:45:01.038275 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:45:01.038241 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29734185-dbvhb" event={"ID":"3cf0d3ea-31a7-4d45-adaf-fa92cf4c671d","Type":"ContainerStarted","Data":"3b47a02a10f08e79cd21afe99d6b995b904b6862b2675c29d0447f8b15ff51c6"} Jul 14 17:45:04.056570 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:45:04.056536 2552 generic.go:356] "Generic (PLEG): container finished" podID="3cf0d3ea-31a7-4d45-adaf-fa92cf4c671d" containerID="dd60d791d48208e588d792dba934f91cec3f1e17917fea93a1221e3b762600da" exitCode=0 Jul 14 17:45:04.056950 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:45:04.056601 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29734185-dbvhb" event={"ID":"3cf0d3ea-31a7-4d45-adaf-fa92cf4c671d","Type":"ContainerDied","Data":"dd60d791d48208e588d792dba934f91cec3f1e17917fea93a1221e3b762600da"} Jul 14 17:45:05.188088 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:45:05.188056 2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29734185-dbvhb" Jul 14 17:45:06.067532 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:45:06.067501 2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29734185-dbvhb" Jul 14 17:45:06.067532 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:45:06.067514 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29734185-dbvhb" event={"ID":"3cf0d3ea-31a7-4d45-adaf-fa92cf4c671d","Type":"ContainerDied","Data":"3b47a02a10f08e79cd21afe99d6b995b904b6862b2675c29d0447f8b15ff51c6"} Jul 14 17:45:06.067844 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:45:06.067565 2552 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="3b47a02a10f08e79cd21afe99d6b995b904b6862b2675c29d0447f8b15ff51c6" Jul 14 17:45:12.523561 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:45:12.523528 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 17:45:34.324250 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:45:34.324216 2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-xsbwg"] Jul 14 17:45:34.324707 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:45:34.324415 2552 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-xsbwg" podUID="94fa4717-c5a5-4982-9ab9-aa06ff65b270" containerName="manager" containerID="cri-o://f57c05933faa77f4191803c43b0ce0355a3ae00357aad09577d2b765c23bf93a" gracePeriod=10 Jul 14 17:45:37.187798 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:45:37.187778 2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-xsbwg" Jul 14 17:45:37.235142 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:45:37.235107 2552 generic.go:356] "Generic (PLEG): container finished" podID="94fa4717-c5a5-4982-9ab9-aa06ff65b270" containerID="f57c05933faa77f4191803c43b0ce0355a3ae00357aad09577d2b765c23bf93a" exitCode=0 Jul 14 17:45:37.235313 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:45:37.235157 2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-xsbwg" Jul 14 17:45:37.235313 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:45:37.235197 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-xsbwg" event={"ID":"94fa4717-c5a5-4982-9ab9-aa06ff65b270","Type":"ContainerDied","Data":"f57c05933faa77f4191803c43b0ce0355a3ae00357aad09577d2b765c23bf93a"} Jul 14 17:45:37.235313 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:45:37.235258 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-xsbwg" event={"ID":"94fa4717-c5a5-4982-9ab9-aa06ff65b270","Type":"ContainerDied","Data":"3a39280d81f6115d7d7ad527f536afeaaa056471ca24d703d594bcc63da818b9"} Jul 14 17:45:37.235313 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:45:37.235291 2552 scope.go:117] "RemoveContainer" containerID="f57c05933faa77f4191803c43b0ce0355a3ae00357aad09577d2b765c23bf93a" Jul 14 17:45:37.245506 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:45:37.245487 2552 scope.go:117] "RemoveContainer" containerID="f57c05933faa77f4191803c43b0ce0355a3ae00357aad09577d2b765c23bf93a" Jul 14 17:45:37.245800 ip-10-0-139-16 kubenswrapper[2552]: E0714 17:45:37.245777 2552 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f57c05933faa77f4191803c43b0ce0355a3ae00357aad09577d2b765c23bf93a\": container with ID starting with f57c05933faa77f4191803c43b0ce0355a3ae00357aad09577d2b765c23bf93a not found: ID does not exist" containerID="f57c05933faa77f4191803c43b0ce0355a3ae00357aad09577d2b765c23bf93a" Jul 14 17:45:37.245885 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:45:37.245815 2552 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f57c05933faa77f4191803c43b0ce0355a3ae00357aad09577d2b765c23bf93a"} err="failed to get container status \"f57c05933faa77f4191803c43b0ce0355a3ae00357aad09577d2b765c23bf93a\": rpc error: code = NotFound desc = could not find container \"f57c05933faa77f4191803c43b0ce0355a3ae00357aad09577d2b765c23bf93a\": container with ID starting with f57c05933faa77f4191803c43b0ce0355a3ae00357aad09577d2b765c23bf93a not found: ID does not exist" Jul 14 17:45:37.375211 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:45:37.375181 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9cgqm\" (UniqueName: \"kubernetes.io/projected/94fa4717-c5a5-4982-9ab9-aa06ff65b270-kube-api-access-9cgqm\") pod \"94fa4717-c5a5-4982-9ab9-aa06ff65b270\" (UID: \"94fa4717-c5a5-4982-9ab9-aa06ff65b270\") " Jul 14 17:45:37.375426 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:45:37.375243 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/94fa4717-c5a5-4982-9ab9-aa06ff65b270-extensions-socket-volume\") pod \"94fa4717-c5a5-4982-9ab9-aa06ff65b270\" (UID: \"94fa4717-c5a5-4982-9ab9-aa06ff65b270\") " Jul 14 17:45:37.375690 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:45:37.375666 2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/94fa4717-c5a5-4982-9ab9-aa06ff65b270-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "94fa4717-c5a5-4982-9ab9-aa06ff65b270" (UID: "94fa4717-c5a5-4982-9ab9-aa06ff65b270"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 14 17:45:37.377258 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:45:37.377236 2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/94fa4717-c5a5-4982-9ab9-aa06ff65b270-kube-api-access-9cgqm" (OuterVolumeSpecName: "kube-api-access-9cgqm") pod "94fa4717-c5a5-4982-9ab9-aa06ff65b270" (UID: "94fa4717-c5a5-4982-9ab9-aa06ff65b270"). InnerVolumeSpecName "kube-api-access-9cgqm". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 14 17:45:37.475982 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:45:37.475945 2552 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9cgqm\" (UniqueName: \"kubernetes.io/projected/94fa4717-c5a5-4982-9ab9-aa06ff65b270-kube-api-access-9cgqm\") on node \"ip-10-0-139-16.ec2.internal\" DevicePath \"\"" Jul 14 17:45:37.475982 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:45:37.475978 2552 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/94fa4717-c5a5-4982-9ab9-aa06ff65b270-extensions-socket-volume\") on node \"ip-10-0-139-16.ec2.internal\" DevicePath \"\"" Jul 14 17:45:37.558739 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:45:37.558709 2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-xsbwg"] Jul 14 17:45:37.563044 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:45:37.563020 2552 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-xsbwg"] Jul 14 17:45:38.149134 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:45:38.149105 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-gnw2z_b3c71861-4db9-4850-a44b-6f5d44a94235/console-operator/2.log" Jul 14 17:45:38.153650 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:45:38.153623 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cwprj_d3492336-881b-4f13-8d3a-b4d4ec05ad3c/ovn-acl-logging/0.log" Jul 14 17:45:38.156823 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:45:38.156805 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-gnw2z_b3c71861-4db9-4850-a44b-6f5d44a94235/console-operator/2.log" Jul 14 17:45:38.161154 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:45:38.161136 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cwprj_d3492336-881b-4f13-8d3a-b4d4ec05ad3c/ovn-acl-logging/0.log" Jul 14 17:45:38.390596 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:45:38.390558 2552 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="94fa4717-c5a5-4982-9ab9-aa06ff65b270" path="/var/lib/kubelet/pods/94fa4717-c5a5-4982-9ab9-aa06ff65b270/volumes" Jul 14 17:46:35.547255 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:46:35.547222 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-lb4ft"] Jul 14 17:46:35.547711 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:46:35.547695 2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3cf0d3ea-31a7-4d45-adaf-fa92cf4c671d" containerName="cleanup" Jul 14 17:46:35.547755 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:46:35.547714 2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="3cf0d3ea-31a7-4d45-adaf-fa92cf4c671d" containerName="cleanup" Jul 14 17:46:35.547755 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:46:35.547745 2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="94fa4717-c5a5-4982-9ab9-aa06ff65b270" containerName="manager" Jul 14 17:46:35.547755 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:46:35.547751 2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="94fa4717-c5a5-4982-9ab9-aa06ff65b270" containerName="manager" Jul 14 17:46:35.547888 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:46:35.547819 2552 memory_manager.go:368] "RemoveStaleState removing state" podUID="3cf0d3ea-31a7-4d45-adaf-fa92cf4c671d" containerName="cleanup" Jul 14 17:46:35.547888 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:46:35.547831 2552 memory_manager.go:368] "RemoveStaleState removing state" podUID="94fa4717-c5a5-4982-9ab9-aa06ff65b270" containerName="manager" Jul 14 17:46:35.551169 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:46:35.551152 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-lb4ft" Jul 14 17:46:35.554080 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:46:35.554058 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-kkk56\"" Jul 14 17:46:35.561103 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:46:35.561081 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-lb4ft"] Jul 14 17:46:35.678424 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:46:35.678375 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/3e194672-6279-4ac2-949d-0d52b878e633-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-lb4ft\" (UID: \"3e194672-6279-4ac2-949d-0d52b878e633\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-lb4ft" Jul 14 17:46:35.678605 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:46:35.678457 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x5v5l\" (UniqueName: \"kubernetes.io/projected/3e194672-6279-4ac2-949d-0d52b878e633-kube-api-access-x5v5l\") pod \"kuadrant-operator-controller-manager-86878c769f-lb4ft\" (UID: \"3e194672-6279-4ac2-949d-0d52b878e633\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-lb4ft" Jul 14 17:46:35.778902 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:46:35.778862 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/3e194672-6279-4ac2-949d-0d52b878e633-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-lb4ft\" (UID: \"3e194672-6279-4ac2-949d-0d52b878e633\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-lb4ft" Jul 14 17:46:35.779089 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:46:35.778930 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x5v5l\" (UniqueName: \"kubernetes.io/projected/3e194672-6279-4ac2-949d-0d52b878e633-kube-api-access-x5v5l\") pod \"kuadrant-operator-controller-manager-86878c769f-lb4ft\" (UID: \"3e194672-6279-4ac2-949d-0d52b878e633\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-lb4ft" Jul 14 17:46:35.779243 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:46:35.779223 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/3e194672-6279-4ac2-949d-0d52b878e633-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-lb4ft\" (UID: \"3e194672-6279-4ac2-949d-0d52b878e633\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-lb4ft" Jul 14 17:46:35.789839 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:46:35.789817 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x5v5l\" (UniqueName: \"kubernetes.io/projected/3e194672-6279-4ac2-949d-0d52b878e633-kube-api-access-x5v5l\") pod \"kuadrant-operator-controller-manager-86878c769f-lb4ft\" (UID: \"3e194672-6279-4ac2-949d-0d52b878e633\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-lb4ft" Jul 14 17:46:35.862553 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:46:35.862462 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-lb4ft" Jul 14 17:46:36.013198 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:46:36.011993 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-lb4ft"] Jul 14 17:46:36.015553 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:46:36.015523 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3e194672_6279_4ac2_949d_0d52b878e633.slice/crio-fffea2f4b853dffcee8c222dc2c5df5d82f2dfec44e0bf92602abb176c7f1db2 WatchSource:0}: Error finding container fffea2f4b853dffcee8c222dc2c5df5d82f2dfec44e0bf92602abb176c7f1db2: Status 404 returned error can't find the container with id fffea2f4b853dffcee8c222dc2c5df5d82f2dfec44e0bf92602abb176c7f1db2 Jul 14 17:46:36.527960 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:46:36.527919 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-lb4ft" event={"ID":"3e194672-6279-4ac2-949d-0d52b878e633","Type":"ContainerStarted","Data":"0ac3b77b7c2f15c2815d73a63637ccf8852b33409a1b94add6e4d7dde0614bca"} Jul 14 17:46:36.528153 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:46:36.527983 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-lb4ft" Jul 14 17:46:36.528153 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:46:36.527999 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-lb4ft" event={"ID":"3e194672-6279-4ac2-949d-0d52b878e633","Type":"ContainerStarted","Data":"fffea2f4b853dffcee8c222dc2c5df5d82f2dfec44e0bf92602abb176c7f1db2"} Jul 14 17:46:36.551655 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:46:36.551605 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-lb4ft" podStartSLOduration=1.551590063 podStartE2EDuration="1.551590063s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 17:46:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 17:46:36.548387951 +0000 UTC m=+1258.927501899" watchObservedRunningTime="2026-07-14 17:46:36.551590063 +0000 UTC m=+1258.930704015" Jul 14 17:46:47.535898 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:46:47.535869 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-lb4ft" Jul 14 17:47:17.158784 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:47:17.158753 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 17:50:03.097577 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:50:03.097492 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 17:50:03.181941 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:50:03.181916 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 17:50:38.181182 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:50:38.181157 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-gnw2z_b3c71861-4db9-4850-a44b-6f5d44a94235/console-operator/2.log" Jul 14 17:50:38.186686 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:50:38.186664 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cwprj_d3492336-881b-4f13-8d3a-b4d4ec05ad3c/ovn-acl-logging/0.log" Jul 14 17:50:38.190030 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:50:38.190008 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-gnw2z_b3c71861-4db9-4850-a44b-6f5d44a94235/console-operator/2.log" Jul 14 17:50:38.196189 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:50:38.196169 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cwprj_d3492336-881b-4f13-8d3a-b4d4ec05ad3c/ovn-acl-logging/0.log" Jul 14 17:51:45.154485 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:51:45.154452 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 17:52:20.958897 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:52:20.958863 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 17:52:28.361778 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:52:28.361707 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 17:52:36.626025 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:52:36.625913 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 17:52:41.735680 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:52:41.735640 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 17:52:44.733338 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:52:44.733288 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 17:52:44.834816 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:52:44.834779 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 17:52:45.196749 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:52:45.196628 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 17:52:50.872367 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:52:50.872309 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 17:52:50.972505 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:52:50.972466 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 17:52:51.054615 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:52:51.054583 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-06d94c77-openshift-default-86fdc4b5f-cqfjg"] Jul 14 17:52:51.058773 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:52:51.058756 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-06d94c77-openshift-default-86fdc4b5f-cqfjg" Jul 14 17:52:51.061577 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:52:51.061555 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-06d94c77-openshift-default-dockercfg-fffrz\"" Jul 14 17:52:51.077168 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:52:51.077130 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-06d94c77-openshift-default-86fdc4b5f-cqfjg"] Jul 14 17:52:51.083175 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:52:51.083147 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 17:52:51.113512 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:52:51.113481 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pc6zv\" (UniqueName: \"kubernetes.io/projected/df1fcf3a-4d42-4917-9fe4-936f4c5802dc-kube-api-access-pc6zv\") pod \"e2e-ait-06d94c77-openshift-default-86fdc4b5f-cqfjg\" (UID: \"df1fcf3a-4d42-4917-9fe4-936f4c5802dc\") " pod="openshift-ingress/e2e-ait-06d94c77-openshift-default-86fdc4b5f-cqfjg" Jul 14 17:52:51.113633 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:52:51.113522 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/df1fcf3a-4d42-4917-9fe4-936f4c5802dc-workload-certs\") pod \"e2e-ait-06d94c77-openshift-default-86fdc4b5f-cqfjg\" (UID: \"df1fcf3a-4d42-4917-9fe4-936f4c5802dc\") " pod="openshift-ingress/e2e-ait-06d94c77-openshift-default-86fdc4b5f-cqfjg" Jul 14 17:52:51.113633 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:52:51.113538 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/df1fcf3a-4d42-4917-9fe4-936f4c5802dc-istio-podinfo\") pod \"e2e-ait-06d94c77-openshift-default-86fdc4b5f-cqfjg\" (UID: \"df1fcf3a-4d42-4917-9fe4-936f4c5802dc\") " pod="openshift-ingress/e2e-ait-06d94c77-openshift-default-86fdc4b5f-cqfjg" Jul 14 17:52:51.113633 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:52:51.113559 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/df1fcf3a-4d42-4917-9fe4-936f4c5802dc-workload-socket\") pod \"e2e-ait-06d94c77-openshift-default-86fdc4b5f-cqfjg\" (UID: \"df1fcf3a-4d42-4917-9fe4-936f4c5802dc\") " pod="openshift-ingress/e2e-ait-06d94c77-openshift-default-86fdc4b5f-cqfjg" Jul 14 17:52:51.113633 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:52:51.113596 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/df1fcf3a-4d42-4917-9fe4-936f4c5802dc-istio-data\") pod \"e2e-ait-06d94c77-openshift-default-86fdc4b5f-cqfjg\" (UID: \"df1fcf3a-4d42-4917-9fe4-936f4c5802dc\") " pod="openshift-ingress/e2e-ait-06d94c77-openshift-default-86fdc4b5f-cqfjg" Jul 14 17:52:51.113633 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:52:51.113610 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/df1fcf3a-4d42-4917-9fe4-936f4c5802dc-istio-token\") pod \"e2e-ait-06d94c77-openshift-default-86fdc4b5f-cqfjg\" (UID: \"df1fcf3a-4d42-4917-9fe4-936f4c5802dc\") " pod="openshift-ingress/e2e-ait-06d94c77-openshift-default-86fdc4b5f-cqfjg" Jul 14 17:52:51.113633 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:52:51.113630 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/df1fcf3a-4d42-4917-9fe4-936f4c5802dc-credential-socket\") pod \"e2e-ait-06d94c77-openshift-default-86fdc4b5f-cqfjg\" (UID: \"df1fcf3a-4d42-4917-9fe4-936f4c5802dc\") " pod="openshift-ingress/e2e-ait-06d94c77-openshift-default-86fdc4b5f-cqfjg" Jul 14 17:52:51.113830 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:52:51.113698 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/df1fcf3a-4d42-4917-9fe4-936f4c5802dc-istio-envoy\") pod \"e2e-ait-06d94c77-openshift-default-86fdc4b5f-cqfjg\" (UID: \"df1fcf3a-4d42-4917-9fe4-936f4c5802dc\") " pod="openshift-ingress/e2e-ait-06d94c77-openshift-default-86fdc4b5f-cqfjg" Jul 14 17:52:51.113830 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:52:51.113753 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/df1fcf3a-4d42-4917-9fe4-936f4c5802dc-istiod-ca-cert\") pod \"e2e-ait-06d94c77-openshift-default-86fdc4b5f-cqfjg\" (UID: \"df1fcf3a-4d42-4917-9fe4-936f4c5802dc\") " pod="openshift-ingress/e2e-ait-06d94c77-openshift-default-86fdc4b5f-cqfjg" Jul 14 17:52:51.183246 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:52:51.183159 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 17:52:51.214347 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:52:51.214302 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/df1fcf3a-4d42-4917-9fe4-936f4c5802dc-istio-data\") pod \"e2e-ait-06d94c77-openshift-default-86fdc4b5f-cqfjg\" (UID: \"df1fcf3a-4d42-4917-9fe4-936f4c5802dc\") " pod="openshift-ingress/e2e-ait-06d94c77-openshift-default-86fdc4b5f-cqfjg" Jul 14 17:52:51.214496 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:52:51.214357 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/df1fcf3a-4d42-4917-9fe4-936f4c5802dc-istio-token\") pod \"e2e-ait-06d94c77-openshift-default-86fdc4b5f-cqfjg\" (UID: \"df1fcf3a-4d42-4917-9fe4-936f4c5802dc\") " pod="openshift-ingress/e2e-ait-06d94c77-openshift-default-86fdc4b5f-cqfjg" Jul 14 17:52:51.214496 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:52:51.214397 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/df1fcf3a-4d42-4917-9fe4-936f4c5802dc-credential-socket\") pod \"e2e-ait-06d94c77-openshift-default-86fdc4b5f-cqfjg\" (UID: \"df1fcf3a-4d42-4917-9fe4-936f4c5802dc\") " pod="openshift-ingress/e2e-ait-06d94c77-openshift-default-86fdc4b5f-cqfjg" Jul 14 17:52:51.214496 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:52:51.214416 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/df1fcf3a-4d42-4917-9fe4-936f4c5802dc-istio-envoy\") pod \"e2e-ait-06d94c77-openshift-default-86fdc4b5f-cqfjg\" (UID: \"df1fcf3a-4d42-4917-9fe4-936f4c5802dc\") " pod="openshift-ingress/e2e-ait-06d94c77-openshift-default-86fdc4b5f-cqfjg" Jul 14 17:52:51.214496 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:52:51.214434 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/df1fcf3a-4d42-4917-9fe4-936f4c5802dc-istiod-ca-cert\") pod \"e2e-ait-06d94c77-openshift-default-86fdc4b5f-cqfjg\" (UID: \"df1fcf3a-4d42-4917-9fe4-936f4c5802dc\") " pod="openshift-ingress/e2e-ait-06d94c77-openshift-default-86fdc4b5f-cqfjg" Jul 14 17:52:51.214729 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:52:51.214521 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pc6zv\" (UniqueName: \"kubernetes.io/projected/df1fcf3a-4d42-4917-9fe4-936f4c5802dc-kube-api-access-pc6zv\") pod \"e2e-ait-06d94c77-openshift-default-86fdc4b5f-cqfjg\" (UID: \"df1fcf3a-4d42-4917-9fe4-936f4c5802dc\") " pod="openshift-ingress/e2e-ait-06d94c77-openshift-default-86fdc4b5f-cqfjg" Jul 14 17:52:51.214729 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:52:51.214555 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/df1fcf3a-4d42-4917-9fe4-936f4c5802dc-workload-certs\") pod \"e2e-ait-06d94c77-openshift-default-86fdc4b5f-cqfjg\" (UID: \"df1fcf3a-4d42-4917-9fe4-936f4c5802dc\") " pod="openshift-ingress/e2e-ait-06d94c77-openshift-default-86fdc4b5f-cqfjg" Jul 14 17:52:51.214729 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:52:51.214570 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/df1fcf3a-4d42-4917-9fe4-936f4c5802dc-istio-podinfo\") pod \"e2e-ait-06d94c77-openshift-default-86fdc4b5f-cqfjg\" (UID: \"df1fcf3a-4d42-4917-9fe4-936f4c5802dc\") " pod="openshift-ingress/e2e-ait-06d94c77-openshift-default-86fdc4b5f-cqfjg" Jul 14 17:52:51.214729 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:52:51.214605 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/df1fcf3a-4d42-4917-9fe4-936f4c5802dc-workload-socket\") pod \"e2e-ait-06d94c77-openshift-default-86fdc4b5f-cqfjg\" (UID: \"df1fcf3a-4d42-4917-9fe4-936f4c5802dc\") " pod="openshift-ingress/e2e-ait-06d94c77-openshift-default-86fdc4b5f-cqfjg" Jul 14 17:52:51.214937 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:52:51.214782 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/df1fcf3a-4d42-4917-9fe4-936f4c5802dc-istio-data\") pod \"e2e-ait-06d94c77-openshift-default-86fdc4b5f-cqfjg\" (UID: \"df1fcf3a-4d42-4917-9fe4-936f4c5802dc\") " pod="openshift-ingress/e2e-ait-06d94c77-openshift-default-86fdc4b5f-cqfjg" Jul 14 17:52:51.214937 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:52:51.214822 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/df1fcf3a-4d42-4917-9fe4-936f4c5802dc-credential-socket\") pod \"e2e-ait-06d94c77-openshift-default-86fdc4b5f-cqfjg\" (UID: \"df1fcf3a-4d42-4917-9fe4-936f4c5802dc\") " pod="openshift-ingress/e2e-ait-06d94c77-openshift-default-86fdc4b5f-cqfjg" Jul 14 17:52:51.215027 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:52:51.214964 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/df1fcf3a-4d42-4917-9fe4-936f4c5802dc-workload-certs\") pod \"e2e-ait-06d94c77-openshift-default-86fdc4b5f-cqfjg\" (UID: \"df1fcf3a-4d42-4917-9fe4-936f4c5802dc\") " pod="openshift-ingress/e2e-ait-06d94c77-openshift-default-86fdc4b5f-cqfjg" Jul 14 17:52:51.215073 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:52:51.215052 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/df1fcf3a-4d42-4917-9fe4-936f4c5802dc-workload-socket\") pod \"e2e-ait-06d94c77-openshift-default-86fdc4b5f-cqfjg\" (UID: \"df1fcf3a-4d42-4917-9fe4-936f4c5802dc\") " pod="openshift-ingress/e2e-ait-06d94c77-openshift-default-86fdc4b5f-cqfjg" Jul 14 17:52:51.215220 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:52:51.215200 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/df1fcf3a-4d42-4917-9fe4-936f4c5802dc-istiod-ca-cert\") pod \"e2e-ait-06d94c77-openshift-default-86fdc4b5f-cqfjg\" (UID: \"df1fcf3a-4d42-4917-9fe4-936f4c5802dc\") " pod="openshift-ingress/e2e-ait-06d94c77-openshift-default-86fdc4b5f-cqfjg" Jul 14 17:52:51.216818 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:52:51.216796 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/df1fcf3a-4d42-4917-9fe4-936f4c5802dc-istio-envoy\") pod \"e2e-ait-06d94c77-openshift-default-86fdc4b5f-cqfjg\" (UID: \"df1fcf3a-4d42-4917-9fe4-936f4c5802dc\") " pod="openshift-ingress/e2e-ait-06d94c77-openshift-default-86fdc4b5f-cqfjg" Jul 14 17:52:51.217086 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:52:51.217070 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/df1fcf3a-4d42-4917-9fe4-936f4c5802dc-istio-podinfo\") pod \"e2e-ait-06d94c77-openshift-default-86fdc4b5f-cqfjg\" (UID: \"df1fcf3a-4d42-4917-9fe4-936f4c5802dc\") " pod="openshift-ingress/e2e-ait-06d94c77-openshift-default-86fdc4b5f-cqfjg" Jul 14 17:52:51.222726 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:52:51.222702 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/df1fcf3a-4d42-4917-9fe4-936f4c5802dc-istio-token\") pod \"e2e-ait-06d94c77-openshift-default-86fdc4b5f-cqfjg\" (UID: \"df1fcf3a-4d42-4917-9fe4-936f4c5802dc\") " pod="openshift-ingress/e2e-ait-06d94c77-openshift-default-86fdc4b5f-cqfjg" Jul 14 17:52:51.222913 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:52:51.222895 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pc6zv\" (UniqueName: \"kubernetes.io/projected/df1fcf3a-4d42-4917-9fe4-936f4c5802dc-kube-api-access-pc6zv\") pod \"e2e-ait-06d94c77-openshift-default-86fdc4b5f-cqfjg\" (UID: \"df1fcf3a-4d42-4917-9fe4-936f4c5802dc\") " pod="openshift-ingress/e2e-ait-06d94c77-openshift-default-86fdc4b5f-cqfjg" Jul 14 17:52:51.369861 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:52:51.369832 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-06d94c77-openshift-default-86fdc4b5f-cqfjg" Jul 14 17:52:51.513282 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:52:51.513256 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-06d94c77-openshift-default-86fdc4b5f-cqfjg"] Jul 14 17:52:51.515204 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:52:51.515167 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddf1fcf3a_4d42_4917_9fe4_936f4c5802dc.slice/crio-fe12f47ef3f8420f59c995a7c5a0de4a47c76df38cb44c8f65741fb5b145405f WatchSource:0}: Error finding container fe12f47ef3f8420f59c995a7c5a0de4a47c76df38cb44c8f65741fb5b145405f: Status 404 returned error can't find the container with id fe12f47ef3f8420f59c995a7c5a0de4a47c76df38cb44c8f65741fb5b145405f Jul 14 17:52:51.517271 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:52:51.517238 2552 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 14 17:52:51.517385 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:52:51.517315 2552 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 14 17:52:51.517385 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:52:51.517377 2552 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 14 17:52:52.206319 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:52:52.206281 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 17:52:52.298138 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:52:52.298102 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 17:52:52.402013 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:52:52.401952 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 17:52:52.523035 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:52:52.522998 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-06d94c77-openshift-default-86fdc4b5f-cqfjg" event={"ID":"df1fcf3a-4d42-4917-9fe4-936f4c5802dc","Type":"ContainerStarted","Data":"d98377c332a3b45df5262a3b8bb9d094dea9b48368bd0eae1e771be5a7cf0de3"} Jul 14 17:52:52.523201 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:52:52.523059 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-06d94c77-openshift-default-86fdc4b5f-cqfjg" event={"ID":"df1fcf3a-4d42-4917-9fe4-936f4c5802dc","Type":"ContainerStarted","Data":"fe12f47ef3f8420f59c995a7c5a0de4a47c76df38cb44c8f65741fb5b145405f"} Jul 14 17:52:52.547123 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:52:52.547073 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-06d94c77-openshift-default-86fdc4b5f-cqfjg" podStartSLOduration=1.547057863 podStartE2EDuration="1.547057863s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 17:52:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 17:52:52.545817413 +0000 UTC m=+1634.924931365" watchObservedRunningTime="2026-07-14 17:52:52.547057863 +0000 UTC m=+1634.926171814" Jul 14 17:52:52.596767 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:52:52.596727 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 17:52:52.979465 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:52:52.979429 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 17:52:53.084272 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:52:53.084234 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 17:52:53.370146 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:52:53.370059 2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-06d94c77-openshift-default-86fdc4b5f-cqfjg" Jul 14 17:52:53.374737 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:52:53.374706 2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-06d94c77-openshift-default-86fdc4b5f-cqfjg" Jul 14 17:52:53.530045 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:52:53.530013 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-06d94c77-openshift-default-86fdc4b5f-cqfjg" Jul 14 17:52:53.530939 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:52:53.530916 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-06d94c77-openshift-default-86fdc4b5f-cqfjg" Jul 14 17:52:55.101047 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:52:55.101017 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 17:53:03.583746 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:53:03.583664 2552 generic.go:356] "Generic (PLEG): container finished" podID="df1fcf3a-4d42-4917-9fe4-936f4c5802dc" containerID="d98377c332a3b45df5262a3b8bb9d094dea9b48368bd0eae1e771be5a7cf0de3" exitCode=0 Jul 14 17:53:03.583746 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:53:03.583736 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-06d94c77-openshift-default-86fdc4b5f-cqfjg" event={"ID":"df1fcf3a-4d42-4917-9fe4-936f4c5802dc","Type":"ContainerDied","Data":"d98377c332a3b45df5262a3b8bb9d094dea9b48368bd0eae1e771be5a7cf0de3"} Jul 14 17:53:03.584202 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:53:03.584152 2552 scope.go:117] "RemoveContainer" containerID="d98377c332a3b45df5262a3b8bb9d094dea9b48368bd0eae1e771be5a7cf0de3" Jul 14 17:53:03.585168 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:53:03.585142 2552 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 14 17:53:03.585222 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:53:03.585210 2552 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 14 17:53:03.585263 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:53:03.585244 2552 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 14 17:53:04.591172 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:53:04.591132 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-06d94c77-openshift-default-86fdc4b5f-cqfjg" event={"ID":"df1fcf3a-4d42-4917-9fe4-936f4c5802dc","Type":"ContainerStarted","Data":"2ba78ad2ffbb38ef18e9635752295c81e7ce76b9ac047b7fe09a41dd62babe60"} Jul 14 17:53:05.370224 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:53:05.370193 2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-06d94c77-openshift-default-86fdc4b5f-cqfjg" Jul 14 17:53:05.371198 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:53:05.371175 2552 patch_prober.go:28] interesting pod/e2e-ait-06d94c77-openshift-default-86fdc4b5f-cqfjg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.55:15021/healthz/ready\": dial tcp 10.132.0.55:15021: connect: connection refused" start-of-body= Jul 14 17:53:05.371300 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:53:05.371250 2552 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-06d94c77-openshift-default-86fdc4b5f-cqfjg" podUID="df1fcf3a-4d42-4917-9fe4-936f4c5802dc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.55:15021/healthz/ready\": dial tcp 10.132.0.55:15021: connect: connection refused" Jul 14 17:53:06.370450 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:53:06.370418 2552 patch_prober.go:28] interesting pod/e2e-ait-06d94c77-openshift-default-86fdc4b5f-cqfjg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.55:15021/healthz/ready\": dial tcp 10.132.0.55:15021: connect: connection refused" start-of-body= Jul 14 17:53:06.370834 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:53:06.370469 2552 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-06d94c77-openshift-default-86fdc4b5f-cqfjg" podUID="df1fcf3a-4d42-4917-9fe4-936f4c5802dc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.55:15021/healthz/ready\": dial tcp 10.132.0.55:15021: connect: connection refused" Jul 14 17:53:07.370443 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:53:07.370403 2552 patch_prober.go:28] interesting pod/e2e-ait-06d94c77-openshift-default-86fdc4b5f-cqfjg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.55:15021/healthz/ready\": dial tcp 10.132.0.55:15021: connect: connection refused" start-of-body= Jul 14 17:53:07.370625 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:53:07.370464 2552 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-06d94c77-openshift-default-86fdc4b5f-cqfjg" podUID="df1fcf3a-4d42-4917-9fe4-936f4c5802dc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.55:15021/healthz/ready\": dial tcp 10.132.0.55:15021: connect: connection refused" Jul 14 17:53:08.370994 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:53:08.370952 2552 patch_prober.go:28] interesting pod/e2e-ait-06d94c77-openshift-default-86fdc4b5f-cqfjg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.55:15021/healthz/ready\": dial tcp 10.132.0.55:15021: connect: connection refused" start-of-body= Jul 14 17:53:08.371403 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:53:08.371019 2552 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-06d94c77-openshift-default-86fdc4b5f-cqfjg" podUID="df1fcf3a-4d42-4917-9fe4-936f4c5802dc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.55:15021/healthz/ready\": dial tcp 10.132.0.55:15021: connect: connection refused" Jul 14 17:53:08.529926 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:53:08.529897 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-06d94c77-openshift-default-86fdc4b5f-cqfjg" Jul 14 17:53:09.374010 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:53:09.373979 2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-06d94c77-openshift-default-86fdc4b5f-cqfjg" Jul 14 17:53:09.375072 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:53:09.375051 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-06d94c77-openshift-default-86fdc4b5f-cqfjg" Jul 14 17:54:07.799224 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:54:07.799135 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 17:54:12.440005 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:54:12.439946 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 17:54:19.458224 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:54:19.458186 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 17:54:19.563075 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:54:19.563039 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 17:54:22.632248 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:54:22.632218 2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-06d94c77-openshift-default-86fdc4b5f-cqfjg"] Jul 14 17:54:22.632794 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:54:22.632475 2552 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-06d94c77-openshift-default-86fdc4b5f-cqfjg" podUID="df1fcf3a-4d42-4917-9fe4-936f4c5802dc" containerName="istio-proxy" containerID="cri-o://2ba78ad2ffbb38ef18e9635752295c81e7ce76b9ac047b7fe09a41dd62babe60" gracePeriod=30 Jul 14 17:54:22.689281 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:54:22.689253 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 17:54:22.990164 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:54:22.990127 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 17:54:23.084000 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:54:23.083964 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 17:54:24.377104 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:54:24.377063 2552 patch_prober.go:28] interesting pod/e2e-ait-06d94c77-openshift-default-86fdc4b5f-cqfjg container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Jul 14 17:54:24.377531 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:54:24.377125 2552 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ait-06d94c77-openshift-default-86fdc4b5f-cqfjg" podUID="df1fcf3a-4d42-4917-9fe4-936f4c5802dc" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 14 17:54:25.057023 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:54:25.056967 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 17:54:25.160835 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:54:25.160805 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 17:54:25.269036 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:54:25.268998 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 17:54:25.376885 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:54:25.376789 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 17:54:27.886563 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:54:27.886534 2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-06d94c77-openshift-default-86fdc4b5f-cqfjg" Jul 14 17:54:27.988176 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:54:27.988147 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/df1fcf3a-4d42-4917-9fe4-936f4c5802dc-istio-podinfo\") pod \"df1fcf3a-4d42-4917-9fe4-936f4c5802dc\" (UID: \"df1fcf3a-4d42-4917-9fe4-936f4c5802dc\") " Jul 14 17:54:27.988369 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:54:27.988184 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/df1fcf3a-4d42-4917-9fe4-936f4c5802dc-istio-data\") pod \"df1fcf3a-4d42-4917-9fe4-936f4c5802dc\" (UID: \"df1fcf3a-4d42-4917-9fe4-936f4c5802dc\") " Jul 14 17:54:27.988369 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:54:27.988220 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/df1fcf3a-4d42-4917-9fe4-936f4c5802dc-workload-socket\") pod \"df1fcf3a-4d42-4917-9fe4-936f4c5802dc\" (UID: \"df1fcf3a-4d42-4917-9fe4-936f4c5802dc\") " Jul 14 17:54:27.988369 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:54:27.988246 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/df1fcf3a-4d42-4917-9fe4-936f4c5802dc-istio-envoy\") pod \"df1fcf3a-4d42-4917-9fe4-936f4c5802dc\" (UID: \"df1fcf3a-4d42-4917-9fe4-936f4c5802dc\") " Jul 14 17:54:27.988369 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:54:27.988298 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pc6zv\" (UniqueName: \"kubernetes.io/projected/df1fcf3a-4d42-4917-9fe4-936f4c5802dc-kube-api-access-pc6zv\") pod \"df1fcf3a-4d42-4917-9fe4-936f4c5802dc\" (UID: \"df1fcf3a-4d42-4917-9fe4-936f4c5802dc\") " Jul 14 17:54:27.988369 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:54:27.988322 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/df1fcf3a-4d42-4917-9fe4-936f4c5802dc-istio-token\") pod \"df1fcf3a-4d42-4917-9fe4-936f4c5802dc\" (UID: \"df1fcf3a-4d42-4917-9fe4-936f4c5802dc\") " Jul 14 17:54:27.988677 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:54:27.988371 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/df1fcf3a-4d42-4917-9fe4-936f4c5802dc-workload-certs\") pod \"df1fcf3a-4d42-4917-9fe4-936f4c5802dc\" (UID: \"df1fcf3a-4d42-4917-9fe4-936f4c5802dc\") " Jul 14 17:54:27.988677 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:54:27.988398 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/df1fcf3a-4d42-4917-9fe4-936f4c5802dc-credential-socket\") pod \"df1fcf3a-4d42-4917-9fe4-936f4c5802dc\" (UID: \"df1fcf3a-4d42-4917-9fe4-936f4c5802dc\") " Jul 14 17:54:27.988677 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:54:27.988422 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/df1fcf3a-4d42-4917-9fe4-936f4c5802dc-istiod-ca-cert\") pod \"df1fcf3a-4d42-4917-9fe4-936f4c5802dc\" (UID: \"df1fcf3a-4d42-4917-9fe4-936f4c5802dc\") " Jul 14 17:54:27.989063 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:54:27.988988 2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/df1fcf3a-4d42-4917-9fe4-936f4c5802dc-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "df1fcf3a-4d42-4917-9fe4-936f4c5802dc" (UID: "df1fcf3a-4d42-4917-9fe4-936f4c5802dc"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 14 17:54:27.989213 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:54:27.989072 2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/df1fcf3a-4d42-4917-9fe4-936f4c5802dc-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "df1fcf3a-4d42-4917-9fe4-936f4c5802dc" (UID: "df1fcf3a-4d42-4917-9fe4-936f4c5802dc"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 14 17:54:27.989213 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:54:27.989162 2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/df1fcf3a-4d42-4917-9fe4-936f4c5802dc-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "df1fcf3a-4d42-4917-9fe4-936f4c5802dc" (UID: "df1fcf3a-4d42-4917-9fe4-936f4c5802dc"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 14 17:54:27.989363 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:54:27.989213 2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/df1fcf3a-4d42-4917-9fe4-936f4c5802dc-istio-data" (OuterVolumeSpecName: "istio-data") pod "df1fcf3a-4d42-4917-9fe4-936f4c5802dc" (UID: "df1fcf3a-4d42-4917-9fe4-936f4c5802dc"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 14 17:54:27.989504 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:54:27.989468 2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/df1fcf3a-4d42-4917-9fe4-936f4c5802dc-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "df1fcf3a-4d42-4917-9fe4-936f4c5802dc" (UID: "df1fcf3a-4d42-4917-9fe4-936f4c5802dc"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 14 17:54:27.990929 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:54:27.990885 2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/df1fcf3a-4d42-4917-9fe4-936f4c5802dc-kube-api-access-pc6zv" (OuterVolumeSpecName: "kube-api-access-pc6zv") pod "df1fcf3a-4d42-4917-9fe4-936f4c5802dc" (UID: "df1fcf3a-4d42-4917-9fe4-936f4c5802dc"). InnerVolumeSpecName "kube-api-access-pc6zv". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 14 17:54:27.991024 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:54:27.990973 2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/df1fcf3a-4d42-4917-9fe4-936f4c5802dc-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "df1fcf3a-4d42-4917-9fe4-936f4c5802dc" (UID: "df1fcf3a-4d42-4917-9fe4-936f4c5802dc"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 14 17:54:27.991297 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:54:27.991275 2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/df1fcf3a-4d42-4917-9fe4-936f4c5802dc-istio-token" (OuterVolumeSpecName: "istio-token") pod "df1fcf3a-4d42-4917-9fe4-936f4c5802dc" (UID: "df1fcf3a-4d42-4917-9fe4-936f4c5802dc"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 14 17:54:27.991578 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:54:27.991560 2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/df1fcf3a-4d42-4917-9fe4-936f4c5802dc-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "df1fcf3a-4d42-4917-9fe4-936f4c5802dc" (UID: "df1fcf3a-4d42-4917-9fe4-936f4c5802dc"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 14 17:54:28.032844 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:54:28.032812 2552 generic.go:356] "Generic (PLEG): container finished" podID="df1fcf3a-4d42-4917-9fe4-936f4c5802dc" containerID="2ba78ad2ffbb38ef18e9635752295c81e7ce76b9ac047b7fe09a41dd62babe60" exitCode=0 Jul 14 17:54:28.032989 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:54:28.032850 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-06d94c77-openshift-default-86fdc4b5f-cqfjg" event={"ID":"df1fcf3a-4d42-4917-9fe4-936f4c5802dc","Type":"ContainerDied","Data":"2ba78ad2ffbb38ef18e9635752295c81e7ce76b9ac047b7fe09a41dd62babe60"} Jul 14 17:54:28.032989 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:54:28.032907 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-06d94c77-openshift-default-86fdc4b5f-cqfjg" event={"ID":"df1fcf3a-4d42-4917-9fe4-936f4c5802dc","Type":"ContainerDied","Data":"fe12f47ef3f8420f59c995a7c5a0de4a47c76df38cb44c8f65741fb5b145405f"} Jul 14 17:54:28.032989 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:54:28.032930 2552 scope.go:117] "RemoveContainer" containerID="2ba78ad2ffbb38ef18e9635752295c81e7ce76b9ac047b7fe09a41dd62babe60" Jul 14 17:54:28.032989 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:54:28.032863 2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-06d94c77-openshift-default-86fdc4b5f-cqfjg" Jul 14 17:54:28.044492 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:54:28.044423 2552 scope.go:117] "RemoveContainer" containerID="d98377c332a3b45df5262a3b8bb9d094dea9b48368bd0eae1e771be5a7cf0de3" Jul 14 17:54:28.053269 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:54:28.053254 2552 scope.go:117] "RemoveContainer" containerID="2ba78ad2ffbb38ef18e9635752295c81e7ce76b9ac047b7fe09a41dd62babe60" Jul 14 17:54:28.053558 ip-10-0-139-16 kubenswrapper[2552]: E0714 17:54:28.053538 2552 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2ba78ad2ffbb38ef18e9635752295c81e7ce76b9ac047b7fe09a41dd62babe60\": container with ID starting with 2ba78ad2ffbb38ef18e9635752295c81e7ce76b9ac047b7fe09a41dd62babe60 not found: ID does not exist" containerID="2ba78ad2ffbb38ef18e9635752295c81e7ce76b9ac047b7fe09a41dd62babe60" Jul 14 17:54:28.053603 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:54:28.053568 2552 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2ba78ad2ffbb38ef18e9635752295c81e7ce76b9ac047b7fe09a41dd62babe60"} err="failed to get container status \"2ba78ad2ffbb38ef18e9635752295c81e7ce76b9ac047b7fe09a41dd62babe60\": rpc error: code = NotFound desc = could not find container \"2ba78ad2ffbb38ef18e9635752295c81e7ce76b9ac047b7fe09a41dd62babe60\": container with ID starting with 2ba78ad2ffbb38ef18e9635752295c81e7ce76b9ac047b7fe09a41dd62babe60 not found: ID does not exist" Jul 14 17:54:28.053603 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:54:28.053585 2552 scope.go:117] "RemoveContainer" containerID="d98377c332a3b45df5262a3b8bb9d094dea9b48368bd0eae1e771be5a7cf0de3" Jul 14 17:54:28.053818 ip-10-0-139-16 kubenswrapper[2552]: E0714 17:54:28.053798 2552 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d98377c332a3b45df5262a3b8bb9d094dea9b48368bd0eae1e771be5a7cf0de3\": container with ID starting with d98377c332a3b45df5262a3b8bb9d094dea9b48368bd0eae1e771be5a7cf0de3 not found: ID does not exist" containerID="d98377c332a3b45df5262a3b8bb9d094dea9b48368bd0eae1e771be5a7cf0de3" Jul 14 17:54:28.053869 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:54:28.053824 2552 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d98377c332a3b45df5262a3b8bb9d094dea9b48368bd0eae1e771be5a7cf0de3"} err="failed to get container status \"d98377c332a3b45df5262a3b8bb9d094dea9b48368bd0eae1e771be5a7cf0de3\": rpc error: code = NotFound desc = could not find container \"d98377c332a3b45df5262a3b8bb9d094dea9b48368bd0eae1e771be5a7cf0de3\": container with ID starting with d98377c332a3b45df5262a3b8bb9d094dea9b48368bd0eae1e771be5a7cf0de3 not found: ID does not exist" Jul 14 17:54:28.058467 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:54:28.058447 2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-06d94c77-openshift-default-86fdc4b5f-cqfjg"] Jul 14 17:54:28.062481 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:54:28.062462 2552 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-06d94c77-openshift-default-86fdc4b5f-cqfjg"] Jul 14 17:54:28.089807 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:54:28.089787 2552 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/df1fcf3a-4d42-4917-9fe4-936f4c5802dc-istio-podinfo\") on node \"ip-10-0-139-16.ec2.internal\" DevicePath \"\"" Jul 14 17:54:28.089807 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:54:28.089806 2552 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/df1fcf3a-4d42-4917-9fe4-936f4c5802dc-istio-data\") on node \"ip-10-0-139-16.ec2.internal\" DevicePath \"\"" Jul 14 17:54:28.089932 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:54:28.089815 2552 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/df1fcf3a-4d42-4917-9fe4-936f4c5802dc-workload-socket\") on node \"ip-10-0-139-16.ec2.internal\" DevicePath \"\"" Jul 14 17:54:28.089932 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:54:28.089823 2552 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/df1fcf3a-4d42-4917-9fe4-936f4c5802dc-istio-envoy\") on node \"ip-10-0-139-16.ec2.internal\" DevicePath \"\"" Jul 14 17:54:28.089932 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:54:28.089834 2552 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pc6zv\" (UniqueName: \"kubernetes.io/projected/df1fcf3a-4d42-4917-9fe4-936f4c5802dc-kube-api-access-pc6zv\") on node \"ip-10-0-139-16.ec2.internal\" DevicePath \"\"" Jul 14 17:54:28.089932 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:54:28.089843 2552 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/df1fcf3a-4d42-4917-9fe4-936f4c5802dc-istio-token\") on node \"ip-10-0-139-16.ec2.internal\" DevicePath \"\"" Jul 14 17:54:28.089932 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:54:28.089851 2552 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/df1fcf3a-4d42-4917-9fe4-936f4c5802dc-workload-certs\") on node \"ip-10-0-139-16.ec2.internal\" DevicePath \"\"" Jul 14 17:54:28.089932 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:54:28.089859 2552 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/df1fcf3a-4d42-4917-9fe4-936f4c5802dc-credential-socket\") on node \"ip-10-0-139-16.ec2.internal\" DevicePath \"\"" Jul 14 17:54:28.089932 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:54:28.089867 2552 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/df1fcf3a-4d42-4917-9fe4-936f4c5802dc-istiod-ca-cert\") on node \"ip-10-0-139-16.ec2.internal\" DevicePath \"\"" Jul 14 17:54:28.397995 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:54:28.397963 2552 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="df1fcf3a-4d42-4917-9fe4-936f4c5802dc" path="/var/lib/kubelet/pods/df1fcf3a-4d42-4917-9fe4-936f4c5802dc/volumes" Jul 14 17:54:45.208553 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:54:45.208512 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 17:54:45.315044 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:54:45.315007 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 17:54:48.534162 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:54:48.534125 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 17:55:29.100164 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:55:29.100118 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 17:55:29.209662 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:55:29.209624 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 17:55:34.452247 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:55:34.452211 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 17:55:35.170449 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:55:35.170408 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 17:55:36.297410 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:55:36.297374 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 17:55:38.214175 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:55:38.214144 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-gnw2z_b3c71861-4db9-4850-a44b-6f5d44a94235/console-operator/2.log" Jul 14 17:55:38.220051 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:55:38.220031 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cwprj_d3492336-881b-4f13-8d3a-b4d4ec05ad3c/ovn-acl-logging/0.log" Jul 14 17:55:38.225357 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:55:38.225340 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-gnw2z_b3c71861-4db9-4850-a44b-6f5d44a94235/console-operator/2.log" Jul 14 17:55:38.229942 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:55:38.229927 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cwprj_d3492336-881b-4f13-8d3a-b4d4ec05ad3c/ovn-acl-logging/0.log" Jul 14 17:55:40.909354 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:55:40.909281 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 17:55:40.981661 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:55:40.981628 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 17:55:41.159680 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:55:41.159582 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 17:55:44.242679 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:55:44.242648 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 17:55:44.327559 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:55:44.327526 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 17:56:09.599953 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:56:09.599922 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 17:56:09.700838 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:56:09.700802 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 17:56:37.932235 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:56:37.932175 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 17:56:38.030854 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:56:38.030816 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 17:56:47.843551 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:56:47.843517 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 17:56:48.028091 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:56:48.028056 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 17:56:55.587677 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:56:55.587627 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 17:56:58.241673 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:56:58.241624 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 17:56:58.303444 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:56:58.303410 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 17:57:03.524113 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:57:03.524026 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 17:57:03.799493 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:57:03.799421 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-derive-eef895f6-openshift-default-78d5df5599-r6bgn"] Jul 14 17:57:03.799847 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:57:03.799835 2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="df1fcf3a-4d42-4917-9fe4-936f4c5802dc" containerName="istio-proxy" Jul 14 17:57:03.799928 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:57:03.799849 2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="df1fcf3a-4d42-4917-9fe4-936f4c5802dc" containerName="istio-proxy" Jul 14 17:57:03.799928 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:57:03.799857 2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="df1fcf3a-4d42-4917-9fe4-936f4c5802dc" containerName="istio-proxy" Jul 14 17:57:03.799928 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:57:03.799862 2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="df1fcf3a-4d42-4917-9fe4-936f4c5802dc" containerName="istio-proxy" Jul 14 17:57:03.800026 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:57:03.799935 2552 memory_manager.go:368] "RemoveStaleState removing state" podUID="df1fcf3a-4d42-4917-9fe4-936f4c5802dc" containerName="istio-proxy" Jul 14 17:57:03.803035 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:57:03.803014 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-eef895f6-openshift-default-78d5df5599-r6bgn" Jul 14 17:57:03.805607 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:57:03.805585 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-derive-eef895f6-openshift-default-dockercfg-jrddd\"" Jul 14 17:57:03.814446 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:57:03.814421 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-eef895f6-openshift-default-78d5df5599-r6bgn"] Jul 14 17:57:03.834105 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:57:03.834074 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 17:57:03.886170 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:57:03.886140 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2ef23658-a55b-4fb1-b0af-611f7f8bbbd3-istio-data\") pod \"e2e-derive-eef895f6-openshift-default-78d5df5599-r6bgn\" (UID: \"2ef23658-a55b-4fb1-b0af-611f7f8bbbd3\") " pod="openshift-ingress/e2e-derive-eef895f6-openshift-default-78d5df5599-r6bgn" Jul 14 17:57:03.886297 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:57:03.886203 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2ef23658-a55b-4fb1-b0af-611f7f8bbbd3-credential-socket\") pod \"e2e-derive-eef895f6-openshift-default-78d5df5599-r6bgn\" (UID: \"2ef23658-a55b-4fb1-b0af-611f7f8bbbd3\") " pod="openshift-ingress/e2e-derive-eef895f6-openshift-default-78d5df5599-r6bgn" Jul 14 17:57:03.886297 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:57:03.886238 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2ef23658-a55b-4fb1-b0af-611f7f8bbbd3-istio-token\") pod \"e2e-derive-eef895f6-openshift-default-78d5df5599-r6bgn\" (UID: \"2ef23658-a55b-4fb1-b0af-611f7f8bbbd3\") " pod="openshift-ingress/e2e-derive-eef895f6-openshift-default-78d5df5599-r6bgn" Jul 14 17:57:03.886297 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:57:03.886271 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2ef23658-a55b-4fb1-b0af-611f7f8bbbd3-workload-certs\") pod \"e2e-derive-eef895f6-openshift-default-78d5df5599-r6bgn\" (UID: \"2ef23658-a55b-4fb1-b0af-611f7f8bbbd3\") " pod="openshift-ingress/e2e-derive-eef895f6-openshift-default-78d5df5599-r6bgn" Jul 14 17:57:03.886436 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:57:03.886349 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9shwh\" (UniqueName: \"kubernetes.io/projected/2ef23658-a55b-4fb1-b0af-611f7f8bbbd3-kube-api-access-9shwh\") pod \"e2e-derive-eef895f6-openshift-default-78d5df5599-r6bgn\" (UID: \"2ef23658-a55b-4fb1-b0af-611f7f8bbbd3\") " pod="openshift-ingress/e2e-derive-eef895f6-openshift-default-78d5df5599-r6bgn" Jul 14 17:57:03.886436 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:57:03.886382 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2ef23658-a55b-4fb1-b0af-611f7f8bbbd3-workload-socket\") pod \"e2e-derive-eef895f6-openshift-default-78d5df5599-r6bgn\" (UID: \"2ef23658-a55b-4fb1-b0af-611f7f8bbbd3\") " pod="openshift-ingress/e2e-derive-eef895f6-openshift-default-78d5df5599-r6bgn" Jul 14 17:57:03.886436 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:57:03.886399 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2ef23658-a55b-4fb1-b0af-611f7f8bbbd3-istio-envoy\") pod \"e2e-derive-eef895f6-openshift-default-78d5df5599-r6bgn\" (UID: \"2ef23658-a55b-4fb1-b0af-611f7f8bbbd3\") " pod="openshift-ingress/e2e-derive-eef895f6-openshift-default-78d5df5599-r6bgn" Jul 14 17:57:03.886532 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:57:03.886481 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2ef23658-a55b-4fb1-b0af-611f7f8bbbd3-istiod-ca-cert\") pod \"e2e-derive-eef895f6-openshift-default-78d5df5599-r6bgn\" (UID: \"2ef23658-a55b-4fb1-b0af-611f7f8bbbd3\") " pod="openshift-ingress/e2e-derive-eef895f6-openshift-default-78d5df5599-r6bgn" Jul 14 17:57:03.886532 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:57:03.886517 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2ef23658-a55b-4fb1-b0af-611f7f8bbbd3-istio-podinfo\") pod \"e2e-derive-eef895f6-openshift-default-78d5df5599-r6bgn\" (UID: \"2ef23658-a55b-4fb1-b0af-611f7f8bbbd3\") " pod="openshift-ingress/e2e-derive-eef895f6-openshift-default-78d5df5599-r6bgn" Jul 14 17:57:03.987578 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:57:03.987545 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2ef23658-a55b-4fb1-b0af-611f7f8bbbd3-workload-certs\") pod \"e2e-derive-eef895f6-openshift-default-78d5df5599-r6bgn\" (UID: \"2ef23658-a55b-4fb1-b0af-611f7f8bbbd3\") " pod="openshift-ingress/e2e-derive-eef895f6-openshift-default-78d5df5599-r6bgn" Jul 14 17:57:03.987767 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:57:03.987583 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9shwh\" (UniqueName: \"kubernetes.io/projected/2ef23658-a55b-4fb1-b0af-611f7f8bbbd3-kube-api-access-9shwh\") pod \"e2e-derive-eef895f6-openshift-default-78d5df5599-r6bgn\" (UID: \"2ef23658-a55b-4fb1-b0af-611f7f8bbbd3\") " pod="openshift-ingress/e2e-derive-eef895f6-openshift-default-78d5df5599-r6bgn" Jul 14 17:57:03.987767 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:57:03.987609 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2ef23658-a55b-4fb1-b0af-611f7f8bbbd3-workload-socket\") pod \"e2e-derive-eef895f6-openshift-default-78d5df5599-r6bgn\" (UID: \"2ef23658-a55b-4fb1-b0af-611f7f8bbbd3\") " pod="openshift-ingress/e2e-derive-eef895f6-openshift-default-78d5df5599-r6bgn" Jul 14 17:57:03.987767 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:57:03.987654 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2ef23658-a55b-4fb1-b0af-611f7f8bbbd3-istio-envoy\") pod \"e2e-derive-eef895f6-openshift-default-78d5df5599-r6bgn\" (UID: \"2ef23658-a55b-4fb1-b0af-611f7f8bbbd3\") " pod="openshift-ingress/e2e-derive-eef895f6-openshift-default-78d5df5599-r6bgn" Jul 14 17:57:03.987767 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:57:03.987698 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2ef23658-a55b-4fb1-b0af-611f7f8bbbd3-istiod-ca-cert\") pod \"e2e-derive-eef895f6-openshift-default-78d5df5599-r6bgn\" (UID: \"2ef23658-a55b-4fb1-b0af-611f7f8bbbd3\") " pod="openshift-ingress/e2e-derive-eef895f6-openshift-default-78d5df5599-r6bgn" Jul 14 17:57:03.988017 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:57:03.987993 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2ef23658-a55b-4fb1-b0af-611f7f8bbbd3-workload-certs\") pod \"e2e-derive-eef895f6-openshift-default-78d5df5599-r6bgn\" (UID: \"2ef23658-a55b-4fb1-b0af-611f7f8bbbd3\") " pod="openshift-ingress/e2e-derive-eef895f6-openshift-default-78d5df5599-r6bgn" Jul 14 17:57:03.988079 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:57:03.988005 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2ef23658-a55b-4fb1-b0af-611f7f8bbbd3-workload-socket\") pod \"e2e-derive-eef895f6-openshift-default-78d5df5599-r6bgn\" (UID: \"2ef23658-a55b-4fb1-b0af-611f7f8bbbd3\") " pod="openshift-ingress/e2e-derive-eef895f6-openshift-default-78d5df5599-r6bgn" Jul 14 17:57:03.988079 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:57:03.988024 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2ef23658-a55b-4fb1-b0af-611f7f8bbbd3-istio-podinfo\") pod \"e2e-derive-eef895f6-openshift-default-78d5df5599-r6bgn\" (UID: \"2ef23658-a55b-4fb1-b0af-611f7f8bbbd3\") " pod="openshift-ingress/e2e-derive-eef895f6-openshift-default-78d5df5599-r6bgn" Jul 14 17:57:03.988176 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:57:03.988096 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2ef23658-a55b-4fb1-b0af-611f7f8bbbd3-istio-data\") pod \"e2e-derive-eef895f6-openshift-default-78d5df5599-r6bgn\" (UID: \"2ef23658-a55b-4fb1-b0af-611f7f8bbbd3\") " pod="openshift-ingress/e2e-derive-eef895f6-openshift-default-78d5df5599-r6bgn" Jul 14 17:57:03.988234 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:57:03.988175 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2ef23658-a55b-4fb1-b0af-611f7f8bbbd3-credential-socket\") pod \"e2e-derive-eef895f6-openshift-default-78d5df5599-r6bgn\" (UID: \"2ef23658-a55b-4fb1-b0af-611f7f8bbbd3\") " pod="openshift-ingress/e2e-derive-eef895f6-openshift-default-78d5df5599-r6bgn" Jul 14 17:57:03.988234 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:57:03.988204 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2ef23658-a55b-4fb1-b0af-611f7f8bbbd3-istio-token\") pod \"e2e-derive-eef895f6-openshift-default-78d5df5599-r6bgn\" (UID: \"2ef23658-a55b-4fb1-b0af-611f7f8bbbd3\") " pod="openshift-ingress/e2e-derive-eef895f6-openshift-default-78d5df5599-r6bgn" Jul 14 17:57:03.988453 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:57:03.988432 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2ef23658-a55b-4fb1-b0af-611f7f8bbbd3-istiod-ca-cert\") pod \"e2e-derive-eef895f6-openshift-default-78d5df5599-r6bgn\" (UID: \"2ef23658-a55b-4fb1-b0af-611f7f8bbbd3\") " pod="openshift-ingress/e2e-derive-eef895f6-openshift-default-78d5df5599-r6bgn" Jul 14 17:57:03.988520 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:57:03.988433 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2ef23658-a55b-4fb1-b0af-611f7f8bbbd3-istio-data\") pod \"e2e-derive-eef895f6-openshift-default-78d5df5599-r6bgn\" (UID: \"2ef23658-a55b-4fb1-b0af-611f7f8bbbd3\") " pod="openshift-ingress/e2e-derive-eef895f6-openshift-default-78d5df5599-r6bgn" Jul 14 17:57:03.988520 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:57:03.988500 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2ef23658-a55b-4fb1-b0af-611f7f8bbbd3-credential-socket\") pod \"e2e-derive-eef895f6-openshift-default-78d5df5599-r6bgn\" (UID: \"2ef23658-a55b-4fb1-b0af-611f7f8bbbd3\") " pod="openshift-ingress/e2e-derive-eef895f6-openshift-default-78d5df5599-r6bgn" Jul 14 17:57:03.990044 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:57:03.990021 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2ef23658-a55b-4fb1-b0af-611f7f8bbbd3-istio-envoy\") pod \"e2e-derive-eef895f6-openshift-default-78d5df5599-r6bgn\" (UID: \"2ef23658-a55b-4fb1-b0af-611f7f8bbbd3\") " pod="openshift-ingress/e2e-derive-eef895f6-openshift-default-78d5df5599-r6bgn" Jul 14 17:57:03.990503 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:57:03.990482 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2ef23658-a55b-4fb1-b0af-611f7f8bbbd3-istio-podinfo\") pod \"e2e-derive-eef895f6-openshift-default-78d5df5599-r6bgn\" (UID: \"2ef23658-a55b-4fb1-b0af-611f7f8bbbd3\") " pod="openshift-ingress/e2e-derive-eef895f6-openshift-default-78d5df5599-r6bgn" Jul 14 17:57:03.996036 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:57:03.996012 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2ef23658-a55b-4fb1-b0af-611f7f8bbbd3-istio-token\") pod \"e2e-derive-eef895f6-openshift-default-78d5df5599-r6bgn\" (UID: \"2ef23658-a55b-4fb1-b0af-611f7f8bbbd3\") " pod="openshift-ingress/e2e-derive-eef895f6-openshift-default-78d5df5599-r6bgn" Jul 14 17:57:03.996457 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:57:03.996438 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9shwh\" (UniqueName: \"kubernetes.io/projected/2ef23658-a55b-4fb1-b0af-611f7f8bbbd3-kube-api-access-9shwh\") pod \"e2e-derive-eef895f6-openshift-default-78d5df5599-r6bgn\" (UID: \"2ef23658-a55b-4fb1-b0af-611f7f8bbbd3\") " pod="openshift-ingress/e2e-derive-eef895f6-openshift-default-78d5df5599-r6bgn" Jul 14 17:57:04.116128 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:57:04.116042 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-eef895f6-openshift-default-78d5df5599-r6bgn" Jul 14 17:57:04.258834 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:57:04.258810 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-eef895f6-openshift-default-78d5df5599-r6bgn"] Jul 14 17:57:04.260868 ip-10-0-139-16 kubenswrapper[2552]: W0714 17:57:04.260834 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2ef23658_a55b_4fb1_b0af_611f7f8bbbd3.slice/crio-a6d0c0d31315c19037a0f6d1dee87cfadcd98703b0e5201e50a4f264ffa48942 WatchSource:0}: Error finding container a6d0c0d31315c19037a0f6d1dee87cfadcd98703b0e5201e50a4f264ffa48942: Status 404 returned error can't find the container with id a6d0c0d31315c19037a0f6d1dee87cfadcd98703b0e5201e50a4f264ffa48942 Jul 14 17:57:04.263056 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:57:04.263013 2552 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 14 17:57:04.263154 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:57:04.263114 2552 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 14 17:57:04.263195 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:57:04.263166 2552 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 14 17:57:04.854890 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:57:04.854855 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-eef895f6-openshift-default-78d5df5599-r6bgn" event={"ID":"2ef23658-a55b-4fb1-b0af-611f7f8bbbd3","Type":"ContainerStarted","Data":"86b5192cbf209a6a0774f14ad83f253b47264d6bb733ad3f2e60737f19f5bbc6"} Jul 14 17:57:04.855262 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:57:04.854939 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-eef895f6-openshift-default-78d5df5599-r6bgn" event={"ID":"2ef23658-a55b-4fb1-b0af-611f7f8bbbd3","Type":"ContainerStarted","Data":"a6d0c0d31315c19037a0f6d1dee87cfadcd98703b0e5201e50a4f264ffa48942"} Jul 14 17:57:04.879387 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:57:04.879342 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-derive-eef895f6-openshift-default-78d5df5599-r6bgn" podStartSLOduration=1.8793141549999999 podStartE2EDuration="1.879314155s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 17:57:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 17:57:04.876314714 +0000 UTC m=+1887.255428665" watchObservedRunningTime="2026-07-14 17:57:04.879314155 +0000 UTC m=+1887.258428167" Jul 14 17:57:05.116443 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:57:05.116315 2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-eef895f6-openshift-default-78d5df5599-r6bgn" Jul 14 17:57:05.121565 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:57:05.121541 2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-eef895f6-openshift-default-78d5df5599-r6bgn" Jul 14 17:57:05.859780 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:57:05.859749 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-eef895f6-openshift-default-78d5df5599-r6bgn" Jul 14 17:57:05.860619 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:57:05.860599 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-eef895f6-openshift-default-78d5df5599-r6bgn" Jul 14 17:57:07.793190 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:57:07.793151 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 17:57:07.894533 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:57:07.894493 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 17:57:10.443044 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:57:10.443011 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 17:57:10.510662 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:57:10.510622 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 17:57:16.236478 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:57:16.236432 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 17:57:18.656497 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:57:18.656450 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 17:57:21.417612 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:57:21.417099 2552 patch_prober.go:28] interesting pod/e2e-derive-eef895f6-openshift-default-78d5df5599-r6bgn container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.56:15021/healthz/ready\": read tcp 10.132.0.2:49916->10.132.0.56:15021: read: connection reset by peer" start-of-body= Jul 14 17:57:21.417612 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:57:21.417178 2552 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-derive-eef895f6-openshift-default-78d5df5599-r6bgn" podUID="2ef23658-a55b-4fb1-b0af-611f7f8bbbd3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.56:15021/healthz/ready\": read tcp 10.132.0.2:49916->10.132.0.56:15021: read: connection reset by peer" Jul 14 17:57:21.950150 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:57:21.950119 2552 generic.go:356] "Generic (PLEG): container finished" podID="2ef23658-a55b-4fb1-b0af-611f7f8bbbd3" containerID="86b5192cbf209a6a0774f14ad83f253b47264d6bb733ad3f2e60737f19f5bbc6" exitCode=0 Jul 14 17:57:21.950363 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:57:21.950202 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-eef895f6-openshift-default-78d5df5599-r6bgn" event={"ID":"2ef23658-a55b-4fb1-b0af-611f7f8bbbd3","Type":"ContainerDied","Data":"86b5192cbf209a6a0774f14ad83f253b47264d6bb733ad3f2e60737f19f5bbc6"} Jul 14 17:57:21.950635 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:57:21.950622 2552 scope.go:117] "RemoveContainer" containerID="86b5192cbf209a6a0774f14ad83f253b47264d6bb733ad3f2e60737f19f5bbc6" Jul 14 17:57:21.951576 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:57:21.951548 2552 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 14 17:57:21.951645 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:57:21.951631 2552 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 14 17:57:21.951682 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:57:21.951665 2552 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 14 17:57:22.957883 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:57:22.957847 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-eef895f6-openshift-default-78d5df5599-r6bgn" event={"ID":"2ef23658-a55b-4fb1-b0af-611f7f8bbbd3","Type":"ContainerStarted","Data":"e54123a4c726111de61a12047a5615d6f9b41d27a09b29567512a2cc2217e6d6"} Jul 14 17:57:23.116862 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:57:23.116810 2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-eef895f6-openshift-default-78d5df5599-r6bgn" Jul 14 17:57:23.117073 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:57:23.117045 2552 patch_prober.go:28] interesting pod/e2e-derive-eef895f6-openshift-default-78d5df5599-r6bgn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused" start-of-body= Jul 14 17:57:23.117143 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:57:23.117104 2552 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-eef895f6-openshift-default-78d5df5599-r6bgn" podUID="2ef23658-a55b-4fb1-b0af-611f7f8bbbd3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused" Jul 14 17:57:24.117146 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:57:24.117107 2552 patch_prober.go:28] interesting pod/e2e-derive-eef895f6-openshift-default-78d5df5599-r6bgn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused" start-of-body= Jul 14 17:57:24.117550 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:57:24.117177 2552 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-eef895f6-openshift-default-78d5df5599-r6bgn" podUID="2ef23658-a55b-4fb1-b0af-611f7f8bbbd3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused" Jul 14 17:57:25.116946 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:57:25.116911 2552 patch_prober.go:28] interesting pod/e2e-derive-eef895f6-openshift-default-78d5df5599-r6bgn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused" start-of-body= Jul 14 17:57:25.117132 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:57:25.116965 2552 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-eef895f6-openshift-default-78d5df5599-r6bgn" podUID="2ef23658-a55b-4fb1-b0af-611f7f8bbbd3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused" Jul 14 17:57:26.116767 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:57:26.116731 2552 patch_prober.go:28] interesting pod/e2e-derive-eef895f6-openshift-default-78d5df5599-r6bgn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused" start-of-body= Jul 14 17:57:26.117152 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:57:26.116797 2552 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-eef895f6-openshift-default-78d5df5599-r6bgn" podUID="2ef23658-a55b-4fb1-b0af-611f7f8bbbd3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused" Jul 14 17:57:27.117046 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:57:27.117014 2552 patch_prober.go:28] interesting pod/e2e-derive-eef895f6-openshift-default-78d5df5599-r6bgn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused" start-of-body= Jul 14 17:57:27.117476 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:57:27.117067 2552 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-eef895f6-openshift-default-78d5df5599-r6bgn" podUID="2ef23658-a55b-4fb1-b0af-611f7f8bbbd3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused" Jul 14 17:57:28.120145 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:57:28.120115 2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-eef895f6-openshift-default-78d5df5599-r6bgn" Jul 14 17:57:28.120622 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:57:28.120387 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-eef895f6-openshift-default-78d5df5599-r6bgn" Jul 14 17:57:28.121033 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:57:28.121015 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-eef895f6-openshift-default-78d5df5599-r6bgn" Jul 14 17:58:10.034721 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:58:10.034686 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 17:58:14.486831 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:58:14.486790 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 17:58:20.428886 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:58:20.428852 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 17:58:20.531204 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:58:20.531168 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 17:58:24.659609 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:58:24.659578 2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-eef895f6-openshift-default-78d5df5599-r6bgn"] Jul 14 17:58:24.660032 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:58:24.659763 2552 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-derive-eef895f6-openshift-default-78d5df5599-r6bgn" podUID="2ef23658-a55b-4fb1-b0af-611f7f8bbbd3" containerName="istio-proxy" containerID="cri-o://e54123a4c726111de61a12047a5615d6f9b41d27a09b29567512a2cc2217e6d6" gracePeriod=30 Jul 14 17:58:26.857654 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:58:26.857618 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 17:58:26.958236 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:58:26.958191 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 17:58:28.123171 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:58:28.123133 2552 patch_prober.go:28] interesting pod/e2e-derive-eef895f6-openshift-default-78d5df5599-r6bgn container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=upstream connect error or disconnect/reset before headers. reset reason: remote connection failure, transport failure reason: delayed connect error: Connection refused Jul 14 17:58:28.123609 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:58:28.123198 2552 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-derive-eef895f6-openshift-default-78d5df5599-r6bgn" podUID="2ef23658-a55b-4fb1-b0af-611f7f8bbbd3" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 14 17:58:29.928336 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:58:29.928265 2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-eef895f6-openshift-default-78d5df5599-r6bgn" Jul 14 17:58:30.002465 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:58:30.002434 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2ef23658-a55b-4fb1-b0af-611f7f8bbbd3-credential-socket\") pod \"2ef23658-a55b-4fb1-b0af-611f7f8bbbd3\" (UID: \"2ef23658-a55b-4fb1-b0af-611f7f8bbbd3\") " Jul 14 17:58:30.002648 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:58:30.002529 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2ef23658-a55b-4fb1-b0af-611f7f8bbbd3-istio-token\") pod \"2ef23658-a55b-4fb1-b0af-611f7f8bbbd3\" (UID: \"2ef23658-a55b-4fb1-b0af-611f7f8bbbd3\") " Jul 14 17:58:30.002648 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:58:30.002559 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2ef23658-a55b-4fb1-b0af-611f7f8bbbd3-workload-certs\") pod \"2ef23658-a55b-4fb1-b0af-611f7f8bbbd3\" (UID: \"2ef23658-a55b-4fb1-b0af-611f7f8bbbd3\") " Jul 14 17:58:30.002648 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:58:30.002598 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2ef23658-a55b-4fb1-b0af-611f7f8bbbd3-istio-envoy\") pod \"2ef23658-a55b-4fb1-b0af-611f7f8bbbd3\" (UID: \"2ef23658-a55b-4fb1-b0af-611f7f8bbbd3\") " Jul 14 17:58:30.002648 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:58:30.002645 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2ef23658-a55b-4fb1-b0af-611f7f8bbbd3-istio-data\") pod \"2ef23658-a55b-4fb1-b0af-611f7f8bbbd3\" (UID: \"2ef23658-a55b-4fb1-b0af-611f7f8bbbd3\") " Jul 14 17:58:30.002839 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:58:30.002671 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2ef23658-a55b-4fb1-b0af-611f7f8bbbd3-istio-podinfo\") pod \"2ef23658-a55b-4fb1-b0af-611f7f8bbbd3\" (UID: \"2ef23658-a55b-4fb1-b0af-611f7f8bbbd3\") " Jul 14 17:58:30.002839 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:58:30.002726 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2ef23658-a55b-4fb1-b0af-611f7f8bbbd3-workload-socket\") pod \"2ef23658-a55b-4fb1-b0af-611f7f8bbbd3\" (UID: \"2ef23658-a55b-4fb1-b0af-611f7f8bbbd3\") " Jul 14 17:58:30.002839 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:58:30.002761 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2ef23658-a55b-4fb1-b0af-611f7f8bbbd3-istiod-ca-cert\") pod \"2ef23658-a55b-4fb1-b0af-611f7f8bbbd3\" (UID: \"2ef23658-a55b-4fb1-b0af-611f7f8bbbd3\") " Jul 14 17:58:30.002839 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:58:30.002824 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9shwh\" (UniqueName: \"kubernetes.io/projected/2ef23658-a55b-4fb1-b0af-611f7f8bbbd3-kube-api-access-9shwh\") pod \"2ef23658-a55b-4fb1-b0af-611f7f8bbbd3\" (UID: \"2ef23658-a55b-4fb1-b0af-611f7f8bbbd3\") " Jul 14 17:58:30.003555 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:58:30.003152 2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2ef23658-a55b-4fb1-b0af-611f7f8bbbd3-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "2ef23658-a55b-4fb1-b0af-611f7f8bbbd3" (UID: "2ef23658-a55b-4fb1-b0af-611f7f8bbbd3"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 14 17:58:30.004504 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:58:30.004250 2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2ef23658-a55b-4fb1-b0af-611f7f8bbbd3-istio-data" (OuterVolumeSpecName: "istio-data") pod "2ef23658-a55b-4fb1-b0af-611f7f8bbbd3" (UID: "2ef23658-a55b-4fb1-b0af-611f7f8bbbd3"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 14 17:58:30.004685 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:58:30.004651 2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2ef23658-a55b-4fb1-b0af-611f7f8bbbd3-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "2ef23658-a55b-4fb1-b0af-611f7f8bbbd3" (UID: "2ef23658-a55b-4fb1-b0af-611f7f8bbbd3"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 14 17:58:30.004823 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:58:30.004792 2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2ef23658-a55b-4fb1-b0af-611f7f8bbbd3-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "2ef23658-a55b-4fb1-b0af-611f7f8bbbd3" (UID: "2ef23658-a55b-4fb1-b0af-611f7f8bbbd3"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 14 17:58:30.004917 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:58:30.004803 2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2ef23658-a55b-4fb1-b0af-611f7f8bbbd3-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "2ef23658-a55b-4fb1-b0af-611f7f8bbbd3" (UID: "2ef23658-a55b-4fb1-b0af-611f7f8bbbd3"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 14 17:58:30.005697 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:58:30.005673 2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/2ef23658-a55b-4fb1-b0af-611f7f8bbbd3-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "2ef23658-a55b-4fb1-b0af-611f7f8bbbd3" (UID: "2ef23658-a55b-4fb1-b0af-611f7f8bbbd3"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 14 17:58:30.005833 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:58:30.005810 2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2ef23658-a55b-4fb1-b0af-611f7f8bbbd3-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "2ef23658-a55b-4fb1-b0af-611f7f8bbbd3" (UID: "2ef23658-a55b-4fb1-b0af-611f7f8bbbd3"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 14 17:58:30.005935 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:58:30.005867 2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2ef23658-a55b-4fb1-b0af-611f7f8bbbd3-istio-token" (OuterVolumeSpecName: "istio-token") pod "2ef23658-a55b-4fb1-b0af-611f7f8bbbd3" (UID: "2ef23658-a55b-4fb1-b0af-611f7f8bbbd3"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 14 17:58:30.006432 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:58:30.006409 2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2ef23658-a55b-4fb1-b0af-611f7f8bbbd3-kube-api-access-9shwh" (OuterVolumeSpecName: "kube-api-access-9shwh") pod "2ef23658-a55b-4fb1-b0af-611f7f8bbbd3" (UID: "2ef23658-a55b-4fb1-b0af-611f7f8bbbd3"). InnerVolumeSpecName "kube-api-access-9shwh". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 14 17:58:30.104080 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:58:30.104050 2552 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2ef23658-a55b-4fb1-b0af-611f7f8bbbd3-istio-envoy\") on node \"ip-10-0-139-16.ec2.internal\" DevicePath \"\"" Jul 14 17:58:30.104080 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:58:30.104075 2552 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2ef23658-a55b-4fb1-b0af-611f7f8bbbd3-istio-data\") on node \"ip-10-0-139-16.ec2.internal\" DevicePath \"\"" Jul 14 17:58:30.104080 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:58:30.104084 2552 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2ef23658-a55b-4fb1-b0af-611f7f8bbbd3-istio-podinfo\") on node \"ip-10-0-139-16.ec2.internal\" DevicePath \"\"" Jul 14 17:58:30.104278 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:58:30.104094 2552 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2ef23658-a55b-4fb1-b0af-611f7f8bbbd3-workload-socket\") on node \"ip-10-0-139-16.ec2.internal\" DevicePath \"\"" Jul 14 17:58:30.104278 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:58:30.104104 2552 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2ef23658-a55b-4fb1-b0af-611f7f8bbbd3-istiod-ca-cert\") on node \"ip-10-0-139-16.ec2.internal\" DevicePath \"\"" Jul 14 17:58:30.104278 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:58:30.104113 2552 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9shwh\" (UniqueName: \"kubernetes.io/projected/2ef23658-a55b-4fb1-b0af-611f7f8bbbd3-kube-api-access-9shwh\") on node \"ip-10-0-139-16.ec2.internal\" DevicePath \"\"" Jul 14 17:58:30.104278 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:58:30.104123 2552 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2ef23658-a55b-4fb1-b0af-611f7f8bbbd3-credential-socket\") on node \"ip-10-0-139-16.ec2.internal\" DevicePath \"\"" Jul 14 17:58:30.104278 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:58:30.104133 2552 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2ef23658-a55b-4fb1-b0af-611f7f8bbbd3-istio-token\") on node \"ip-10-0-139-16.ec2.internal\" DevicePath \"\"" Jul 14 17:58:30.104278 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:58:30.104141 2552 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2ef23658-a55b-4fb1-b0af-611f7f8bbbd3-workload-certs\") on node \"ip-10-0-139-16.ec2.internal\" DevicePath \"\"" Jul 14 17:58:30.311604 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:58:30.311572 2552 generic.go:356] "Generic (PLEG): container finished" podID="2ef23658-a55b-4fb1-b0af-611f7f8bbbd3" containerID="e54123a4c726111de61a12047a5615d6f9b41d27a09b29567512a2cc2217e6d6" exitCode=0 Jul 14 17:58:30.311772 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:58:30.311623 2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-eef895f6-openshift-default-78d5df5599-r6bgn" Jul 14 17:58:30.311772 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:58:30.311654 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-eef895f6-openshift-default-78d5df5599-r6bgn" event={"ID":"2ef23658-a55b-4fb1-b0af-611f7f8bbbd3","Type":"ContainerDied","Data":"e54123a4c726111de61a12047a5615d6f9b41d27a09b29567512a2cc2217e6d6"} Jul 14 17:58:30.311772 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:58:30.311709 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-eef895f6-openshift-default-78d5df5599-r6bgn" event={"ID":"2ef23658-a55b-4fb1-b0af-611f7f8bbbd3","Type":"ContainerDied","Data":"a6d0c0d31315c19037a0f6d1dee87cfadcd98703b0e5201e50a4f264ffa48942"} Jul 14 17:58:30.311772 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:58:30.311732 2552 scope.go:117] "RemoveContainer" containerID="e54123a4c726111de61a12047a5615d6f9b41d27a09b29567512a2cc2217e6d6" Jul 14 17:58:30.321466 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:58:30.321447 2552 scope.go:117] "RemoveContainer" containerID="86b5192cbf209a6a0774f14ad83f253b47264d6bb733ad3f2e60737f19f5bbc6" Jul 14 17:58:30.330302 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:58:30.330284 2552 scope.go:117] "RemoveContainer" containerID="e54123a4c726111de61a12047a5615d6f9b41d27a09b29567512a2cc2217e6d6" Jul 14 17:58:30.330538 ip-10-0-139-16 kubenswrapper[2552]: E0714 17:58:30.330519 2552 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e54123a4c726111de61a12047a5615d6f9b41d27a09b29567512a2cc2217e6d6\": container with ID starting with e54123a4c726111de61a12047a5615d6f9b41d27a09b29567512a2cc2217e6d6 not found: ID does not exist" containerID="e54123a4c726111de61a12047a5615d6f9b41d27a09b29567512a2cc2217e6d6" Jul 14 17:58:30.330588 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:58:30.330547 2552 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e54123a4c726111de61a12047a5615d6f9b41d27a09b29567512a2cc2217e6d6"} err="failed to get container status \"e54123a4c726111de61a12047a5615d6f9b41d27a09b29567512a2cc2217e6d6\": rpc error: code = NotFound desc = could not find container \"e54123a4c726111de61a12047a5615d6f9b41d27a09b29567512a2cc2217e6d6\": container with ID starting with e54123a4c726111de61a12047a5615d6f9b41d27a09b29567512a2cc2217e6d6 not found: ID does not exist" Jul 14 17:58:30.330588 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:58:30.330563 2552 scope.go:117] "RemoveContainer" containerID="86b5192cbf209a6a0774f14ad83f253b47264d6bb733ad3f2e60737f19f5bbc6" Jul 14 17:58:30.330803 ip-10-0-139-16 kubenswrapper[2552]: E0714 17:58:30.330785 2552 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"86b5192cbf209a6a0774f14ad83f253b47264d6bb733ad3f2e60737f19f5bbc6\": container with ID starting with 86b5192cbf209a6a0774f14ad83f253b47264d6bb733ad3f2e60737f19f5bbc6 not found: ID does not exist" containerID="86b5192cbf209a6a0774f14ad83f253b47264d6bb733ad3f2e60737f19f5bbc6" Jul 14 17:58:30.330848 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:58:30.330808 2552 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"86b5192cbf209a6a0774f14ad83f253b47264d6bb733ad3f2e60737f19f5bbc6"} err="failed to get container status \"86b5192cbf209a6a0774f14ad83f253b47264d6bb733ad3f2e60737f19f5bbc6\": rpc error: code = NotFound desc = could not find container \"86b5192cbf209a6a0774f14ad83f253b47264d6bb733ad3f2e60737f19f5bbc6\": container with ID starting with 86b5192cbf209a6a0774f14ad83f253b47264d6bb733ad3f2e60737f19f5bbc6 not found: ID does not exist" Jul 14 17:58:30.334617 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:58:30.334595 2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-eef895f6-openshift-default-78d5df5599-r6bgn"] Jul 14 17:58:30.340904 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:58:30.340884 2552 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-derive-eef895f6-openshift-default-78d5df5599-r6bgn"] Jul 14 17:58:30.389435 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:58:30.389399 2552 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2ef23658-a55b-4fb1-b0af-611f7f8bbbd3" path="/var/lib/kubelet/pods/2ef23658-a55b-4fb1-b0af-611f7f8bbbd3/volumes" Jul 14 17:58:31.157522 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:58:31.157493 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 17:58:32.820776 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:58:32.820727 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 17:58:32.920510 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:58:32.920469 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 17:58:33.020390 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:58:33.020352 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 17:58:33.120042 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:58:33.119939 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 17:58:33.493280 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:58:33.493248 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 17:59:01.467389 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:59:01.467356 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 17:59:05.532526 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:59:05.532492 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 17:59:05.651843 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:59:05.651808 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 17:59:05.765376 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:59:05.765320 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 17:59:06.275566 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:59:06.275522 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 17:59:06.391666 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:59:06.391633 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 17:59:21.656992 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:59:21.656954 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 17:59:27.854854 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:59:27.854816 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 17:59:28.042968 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:59:28.042929 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 17:59:28.164237 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:59:28.164144 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 17:59:38.626849 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:59:38.626809 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 17:59:39.426540 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:59:39.426507 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 17:59:45.759035 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:59:45.759003 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 17:59:45.894108 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:59:45.894066 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 17:59:46.038246 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:59:46.038132 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 17:59:46.131097 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:59:46.131066 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 17:59:46.919601 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:59:46.919567 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 17:59:47.021317 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:59:47.021277 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 17:59:47.138655 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:59:47.138613 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 17:59:49.050890 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:59:49.050855 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 17:59:56.074686 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:59:56.074651 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 17:59:56.168976 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:59:56.168941 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 17:59:56.781667 ip-10-0-139-16 kubenswrapper[2552]: I0714 17:59:56.781609 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 18:00:02.958051 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:00:02.957965 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 18:00:03.206182 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:00:03.206143 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 18:00:03.339563 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:00:03.339522 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 18:00:03.480255 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:00:03.480226 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-f92df6e4-openshift-default-56fcfb88c9-t458h"] Jul 14 18:00:03.480706 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:00:03.480690 2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2ef23658-a55b-4fb1-b0af-611f7f8bbbd3" containerName="istio-proxy" Jul 14 18:00:03.480706 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:00:03.480706 2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="2ef23658-a55b-4fb1-b0af-611f7f8bbbd3" containerName="istio-proxy" Jul 14 18:00:03.480825 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:00:03.480714 2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2ef23658-a55b-4fb1-b0af-611f7f8bbbd3" containerName="istio-proxy" Jul 14 18:00:03.480825 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:00:03.480719 2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="2ef23658-a55b-4fb1-b0af-611f7f8bbbd3" containerName="istio-proxy" Jul 14 18:00:03.480825 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:00:03.480802 2552 memory_manager.go:368] "RemoveStaleState removing state" podUID="2ef23658-a55b-4fb1-b0af-611f7f8bbbd3" containerName="istio-proxy" Jul 14 18:00:03.480825 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:00:03.480811 2552 memory_manager.go:368] "RemoveStaleState removing state" podUID="2ef23658-a55b-4fb1-b0af-611f7f8bbbd3" containerName="istio-proxy" Jul 14 18:00:03.480825 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:00:03.480818 2552 memory_manager.go:368] "RemoveStaleState removing state" podUID="df1fcf3a-4d42-4917-9fe4-936f4c5802dc" containerName="istio-proxy" Jul 14 18:00:03.484209 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:00:03.484192 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-f92df6e4-openshift-default-56fcfb88c9-t458h" Jul 14 18:00:03.487530 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:00:03.487507 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-f92df6e4-openshift-default-dockercfg-nfbdq\"" Jul 14 18:00:03.502763 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:00:03.502742 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-f92df6e4-openshift-default-56fcfb88c9-t458h"] Jul 14 18:00:03.518097 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:00:03.518066 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 18:00:03.555161 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:00:03.555131 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/85d80f53-c29a-4e71-a649-3cd459d686ef-workload-socket\") pod \"e2e-mt-f92df6e4-openshift-default-56fcfb88c9-t458h\" (UID: \"85d80f53-c29a-4e71-a649-3cd459d686ef\") " pod="openshift-ingress/e2e-mt-f92df6e4-openshift-default-56fcfb88c9-t458h" Jul 14 18:00:03.555358 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:00:03.555174 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/85d80f53-c29a-4e71-a649-3cd459d686ef-workload-certs\") pod \"e2e-mt-f92df6e4-openshift-default-56fcfb88c9-t458h\" (UID: \"85d80f53-c29a-4e71-a649-3cd459d686ef\") " pod="openshift-ingress/e2e-mt-f92df6e4-openshift-default-56fcfb88c9-t458h" Jul 14 18:00:03.555358 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:00:03.555192 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5k7rc\" (UniqueName: \"kubernetes.io/projected/85d80f53-c29a-4e71-a649-3cd459d686ef-kube-api-access-5k7rc\") pod \"e2e-mt-f92df6e4-openshift-default-56fcfb88c9-t458h\" (UID: \"85d80f53-c29a-4e71-a649-3cd459d686ef\") " pod="openshift-ingress/e2e-mt-f92df6e4-openshift-default-56fcfb88c9-t458h" Jul 14 18:00:03.555358 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:00:03.555280 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/85d80f53-c29a-4e71-a649-3cd459d686ef-istio-token\") pod \"e2e-mt-f92df6e4-openshift-default-56fcfb88c9-t458h\" (UID: \"85d80f53-c29a-4e71-a649-3cd459d686ef\") " pod="openshift-ingress/e2e-mt-f92df6e4-openshift-default-56fcfb88c9-t458h" Jul 14 18:00:03.555358 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:00:03.555348 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/85d80f53-c29a-4e71-a649-3cd459d686ef-istio-podinfo\") pod \"e2e-mt-f92df6e4-openshift-default-56fcfb88c9-t458h\" (UID: \"85d80f53-c29a-4e71-a649-3cd459d686ef\") " pod="openshift-ingress/e2e-mt-f92df6e4-openshift-default-56fcfb88c9-t458h" Jul 14 18:00:03.555585 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:00:03.555376 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/85d80f53-c29a-4e71-a649-3cd459d686ef-istiod-ca-cert\") pod \"e2e-mt-f92df6e4-openshift-default-56fcfb88c9-t458h\" (UID: \"85d80f53-c29a-4e71-a649-3cd459d686ef\") " pod="openshift-ingress/e2e-mt-f92df6e4-openshift-default-56fcfb88c9-t458h" Jul 14 18:00:03.555585 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:00:03.555444 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/85d80f53-c29a-4e71-a649-3cd459d686ef-istio-envoy\") pod \"e2e-mt-f92df6e4-openshift-default-56fcfb88c9-t458h\" (UID: \"85d80f53-c29a-4e71-a649-3cd459d686ef\") " pod="openshift-ingress/e2e-mt-f92df6e4-openshift-default-56fcfb88c9-t458h" Jul 14 18:00:03.555585 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:00:03.555506 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/85d80f53-c29a-4e71-a649-3cd459d686ef-credential-socket\") pod \"e2e-mt-f92df6e4-openshift-default-56fcfb88c9-t458h\" (UID: \"85d80f53-c29a-4e71-a649-3cd459d686ef\") " pod="openshift-ingress/e2e-mt-f92df6e4-openshift-default-56fcfb88c9-t458h" Jul 14 18:00:03.555585 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:00:03.555531 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/85d80f53-c29a-4e71-a649-3cd459d686ef-istio-data\") pod \"e2e-mt-f92df6e4-openshift-default-56fcfb88c9-t458h\" (UID: \"85d80f53-c29a-4e71-a649-3cd459d686ef\") " pod="openshift-ingress/e2e-mt-f92df6e4-openshift-default-56fcfb88c9-t458h" Jul 14 18:00:03.656567 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:00:03.656470 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/85d80f53-c29a-4e71-a649-3cd459d686ef-credential-socket\") pod \"e2e-mt-f92df6e4-openshift-default-56fcfb88c9-t458h\" (UID: \"85d80f53-c29a-4e71-a649-3cd459d686ef\") " pod="openshift-ingress/e2e-mt-f92df6e4-openshift-default-56fcfb88c9-t458h" Jul 14 18:00:03.656567 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:00:03.656505 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/85d80f53-c29a-4e71-a649-3cd459d686ef-istio-data\") pod \"e2e-mt-f92df6e4-openshift-default-56fcfb88c9-t458h\" (UID: \"85d80f53-c29a-4e71-a649-3cd459d686ef\") " pod="openshift-ingress/e2e-mt-f92df6e4-openshift-default-56fcfb88c9-t458h" Jul 14 18:00:03.656567 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:00:03.656534 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/85d80f53-c29a-4e71-a649-3cd459d686ef-workload-socket\") pod \"e2e-mt-f92df6e4-openshift-default-56fcfb88c9-t458h\" (UID: \"85d80f53-c29a-4e71-a649-3cd459d686ef\") " pod="openshift-ingress/e2e-mt-f92df6e4-openshift-default-56fcfb88c9-t458h" Jul 14 18:00:03.656567 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:00:03.656556 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/85d80f53-c29a-4e71-a649-3cd459d686ef-workload-certs\") pod \"e2e-mt-f92df6e4-openshift-default-56fcfb88c9-t458h\" (UID: \"85d80f53-c29a-4e71-a649-3cd459d686ef\") " pod="openshift-ingress/e2e-mt-f92df6e4-openshift-default-56fcfb88c9-t458h" Jul 14 18:00:03.656897 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:00:03.656644 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5k7rc\" (UniqueName: \"kubernetes.io/projected/85d80f53-c29a-4e71-a649-3cd459d686ef-kube-api-access-5k7rc\") pod \"e2e-mt-f92df6e4-openshift-default-56fcfb88c9-t458h\" (UID: \"85d80f53-c29a-4e71-a649-3cd459d686ef\") " pod="openshift-ingress/e2e-mt-f92df6e4-openshift-default-56fcfb88c9-t458h" Jul 14 18:00:03.656897 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:00:03.656714 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/85d80f53-c29a-4e71-a649-3cd459d686ef-istio-token\") pod \"e2e-mt-f92df6e4-openshift-default-56fcfb88c9-t458h\" (UID: \"85d80f53-c29a-4e71-a649-3cd459d686ef\") " pod="openshift-ingress/e2e-mt-f92df6e4-openshift-default-56fcfb88c9-t458h" Jul 14 18:00:03.656897 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:00:03.656741 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/85d80f53-c29a-4e71-a649-3cd459d686ef-istio-podinfo\") pod \"e2e-mt-f92df6e4-openshift-default-56fcfb88c9-t458h\" (UID: \"85d80f53-c29a-4e71-a649-3cd459d686ef\") " pod="openshift-ingress/e2e-mt-f92df6e4-openshift-default-56fcfb88c9-t458h" Jul 14 18:00:03.656897 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:00:03.656767 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/85d80f53-c29a-4e71-a649-3cd459d686ef-istiod-ca-cert\") pod \"e2e-mt-f92df6e4-openshift-default-56fcfb88c9-t458h\" (UID: \"85d80f53-c29a-4e71-a649-3cd459d686ef\") " pod="openshift-ingress/e2e-mt-f92df6e4-openshift-default-56fcfb88c9-t458h" Jul 14 18:00:03.656897 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:00:03.656836 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/85d80f53-c29a-4e71-a649-3cd459d686ef-istio-envoy\") pod \"e2e-mt-f92df6e4-openshift-default-56fcfb88c9-t458h\" (UID: \"85d80f53-c29a-4e71-a649-3cd459d686ef\") " pod="openshift-ingress/e2e-mt-f92df6e4-openshift-default-56fcfb88c9-t458h" Jul 14 18:00:03.657122 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:00:03.656945 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/85d80f53-c29a-4e71-a649-3cd459d686ef-workload-certs\") pod \"e2e-mt-f92df6e4-openshift-default-56fcfb88c9-t458h\" (UID: \"85d80f53-c29a-4e71-a649-3cd459d686ef\") " pod="openshift-ingress/e2e-mt-f92df6e4-openshift-default-56fcfb88c9-t458h" Jul 14 18:00:03.657122 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:00:03.656999 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/85d80f53-c29a-4e71-a649-3cd459d686ef-istio-data\") pod \"e2e-mt-f92df6e4-openshift-default-56fcfb88c9-t458h\" (UID: \"85d80f53-c29a-4e71-a649-3cd459d686ef\") " pod="openshift-ingress/e2e-mt-f92df6e4-openshift-default-56fcfb88c9-t458h" Jul 14 18:00:03.657187 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:00:03.657115 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/85d80f53-c29a-4e71-a649-3cd459d686ef-credential-socket\") pod \"e2e-mt-f92df6e4-openshift-default-56fcfb88c9-t458h\" (UID: \"85d80f53-c29a-4e71-a649-3cd459d686ef\") " pod="openshift-ingress/e2e-mt-f92df6e4-openshift-default-56fcfb88c9-t458h" Jul 14 18:00:03.657187 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:00:03.657158 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/85d80f53-c29a-4e71-a649-3cd459d686ef-workload-socket\") pod \"e2e-mt-f92df6e4-openshift-default-56fcfb88c9-t458h\" (UID: \"85d80f53-c29a-4e71-a649-3cd459d686ef\") " pod="openshift-ingress/e2e-mt-f92df6e4-openshift-default-56fcfb88c9-t458h" Jul 14 18:00:03.657628 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:00:03.657606 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/85d80f53-c29a-4e71-a649-3cd459d686ef-istiod-ca-cert\") pod \"e2e-mt-f92df6e4-openshift-default-56fcfb88c9-t458h\" (UID: \"85d80f53-c29a-4e71-a649-3cd459d686ef\") " pod="openshift-ingress/e2e-mt-f92df6e4-openshift-default-56fcfb88c9-t458h" Jul 14 18:00:03.659247 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:00:03.659218 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/85d80f53-c29a-4e71-a649-3cd459d686ef-istio-envoy\") pod \"e2e-mt-f92df6e4-openshift-default-56fcfb88c9-t458h\" (UID: \"85d80f53-c29a-4e71-a649-3cd459d686ef\") " pod="openshift-ingress/e2e-mt-f92df6e4-openshift-default-56fcfb88c9-t458h" Jul 14 18:00:03.659395 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:00:03.659371 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/85d80f53-c29a-4e71-a649-3cd459d686ef-istio-podinfo\") pod \"e2e-mt-f92df6e4-openshift-default-56fcfb88c9-t458h\" (UID: \"85d80f53-c29a-4e71-a649-3cd459d686ef\") " pod="openshift-ingress/e2e-mt-f92df6e4-openshift-default-56fcfb88c9-t458h" Jul 14 18:00:03.666871 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:00:03.666844 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/85d80f53-c29a-4e71-a649-3cd459d686ef-istio-token\") pod \"e2e-mt-f92df6e4-openshift-default-56fcfb88c9-t458h\" (UID: \"85d80f53-c29a-4e71-a649-3cd459d686ef\") " pod="openshift-ingress/e2e-mt-f92df6e4-openshift-default-56fcfb88c9-t458h" Jul 14 18:00:03.666956 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:00:03.666908 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5k7rc\" (UniqueName: \"kubernetes.io/projected/85d80f53-c29a-4e71-a649-3cd459d686ef-kube-api-access-5k7rc\") pod \"e2e-mt-f92df6e4-openshift-default-56fcfb88c9-t458h\" (UID: \"85d80f53-c29a-4e71-a649-3cd459d686ef\") " pod="openshift-ingress/e2e-mt-f92df6e4-openshift-default-56fcfb88c9-t458h" Jul 14 18:00:03.719071 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:00:03.719036 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 18:00:03.795230 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:00:03.795195 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-f92df6e4-openshift-default-56fcfb88c9-t458h" Jul 14 18:00:03.949371 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:00:03.949180 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-f92df6e4-openshift-default-56fcfb88c9-t458h"] Jul 14 18:00:03.952001 ip-10-0-139-16 kubenswrapper[2552]: W0714 18:00:03.951974 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod85d80f53_c29a_4e71_a649_3cd459d686ef.slice/crio-d8904d507cd560fb7c9bf89afa22f31981d8b0352df125c60595bb12a8910742 WatchSource:0}: Error finding container d8904d507cd560fb7c9bf89afa22f31981d8b0352df125c60595bb12a8910742: Status 404 returned error can't find the container with id d8904d507cd560fb7c9bf89afa22f31981d8b0352df125c60595bb12a8910742 Jul 14 18:00:03.954496 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:00:03.954460 2552 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 14 18:00:03.954598 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:00:03.954544 2552 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 14 18:00:03.954598 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:00:03.954589 2552 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 14 18:00:04.789172 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:00:04.789131 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-f92df6e4-openshift-default-56fcfb88c9-t458h" event={"ID":"85d80f53-c29a-4e71-a649-3cd459d686ef","Type":"ContainerStarted","Data":"b3d9c1450e99e9ec93f1f8c61a6df1a1ad544ae5ef58c09e7bf9e3de5e79b4f6"} Jul 14 18:00:04.789666 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:00:04.789184 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-f92df6e4-openshift-default-56fcfb88c9-t458h" event={"ID":"85d80f53-c29a-4e71-a649-3cd459d686ef","Type":"ContainerStarted","Data":"d8904d507cd560fb7c9bf89afa22f31981d8b0352df125c60595bb12a8910742"} Jul 14 18:00:04.795278 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:00:04.795255 2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-f92df6e4-openshift-default-56fcfb88c9-t458h" Jul 14 18:00:04.816782 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:00:04.816738 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-f92df6e4-openshift-default-56fcfb88c9-t458h" podStartSLOduration=1.81672386 podStartE2EDuration="1.81672386s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 18:00:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 18:00:04.814150969 +0000 UTC m=+2067.193264923" watchObservedRunningTime="2026-07-14 18:00:04.81672386 +0000 UTC m=+2067.195837871" Jul 14 18:00:05.800725 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:00:05.800688 2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-f92df6e4-openshift-default-56fcfb88c9-t458h" Jul 14 18:00:06.802702 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:00:06.802671 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-f92df6e4-openshift-default-56fcfb88c9-t458h" Jul 14 18:00:06.804006 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:00:06.803980 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-f92df6e4-openshift-default-56fcfb88c9-t458h" Jul 14 18:00:06.804134 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:00:06.804088 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 18:00:06.952235 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:00:06.952203 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 18:00:07.102539 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:00:07.102443 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 18:00:07.231638 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:00:07.231601 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 18:00:08.145549 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:00:08.145516 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 18:00:08.331744 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:00:08.331710 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 18:00:11.363631 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:00:11.363596 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 18:00:12.138317 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:00:12.138266 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 18:00:12.285094 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:00:12.285055 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 18:00:12.569801 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:00:12.569767 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 18:00:19.366972 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:00:19.366931 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 18:00:19.573065 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:00:19.573025 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 18:00:22.093268 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:00:22.091833 2552 patch_prober.go:28] interesting pod/e2e-mt-f92df6e4-openshift-default-56fcfb88c9-t458h container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.57:15021/healthz/ready\": read tcp 10.132.0.2:57630->10.132.0.57:15021: read: connection reset by peer" start-of-body= Jul 14 18:00:22.093268 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:00:22.091900 2552 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-f92df6e4-openshift-default-56fcfb88c9-t458h" podUID="85d80f53-c29a-4e71-a649-3cd459d686ef" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.57:15021/healthz/ready\": read tcp 10.132.0.2:57630->10.132.0.57:15021: read: connection reset by peer" Jul 14 18:00:22.894268 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:00:22.894237 2552 generic.go:356] "Generic (PLEG): container finished" podID="85d80f53-c29a-4e71-a649-3cd459d686ef" containerID="b3d9c1450e99e9ec93f1f8c61a6df1a1ad544ae5ef58c09e7bf9e3de5e79b4f6" exitCode=0 Jul 14 18:00:22.894476 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:00:22.894312 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-f92df6e4-openshift-default-56fcfb88c9-t458h" event={"ID":"85d80f53-c29a-4e71-a649-3cd459d686ef","Type":"ContainerDied","Data":"b3d9c1450e99e9ec93f1f8c61a6df1a1ad544ae5ef58c09e7bf9e3de5e79b4f6"} Jul 14 18:00:22.894781 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:00:22.894754 2552 scope.go:117] "RemoveContainer" containerID="b3d9c1450e99e9ec93f1f8c61a6df1a1ad544ae5ef58c09e7bf9e3de5e79b4f6" Jul 14 18:00:22.895910 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:00:22.895877 2552 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 14 18:00:22.896013 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:00:22.895996 2552 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 14 18:00:22.896055 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:00:22.896040 2552 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 14 18:00:23.905672 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:00:23.905629 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-f92df6e4-openshift-default-56fcfb88c9-t458h" event={"ID":"85d80f53-c29a-4e71-a649-3cd459d686ef","Type":"ContainerStarted","Data":"d678aa37ebce02c60d0843e5d7c5d9ae92bc8d3c7c96c3bc8fd155ce0daabf02"} Jul 14 18:00:24.795926 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:00:24.795888 2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-f92df6e4-openshift-default-56fcfb88c9-t458h" Jul 14 18:00:24.796180 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:00:24.796152 2552 patch_prober.go:28] interesting pod/e2e-mt-f92df6e4-openshift-default-56fcfb88c9-t458h container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused" start-of-body= Jul 14 18:00:24.796266 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:00:24.796211 2552 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-f92df6e4-openshift-default-56fcfb88c9-t458h" podUID="85d80f53-c29a-4e71-a649-3cd459d686ef" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused" Jul 14 18:00:25.796405 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:00:25.795917 2552 patch_prober.go:28] interesting pod/e2e-mt-f92df6e4-openshift-default-56fcfb88c9-t458h container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused" start-of-body= Jul 14 18:00:25.796405 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:00:25.795977 2552 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-f92df6e4-openshift-default-56fcfb88c9-t458h" podUID="85d80f53-c29a-4e71-a649-3cd459d686ef" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused" Jul 14 18:00:26.801473 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:00:26.801430 2552 patch_prober.go:28] interesting pod/e2e-mt-f92df6e4-openshift-default-56fcfb88c9-t458h container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused" start-of-body= Jul 14 18:00:26.801969 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:00:26.801498 2552 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-f92df6e4-openshift-default-56fcfb88c9-t458h" podUID="85d80f53-c29a-4e71-a649-3cd459d686ef" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused" Jul 14 18:00:27.795719 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:00:27.795682 2552 patch_prober.go:28] interesting pod/e2e-mt-f92df6e4-openshift-default-56fcfb88c9-t458h container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused" start-of-body= Jul 14 18:00:27.795998 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:00:27.795968 2552 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-f92df6e4-openshift-default-56fcfb88c9-t458h" podUID="85d80f53-c29a-4e71-a649-3cd459d686ef" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused" Jul 14 18:00:28.799560 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:00:28.799531 2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-f92df6e4-openshift-default-56fcfb88c9-t458h" Jul 14 18:00:28.799922 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:00:28.799782 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-f92df6e4-openshift-default-56fcfb88c9-t458h" Jul 14 18:00:28.800474 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:00:28.800458 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-f92df6e4-openshift-default-56fcfb88c9-t458h" Jul 14 18:00:30.617359 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:00:30.617305 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 18:00:34.915810 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:00:34.915767 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 18:00:38.247607 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:00:38.247582 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-gnw2z_b3c71861-4db9-4850-a44b-6f5d44a94235/console-operator/2.log" Jul 14 18:00:38.252435 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:00:38.252414 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cwprj_d3492336-881b-4f13-8d3a-b4d4ec05ad3c/ovn-acl-logging/0.log" Jul 14 18:00:38.258824 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:00:38.258809 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-gnw2z_b3c71861-4db9-4850-a44b-6f5d44a94235/console-operator/2.log" Jul 14 18:00:38.263742 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:00:38.263728 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cwprj_d3492336-881b-4f13-8d3a-b4d4ec05ad3c/ovn-acl-logging/0.log" Jul 14 18:00:41.186919 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:00:41.186882 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 18:00:41.276722 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:00:41.276681 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 18:00:45.623157 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:00:45.623126 2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-f92df6e4-openshift-default-56fcfb88c9-t458h"] Jul 14 18:00:45.623576 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:00:45.623375 2552 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-f92df6e4-openshift-default-56fcfb88c9-t458h" podUID="85d80f53-c29a-4e71-a649-3cd459d686ef" containerName="istio-proxy" containerID="cri-o://d678aa37ebce02c60d0843e5d7c5d9ae92bc8d3c7c96c3bc8fd155ce0daabf02" gracePeriod=30 Jul 14 18:00:45.645801 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:00:45.645777 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 18:00:45.850866 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:00:45.850830 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 18:00:45.989892 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:00:45.989858 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 18:00:46.087389 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:00:46.087319 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 18:00:46.214881 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:00:46.214837 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 18:00:50.886487 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:00:50.886459 2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-f92df6e4-openshift-default-56fcfb88c9-t458h" Jul 14 18:00:51.004637 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:00:51.004600 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/85d80f53-c29a-4e71-a649-3cd459d686ef-workload-socket\") pod \"85d80f53-c29a-4e71-a649-3cd459d686ef\" (UID: \"85d80f53-c29a-4e71-a649-3cd459d686ef\") " Jul 14 18:00:51.004637 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:00:51.004642 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/85d80f53-c29a-4e71-a649-3cd459d686ef-istio-token\") pod \"85d80f53-c29a-4e71-a649-3cd459d686ef\" (UID: \"85d80f53-c29a-4e71-a649-3cd459d686ef\") " Jul 14 18:00:51.004871 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:00:51.004663 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/85d80f53-c29a-4e71-a649-3cd459d686ef-credential-socket\") pod \"85d80f53-c29a-4e71-a649-3cd459d686ef\" (UID: \"85d80f53-c29a-4e71-a649-3cd459d686ef\") " Jul 14 18:00:51.004871 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:00:51.004721 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/85d80f53-c29a-4e71-a649-3cd459d686ef-istio-podinfo\") pod \"85d80f53-c29a-4e71-a649-3cd459d686ef\" (UID: \"85d80f53-c29a-4e71-a649-3cd459d686ef\") " Jul 14 18:00:51.004871 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:00:51.004742 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/85d80f53-c29a-4e71-a649-3cd459d686ef-istio-envoy\") pod \"85d80f53-c29a-4e71-a649-3cd459d686ef\" (UID: \"85d80f53-c29a-4e71-a649-3cd459d686ef\") " Jul 14 18:00:51.004871 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:00:51.004790 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5k7rc\" (UniqueName: \"kubernetes.io/projected/85d80f53-c29a-4e71-a649-3cd459d686ef-kube-api-access-5k7rc\") pod \"85d80f53-c29a-4e71-a649-3cd459d686ef\" (UID: \"85d80f53-c29a-4e71-a649-3cd459d686ef\") " Jul 14 18:00:51.005121 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:00:51.004900 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/85d80f53-c29a-4e71-a649-3cd459d686ef-workload-certs\") pod \"85d80f53-c29a-4e71-a649-3cd459d686ef\" (UID: \"85d80f53-c29a-4e71-a649-3cd459d686ef\") " Jul 14 18:00:51.005121 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:00:51.004927 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/85d80f53-c29a-4e71-a649-3cd459d686ef-istiod-ca-cert\") pod \"85d80f53-c29a-4e71-a649-3cd459d686ef\" (UID: \"85d80f53-c29a-4e71-a649-3cd459d686ef\") " Jul 14 18:00:51.005121 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:00:51.004949 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/85d80f53-c29a-4e71-a649-3cd459d686ef-istio-data\") pod \"85d80f53-c29a-4e71-a649-3cd459d686ef\" (UID: \"85d80f53-c29a-4e71-a649-3cd459d686ef\") " Jul 14 18:00:51.005121 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:00:51.005006 2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/85d80f53-c29a-4e71-a649-3cd459d686ef-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "85d80f53-c29a-4e71-a649-3cd459d686ef" (UID: "85d80f53-c29a-4e71-a649-3cd459d686ef"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 14 18:00:51.005350 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:00:51.005187 2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/85d80f53-c29a-4e71-a649-3cd459d686ef-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "85d80f53-c29a-4e71-a649-3cd459d686ef" (UID: "85d80f53-c29a-4e71-a649-3cd459d686ef"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 14 18:00:51.005350 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:00:51.005277 2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/85d80f53-c29a-4e71-a649-3cd459d686ef-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "85d80f53-c29a-4e71-a649-3cd459d686ef" (UID: "85d80f53-c29a-4e71-a649-3cd459d686ef"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 14 18:00:51.005465 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:00:51.005392 2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/85d80f53-c29a-4e71-a649-3cd459d686ef-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "85d80f53-c29a-4e71-a649-3cd459d686ef" (UID: "85d80f53-c29a-4e71-a649-3cd459d686ef"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 14 18:00:51.005465 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:00:51.005453 2552 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/85d80f53-c29a-4e71-a649-3cd459d686ef-workload-certs\") on node \"ip-10-0-139-16.ec2.internal\" DevicePath \"\"" Jul 14 18:00:51.005583 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:00:51.005474 2552 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/85d80f53-c29a-4e71-a649-3cd459d686ef-workload-socket\") on node \"ip-10-0-139-16.ec2.internal\" DevicePath \"\"" Jul 14 18:00:51.005985 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:00:51.005958 2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/85d80f53-c29a-4e71-a649-3cd459d686ef-istio-data" (OuterVolumeSpecName: "istio-data") pod "85d80f53-c29a-4e71-a649-3cd459d686ef" (UID: "85d80f53-c29a-4e71-a649-3cd459d686ef"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 14 18:00:51.006955 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:00:51.006930 2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/85d80f53-c29a-4e71-a649-3cd459d686ef-istio-token" (OuterVolumeSpecName: "istio-token") pod "85d80f53-c29a-4e71-a649-3cd459d686ef" (UID: "85d80f53-c29a-4e71-a649-3cd459d686ef"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 14 18:00:51.007091 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:00:51.007070 2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/85d80f53-c29a-4e71-a649-3cd459d686ef-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "85d80f53-c29a-4e71-a649-3cd459d686ef" (UID: "85d80f53-c29a-4e71-a649-3cd459d686ef"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 14 18:00:51.007509 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:00:51.007489 2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/85d80f53-c29a-4e71-a649-3cd459d686ef-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "85d80f53-c29a-4e71-a649-3cd459d686ef" (UID: "85d80f53-c29a-4e71-a649-3cd459d686ef"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 14 18:00:51.007597 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:00:51.007505 2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/85d80f53-c29a-4e71-a649-3cd459d686ef-kube-api-access-5k7rc" (OuterVolumeSpecName: "kube-api-access-5k7rc") pod "85d80f53-c29a-4e71-a649-3cd459d686ef" (UID: "85d80f53-c29a-4e71-a649-3cd459d686ef"). InnerVolumeSpecName "kube-api-access-5k7rc". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 14 18:00:51.046900 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:00:51.046872 2552 generic.go:356] "Generic (PLEG): container finished" podID="85d80f53-c29a-4e71-a649-3cd459d686ef" containerID="d678aa37ebce02c60d0843e5d7c5d9ae92bc8d3c7c96c3bc8fd155ce0daabf02" exitCode=0 Jul 14 18:00:51.047044 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:00:51.046916 2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-f92df6e4-openshift-default-56fcfb88c9-t458h" Jul 14 18:00:51.047044 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:00:51.046958 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-f92df6e4-openshift-default-56fcfb88c9-t458h" event={"ID":"85d80f53-c29a-4e71-a649-3cd459d686ef","Type":"ContainerDied","Data":"d678aa37ebce02c60d0843e5d7c5d9ae92bc8d3c7c96c3bc8fd155ce0daabf02"} Jul 14 18:00:51.047044 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:00:51.047017 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-f92df6e4-openshift-default-56fcfb88c9-t458h" event={"ID":"85d80f53-c29a-4e71-a649-3cd459d686ef","Type":"ContainerDied","Data":"d8904d507cd560fb7c9bf89afa22f31981d8b0352df125c60595bb12a8910742"} Jul 14 18:00:51.047044 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:00:51.047041 2552 scope.go:117] "RemoveContainer" containerID="d678aa37ebce02c60d0843e5d7c5d9ae92bc8d3c7c96c3bc8fd155ce0daabf02" Jul 14 18:00:51.056548 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:00:51.056530 2552 scope.go:117] "RemoveContainer" containerID="b3d9c1450e99e9ec93f1f8c61a6df1a1ad544ae5ef58c09e7bf9e3de5e79b4f6" Jul 14 18:00:51.064783 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:00:51.064764 2552 scope.go:117] "RemoveContainer" containerID="d678aa37ebce02c60d0843e5d7c5d9ae92bc8d3c7c96c3bc8fd155ce0daabf02" Jul 14 18:00:51.065020 ip-10-0-139-16 kubenswrapper[2552]: E0714 18:00:51.065003 2552 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d678aa37ebce02c60d0843e5d7c5d9ae92bc8d3c7c96c3bc8fd155ce0daabf02\": container with ID starting with d678aa37ebce02c60d0843e5d7c5d9ae92bc8d3c7c96c3bc8fd155ce0daabf02 not found: ID does not exist" containerID="d678aa37ebce02c60d0843e5d7c5d9ae92bc8d3c7c96c3bc8fd155ce0daabf02" Jul 14 18:00:51.065066 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:00:51.065028 2552 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d678aa37ebce02c60d0843e5d7c5d9ae92bc8d3c7c96c3bc8fd155ce0daabf02"} err="failed to get container status \"d678aa37ebce02c60d0843e5d7c5d9ae92bc8d3c7c96c3bc8fd155ce0daabf02\": rpc error: code = NotFound desc = could not find container \"d678aa37ebce02c60d0843e5d7c5d9ae92bc8d3c7c96c3bc8fd155ce0daabf02\": container with ID starting with d678aa37ebce02c60d0843e5d7c5d9ae92bc8d3c7c96c3bc8fd155ce0daabf02 not found: ID does not exist" Jul 14 18:00:51.065066 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:00:51.065046 2552 scope.go:117] "RemoveContainer" containerID="b3d9c1450e99e9ec93f1f8c61a6df1a1ad544ae5ef58c09e7bf9e3de5e79b4f6" Jul 14 18:00:51.065272 ip-10-0-139-16 kubenswrapper[2552]: E0714 18:00:51.065252 2552 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b3d9c1450e99e9ec93f1f8c61a6df1a1ad544ae5ef58c09e7bf9e3de5e79b4f6\": container with ID starting with b3d9c1450e99e9ec93f1f8c61a6df1a1ad544ae5ef58c09e7bf9e3de5e79b4f6 not found: ID does not exist" containerID="b3d9c1450e99e9ec93f1f8c61a6df1a1ad544ae5ef58c09e7bf9e3de5e79b4f6" Jul 14 18:00:51.065345 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:00:51.065279 2552 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b3d9c1450e99e9ec93f1f8c61a6df1a1ad544ae5ef58c09e7bf9e3de5e79b4f6"} err="failed to get container status \"b3d9c1450e99e9ec93f1f8c61a6df1a1ad544ae5ef58c09e7bf9e3de5e79b4f6\": rpc error: code = NotFound desc = could not find container \"b3d9c1450e99e9ec93f1f8c61a6df1a1ad544ae5ef58c09e7bf9e3de5e79b4f6\": container with ID starting with b3d9c1450e99e9ec93f1f8c61a6df1a1ad544ae5ef58c09e7bf9e3de5e79b4f6 not found: ID does not exist" Jul 14 18:00:51.070098 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:00:51.070076 2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-f92df6e4-openshift-default-56fcfb88c9-t458h"] Jul 14 18:00:51.073948 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:00:51.073930 2552 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-f92df6e4-openshift-default-56fcfb88c9-t458h"] Jul 14 18:00:51.106070 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:00:51.106044 2552 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/85d80f53-c29a-4e71-a649-3cd459d686ef-istiod-ca-cert\") on node \"ip-10-0-139-16.ec2.internal\" DevicePath \"\"" Jul 14 18:00:51.106070 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:00:51.106067 2552 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/85d80f53-c29a-4e71-a649-3cd459d686ef-istio-data\") on node \"ip-10-0-139-16.ec2.internal\" DevicePath \"\"" Jul 14 18:00:51.106187 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:00:51.106075 2552 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/85d80f53-c29a-4e71-a649-3cd459d686ef-istio-token\") on node \"ip-10-0-139-16.ec2.internal\" DevicePath \"\"" Jul 14 18:00:51.106187 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:00:51.106085 2552 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/85d80f53-c29a-4e71-a649-3cd459d686ef-credential-socket\") on node \"ip-10-0-139-16.ec2.internal\" DevicePath \"\"" Jul 14 18:00:51.106187 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:00:51.106098 2552 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/85d80f53-c29a-4e71-a649-3cd459d686ef-istio-podinfo\") on node \"ip-10-0-139-16.ec2.internal\" DevicePath \"\"" Jul 14 18:00:51.106187 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:00:51.106109 2552 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/85d80f53-c29a-4e71-a649-3cd459d686ef-istio-envoy\") on node \"ip-10-0-139-16.ec2.internal\" DevicePath \"\"" Jul 14 18:00:51.106187 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:00:51.106117 2552 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5k7rc\" (UniqueName: \"kubernetes.io/projected/85d80f53-c29a-4e71-a649-3cd459d686ef-kube-api-access-5k7rc\") on node \"ip-10-0-139-16.ec2.internal\" DevicePath \"\"" Jul 14 18:00:52.204049 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:00:52.204010 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 18:00:52.308260 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:00:52.308218 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 18:00:52.388708 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:00:52.388674 2552 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="85d80f53-c29a-4e71-a649-3cd459d686ef" path="/var/lib/kubelet/pods/85d80f53-c29a-4e71-a649-3cd459d686ef/volumes" Jul 14 18:00:52.404569 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:00:52.404537 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 18:00:52.595288 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:00:52.595256 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 18:00:54.256481 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:00:54.256449 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 18:00:58.586303 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:00:58.586267 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 18:00:58.687212 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:00:58.687177 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 18:01:05.483213 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:01:05.483171 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 18:01:05.869867 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:01:05.869782 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 18:01:06.101965 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:01:06.101915 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 18:01:09.111206 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:01:09.111165 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 18:01:09.234189 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:01:09.234154 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 18:01:09.407552 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:01:09.407463 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 18:01:09.577766 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:01:09.577730 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 18:01:09.897403 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:01:09.897373 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 18:01:10.002142 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:01:10.002105 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 18:01:10.843021 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:01:10.842978 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 18:01:10.941391 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:01:10.941317 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 18:01:11.631984 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:01:11.631952 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 18:01:11.732973 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:01:11.732940 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 18:01:13.596321 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:01:13.596271 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 18:01:30.129587 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:01:30.129491 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 18:02:02.353745 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:02:02.353681 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 18:02:06.966437 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:02:06.966400 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 18:02:11.997343 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:02:11.997290 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 18:02:48.650210 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:02:48.650176 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 18:02:49.107387 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:02:49.107349 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 18:02:54.972736 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:02:54.972691 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 18:03:00.679724 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:03:00.679633 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 18:03:00.743076 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:03:00.743036 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 18:03:09.325830 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:03:09.325783 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 18:03:09.570285 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:03:09.570251 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 18:03:10.686046 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:03:10.686007 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 18:03:10.784342 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:03:10.784286 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 18:03:10.881292 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:03:10.881253 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 18:03:11.602294 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:03:11.602244 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 18:03:13.419219 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:03:13.419181 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 18:03:13.520692 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:03:13.520652 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 18:03:19.060732 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:03:19.060692 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 18:03:19.160808 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:03:19.160775 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 18:03:19.770959 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:03:19.770926 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 18:03:25.538830 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:03:25.538799 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 18:03:25.644162 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:03:25.644122 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 18:03:25.739412 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:03:25.739374 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 18:03:36.276713 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:03:36.276674 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 18:03:36.639319 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:03:36.639241 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 18:03:57.730824 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:03:57.730785 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 18:04:03.623871 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:04:03.623835 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 18:04:03.721961 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:04:03.721924 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 18:04:03.979792 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:04:03.979759 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 18:04:04.273343 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:04:04.273251 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-a-4ef174-openshift-default-9bb6d755f-7fsk9"] Jul 14 18:04:04.273731 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:04:04.273716 2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="85d80f53-c29a-4e71-a649-3cd459d686ef" containerName="istio-proxy" Jul 14 18:04:04.273798 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:04:04.273734 2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="85d80f53-c29a-4e71-a649-3cd459d686ef" containerName="istio-proxy" Jul 14 18:04:04.273798 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:04:04.273757 2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="85d80f53-c29a-4e71-a649-3cd459d686ef" containerName="istio-proxy" Jul 14 18:04:04.273798 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:04:04.273763 2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="85d80f53-c29a-4e71-a649-3cd459d686ef" containerName="istio-proxy" Jul 14 18:04:04.273949 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:04:04.273831 2552 memory_manager.go:368] "RemoveStaleState removing state" podUID="85d80f53-c29a-4e71-a649-3cd459d686ef" containerName="istio-proxy" Jul 14 18:04:04.273949 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:04:04.273842 2552 memory_manager.go:368] "RemoveStaleState removing state" podUID="85d80f53-c29a-4e71-a649-3cd459d686ef" containerName="istio-proxy" Jul 14 18:04:04.276871 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:04:04.276848 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-4ef174-openshift-default-9bb6d755f-7fsk9" Jul 14 18:04:04.280198 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:04:04.280181 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-a-4ef174-openshift-default-dockercfg-d29zm\"" Jul 14 18:04:04.290898 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:04:04.290871 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-4ef174-openshift-default-9bb6d755f-7fsk9"] Jul 14 18:04:04.314706 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:04:04.314666 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 18:04:04.363888 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:04:04.363854 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2cd2503a-9689-4ad5-908f-b634c98e2357-workload-socket\") pod \"e2e-inf-a-4ef174-openshift-default-9bb6d755f-7fsk9\" (UID: \"2cd2503a-9689-4ad5-908f-b634c98e2357\") " pod="openshift-ingress/e2e-inf-a-4ef174-openshift-default-9bb6d755f-7fsk9" Jul 14 18:04:04.363888 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:04:04.363890 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2cd2503a-9689-4ad5-908f-b634c98e2357-credential-socket\") pod \"e2e-inf-a-4ef174-openshift-default-9bb6d755f-7fsk9\" (UID: \"2cd2503a-9689-4ad5-908f-b634c98e2357\") " pod="openshift-ingress/e2e-inf-a-4ef174-openshift-default-9bb6d755f-7fsk9" Jul 14 18:04:04.364147 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:04:04.363914 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2cd2503a-9689-4ad5-908f-b634c98e2357-istio-podinfo\") pod \"e2e-inf-a-4ef174-openshift-default-9bb6d755f-7fsk9\" (UID: \"2cd2503a-9689-4ad5-908f-b634c98e2357\") " pod="openshift-ingress/e2e-inf-a-4ef174-openshift-default-9bb6d755f-7fsk9" Jul 14 18:04:04.364147 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:04:04.364041 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2cd2503a-9689-4ad5-908f-b634c98e2357-workload-certs\") pod \"e2e-inf-a-4ef174-openshift-default-9bb6d755f-7fsk9\" (UID: \"2cd2503a-9689-4ad5-908f-b634c98e2357\") " pod="openshift-ingress/e2e-inf-a-4ef174-openshift-default-9bb6d755f-7fsk9" Jul 14 18:04:04.364147 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:04:04.364124 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2cd2503a-9689-4ad5-908f-b634c98e2357-istio-envoy\") pod \"e2e-inf-a-4ef174-openshift-default-9bb6d755f-7fsk9\" (UID: \"2cd2503a-9689-4ad5-908f-b634c98e2357\") " pod="openshift-ingress/e2e-inf-a-4ef174-openshift-default-9bb6d755f-7fsk9" Jul 14 18:04:04.364371 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:04:04.364179 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cb8br\" (UniqueName: \"kubernetes.io/projected/2cd2503a-9689-4ad5-908f-b634c98e2357-kube-api-access-cb8br\") pod \"e2e-inf-a-4ef174-openshift-default-9bb6d755f-7fsk9\" (UID: \"2cd2503a-9689-4ad5-908f-b634c98e2357\") " pod="openshift-ingress/e2e-inf-a-4ef174-openshift-default-9bb6d755f-7fsk9" Jul 14 18:04:04.364371 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:04:04.364224 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2cd2503a-9689-4ad5-908f-b634c98e2357-istio-token\") pod \"e2e-inf-a-4ef174-openshift-default-9bb6d755f-7fsk9\" (UID: \"2cd2503a-9689-4ad5-908f-b634c98e2357\") " pod="openshift-ingress/e2e-inf-a-4ef174-openshift-default-9bb6d755f-7fsk9" Jul 14 18:04:04.364371 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:04:04.364277 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2cd2503a-9689-4ad5-908f-b634c98e2357-istio-data\") pod \"e2e-inf-a-4ef174-openshift-default-9bb6d755f-7fsk9\" (UID: \"2cd2503a-9689-4ad5-908f-b634c98e2357\") " pod="openshift-ingress/e2e-inf-a-4ef174-openshift-default-9bb6d755f-7fsk9" Jul 14 18:04:04.364371 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:04:04.364304 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2cd2503a-9689-4ad5-908f-b634c98e2357-istiod-ca-cert\") pod \"e2e-inf-a-4ef174-openshift-default-9bb6d755f-7fsk9\" (UID: \"2cd2503a-9689-4ad5-908f-b634c98e2357\") " pod="openshift-ingress/e2e-inf-a-4ef174-openshift-default-9bb6d755f-7fsk9" Jul 14 18:04:04.465831 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:04:04.465796 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2cd2503a-9689-4ad5-908f-b634c98e2357-workload-socket\") pod \"e2e-inf-a-4ef174-openshift-default-9bb6d755f-7fsk9\" (UID: \"2cd2503a-9689-4ad5-908f-b634c98e2357\") " pod="openshift-ingress/e2e-inf-a-4ef174-openshift-default-9bb6d755f-7fsk9" Jul 14 18:04:04.465831 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:04:04.465830 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2cd2503a-9689-4ad5-908f-b634c98e2357-credential-socket\") pod \"e2e-inf-a-4ef174-openshift-default-9bb6d755f-7fsk9\" (UID: \"2cd2503a-9689-4ad5-908f-b634c98e2357\") " pod="openshift-ingress/e2e-inf-a-4ef174-openshift-default-9bb6d755f-7fsk9" Jul 14 18:04:04.466103 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:04:04.465848 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2cd2503a-9689-4ad5-908f-b634c98e2357-istio-podinfo\") pod \"e2e-inf-a-4ef174-openshift-default-9bb6d755f-7fsk9\" (UID: \"2cd2503a-9689-4ad5-908f-b634c98e2357\") " pod="openshift-ingress/e2e-inf-a-4ef174-openshift-default-9bb6d755f-7fsk9" Jul 14 18:04:04.466103 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:04:04.465893 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2cd2503a-9689-4ad5-908f-b634c98e2357-workload-certs\") pod \"e2e-inf-a-4ef174-openshift-default-9bb6d755f-7fsk9\" (UID: \"2cd2503a-9689-4ad5-908f-b634c98e2357\") " pod="openshift-ingress/e2e-inf-a-4ef174-openshift-default-9bb6d755f-7fsk9" Jul 14 18:04:04.466103 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:04:04.465941 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2cd2503a-9689-4ad5-908f-b634c98e2357-istio-envoy\") pod \"e2e-inf-a-4ef174-openshift-default-9bb6d755f-7fsk9\" (UID: \"2cd2503a-9689-4ad5-908f-b634c98e2357\") " pod="openshift-ingress/e2e-inf-a-4ef174-openshift-default-9bb6d755f-7fsk9" Jul 14 18:04:04.466103 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:04:04.465976 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cb8br\" (UniqueName: \"kubernetes.io/projected/2cd2503a-9689-4ad5-908f-b634c98e2357-kube-api-access-cb8br\") pod \"e2e-inf-a-4ef174-openshift-default-9bb6d755f-7fsk9\" (UID: \"2cd2503a-9689-4ad5-908f-b634c98e2357\") " pod="openshift-ingress/e2e-inf-a-4ef174-openshift-default-9bb6d755f-7fsk9" Jul 14 18:04:04.466103 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:04:04.466006 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2cd2503a-9689-4ad5-908f-b634c98e2357-istio-token\") pod \"e2e-inf-a-4ef174-openshift-default-9bb6d755f-7fsk9\" (UID: \"2cd2503a-9689-4ad5-908f-b634c98e2357\") " pod="openshift-ingress/e2e-inf-a-4ef174-openshift-default-9bb6d755f-7fsk9" Jul 14 18:04:04.466103 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:04:04.466052 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2cd2503a-9689-4ad5-908f-b634c98e2357-istio-data\") pod \"e2e-inf-a-4ef174-openshift-default-9bb6d755f-7fsk9\" (UID: \"2cd2503a-9689-4ad5-908f-b634c98e2357\") " pod="openshift-ingress/e2e-inf-a-4ef174-openshift-default-9bb6d755f-7fsk9" Jul 14 18:04:04.466103 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:04:04.466076 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2cd2503a-9689-4ad5-908f-b634c98e2357-istiod-ca-cert\") pod \"e2e-inf-a-4ef174-openshift-default-9bb6d755f-7fsk9\" (UID: \"2cd2503a-9689-4ad5-908f-b634c98e2357\") " pod="openshift-ingress/e2e-inf-a-4ef174-openshift-default-9bb6d755f-7fsk9" Jul 14 18:04:04.466466 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:04:04.466268 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2cd2503a-9689-4ad5-908f-b634c98e2357-workload-socket\") pod \"e2e-inf-a-4ef174-openshift-default-9bb6d755f-7fsk9\" (UID: \"2cd2503a-9689-4ad5-908f-b634c98e2357\") " pod="openshift-ingress/e2e-inf-a-4ef174-openshift-default-9bb6d755f-7fsk9" Jul 14 18:04:04.466527 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:04:04.466494 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2cd2503a-9689-4ad5-908f-b634c98e2357-credential-socket\") pod \"e2e-inf-a-4ef174-openshift-default-9bb6d755f-7fsk9\" (UID: \"2cd2503a-9689-4ad5-908f-b634c98e2357\") " pod="openshift-ingress/e2e-inf-a-4ef174-openshift-default-9bb6d755f-7fsk9" Jul 14 18:04:04.466591 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:04:04.466521 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2cd2503a-9689-4ad5-908f-b634c98e2357-workload-certs\") pod \"e2e-inf-a-4ef174-openshift-default-9bb6d755f-7fsk9\" (UID: \"2cd2503a-9689-4ad5-908f-b634c98e2357\") " pod="openshift-ingress/e2e-inf-a-4ef174-openshift-default-9bb6d755f-7fsk9" Jul 14 18:04:04.466774 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:04:04.466752 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2cd2503a-9689-4ad5-908f-b634c98e2357-istio-data\") pod \"e2e-inf-a-4ef174-openshift-default-9bb6d755f-7fsk9\" (UID: \"2cd2503a-9689-4ad5-908f-b634c98e2357\") " pod="openshift-ingress/e2e-inf-a-4ef174-openshift-default-9bb6d755f-7fsk9" Jul 14 18:04:04.467042 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:04:04.467024 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2cd2503a-9689-4ad5-908f-b634c98e2357-istiod-ca-cert\") pod \"e2e-inf-a-4ef174-openshift-default-9bb6d755f-7fsk9\" (UID: \"2cd2503a-9689-4ad5-908f-b634c98e2357\") " pod="openshift-ingress/e2e-inf-a-4ef174-openshift-default-9bb6d755f-7fsk9" Jul 14 18:04:04.468466 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:04:04.468445 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2cd2503a-9689-4ad5-908f-b634c98e2357-istio-envoy\") pod \"e2e-inf-a-4ef174-openshift-default-9bb6d755f-7fsk9\" (UID: \"2cd2503a-9689-4ad5-908f-b634c98e2357\") " pod="openshift-ingress/e2e-inf-a-4ef174-openshift-default-9bb6d755f-7fsk9" Jul 14 18:04:04.468565 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:04:04.468540 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2cd2503a-9689-4ad5-908f-b634c98e2357-istio-podinfo\") pod \"e2e-inf-a-4ef174-openshift-default-9bb6d755f-7fsk9\" (UID: \"2cd2503a-9689-4ad5-908f-b634c98e2357\") " pod="openshift-ingress/e2e-inf-a-4ef174-openshift-default-9bb6d755f-7fsk9" Jul 14 18:04:04.475187 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:04:04.475165 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2cd2503a-9689-4ad5-908f-b634c98e2357-istio-token\") pod \"e2e-inf-a-4ef174-openshift-default-9bb6d755f-7fsk9\" (UID: \"2cd2503a-9689-4ad5-908f-b634c98e2357\") " pod="openshift-ingress/e2e-inf-a-4ef174-openshift-default-9bb6d755f-7fsk9" Jul 14 18:04:04.475279 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:04:04.475171 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cb8br\" (UniqueName: \"kubernetes.io/projected/2cd2503a-9689-4ad5-908f-b634c98e2357-kube-api-access-cb8br\") pod \"e2e-inf-a-4ef174-openshift-default-9bb6d755f-7fsk9\" (UID: \"2cd2503a-9689-4ad5-908f-b634c98e2357\") " pod="openshift-ingress/e2e-inf-a-4ef174-openshift-default-9bb6d755f-7fsk9" Jul 14 18:04:04.588258 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:04:04.588164 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-4ef174-openshift-default-9bb6d755f-7fsk9" Jul 14 18:04:04.740940 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:04:04.740914 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-4ef174-openshift-default-9bb6d755f-7fsk9"] Jul 14 18:04:04.743121 ip-10-0-139-16 kubenswrapper[2552]: W0714 18:04:04.743090 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2cd2503a_9689_4ad5_908f_b634c98e2357.slice/crio-d5e12688418306023b52dbd84bfcea1f15855741d63aa61457c6cc6e26a0ff59 WatchSource:0}: Error finding container d5e12688418306023b52dbd84bfcea1f15855741d63aa61457c6cc6e26a0ff59: Status 404 returned error can't find the container with id d5e12688418306023b52dbd84bfcea1f15855741d63aa61457c6cc6e26a0ff59 Jul 14 18:04:04.745431 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:04:04.745395 2552 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 14 18:04:04.745526 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:04:04.745465 2552 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 14 18:04:04.745526 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:04:04.745491 2552 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 14 18:04:04.884956 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:04:04.884843 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 18:04:05.027818 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:04:05.027781 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-4ef174-openshift-default-9bb6d755f-7fsk9" event={"ID":"2cd2503a-9689-4ad5-908f-b634c98e2357","Type":"ContainerStarted","Data":"218c17b817219a1931ba73e11afcac854c2d06ea16ae32e8f032323ea66e18c8"} Jul 14 18:04:05.028023 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:04:05.027844 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-4ef174-openshift-default-9bb6d755f-7fsk9" event={"ID":"2cd2503a-9689-4ad5-908f-b634c98e2357","Type":"ContainerStarted","Data":"d5e12688418306023b52dbd84bfcea1f15855741d63aa61457c6cc6e26a0ff59"} Jul 14 18:04:05.050792 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:04:05.050740 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-a-4ef174-openshift-default-9bb6d755f-7fsk9" podStartSLOduration=1.050719069 podStartE2EDuration="1.050719069s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 18:04:04 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 18:04:05.049204163 +0000 UTC m=+2307.428318115" watchObservedRunningTime="2026-07-14 18:04:05.050719069 +0000 UTC m=+2307.429833021" Jul 14 18:04:05.589064 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:04:05.589029 2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-4ef174-openshift-default-9bb6d755f-7fsk9" Jul 14 18:04:05.594708 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:04:05.594684 2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-4ef174-openshift-default-9bb6d755f-7fsk9" Jul 14 18:04:06.033883 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:04:06.033852 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-4ef174-openshift-default-9bb6d755f-7fsk9" Jul 14 18:04:06.034779 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:04:06.034758 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-4ef174-openshift-default-9bb6d755f-7fsk9" Jul 14 18:04:07.039675 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:04:07.039621 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 18:04:07.137731 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:04:07.137686 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 18:04:07.269533 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:04:07.269494 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 18:04:07.825018 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:04:07.824976 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 18:04:07.926104 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:04:07.926059 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 18:04:08.026686 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:04:08.026655 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 18:04:11.564984 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:04:11.564955 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 18:04:11.895018 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:04:11.894923 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 18:04:12.234888 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:04:12.234857 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 18:04:12.711509 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:04:12.711473 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 18:04:15.022506 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:04:15.022465 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 18:04:15.126042 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:04:15.126008 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 18:04:15.349154 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:04:15.349054 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 18:04:15.628396 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:04:15.628275 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 18:04:15.880160 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:04:15.880083 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 18:04:15.980261 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:04:15.980228 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 18:04:19.584623 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:04:19.584589 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 18:04:20.116598 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:04:20.116552 2552 generic.go:356] "Generic (PLEG): container finished" podID="2cd2503a-9689-4ad5-908f-b634c98e2357" containerID="218c17b817219a1931ba73e11afcac854c2d06ea16ae32e8f032323ea66e18c8" exitCode=0 Jul 14 18:04:20.116811 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:04:20.116627 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-4ef174-openshift-default-9bb6d755f-7fsk9" event={"ID":"2cd2503a-9689-4ad5-908f-b634c98e2357","Type":"ContainerDied","Data":"218c17b817219a1931ba73e11afcac854c2d06ea16ae32e8f032323ea66e18c8"} Jul 14 18:04:20.117066 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:04:20.117048 2552 scope.go:117] "RemoveContainer" containerID="218c17b817219a1931ba73e11afcac854c2d06ea16ae32e8f032323ea66e18c8" Jul 14 18:04:20.117397 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:04:20.117368 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 18:04:20.118267 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:04:20.118235 2552 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 14 18:04:20.118358 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:04:20.118319 2552 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 14 18:04:20.118415 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:04:20.118385 2552 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 14 18:04:21.034577 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:04:21.034537 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-4ef174-openshift-default-9bb6d755f-7fsk9" Jul 14 18:04:21.123493 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:04:21.123460 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-4ef174-openshift-default-9bb6d755f-7fsk9" event={"ID":"2cd2503a-9689-4ad5-908f-b634c98e2357","Type":"ContainerStarted","Data":"b25327dde7aa49c0fb003c359ac3c0147d1f2eb8be19736f5e3db2472ffd233b"} Jul 14 18:04:21.589134 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:04:21.589025 2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-4ef174-openshift-default-9bb6d755f-7fsk9" Jul 14 18:04:21.590482 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:04:21.590450 2552 patch_prober.go:28] interesting pod/e2e-inf-a-4ef174-openshift-default-9bb6d755f-7fsk9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused" start-of-body= Jul 14 18:04:21.590610 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:04:21.590545 2552 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-4ef174-openshift-default-9bb6d755f-7fsk9" podUID="2cd2503a-9689-4ad5-908f-b634c98e2357" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused" Jul 14 18:04:22.589262 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:04:22.589226 2552 patch_prober.go:28] interesting pod/e2e-inf-a-4ef174-openshift-default-9bb6d755f-7fsk9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused" start-of-body= Jul 14 18:04:22.589865 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:04:22.589831 2552 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-4ef174-openshift-default-9bb6d755f-7fsk9" podUID="2cd2503a-9689-4ad5-908f-b634c98e2357" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused" Jul 14 18:04:23.589607 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:04:23.589560 2552 patch_prober.go:28] interesting pod/e2e-inf-a-4ef174-openshift-default-9bb6d755f-7fsk9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused" start-of-body= Jul 14 18:04:23.590085 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:04:23.589630 2552 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-4ef174-openshift-default-9bb6d755f-7fsk9" podUID="2cd2503a-9689-4ad5-908f-b634c98e2357" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused" Jul 14 18:04:24.525583 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:04:24.525529 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 18:04:24.596353 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:04:24.592677 2552 patch_prober.go:28] interesting pod/e2e-inf-a-4ef174-openshift-default-9bb6d755f-7fsk9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused" start-of-body= Jul 14 18:04:24.596353 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:04:24.592733 2552 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-4ef174-openshift-default-9bb6d755f-7fsk9" podUID="2cd2503a-9689-4ad5-908f-b634c98e2357" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused" Jul 14 18:04:25.594435 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:04:25.594402 2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-4ef174-openshift-default-9bb6d755f-7fsk9" Jul 14 18:04:25.594699 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:04:25.594679 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-4ef174-openshift-default-9bb6d755f-7fsk9" Jul 14 18:04:25.595338 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:04:25.595301 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-4ef174-openshift-default-9bb6d755f-7fsk9" Jul 14 18:04:28.680237 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:04:28.680208 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 18:04:28.782055 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:04:28.782024 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 18:04:36.777048 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:04:36.776962 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 18:04:36.871599 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:04:36.871560 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 18:04:41.770530 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:04:41.770495 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 18:04:50.236935 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:04:50.236899 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 18:05:09.817047 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:05:09.816979 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 18:05:09.921633 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:05:09.921602 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 18:05:10.018708 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:05:10.018669 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 18:05:19.910383 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:05:19.910344 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 18:05:24.471291 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:05:24.471251 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 18:05:30.567382 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:05:30.567347 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 18:05:30.668263 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:05:30.668231 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 18:05:35.138626 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:05:35.138589 2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-4ef174-openshift-default-9bb6d755f-7fsk9"] Jul 14 18:05:35.139048 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:05:35.138897 2552 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-a-4ef174-openshift-default-9bb6d755f-7fsk9" podUID="2cd2503a-9689-4ad5-908f-b634c98e2357" containerName="istio-proxy" containerID="cri-o://b25327dde7aa49c0fb003c359ac3c0147d1f2eb8be19736f5e3db2472ffd233b" gracePeriod=30 Jul 14 18:05:35.163904 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:05:35.163868 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 18:05:35.394093 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:05:35.393997 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 18:05:36.061355 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:05:36.061290 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 18:05:36.154417 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:05:36.154380 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 18:05:38.279590 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:05:38.279565 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-gnw2z_b3c71861-4db9-4850-a44b-6f5d44a94235/console-operator/2.log" Jul 14 18:05:38.284593 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:05:38.284573 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cwprj_d3492336-881b-4f13-8d3a-b4d4ec05ad3c/ovn-acl-logging/0.log" Jul 14 18:05:38.293208 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:05:38.293190 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-gnw2z_b3c71861-4db9-4850-a44b-6f5d44a94235/console-operator/2.log" Jul 14 18:05:38.306679 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:05:38.306658 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cwprj_d3492336-881b-4f13-8d3a-b4d4ec05ad3c/ovn-acl-logging/0.log" Jul 14 18:05:40.396400 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:05:40.396379 2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-4ef174-openshift-default-9bb6d755f-7fsk9" Jul 14 18:05:40.530095 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:05:40.530063 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cb8br\" (UniqueName: \"kubernetes.io/projected/2cd2503a-9689-4ad5-908f-b634c98e2357-kube-api-access-cb8br\") pod \"2cd2503a-9689-4ad5-908f-b634c98e2357\" (UID: \"2cd2503a-9689-4ad5-908f-b634c98e2357\") " Jul 14 18:05:40.530282 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:05:40.530108 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2cd2503a-9689-4ad5-908f-b634c98e2357-workload-certs\") pod \"2cd2503a-9689-4ad5-908f-b634c98e2357\" (UID: \"2cd2503a-9689-4ad5-908f-b634c98e2357\") " Jul 14 18:05:40.530282 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:05:40.530164 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2cd2503a-9689-4ad5-908f-b634c98e2357-istio-envoy\") pod \"2cd2503a-9689-4ad5-908f-b634c98e2357\" (UID: \"2cd2503a-9689-4ad5-908f-b634c98e2357\") " Jul 14 18:05:40.530282 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:05:40.530193 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2cd2503a-9689-4ad5-908f-b634c98e2357-istiod-ca-cert\") pod \"2cd2503a-9689-4ad5-908f-b634c98e2357\" (UID: \"2cd2503a-9689-4ad5-908f-b634c98e2357\") " Jul 14 18:05:40.530282 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:05:40.530217 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2cd2503a-9689-4ad5-908f-b634c98e2357-istio-data\") pod \"2cd2503a-9689-4ad5-908f-b634c98e2357\" (UID: \"2cd2503a-9689-4ad5-908f-b634c98e2357\") " Jul 14 18:05:40.530282 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:05:40.530273 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2cd2503a-9689-4ad5-908f-b634c98e2357-credential-socket\") pod \"2cd2503a-9689-4ad5-908f-b634c98e2357\" (UID: \"2cd2503a-9689-4ad5-908f-b634c98e2357\") " Jul 14 18:05:40.530577 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:05:40.530359 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2cd2503a-9689-4ad5-908f-b634c98e2357-workload-socket\") pod \"2cd2503a-9689-4ad5-908f-b634c98e2357\" (UID: \"2cd2503a-9689-4ad5-908f-b634c98e2357\") " Jul 14 18:05:40.530577 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:05:40.530384 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2cd2503a-9689-4ad5-908f-b634c98e2357-istio-token\") pod \"2cd2503a-9689-4ad5-908f-b634c98e2357\" (UID: \"2cd2503a-9689-4ad5-908f-b634c98e2357\") " Jul 14 18:05:40.530577 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:05:40.530441 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2cd2503a-9689-4ad5-908f-b634c98e2357-istio-podinfo\") pod \"2cd2503a-9689-4ad5-908f-b634c98e2357\" (UID: \"2cd2503a-9689-4ad5-908f-b634c98e2357\") " Jul 14 18:05:40.530577 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:05:40.530532 2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2cd2503a-9689-4ad5-908f-b634c98e2357-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "2cd2503a-9689-4ad5-908f-b634c98e2357" (UID: "2cd2503a-9689-4ad5-908f-b634c98e2357"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 14 18:05:40.530793 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:05:40.530611 2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2cd2503a-9689-4ad5-908f-b634c98e2357-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "2cd2503a-9689-4ad5-908f-b634c98e2357" (UID: "2cd2503a-9689-4ad5-908f-b634c98e2357"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 14 18:05:40.530793 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:05:40.530623 2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2cd2503a-9689-4ad5-908f-b634c98e2357-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "2cd2503a-9689-4ad5-908f-b634c98e2357" (UID: "2cd2503a-9689-4ad5-908f-b634c98e2357"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 14 18:05:40.530793 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:05:40.530680 2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2cd2503a-9689-4ad5-908f-b634c98e2357-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "2cd2503a-9689-4ad5-908f-b634c98e2357" (UID: "2cd2503a-9689-4ad5-908f-b634c98e2357"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 14 18:05:40.530959 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:05:40.530808 2552 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2cd2503a-9689-4ad5-908f-b634c98e2357-credential-socket\") on node \"ip-10-0-139-16.ec2.internal\" DevicePath \"\"" Jul 14 18:05:40.530959 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:05:40.530830 2552 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2cd2503a-9689-4ad5-908f-b634c98e2357-workload-socket\") on node \"ip-10-0-139-16.ec2.internal\" DevicePath \"\"" Jul 14 18:05:40.530959 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:05:40.530843 2552 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2cd2503a-9689-4ad5-908f-b634c98e2357-workload-certs\") on node \"ip-10-0-139-16.ec2.internal\" DevicePath \"\"" Jul 14 18:05:40.530959 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:05:40.530860 2552 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2cd2503a-9689-4ad5-908f-b634c98e2357-istiod-ca-cert\") on node \"ip-10-0-139-16.ec2.internal\" DevicePath \"\"" Jul 14 18:05:40.531349 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:05:40.531306 2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2cd2503a-9689-4ad5-908f-b634c98e2357-istio-data" (OuterVolumeSpecName: "istio-data") pod "2cd2503a-9689-4ad5-908f-b634c98e2357" (UID: "2cd2503a-9689-4ad5-908f-b634c98e2357"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 14 18:05:40.532513 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:05:40.532485 2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2cd2503a-9689-4ad5-908f-b634c98e2357-kube-api-access-cb8br" (OuterVolumeSpecName: "kube-api-access-cb8br") pod "2cd2503a-9689-4ad5-908f-b634c98e2357" (UID: "2cd2503a-9689-4ad5-908f-b634c98e2357"). InnerVolumeSpecName "kube-api-access-cb8br". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 14 18:05:40.532637 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:05:40.532575 2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2cd2503a-9689-4ad5-908f-b634c98e2357-istio-token" (OuterVolumeSpecName: "istio-token") pod "2cd2503a-9689-4ad5-908f-b634c98e2357" (UID: "2cd2503a-9689-4ad5-908f-b634c98e2357"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 14 18:05:40.532975 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:05:40.532950 2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/2cd2503a-9689-4ad5-908f-b634c98e2357-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "2cd2503a-9689-4ad5-908f-b634c98e2357" (UID: "2cd2503a-9689-4ad5-908f-b634c98e2357"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 14 18:05:40.532975 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:05:40.532966 2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2cd2503a-9689-4ad5-908f-b634c98e2357-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "2cd2503a-9689-4ad5-908f-b634c98e2357" (UID: "2cd2503a-9689-4ad5-908f-b634c98e2357"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 14 18:05:40.544532 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:05:40.544510 2552 generic.go:356] "Generic (PLEG): container finished" podID="2cd2503a-9689-4ad5-908f-b634c98e2357" containerID="b25327dde7aa49c0fb003c359ac3c0147d1f2eb8be19736f5e3db2472ffd233b" exitCode=0 Jul 14 18:05:40.544630 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:05:40.544567 2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-4ef174-openshift-default-9bb6d755f-7fsk9" Jul 14 18:05:40.544630 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:05:40.544610 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-4ef174-openshift-default-9bb6d755f-7fsk9" event={"ID":"2cd2503a-9689-4ad5-908f-b634c98e2357","Type":"ContainerDied","Data":"b25327dde7aa49c0fb003c359ac3c0147d1f2eb8be19736f5e3db2472ffd233b"} Jul 14 18:05:40.544717 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:05:40.544671 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-4ef174-openshift-default-9bb6d755f-7fsk9" event={"ID":"2cd2503a-9689-4ad5-908f-b634c98e2357","Type":"ContainerDied","Data":"d5e12688418306023b52dbd84bfcea1f15855741d63aa61457c6cc6e26a0ff59"} Jul 14 18:05:40.544717 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:05:40.544702 2552 scope.go:117] "RemoveContainer" containerID="b25327dde7aa49c0fb003c359ac3c0147d1f2eb8be19736f5e3db2472ffd233b" Jul 14 18:05:40.556730 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:05:40.556714 2552 scope.go:117] "RemoveContainer" containerID="218c17b817219a1931ba73e11afcac854c2d06ea16ae32e8f032323ea66e18c8" Jul 14 18:05:40.565259 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:05:40.565241 2552 scope.go:117] "RemoveContainer" containerID="b25327dde7aa49c0fb003c359ac3c0147d1f2eb8be19736f5e3db2472ffd233b" Jul 14 18:05:40.565535 ip-10-0-139-16 kubenswrapper[2552]: E0714 18:05:40.565513 2552 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b25327dde7aa49c0fb003c359ac3c0147d1f2eb8be19736f5e3db2472ffd233b\": container with ID starting with b25327dde7aa49c0fb003c359ac3c0147d1f2eb8be19736f5e3db2472ffd233b not found: ID does not exist" containerID="b25327dde7aa49c0fb003c359ac3c0147d1f2eb8be19736f5e3db2472ffd233b" Jul 14 18:05:40.565590 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:05:40.565542 2552 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b25327dde7aa49c0fb003c359ac3c0147d1f2eb8be19736f5e3db2472ffd233b"} err="failed to get container status \"b25327dde7aa49c0fb003c359ac3c0147d1f2eb8be19736f5e3db2472ffd233b\": rpc error: code = NotFound desc = could not find container \"b25327dde7aa49c0fb003c359ac3c0147d1f2eb8be19736f5e3db2472ffd233b\": container with ID starting with b25327dde7aa49c0fb003c359ac3c0147d1f2eb8be19736f5e3db2472ffd233b not found: ID does not exist" Jul 14 18:05:40.565590 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:05:40.565557 2552 scope.go:117] "RemoveContainer" containerID="218c17b817219a1931ba73e11afcac854c2d06ea16ae32e8f032323ea66e18c8" Jul 14 18:05:40.565804 ip-10-0-139-16 kubenswrapper[2552]: E0714 18:05:40.565782 2552 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"218c17b817219a1931ba73e11afcac854c2d06ea16ae32e8f032323ea66e18c8\": container with ID starting with 218c17b817219a1931ba73e11afcac854c2d06ea16ae32e8f032323ea66e18c8 not found: ID does not exist" containerID="218c17b817219a1931ba73e11afcac854c2d06ea16ae32e8f032323ea66e18c8" Jul 14 18:05:40.565844 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:05:40.565812 2552 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"218c17b817219a1931ba73e11afcac854c2d06ea16ae32e8f032323ea66e18c8"} err="failed to get container status \"218c17b817219a1931ba73e11afcac854c2d06ea16ae32e8f032323ea66e18c8\": rpc error: code = NotFound desc = could not find container \"218c17b817219a1931ba73e11afcac854c2d06ea16ae32e8f032323ea66e18c8\": container with ID starting with 218c17b817219a1931ba73e11afcac854c2d06ea16ae32e8f032323ea66e18c8 not found: ID does not exist" Jul 14 18:05:40.571124 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:05:40.571104 2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-4ef174-openshift-default-9bb6d755f-7fsk9"] Jul 14 18:05:40.577215 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:05:40.577195 2552 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-a-4ef174-openshift-default-9bb6d755f-7fsk9"] Jul 14 18:05:40.631577 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:05:40.631545 2552 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2cd2503a-9689-4ad5-908f-b634c98e2357-istio-token\") on node \"ip-10-0-139-16.ec2.internal\" DevicePath \"\"" Jul 14 18:05:40.631577 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:05:40.631569 2552 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2cd2503a-9689-4ad5-908f-b634c98e2357-istio-podinfo\") on node \"ip-10-0-139-16.ec2.internal\" DevicePath \"\"" Jul 14 18:05:40.631577 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:05:40.631578 2552 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cb8br\" (UniqueName: \"kubernetes.io/projected/2cd2503a-9689-4ad5-908f-b634c98e2357-kube-api-access-cb8br\") on node \"ip-10-0-139-16.ec2.internal\" DevicePath \"\"" Jul 14 18:05:40.631805 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:05:40.631589 2552 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2cd2503a-9689-4ad5-908f-b634c98e2357-istio-envoy\") on node \"ip-10-0-139-16.ec2.internal\" DevicePath \"\"" Jul 14 18:05:40.631805 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:05:40.631600 2552 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2cd2503a-9689-4ad5-908f-b634c98e2357-istio-data\") on node \"ip-10-0-139-16.ec2.internal\" DevicePath \"\"" Jul 14 18:05:42.388602 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:05:42.388574 2552 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2cd2503a-9689-4ad5-908f-b634c98e2357" path="/var/lib/kubelet/pods/2cd2503a-9689-4ad5-908f-b634c98e2357/volumes" Jul 14 18:05:45.988895 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:05:45.988851 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 18:05:50.597978 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:05:50.597929 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 18:05:56.819244 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:05:56.819201 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 18:05:56.919378 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:05:56.919320 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 18:06:01.298238 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:06:01.298144 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 18:06:01.522209 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:06:01.522175 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 18:06:02.137894 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:06:02.137858 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 18:06:02.193845 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:06:02.193814 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-a-e8afdc-openshift-default-6b7b9cb777-nm4qm"] Jul 14 18:06:02.194229 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:06:02.194216 2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2cd2503a-9689-4ad5-908f-b634c98e2357" containerName="istio-proxy" Jul 14 18:06:02.194300 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:06:02.194229 2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="2cd2503a-9689-4ad5-908f-b634c98e2357" containerName="istio-proxy" Jul 14 18:06:02.194300 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:06:02.194249 2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2cd2503a-9689-4ad5-908f-b634c98e2357" containerName="istio-proxy" Jul 14 18:06:02.194300 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:06:02.194255 2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="2cd2503a-9689-4ad5-908f-b634c98e2357" containerName="istio-proxy" Jul 14 18:06:02.194471 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:06:02.194336 2552 memory_manager.go:368] "RemoveStaleState removing state" podUID="2cd2503a-9689-4ad5-908f-b634c98e2357" containerName="istio-proxy" Jul 14 18:06:02.194471 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:06:02.194350 2552 memory_manager.go:368] "RemoveStaleState removing state" podUID="2cd2503a-9689-4ad5-908f-b634c98e2357" containerName="istio-proxy" Jul 14 18:06:02.197472 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:06:02.197451 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-e8afdc-openshift-default-6b7b9cb777-nm4qm" Jul 14 18:06:02.200877 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:06:02.200855 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-a-e8afdc-openshift-default-dockercfg-w77t5\"" Jul 14 18:06:02.219454 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:06:02.219428 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-e8afdc-openshift-default-6b7b9cb777-nm4qm"] Jul 14 18:06:02.219608 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:06:02.219557 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/60e6ffbf-a084-4b1a-98a0-5980035670aa-istio-envoy\") pod \"e2e-api-a-e8afdc-openshift-default-6b7b9cb777-nm4qm\" (UID: \"60e6ffbf-a084-4b1a-98a0-5980035670aa\") " pod="openshift-ingress/e2e-api-a-e8afdc-openshift-default-6b7b9cb777-nm4qm" Jul 14 18:06:02.219672 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:06:02.219611 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/60e6ffbf-a084-4b1a-98a0-5980035670aa-istio-token\") pod \"e2e-api-a-e8afdc-openshift-default-6b7b9cb777-nm4qm\" (UID: \"60e6ffbf-a084-4b1a-98a0-5980035670aa\") " pod="openshift-ingress/e2e-api-a-e8afdc-openshift-default-6b7b9cb777-nm4qm" Jul 14 18:06:02.219672 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:06:02.219661 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/60e6ffbf-a084-4b1a-98a0-5980035670aa-istio-data\") pod \"e2e-api-a-e8afdc-openshift-default-6b7b9cb777-nm4qm\" (UID: \"60e6ffbf-a084-4b1a-98a0-5980035670aa\") " pod="openshift-ingress/e2e-api-a-e8afdc-openshift-default-6b7b9cb777-nm4qm" Jul 14 18:06:02.219781 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:06:02.219751 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/60e6ffbf-a084-4b1a-98a0-5980035670aa-istio-podinfo\") pod \"e2e-api-a-e8afdc-openshift-default-6b7b9cb777-nm4qm\" (UID: \"60e6ffbf-a084-4b1a-98a0-5980035670aa\") " pod="openshift-ingress/e2e-api-a-e8afdc-openshift-default-6b7b9cb777-nm4qm" Jul 14 18:06:02.219838 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:06:02.219780 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rjlxz\" (UniqueName: \"kubernetes.io/projected/60e6ffbf-a084-4b1a-98a0-5980035670aa-kube-api-access-rjlxz\") pod \"e2e-api-a-e8afdc-openshift-default-6b7b9cb777-nm4qm\" (UID: \"60e6ffbf-a084-4b1a-98a0-5980035670aa\") " pod="openshift-ingress/e2e-api-a-e8afdc-openshift-default-6b7b9cb777-nm4qm" Jul 14 18:06:02.219838 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:06:02.219819 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/60e6ffbf-a084-4b1a-98a0-5980035670aa-credential-socket\") pod \"e2e-api-a-e8afdc-openshift-default-6b7b9cb777-nm4qm\" (UID: \"60e6ffbf-a084-4b1a-98a0-5980035670aa\") " pod="openshift-ingress/e2e-api-a-e8afdc-openshift-default-6b7b9cb777-nm4qm" Jul 14 18:06:02.219945 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:06:02.219848 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/60e6ffbf-a084-4b1a-98a0-5980035670aa-workload-socket\") pod \"e2e-api-a-e8afdc-openshift-default-6b7b9cb777-nm4qm\" (UID: \"60e6ffbf-a084-4b1a-98a0-5980035670aa\") " pod="openshift-ingress/e2e-api-a-e8afdc-openshift-default-6b7b9cb777-nm4qm" Jul 14 18:06:02.219945 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:06:02.219880 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/60e6ffbf-a084-4b1a-98a0-5980035670aa-workload-certs\") pod \"e2e-api-a-e8afdc-openshift-default-6b7b9cb777-nm4qm\" (UID: \"60e6ffbf-a084-4b1a-98a0-5980035670aa\") " pod="openshift-ingress/e2e-api-a-e8afdc-openshift-default-6b7b9cb777-nm4qm" Jul 14 18:06:02.219945 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:06:02.219911 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/60e6ffbf-a084-4b1a-98a0-5980035670aa-istiod-ca-cert\") pod \"e2e-api-a-e8afdc-openshift-default-6b7b9cb777-nm4qm\" (UID: \"60e6ffbf-a084-4b1a-98a0-5980035670aa\") " pod="openshift-ingress/e2e-api-a-e8afdc-openshift-default-6b7b9cb777-nm4qm" Jul 14 18:06:02.270086 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:06:02.270049 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 18:06:02.321527 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:06:02.321489 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/60e6ffbf-a084-4b1a-98a0-5980035670aa-istio-data\") pod \"e2e-api-a-e8afdc-openshift-default-6b7b9cb777-nm4qm\" (UID: \"60e6ffbf-a084-4b1a-98a0-5980035670aa\") " pod="openshift-ingress/e2e-api-a-e8afdc-openshift-default-6b7b9cb777-nm4qm" Jul 14 18:06:02.322004 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:06:02.321574 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/60e6ffbf-a084-4b1a-98a0-5980035670aa-istio-podinfo\") pod \"e2e-api-a-e8afdc-openshift-default-6b7b9cb777-nm4qm\" (UID: \"60e6ffbf-a084-4b1a-98a0-5980035670aa\") " pod="openshift-ingress/e2e-api-a-e8afdc-openshift-default-6b7b9cb777-nm4qm" Jul 14 18:06:02.322004 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:06:02.321599 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rjlxz\" (UniqueName: \"kubernetes.io/projected/60e6ffbf-a084-4b1a-98a0-5980035670aa-kube-api-access-rjlxz\") pod \"e2e-api-a-e8afdc-openshift-default-6b7b9cb777-nm4qm\" (UID: \"60e6ffbf-a084-4b1a-98a0-5980035670aa\") " pod="openshift-ingress/e2e-api-a-e8afdc-openshift-default-6b7b9cb777-nm4qm" Jul 14 18:06:02.322004 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:06:02.321658 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/60e6ffbf-a084-4b1a-98a0-5980035670aa-credential-socket\") pod \"e2e-api-a-e8afdc-openshift-default-6b7b9cb777-nm4qm\" (UID: \"60e6ffbf-a084-4b1a-98a0-5980035670aa\") " pod="openshift-ingress/e2e-api-a-e8afdc-openshift-default-6b7b9cb777-nm4qm" Jul 14 18:06:02.322004 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:06:02.321929 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/60e6ffbf-a084-4b1a-98a0-5980035670aa-workload-socket\") pod \"e2e-api-a-e8afdc-openshift-default-6b7b9cb777-nm4qm\" (UID: \"60e6ffbf-a084-4b1a-98a0-5980035670aa\") " pod="openshift-ingress/e2e-api-a-e8afdc-openshift-default-6b7b9cb777-nm4qm" Jul 14 18:06:02.322004 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:06:02.321979 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/60e6ffbf-a084-4b1a-98a0-5980035670aa-workload-certs\") pod \"e2e-api-a-e8afdc-openshift-default-6b7b9cb777-nm4qm\" (UID: \"60e6ffbf-a084-4b1a-98a0-5980035670aa\") " pod="openshift-ingress/e2e-api-a-e8afdc-openshift-default-6b7b9cb777-nm4qm" Jul 14 18:06:02.322004 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:06:02.321940 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/60e6ffbf-a084-4b1a-98a0-5980035670aa-istio-data\") pod \"e2e-api-a-e8afdc-openshift-default-6b7b9cb777-nm4qm\" (UID: \"60e6ffbf-a084-4b1a-98a0-5980035670aa\") " pod="openshift-ingress/e2e-api-a-e8afdc-openshift-default-6b7b9cb777-nm4qm" Jul 14 18:06:02.322004 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:06:02.321997 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/60e6ffbf-a084-4b1a-98a0-5980035670aa-credential-socket\") pod \"e2e-api-a-e8afdc-openshift-default-6b7b9cb777-nm4qm\" (UID: \"60e6ffbf-a084-4b1a-98a0-5980035670aa\") " pod="openshift-ingress/e2e-api-a-e8afdc-openshift-default-6b7b9cb777-nm4qm" Jul 14 18:06:02.322766 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:06:02.322005 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/60e6ffbf-a084-4b1a-98a0-5980035670aa-istiod-ca-cert\") pod \"e2e-api-a-e8afdc-openshift-default-6b7b9cb777-nm4qm\" (UID: \"60e6ffbf-a084-4b1a-98a0-5980035670aa\") " pod="openshift-ingress/e2e-api-a-e8afdc-openshift-default-6b7b9cb777-nm4qm" Jul 14 18:06:02.322766 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:06:02.322093 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/60e6ffbf-a084-4b1a-98a0-5980035670aa-istio-envoy\") pod \"e2e-api-a-e8afdc-openshift-default-6b7b9cb777-nm4qm\" (UID: \"60e6ffbf-a084-4b1a-98a0-5980035670aa\") " pod="openshift-ingress/e2e-api-a-e8afdc-openshift-default-6b7b9cb777-nm4qm" Jul 14 18:06:02.322766 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:06:02.322136 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/60e6ffbf-a084-4b1a-98a0-5980035670aa-istio-token\") pod \"e2e-api-a-e8afdc-openshift-default-6b7b9cb777-nm4qm\" (UID: \"60e6ffbf-a084-4b1a-98a0-5980035670aa\") " pod="openshift-ingress/e2e-api-a-e8afdc-openshift-default-6b7b9cb777-nm4qm" Jul 14 18:06:02.322766 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:06:02.322145 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/60e6ffbf-a084-4b1a-98a0-5980035670aa-workload-socket\") pod \"e2e-api-a-e8afdc-openshift-default-6b7b9cb777-nm4qm\" (UID: \"60e6ffbf-a084-4b1a-98a0-5980035670aa\") " pod="openshift-ingress/e2e-api-a-e8afdc-openshift-default-6b7b9cb777-nm4qm" Jul 14 18:06:02.322766 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:06:02.322269 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/60e6ffbf-a084-4b1a-98a0-5980035670aa-workload-certs\") pod \"e2e-api-a-e8afdc-openshift-default-6b7b9cb777-nm4qm\" (UID: \"60e6ffbf-a084-4b1a-98a0-5980035670aa\") " pod="openshift-ingress/e2e-api-a-e8afdc-openshift-default-6b7b9cb777-nm4qm" Jul 14 18:06:02.322766 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:06:02.322753 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/60e6ffbf-a084-4b1a-98a0-5980035670aa-istiod-ca-cert\") pod \"e2e-api-a-e8afdc-openshift-default-6b7b9cb777-nm4qm\" (UID: \"60e6ffbf-a084-4b1a-98a0-5980035670aa\") " pod="openshift-ingress/e2e-api-a-e8afdc-openshift-default-6b7b9cb777-nm4qm" Jul 14 18:06:02.324308 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:06:02.324274 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/60e6ffbf-a084-4b1a-98a0-5980035670aa-istio-envoy\") pod \"e2e-api-a-e8afdc-openshift-default-6b7b9cb777-nm4qm\" (UID: \"60e6ffbf-a084-4b1a-98a0-5980035670aa\") " pod="openshift-ingress/e2e-api-a-e8afdc-openshift-default-6b7b9cb777-nm4qm" Jul 14 18:06:02.324308 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:06:02.324293 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/60e6ffbf-a084-4b1a-98a0-5980035670aa-istio-podinfo\") pod \"e2e-api-a-e8afdc-openshift-default-6b7b9cb777-nm4qm\" (UID: \"60e6ffbf-a084-4b1a-98a0-5980035670aa\") " pod="openshift-ingress/e2e-api-a-e8afdc-openshift-default-6b7b9cb777-nm4qm" Jul 14 18:06:02.333013 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:06:02.332993 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/60e6ffbf-a084-4b1a-98a0-5980035670aa-istio-token\") pod \"e2e-api-a-e8afdc-openshift-default-6b7b9cb777-nm4qm\" (UID: \"60e6ffbf-a084-4b1a-98a0-5980035670aa\") " pod="openshift-ingress/e2e-api-a-e8afdc-openshift-default-6b7b9cb777-nm4qm" Jul 14 18:06:02.333378 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:06:02.333356 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rjlxz\" (UniqueName: \"kubernetes.io/projected/60e6ffbf-a084-4b1a-98a0-5980035670aa-kube-api-access-rjlxz\") pod \"e2e-api-a-e8afdc-openshift-default-6b7b9cb777-nm4qm\" (UID: \"60e6ffbf-a084-4b1a-98a0-5980035670aa\") " pod="openshift-ingress/e2e-api-a-e8afdc-openshift-default-6b7b9cb777-nm4qm" Jul 14 18:06:02.364248 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:06:02.364181 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 18:06:02.507953 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:06:02.507916 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-e8afdc-openshift-default-6b7b9cb777-nm4qm" Jul 14 18:06:02.654016 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:06:02.653990 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-e8afdc-openshift-default-6b7b9cb777-nm4qm"] Jul 14 18:06:02.655574 ip-10-0-139-16 kubenswrapper[2552]: W0714 18:06:02.655543 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod60e6ffbf_a084_4b1a_98a0_5980035670aa.slice/crio-7ebddf0bf0dd897f05dc1d210031cd3d5009e03a3f826bb1a3048438966cd6ea WatchSource:0}: Error finding container 7ebddf0bf0dd897f05dc1d210031cd3d5009e03a3f826bb1a3048438966cd6ea: Status 404 returned error can't find the container with id 7ebddf0bf0dd897f05dc1d210031cd3d5009e03a3f826bb1a3048438966cd6ea Jul 14 18:06:02.657876 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:06:02.657824 2552 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 14 18:06:02.657968 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:06:02.657932 2552 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 14 18:06:02.658013 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:06:02.657973 2552 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 14 18:06:03.666993 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:06:03.666952 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-e8afdc-openshift-default-6b7b9cb777-nm4qm" event={"ID":"60e6ffbf-a084-4b1a-98a0-5980035670aa","Type":"ContainerStarted","Data":"9d8418bbfc8611781e6b9731cacddc1e1238aa848c6d84b5cb9c7930e3042d5a"} Jul 14 18:06:03.667414 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:06:03.667014 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-e8afdc-openshift-default-6b7b9cb777-nm4qm" event={"ID":"60e6ffbf-a084-4b1a-98a0-5980035670aa","Type":"ContainerStarted","Data":"7ebddf0bf0dd897f05dc1d210031cd3d5009e03a3f826bb1a3048438966cd6ea"} Jul 14 18:06:03.691464 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:06:03.691384 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-a-e8afdc-openshift-default-6b7b9cb777-nm4qm" podStartSLOduration=1.69136956 podStartE2EDuration="1.69136956s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 18:06:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 18:06:03.690150759 +0000 UTC m=+2426.069264712" watchObservedRunningTime="2026-07-14 18:06:03.69136956 +0000 UTC m=+2426.070483511" Jul 14 18:06:04.508045 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:06:04.508010 2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-e8afdc-openshift-default-6b7b9cb777-nm4qm" Jul 14 18:06:04.512909 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:06:04.512886 2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-e8afdc-openshift-default-6b7b9cb777-nm4qm" Jul 14 18:06:04.675349 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:06:04.674446 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-e8afdc-openshift-default-6b7b9cb777-nm4qm" Jul 14 18:06:04.679636 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:06:04.679610 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-e8afdc-openshift-default-6b7b9cb777-nm4qm" Jul 14 18:06:06.690043 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:06:06.690008 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 18:06:06.788307 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:06:06.788268 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 18:06:10.153337 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:06:10.153292 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 18:06:10.532026 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:06:10.531989 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 18:06:10.629608 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:06:10.629571 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 18:06:10.951229 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:06:10.951142 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 18:06:11.618128 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:06:11.618076 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 18:06:11.817479 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:06:11.817431 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 18:06:11.945904 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:06:11.945807 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 18:06:13.496866 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:06:13.496832 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 18:06:13.597317 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:06:13.597281 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 18:06:13.830382 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:06:13.830258 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 18:06:13.931672 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:06:13.931633 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 18:06:14.484395 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:06:14.484360 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 18:06:14.578307 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:06:14.578268 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 18:06:17.995278 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:06:17.995241 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 18:06:18.757817 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:06:18.757786 2552 generic.go:356] "Generic (PLEG): container finished" podID="60e6ffbf-a084-4b1a-98a0-5980035670aa" containerID="9d8418bbfc8611781e6b9731cacddc1e1238aa848c6d84b5cb9c7930e3042d5a" exitCode=0 Jul 14 18:06:18.758032 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:06:18.757858 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-e8afdc-openshift-default-6b7b9cb777-nm4qm" event={"ID":"60e6ffbf-a084-4b1a-98a0-5980035670aa","Type":"ContainerDied","Data":"9d8418bbfc8611781e6b9731cacddc1e1238aa848c6d84b5cb9c7930e3042d5a"} Jul 14 18:06:18.758257 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:06:18.758242 2552 scope.go:117] "RemoveContainer" containerID="9d8418bbfc8611781e6b9731cacddc1e1238aa848c6d84b5cb9c7930e3042d5a" Jul 14 18:06:18.759230 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:06:18.759202 2552 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 14 18:06:18.759322 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:06:18.759286 2552 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 14 18:06:18.759425 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:06:18.759370 2552 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 14 18:06:19.674465 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:06:19.674410 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-e8afdc-openshift-default-6b7b9cb777-nm4qm" Jul 14 18:06:19.765128 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:06:19.765093 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-e8afdc-openshift-default-6b7b9cb777-nm4qm" event={"ID":"60e6ffbf-a084-4b1a-98a0-5980035670aa","Type":"ContainerStarted","Data":"64bea523bd6382ffa3cb1968918ba130ea75f3ce775314b3bfbd8a9ba02454d6"} Jul 14 18:06:20.510270 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:06:20.510230 2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-e8afdc-openshift-default-6b7b9cb777-nm4qm" Jul 14 18:06:20.510498 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:06:20.510370 2552 patch_prober.go:28] interesting pod/e2e-api-a-e8afdc-openshift-default-6b7b9cb777-nm4qm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused" start-of-body= Jul 14 18:06:20.510498 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:06:20.510416 2552 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-e8afdc-openshift-default-6b7b9cb777-nm4qm" podUID="60e6ffbf-a084-4b1a-98a0-5980035670aa" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused" Jul 14 18:06:21.508403 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:06:21.508366 2552 patch_prober.go:28] interesting pod/e2e-api-a-e8afdc-openshift-default-6b7b9cb777-nm4qm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused" start-of-body= Jul 14 18:06:21.508989 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:06:21.508959 2552 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-e8afdc-openshift-default-6b7b9cb777-nm4qm" podUID="60e6ffbf-a084-4b1a-98a0-5980035670aa" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused" Jul 14 18:06:22.508722 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:06:22.508682 2552 patch_prober.go:28] interesting pod/e2e-api-a-e8afdc-openshift-default-6b7b9cb777-nm4qm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused" start-of-body= Jul 14 18:06:22.509316 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:06:22.509281 2552 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-e8afdc-openshift-default-6b7b9cb777-nm4qm" podUID="60e6ffbf-a084-4b1a-98a0-5980035670aa" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused" Jul 14 18:06:23.508861 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:06:23.508823 2552 patch_prober.go:28] interesting pod/e2e-api-a-e8afdc-openshift-default-6b7b9cb777-nm4qm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused" start-of-body= Jul 14 18:06:23.509480 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:06:23.509441 2552 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-e8afdc-openshift-default-6b7b9cb777-nm4qm" podUID="60e6ffbf-a084-4b1a-98a0-5980035670aa" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused" Jul 14 18:06:24.512930 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:06:24.512900 2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-e8afdc-openshift-default-6b7b9cb777-nm4qm" Jul 14 18:06:24.513410 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:06:24.513269 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-e8afdc-openshift-default-6b7b9cb777-nm4qm" Jul 14 18:06:24.513841 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:06:24.513822 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-e8afdc-openshift-default-6b7b9cb777-nm4qm" Jul 14 18:06:26.714466 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:06:26.714428 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 18:06:26.807090 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:06:26.807058 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 18:06:35.421942 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:06:35.421899 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 18:06:35.518840 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:06:35.518802 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 18:06:36.155245 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:06:36.155208 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 18:06:41.106250 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:06:41.106210 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 18:06:47.016402 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:06:47.016360 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 18:06:47.116255 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:06:47.116220 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 18:06:51.793141 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:06:51.793104 2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-e8afdc-openshift-default-6b7b9cb777-nm4qm"] Jul 14 18:06:51.793614 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:06:51.793373 2552 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-api-a-e8afdc-openshift-default-6b7b9cb777-nm4qm" podUID="60e6ffbf-a084-4b1a-98a0-5980035670aa" containerName="istio-proxy" containerID="cri-o://64bea523bd6382ffa3cb1968918ba130ea75f3ce775314b3bfbd8a9ba02454d6" gracePeriod=30 Jul 14 18:06:51.820525 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:06:51.820497 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 18:06:52.037284 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:06:52.037255 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 18:06:54.515719 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:06:54.515678 2552 patch_prober.go:28] interesting pod/e2e-api-a-e8afdc-openshift-default-6b7b9cb777-nm4qm container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Jul 14 18:06:54.516080 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:06:54.515760 2552 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-a-e8afdc-openshift-default-6b7b9cb777-nm4qm" podUID="60e6ffbf-a084-4b1a-98a0-5980035670aa" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 14 18:06:56.964181 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:06:56.964153 2552 generic.go:356] "Generic (PLEG): container finished" podID="60e6ffbf-a084-4b1a-98a0-5980035670aa" containerID="64bea523bd6382ffa3cb1968918ba130ea75f3ce775314b3bfbd8a9ba02454d6" exitCode=0 Jul 14 18:06:56.964562 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:06:56.964221 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-e8afdc-openshift-default-6b7b9cb777-nm4qm" event={"ID":"60e6ffbf-a084-4b1a-98a0-5980035670aa","Type":"ContainerDied","Data":"64bea523bd6382ffa3cb1968918ba130ea75f3ce775314b3bfbd8a9ba02454d6"} Jul 14 18:06:56.964562 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:06:56.964284 2552 scope.go:117] "RemoveContainer" containerID="9d8418bbfc8611781e6b9731cacddc1e1238aa848c6d84b5cb9c7930e3042d5a" Jul 14 18:06:57.060159 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:06:57.060109 2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-e8afdc-openshift-default-6b7b9cb777-nm4qm" Jul 14 18:06:57.145421 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:06:57.145397 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/60e6ffbf-a084-4b1a-98a0-5980035670aa-workload-socket\") pod \"60e6ffbf-a084-4b1a-98a0-5980035670aa\" (UID: \"60e6ffbf-a084-4b1a-98a0-5980035670aa\") " Jul 14 18:06:57.145561 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:06:57.145444 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/60e6ffbf-a084-4b1a-98a0-5980035670aa-istiod-ca-cert\") pod \"60e6ffbf-a084-4b1a-98a0-5980035670aa\" (UID: \"60e6ffbf-a084-4b1a-98a0-5980035670aa\") " Jul 14 18:06:57.145561 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:06:57.145485 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/60e6ffbf-a084-4b1a-98a0-5980035670aa-istio-token\") pod \"60e6ffbf-a084-4b1a-98a0-5980035670aa\" (UID: \"60e6ffbf-a084-4b1a-98a0-5980035670aa\") " Jul 14 18:06:57.145561 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:06:57.145508 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rjlxz\" (UniqueName: \"kubernetes.io/projected/60e6ffbf-a084-4b1a-98a0-5980035670aa-kube-api-access-rjlxz\") pod \"60e6ffbf-a084-4b1a-98a0-5980035670aa\" (UID: \"60e6ffbf-a084-4b1a-98a0-5980035670aa\") " Jul 14 18:06:57.145561 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:06:57.145532 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/60e6ffbf-a084-4b1a-98a0-5980035670aa-istio-envoy\") pod \"60e6ffbf-a084-4b1a-98a0-5980035670aa\" (UID: \"60e6ffbf-a084-4b1a-98a0-5980035670aa\") " Jul 14 18:06:57.145765 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:06:57.145635 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/60e6ffbf-a084-4b1a-98a0-5980035670aa-istio-podinfo\") pod \"60e6ffbf-a084-4b1a-98a0-5980035670aa\" (UID: \"60e6ffbf-a084-4b1a-98a0-5980035670aa\") " Jul 14 18:06:57.145765 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:06:57.145671 2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/60e6ffbf-a084-4b1a-98a0-5980035670aa-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "60e6ffbf-a084-4b1a-98a0-5980035670aa" (UID: "60e6ffbf-a084-4b1a-98a0-5980035670aa"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 14 18:06:57.145765 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:06:57.145683 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/60e6ffbf-a084-4b1a-98a0-5980035670aa-istio-data\") pod \"60e6ffbf-a084-4b1a-98a0-5980035670aa\" (UID: \"60e6ffbf-a084-4b1a-98a0-5980035670aa\") " Jul 14 18:06:57.145765 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:06:57.145750 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/60e6ffbf-a084-4b1a-98a0-5980035670aa-credential-socket\") pod \"60e6ffbf-a084-4b1a-98a0-5980035670aa\" (UID: \"60e6ffbf-a084-4b1a-98a0-5980035670aa\") " Jul 14 18:06:57.145968 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:06:57.145783 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/60e6ffbf-a084-4b1a-98a0-5980035670aa-workload-certs\") pod \"60e6ffbf-a084-4b1a-98a0-5980035670aa\" (UID: \"60e6ffbf-a084-4b1a-98a0-5980035670aa\") " Jul 14 18:06:57.145968 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:06:57.145914 2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/60e6ffbf-a084-4b1a-98a0-5980035670aa-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "60e6ffbf-a084-4b1a-98a0-5980035670aa" (UID: "60e6ffbf-a084-4b1a-98a0-5980035670aa"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 14 18:06:57.146173 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:06:57.146104 2552 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/60e6ffbf-a084-4b1a-98a0-5980035670aa-workload-socket\") on node \"ip-10-0-139-16.ec2.internal\" DevicePath \"\"" Jul 14 18:06:57.146173 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:06:57.146114 2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/60e6ffbf-a084-4b1a-98a0-5980035670aa-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "60e6ffbf-a084-4b1a-98a0-5980035670aa" (UID: "60e6ffbf-a084-4b1a-98a0-5980035670aa"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 14 18:06:57.146173 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:06:57.146129 2552 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/60e6ffbf-a084-4b1a-98a0-5980035670aa-istiod-ca-cert\") on node \"ip-10-0-139-16.ec2.internal\" DevicePath \"\"" Jul 14 18:06:57.146173 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:06:57.146152 2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/60e6ffbf-a084-4b1a-98a0-5980035670aa-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "60e6ffbf-a084-4b1a-98a0-5980035670aa" (UID: "60e6ffbf-a084-4b1a-98a0-5980035670aa"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 14 18:06:57.146689 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:06:57.146666 2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/60e6ffbf-a084-4b1a-98a0-5980035670aa-istio-data" (OuterVolumeSpecName: "istio-data") pod "60e6ffbf-a084-4b1a-98a0-5980035670aa" (UID: "60e6ffbf-a084-4b1a-98a0-5980035670aa"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 14 18:06:57.147676 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:06:57.147657 2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/60e6ffbf-a084-4b1a-98a0-5980035670aa-istio-token" (OuterVolumeSpecName: "istio-token") pod "60e6ffbf-a084-4b1a-98a0-5980035670aa" (UID: "60e6ffbf-a084-4b1a-98a0-5980035670aa"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 14 18:06:57.147935 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:06:57.147893 2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/60e6ffbf-a084-4b1a-98a0-5980035670aa-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "60e6ffbf-a084-4b1a-98a0-5980035670aa" (UID: "60e6ffbf-a084-4b1a-98a0-5980035670aa"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 14 18:06:57.148071 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:06:57.148050 2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/60e6ffbf-a084-4b1a-98a0-5980035670aa-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "60e6ffbf-a084-4b1a-98a0-5980035670aa" (UID: "60e6ffbf-a084-4b1a-98a0-5980035670aa"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 14 18:06:57.148132 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:06:57.148068 2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/60e6ffbf-a084-4b1a-98a0-5980035670aa-kube-api-access-rjlxz" (OuterVolumeSpecName: "kube-api-access-rjlxz") pod "60e6ffbf-a084-4b1a-98a0-5980035670aa" (UID: "60e6ffbf-a084-4b1a-98a0-5980035670aa"). InnerVolumeSpecName "kube-api-access-rjlxz". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 14 18:06:57.247483 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:06:57.247453 2552 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/60e6ffbf-a084-4b1a-98a0-5980035670aa-credential-socket\") on node \"ip-10-0-139-16.ec2.internal\" DevicePath \"\"" Jul 14 18:06:57.247483 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:06:57.247480 2552 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/60e6ffbf-a084-4b1a-98a0-5980035670aa-workload-certs\") on node \"ip-10-0-139-16.ec2.internal\" DevicePath \"\"" Jul 14 18:06:57.247483 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:06:57.247490 2552 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/60e6ffbf-a084-4b1a-98a0-5980035670aa-istio-token\") on node \"ip-10-0-139-16.ec2.internal\" DevicePath \"\"" Jul 14 18:06:57.247684 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:06:57.247498 2552 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rjlxz\" (UniqueName: \"kubernetes.io/projected/60e6ffbf-a084-4b1a-98a0-5980035670aa-kube-api-access-rjlxz\") on node \"ip-10-0-139-16.ec2.internal\" DevicePath \"\"" Jul 14 18:06:57.247684 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:06:57.247507 2552 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/60e6ffbf-a084-4b1a-98a0-5980035670aa-istio-envoy\") on node \"ip-10-0-139-16.ec2.internal\" DevicePath \"\"" Jul 14 18:06:57.247684 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:06:57.247515 2552 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/60e6ffbf-a084-4b1a-98a0-5980035670aa-istio-podinfo\") on node \"ip-10-0-139-16.ec2.internal\" DevicePath \"\"" Jul 14 18:06:57.247684 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:06:57.247522 2552 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/60e6ffbf-a084-4b1a-98a0-5980035670aa-istio-data\") on node \"ip-10-0-139-16.ec2.internal\" DevicePath \"\"" Jul 14 18:06:57.970703 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:06:57.970669 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-e8afdc-openshift-default-6b7b9cb777-nm4qm" event={"ID":"60e6ffbf-a084-4b1a-98a0-5980035670aa","Type":"ContainerDied","Data":"7ebddf0bf0dd897f05dc1d210031cd3d5009e03a3f826bb1a3048438966cd6ea"} Jul 14 18:06:57.971124 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:06:57.970728 2552 scope.go:117] "RemoveContainer" containerID="64bea523bd6382ffa3cb1968918ba130ea75f3ce775314b3bfbd8a9ba02454d6" Jul 14 18:06:57.971124 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:06:57.970677 2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-e8afdc-openshift-default-6b7b9cb777-nm4qm" Jul 14 18:06:57.995499 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:06:57.995473 2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-e8afdc-openshift-default-6b7b9cb777-nm4qm"] Jul 14 18:06:58.000031 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:06:58.000009 2552 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-a-e8afdc-openshift-default-6b7b9cb777-nm4qm"] Jul 14 18:06:58.388662 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:06:58.388582 2552 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="60e6ffbf-a084-4b1a-98a0-5980035670aa" path="/var/lib/kubelet/pods/60e6ffbf-a084-4b1a-98a0-5980035670aa/volumes" Jul 14 18:07:02.617818 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:07:02.617778 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 18:07:07.239995 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:07:07.239956 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 18:07:13.183499 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:07:13.183456 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 18:07:13.248178 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:07:13.248147 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 18:07:17.949792 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:07:17.949753 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 18:07:18.184845 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:07:18.184806 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 18:07:18.534997 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:07:18.534963 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 18:07:18.834242 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:07:18.834151 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-a-8bfa74-openshift-default-58f768484c-25tk5"] Jul 14 18:07:18.834609 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:07:18.834594 2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="60e6ffbf-a084-4b1a-98a0-5980035670aa" containerName="istio-proxy" Jul 14 18:07:18.834664 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:07:18.834611 2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="60e6ffbf-a084-4b1a-98a0-5980035670aa" containerName="istio-proxy" Jul 14 18:07:18.834701 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:07:18.834696 2552 memory_manager.go:368] "RemoveStaleState removing state" podUID="60e6ffbf-a084-4b1a-98a0-5980035670aa" containerName="istio-proxy" Jul 14 18:07:18.834735 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:07:18.834705 2552 memory_manager.go:368] "RemoveStaleState removing state" podUID="60e6ffbf-a084-4b1a-98a0-5980035670aa" containerName="istio-proxy" Jul 14 18:07:18.838063 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:07:18.838042 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-8bfa74-openshift-default-58f768484c-25tk5" Jul 14 18:07:18.841370 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:07:18.841321 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-a-8bfa74-openshift-default-dockercfg-694pd\"" Jul 14 18:07:18.852704 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:07:18.852681 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-8bfa74-openshift-default-58f768484c-25tk5"] Jul 14 18:07:18.932179 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:07:18.932148 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5113a00c-04a3-4f6b-bc0d-419d57d1fd9d-istio-envoy\") pod \"e2e-shared-a-8bfa74-openshift-default-58f768484c-25tk5\" (UID: \"5113a00c-04a3-4f6b-bc0d-419d57d1fd9d\") " pod="openshift-ingress/e2e-shared-a-8bfa74-openshift-default-58f768484c-25tk5" Jul 14 18:07:18.932179 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:07:18.932181 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5113a00c-04a3-4f6b-bc0d-419d57d1fd9d-istio-data\") pod \"e2e-shared-a-8bfa74-openshift-default-58f768484c-25tk5\" (UID: \"5113a00c-04a3-4f6b-bc0d-419d57d1fd9d\") " pod="openshift-ingress/e2e-shared-a-8bfa74-openshift-default-58f768484c-25tk5" Jul 14 18:07:18.932437 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:07:18.932210 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5113a00c-04a3-4f6b-bc0d-419d57d1fd9d-workload-socket\") pod \"e2e-shared-a-8bfa74-openshift-default-58f768484c-25tk5\" (UID: \"5113a00c-04a3-4f6b-bc0d-419d57d1fd9d\") " pod="openshift-ingress/e2e-shared-a-8bfa74-openshift-default-58f768484c-25tk5" Jul 14 18:07:18.932437 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:07:18.932234 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5113a00c-04a3-4f6b-bc0d-419d57d1fd9d-workload-certs\") pod \"e2e-shared-a-8bfa74-openshift-default-58f768484c-25tk5\" (UID: \"5113a00c-04a3-4f6b-bc0d-419d57d1fd9d\") " pod="openshift-ingress/e2e-shared-a-8bfa74-openshift-default-58f768484c-25tk5" Jul 14 18:07:18.932559 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:07:18.932453 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ckhnm\" (UniqueName: \"kubernetes.io/projected/5113a00c-04a3-4f6b-bc0d-419d57d1fd9d-kube-api-access-ckhnm\") pod \"e2e-shared-a-8bfa74-openshift-default-58f768484c-25tk5\" (UID: \"5113a00c-04a3-4f6b-bc0d-419d57d1fd9d\") " pod="openshift-ingress/e2e-shared-a-8bfa74-openshift-default-58f768484c-25tk5" Jul 14 18:07:18.932559 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:07:18.932514 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5113a00c-04a3-4f6b-bc0d-419d57d1fd9d-istio-podinfo\") pod \"e2e-shared-a-8bfa74-openshift-default-58f768484c-25tk5\" (UID: \"5113a00c-04a3-4f6b-bc0d-419d57d1fd9d\") " pod="openshift-ingress/e2e-shared-a-8bfa74-openshift-default-58f768484c-25tk5" Jul 14 18:07:18.932651 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:07:18.932564 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5113a00c-04a3-4f6b-bc0d-419d57d1fd9d-istio-token\") pod \"e2e-shared-a-8bfa74-openshift-default-58f768484c-25tk5\" (UID: \"5113a00c-04a3-4f6b-bc0d-419d57d1fd9d\") " pod="openshift-ingress/e2e-shared-a-8bfa74-openshift-default-58f768484c-25tk5" Jul 14 18:07:18.932651 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:07:18.932622 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5113a00c-04a3-4f6b-bc0d-419d57d1fd9d-credential-socket\") pod \"e2e-shared-a-8bfa74-openshift-default-58f768484c-25tk5\" (UID: \"5113a00c-04a3-4f6b-bc0d-419d57d1fd9d\") " pod="openshift-ingress/e2e-shared-a-8bfa74-openshift-default-58f768484c-25tk5" Jul 14 18:07:18.932729 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:07:18.932653 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5113a00c-04a3-4f6b-bc0d-419d57d1fd9d-istiod-ca-cert\") pod \"e2e-shared-a-8bfa74-openshift-default-58f768484c-25tk5\" (UID: \"5113a00c-04a3-4f6b-bc0d-419d57d1fd9d\") " pod="openshift-ingress/e2e-shared-a-8bfa74-openshift-default-58f768484c-25tk5" Jul 14 18:07:18.972515 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:07:18.972481 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 18:07:19.033779 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:07:19.033740 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5113a00c-04a3-4f6b-bc0d-419d57d1fd9d-istio-envoy\") pod \"e2e-shared-a-8bfa74-openshift-default-58f768484c-25tk5\" (UID: \"5113a00c-04a3-4f6b-bc0d-419d57d1fd9d\") " pod="openshift-ingress/e2e-shared-a-8bfa74-openshift-default-58f768484c-25tk5" Jul 14 18:07:19.033779 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:07:19.033777 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5113a00c-04a3-4f6b-bc0d-419d57d1fd9d-istio-data\") pod \"e2e-shared-a-8bfa74-openshift-default-58f768484c-25tk5\" (UID: \"5113a00c-04a3-4f6b-bc0d-419d57d1fd9d\") " pod="openshift-ingress/e2e-shared-a-8bfa74-openshift-default-58f768484c-25tk5" Jul 14 18:07:19.034035 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:07:19.033807 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5113a00c-04a3-4f6b-bc0d-419d57d1fd9d-workload-socket\") pod \"e2e-shared-a-8bfa74-openshift-default-58f768484c-25tk5\" (UID: \"5113a00c-04a3-4f6b-bc0d-419d57d1fd9d\") " pod="openshift-ingress/e2e-shared-a-8bfa74-openshift-default-58f768484c-25tk5" Jul 14 18:07:19.034035 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:07:19.033831 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5113a00c-04a3-4f6b-bc0d-419d57d1fd9d-workload-certs\") pod \"e2e-shared-a-8bfa74-openshift-default-58f768484c-25tk5\" (UID: \"5113a00c-04a3-4f6b-bc0d-419d57d1fd9d\") " pod="openshift-ingress/e2e-shared-a-8bfa74-openshift-default-58f768484c-25tk5" Jul 14 18:07:19.034035 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:07:19.033928 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ckhnm\" (UniqueName: \"kubernetes.io/projected/5113a00c-04a3-4f6b-bc0d-419d57d1fd9d-kube-api-access-ckhnm\") pod \"e2e-shared-a-8bfa74-openshift-default-58f768484c-25tk5\" (UID: \"5113a00c-04a3-4f6b-bc0d-419d57d1fd9d\") " pod="openshift-ingress/e2e-shared-a-8bfa74-openshift-default-58f768484c-25tk5" Jul 14 18:07:19.034035 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:07:19.033976 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5113a00c-04a3-4f6b-bc0d-419d57d1fd9d-istio-podinfo\") pod \"e2e-shared-a-8bfa74-openshift-default-58f768484c-25tk5\" (UID: \"5113a00c-04a3-4f6b-bc0d-419d57d1fd9d\") " pod="openshift-ingress/e2e-shared-a-8bfa74-openshift-default-58f768484c-25tk5" Jul 14 18:07:19.034035 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:07:19.034012 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5113a00c-04a3-4f6b-bc0d-419d57d1fd9d-istio-token\") pod \"e2e-shared-a-8bfa74-openshift-default-58f768484c-25tk5\" (UID: \"5113a00c-04a3-4f6b-bc0d-419d57d1fd9d\") " pod="openshift-ingress/e2e-shared-a-8bfa74-openshift-default-58f768484c-25tk5" Jul 14 18:07:19.034312 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:07:19.034044 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5113a00c-04a3-4f6b-bc0d-419d57d1fd9d-credential-socket\") pod \"e2e-shared-a-8bfa74-openshift-default-58f768484c-25tk5\" (UID: \"5113a00c-04a3-4f6b-bc0d-419d57d1fd9d\") " pod="openshift-ingress/e2e-shared-a-8bfa74-openshift-default-58f768484c-25tk5" Jul 14 18:07:19.034312 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:07:19.034069 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5113a00c-04a3-4f6b-bc0d-419d57d1fd9d-istiod-ca-cert\") pod \"e2e-shared-a-8bfa74-openshift-default-58f768484c-25tk5\" (UID: \"5113a00c-04a3-4f6b-bc0d-419d57d1fd9d\") " pod="openshift-ingress/e2e-shared-a-8bfa74-openshift-default-58f768484c-25tk5" Jul 14 18:07:19.034312 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:07:19.034204 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5113a00c-04a3-4f6b-bc0d-419d57d1fd9d-istio-data\") pod \"e2e-shared-a-8bfa74-openshift-default-58f768484c-25tk5\" (UID: \"5113a00c-04a3-4f6b-bc0d-419d57d1fd9d\") " pod="openshift-ingress/e2e-shared-a-8bfa74-openshift-default-58f768484c-25tk5" Jul 14 18:07:19.034613 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:07:19.034591 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5113a00c-04a3-4f6b-bc0d-419d57d1fd9d-workload-socket\") pod \"e2e-shared-a-8bfa74-openshift-default-58f768484c-25tk5\" (UID: \"5113a00c-04a3-4f6b-bc0d-419d57d1fd9d\") " pod="openshift-ingress/e2e-shared-a-8bfa74-openshift-default-58f768484c-25tk5" Jul 14 18:07:19.034687 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:07:19.034621 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5113a00c-04a3-4f6b-bc0d-419d57d1fd9d-credential-socket\") pod \"e2e-shared-a-8bfa74-openshift-default-58f768484c-25tk5\" (UID: \"5113a00c-04a3-4f6b-bc0d-419d57d1fd9d\") " pod="openshift-ingress/e2e-shared-a-8bfa74-openshift-default-58f768484c-25tk5" Jul 14 18:07:19.034748 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:07:19.034722 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5113a00c-04a3-4f6b-bc0d-419d57d1fd9d-workload-certs\") pod \"e2e-shared-a-8bfa74-openshift-default-58f768484c-25tk5\" (UID: \"5113a00c-04a3-4f6b-bc0d-419d57d1fd9d\") " pod="openshift-ingress/e2e-shared-a-8bfa74-openshift-default-58f768484c-25tk5" Jul 14 18:07:19.034947 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:07:19.034924 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5113a00c-04a3-4f6b-bc0d-419d57d1fd9d-istiod-ca-cert\") pod \"e2e-shared-a-8bfa74-openshift-default-58f768484c-25tk5\" (UID: \"5113a00c-04a3-4f6b-bc0d-419d57d1fd9d\") " pod="openshift-ingress/e2e-shared-a-8bfa74-openshift-default-58f768484c-25tk5" Jul 14 18:07:19.036569 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:07:19.036523 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5113a00c-04a3-4f6b-bc0d-419d57d1fd9d-istio-envoy\") pod \"e2e-shared-a-8bfa74-openshift-default-58f768484c-25tk5\" (UID: \"5113a00c-04a3-4f6b-bc0d-419d57d1fd9d\") " pod="openshift-ingress/e2e-shared-a-8bfa74-openshift-default-58f768484c-25tk5" Jul 14 18:07:19.036704 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:07:19.036640 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5113a00c-04a3-4f6b-bc0d-419d57d1fd9d-istio-podinfo\") pod \"e2e-shared-a-8bfa74-openshift-default-58f768484c-25tk5\" (UID: \"5113a00c-04a3-4f6b-bc0d-419d57d1fd9d\") " pod="openshift-ingress/e2e-shared-a-8bfa74-openshift-default-58f768484c-25tk5" Jul 14 18:07:19.043061 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:07:19.043035 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5113a00c-04a3-4f6b-bc0d-419d57d1fd9d-istio-token\") pod \"e2e-shared-a-8bfa74-openshift-default-58f768484c-25tk5\" (UID: \"5113a00c-04a3-4f6b-bc0d-419d57d1fd9d\") " pod="openshift-ingress/e2e-shared-a-8bfa74-openshift-default-58f768484c-25tk5" Jul 14 18:07:19.043203 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:07:19.043152 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ckhnm\" (UniqueName: \"kubernetes.io/projected/5113a00c-04a3-4f6b-bc0d-419d57d1fd9d-kube-api-access-ckhnm\") pod \"e2e-shared-a-8bfa74-openshift-default-58f768484c-25tk5\" (UID: \"5113a00c-04a3-4f6b-bc0d-419d57d1fd9d\") " pod="openshift-ingress/e2e-shared-a-8bfa74-openshift-default-58f768484c-25tk5" Jul 14 18:07:19.148937 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:07:19.148843 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-8bfa74-openshift-default-58f768484c-25tk5" Jul 14 18:07:19.313058 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:07:19.313031 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-8bfa74-openshift-default-58f768484c-25tk5"] Jul 14 18:07:19.314773 ip-10-0-139-16 kubenswrapper[2552]: W0714 18:07:19.314744 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5113a00c_04a3_4f6b_bc0d_419d57d1fd9d.slice/crio-967efe22f0b3cdf04e808a623566e6d897809cddfe3c2e7d108040dbe81be739 WatchSource:0}: Error finding container 967efe22f0b3cdf04e808a623566e6d897809cddfe3c2e7d108040dbe81be739: Status 404 returned error can't find the container with id 967efe22f0b3cdf04e808a623566e6d897809cddfe3c2e7d108040dbe81be739 Jul 14 18:07:19.317211 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:07:19.317178 2552 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 14 18:07:19.317296 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:07:19.317247 2552 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 14 18:07:19.317296 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:07:19.317275 2552 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 14 18:07:19.823312 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:07:19.823278 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 18:07:20.084812 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:07:20.084724 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-8bfa74-openshift-default-58f768484c-25tk5" event={"ID":"5113a00c-04a3-4f6b-bc0d-419d57d1fd9d","Type":"ContainerStarted","Data":"1bd0e2bda5654fd694d122565cfa855a892c7e6f5a204d255a3c64f8e93dbb8e"} Jul 14 18:07:20.084812 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:07:20.084785 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-8bfa74-openshift-default-58f768484c-25tk5" event={"ID":"5113a00c-04a3-4f6b-bc0d-419d57d1fd9d","Type":"ContainerStarted","Data":"967efe22f0b3cdf04e808a623566e6d897809cddfe3c2e7d108040dbe81be739"} Jul 14 18:07:20.110906 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:07:20.110862 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-a-8bfa74-openshift-default-58f768484c-25tk5" podStartSLOduration=2.110848068 podStartE2EDuration="2.110848068s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 18:07:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 18:07:20.108257805 +0000 UTC m=+2502.487371780" watchObservedRunningTime="2026-07-14 18:07:20.110848068 +0000 UTC m=+2502.489962108" Jul 14 18:07:20.149760 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:07:20.149730 2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-8bfa74-openshift-default-58f768484c-25tk5" Jul 14 18:07:20.155123 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:07:20.155102 2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-8bfa74-openshift-default-58f768484c-25tk5" Jul 14 18:07:21.091543 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:07:21.091509 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-8bfa74-openshift-default-58f768484c-25tk5" Jul 14 18:07:21.092507 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:07:21.092486 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-8bfa74-openshift-default-58f768484c-25tk5" Jul 14 18:07:22.037994 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:07:22.037957 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 18:07:22.119369 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:07:22.119311 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 18:07:22.191462 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:07:22.191425 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 18:07:22.472818 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:07:22.472791 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 18:07:22.743518 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:07:22.743427 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 18:07:22.844475 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:07:22.844438 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 18:07:26.531170 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:07:26.531139 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 18:07:26.862158 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:07:26.862080 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 18:07:27.238373 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:07:27.238320 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 18:07:27.407681 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:07:27.407640 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 18:07:29.851347 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:07:29.851284 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 18:07:29.951312 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:07:29.951281 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 18:07:30.139711 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:07:30.139585 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 18:07:30.693978 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:07:30.693936 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 18:07:30.939316 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:07:30.939281 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 18:07:31.036956 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:07:31.036920 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 18:07:34.324210 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:07:34.324174 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 18:07:36.092973 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:07:36.092932 2552 patch_prober.go:28] interesting pod/e2e-shared-a-8bfa74-openshift-default-58f768484c-25tk5 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused" start-of-body= Jul 14 18:07:36.093498 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:07:36.093015 2552 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-a-8bfa74-openshift-default-58f768484c-25tk5" podUID="5113a00c-04a3-4f6b-bc0d-419d57d1fd9d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused" Jul 14 18:07:36.173190 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:07:36.173156 2552 generic.go:356] "Generic (PLEG): container finished" podID="5113a00c-04a3-4f6b-bc0d-419d57d1fd9d" containerID="1bd0e2bda5654fd694d122565cfa855a892c7e6f5a204d255a3c64f8e93dbb8e" exitCode=0 Jul 14 18:07:36.173408 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:07:36.173197 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-8bfa74-openshift-default-58f768484c-25tk5" event={"ID":"5113a00c-04a3-4f6b-bc0d-419d57d1fd9d","Type":"ContainerDied","Data":"1bd0e2bda5654fd694d122565cfa855a892c7e6f5a204d255a3c64f8e93dbb8e"} Jul 14 18:07:36.173668 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:07:36.173651 2552 scope.go:117] "RemoveContainer" containerID="1bd0e2bda5654fd694d122565cfa855a892c7e6f5a204d255a3c64f8e93dbb8e" Jul 14 18:07:36.174796 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:07:36.174767 2552 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 14 18:07:36.174854 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:07:36.174835 2552 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 14 18:07:36.174889 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:07:36.174869 2552 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 14 18:07:37.180086 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:07:37.180053 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-8bfa74-openshift-default-58f768484c-25tk5" event={"ID":"5113a00c-04a3-4f6b-bc0d-419d57d1fd9d","Type":"ContainerStarted","Data":"c0f6f55435dc6587158e4f24a1b17117920e2add4773d3f43b080f0d134b2567"} Jul 14 18:07:38.149679 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:07:38.149639 2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-8bfa74-openshift-default-58f768484c-25tk5" Jul 14 18:07:38.149925 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:07:38.149903 2552 patch_prober.go:28] interesting pod/e2e-shared-a-8bfa74-openshift-default-58f768484c-25tk5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused" start-of-body= Jul 14 18:07:38.149972 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:07:38.149949 2552 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-8bfa74-openshift-default-58f768484c-25tk5" podUID="5113a00c-04a3-4f6b-bc0d-419d57d1fd9d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused" Jul 14 18:07:39.149841 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:07:39.149801 2552 patch_prober.go:28] interesting pod/e2e-shared-a-8bfa74-openshift-default-58f768484c-25tk5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused" start-of-body= Jul 14 18:07:39.150228 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:07:39.149874 2552 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-8bfa74-openshift-default-58f768484c-25tk5" podUID="5113a00c-04a3-4f6b-bc0d-419d57d1fd9d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused" Jul 14 18:07:40.149322 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:07:40.149282 2552 patch_prober.go:28] interesting pod/e2e-shared-a-8bfa74-openshift-default-58f768484c-25tk5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused" start-of-body= Jul 14 18:07:40.149529 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:07:40.149379 2552 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-8bfa74-openshift-default-58f768484c-25tk5" podUID="5113a00c-04a3-4f6b-bc0d-419d57d1fd9d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused" Jul 14 18:07:41.153125 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:07:41.153096 2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-8bfa74-openshift-default-58f768484c-25tk5" Jul 14 18:07:41.153641 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:07:41.153363 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-8bfa74-openshift-default-58f768484c-25tk5" Jul 14 18:07:41.154003 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:07:41.153988 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-8bfa74-openshift-default-58f768484c-25tk5" Jul 14 18:07:43.599633 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:07:43.599598 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 18:07:43.699904 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:07:43.699859 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 18:07:51.534762 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:07:51.534724 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 18:07:51.633919 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:07:51.633882 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 18:07:58.990114 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:07:58.990080 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 18:08:14.198362 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:08:14.198302 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 18:08:38.427220 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:08:38.427187 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 18:08:38.485635 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:08:38.485607 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 18:10:09.380823 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:10:09.380773 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 18:10:10.287704 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:10:10.287664 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 18:10:22.025759 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:10:22.025722 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 18:10:38.316375 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:10:38.316294 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-gnw2z_b3c71861-4db9-4850-a44b-6f5d44a94235/console-operator/2.log" Jul 14 18:10:38.321781 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:10:38.321752 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cwprj_d3492336-881b-4f13-8d3a-b4d4ec05ad3c/ovn-acl-logging/0.log" Jul 14 18:10:38.334607 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:10:38.334583 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-gnw2z_b3c71861-4db9-4850-a44b-6f5d44a94235/console-operator/2.log" Jul 14 18:10:38.339015 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:10:38.338994 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cwprj_d3492336-881b-4f13-8d3a-b4d4ec05ad3c/ovn-acl-logging/0.log" Jul 14 18:10:43.723368 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:10:43.723312 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 18:10:52.779159 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:10:52.779122 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 18:10:52.879343 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:10:52.879291 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 18:11:12.695608 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:11:12.695574 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 18:11:12.795870 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:11:12.795831 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 18:11:32.140969 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:11:32.140931 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 18:11:32.933780 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:11:32.933747 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 18:11:47.112278 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:11:47.112237 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 18:12:27.322836 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:12:27.322799 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 18:12:44.354463 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:12:44.354424 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 18:12:44.453262 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:12:44.453207 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 18:12:52.399057 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:12:52.399019 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 18:12:52.499546 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:12:52.499513 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 18:12:57.068657 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:12:57.068624 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 18:13:13.477666 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:13:13.477572 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 18:13:14.321788 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:13:14.321754 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 18:13:15.261908 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:13:15.261875 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7417-140101077048368"] Jul 14 18:13:15.262293 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:13:15.262277 2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="60e6ffbf-a084-4b1a-98a0-5980035670aa" containerName="istio-proxy" Jul 14 18:13:15.262293 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:13:15.262289 2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="60e6ffbf-a084-4b1a-98a0-5980035670aa" containerName="istio-proxy" Jul 14 18:13:15.264841 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:13:15.264825 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7417-140101077048368" Jul 14 18:13:15.267476 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:13:15.267453 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-kdsgk\"" Jul 14 18:13:15.272133 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:13:15.271640 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7417-140101077048368"] Jul 14 18:13:15.433832 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:13:15.433797 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cg9l6\" (UniqueName: \"kubernetes.io/projected/5d8343a0-17b1-484c-896e-4ed54536076f-kube-api-access-cg9l6\") pod \"test-curl-7417-140101077048368\" (UID: \"5d8343a0-17b1-484c-896e-4ed54536076f\") " pod="opendatahub/test-curl-7417-140101077048368" Jul 14 18:13:15.534738 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:13:15.534656 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cg9l6\" (UniqueName: \"kubernetes.io/projected/5d8343a0-17b1-484c-896e-4ed54536076f-kube-api-access-cg9l6\") pod \"test-curl-7417-140101077048368\" (UID: \"5d8343a0-17b1-484c-896e-4ed54536076f\") " pod="opendatahub/test-curl-7417-140101077048368" Jul 14 18:13:15.543219 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:13:15.543193 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cg9l6\" (UniqueName: \"kubernetes.io/projected/5d8343a0-17b1-484c-896e-4ed54536076f-kube-api-access-cg9l6\") pod \"test-curl-7417-140101077048368\" (UID: \"5d8343a0-17b1-484c-896e-4ed54536076f\") " pod="opendatahub/test-curl-7417-140101077048368" Jul 14 18:13:15.575672 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:13:15.575646 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7417-140101077048368" Jul 14 18:13:15.710813 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:13:15.710787 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7417-140101077048368"] Jul 14 18:13:15.713027 ip-10-0-139-16 kubenswrapper[2552]: W0714 18:13:15.713000 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod5d8343a0_17b1_484c_896e_4ed54536076f.slice/crio-0f5e5034d34f53350b67e4f6ad1def7ce68f133e611b206cd8b5fcabbc149b1b WatchSource:0}: Error finding container 0f5e5034d34f53350b67e4f6ad1def7ce68f133e611b206cd8b5fcabbc149b1b: Status 404 returned error can't find the container with id 0f5e5034d34f53350b67e4f6ad1def7ce68f133e611b206cd8b5fcabbc149b1b Jul 14 18:13:15.714913 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:13:15.714894 2552 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 14 18:13:15.982391 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:13:15.982352 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7417-140101077048368" event={"ID":"5d8343a0-17b1-484c-896e-4ed54536076f","Type":"ContainerStarted","Data":"0f5e5034d34f53350b67e4f6ad1def7ce68f133e611b206cd8b5fcabbc149b1b"} Jul 14 18:13:16.988736 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:13:16.988701 2552 generic.go:356] "Generic (PLEG): container finished" podID="5d8343a0-17b1-484c-896e-4ed54536076f" containerID="b29e3c184a3488530f38a9ce6941e6172fdfd2cb1d47cf66a3d38880d36d8147" exitCode=0 Jul 14 18:13:16.989124 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:13:16.988782 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7417-140101077048368" event={"ID":"5d8343a0-17b1-484c-896e-4ed54536076f","Type":"ContainerDied","Data":"b29e3c184a3488530f38a9ce6941e6172fdfd2cb1d47cf66a3d38880d36d8147"} Jul 14 18:13:18.138600 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:13:18.138575 2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7417-140101077048368" Jul 14 18:13:18.158284 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:13:18.158253 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cg9l6\" (UniqueName: \"kubernetes.io/projected/5d8343a0-17b1-484c-896e-4ed54536076f-kube-api-access-cg9l6\") pod \"5d8343a0-17b1-484c-896e-4ed54536076f\" (UID: \"5d8343a0-17b1-484c-896e-4ed54536076f\") " Jul 14 18:13:18.160309 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:13:18.160279 2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5d8343a0-17b1-484c-896e-4ed54536076f-kube-api-access-cg9l6" (OuterVolumeSpecName: "kube-api-access-cg9l6") pod "5d8343a0-17b1-484c-896e-4ed54536076f" (UID: "5d8343a0-17b1-484c-896e-4ed54536076f"). InnerVolumeSpecName "kube-api-access-cg9l6". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 14 18:13:18.162013 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:13:18.161966 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7417-140101077048368_5d8343a0-17b1-484c-896e-4ed54536076f/test-curl-7417-140101077048368/0.log" Jul 14 18:13:18.186915 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:13:18.186886 2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7417-140101077048368"] Jul 14 18:13:18.192247 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:13:18.192226 2552 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7417-140101077048368"] Jul 14 18:13:18.259534 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:13:18.259466 2552 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cg9l6\" (UniqueName: \"kubernetes.io/projected/5d8343a0-17b1-484c-896e-4ed54536076f-kube-api-access-cg9l6\") on node \"ip-10-0-139-16.ec2.internal\" DevicePath \"\"" Jul 14 18:13:18.343082 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:13:18.343047 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7417-140101077045296"] Jul 14 18:13:18.343580 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:13:18.343560 2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5d8343a0-17b1-484c-896e-4ed54536076f" containerName="test-curl-7417-140101077048368" Jul 14 18:13:18.343683 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:13:18.343582 2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="5d8343a0-17b1-484c-896e-4ed54536076f" containerName="test-curl-7417-140101077048368" Jul 14 18:13:18.343753 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:13:18.343717 2552 memory_manager.go:368] "RemoveStaleState removing state" podUID="5d8343a0-17b1-484c-896e-4ed54536076f" containerName="test-curl-7417-140101077048368" Jul 14 18:13:18.345966 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:13:18.345946 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7417-140101077045296" Jul 14 18:13:18.353999 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:13:18.353979 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7417-140101077045296"] Jul 14 18:13:18.360012 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:13:18.359991 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9d68c\" (UniqueName: \"kubernetes.io/projected/94304cba-68d8-49b6-93f3-58ac89d7618d-kube-api-access-9d68c\") pod \"test-curl-7417-140101077045296\" (UID: \"94304cba-68d8-49b6-93f3-58ac89d7618d\") " pod="opendatahub/test-curl-7417-140101077045296" Jul 14 18:13:18.389519 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:13:18.389499 2552 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5d8343a0-17b1-484c-896e-4ed54536076f" path="/var/lib/kubelet/pods/5d8343a0-17b1-484c-896e-4ed54536076f/volumes" Jul 14 18:13:18.460562 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:13:18.460532 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9d68c\" (UniqueName: \"kubernetes.io/projected/94304cba-68d8-49b6-93f3-58ac89d7618d-kube-api-access-9d68c\") pod \"test-curl-7417-140101077045296\" (UID: \"94304cba-68d8-49b6-93f3-58ac89d7618d\") " pod="opendatahub/test-curl-7417-140101077045296" Jul 14 18:13:18.469747 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:13:18.469728 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9d68c\" (UniqueName: \"kubernetes.io/projected/94304cba-68d8-49b6-93f3-58ac89d7618d-kube-api-access-9d68c\") pod \"test-curl-7417-140101077045296\" (UID: \"94304cba-68d8-49b6-93f3-58ac89d7618d\") " pod="opendatahub/test-curl-7417-140101077045296" Jul 14 18:13:18.656357 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:13:18.656250 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7417-140101077045296" Jul 14 18:13:18.787720 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:13:18.787690 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7417-140101077045296"] Jul 14 18:13:18.790304 ip-10-0-139-16 kubenswrapper[2552]: W0714 18:13:18.790269 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod94304cba_68d8_49b6_93f3_58ac89d7618d.slice/crio-1c77510dfb8da8608db9b0f570b5e96d0f8669610d52dd5bc40df4d14fb6d8c5 WatchSource:0}: Error finding container 1c77510dfb8da8608db9b0f570b5e96d0f8669610d52dd5bc40df4d14fb6d8c5: Status 404 returned error can't find the container with id 1c77510dfb8da8608db9b0f570b5e96d0f8669610d52dd5bc40df4d14fb6d8c5 Jul 14 18:13:19.001273 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:13:19.001238 2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7417-140101077048368" Jul 14 18:13:19.001471 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:13:19.001283 2552 scope.go:117] "RemoveContainer" containerID="b29e3c184a3488530f38a9ce6941e6172fdfd2cb1d47cf66a3d38880d36d8147" Jul 14 18:13:19.002799 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:13:19.002517 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7417-140101077045296" event={"ID":"94304cba-68d8-49b6-93f3-58ac89d7618d","Type":"ContainerStarted","Data":"1c77510dfb8da8608db9b0f570b5e96d0f8669610d52dd5bc40df4d14fb6d8c5"} Jul 14 18:13:20.010071 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:13:20.010042 2552 generic.go:356] "Generic (PLEG): container finished" podID="94304cba-68d8-49b6-93f3-58ac89d7618d" containerID="5cedc3debba68167ebdbf3d3e7fb2c41ea85994f4b8161cf7c6d3eeee2de2f1c" exitCode=0 Jul 14 18:13:20.010466 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:13:20.010098 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7417-140101077045296" event={"ID":"94304cba-68d8-49b6-93f3-58ac89d7618d","Type":"ContainerDied","Data":"5cedc3debba68167ebdbf3d3e7fb2c41ea85994f4b8161cf7c6d3eeee2de2f1c"} Jul 14 18:13:21.158406 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:13:21.158385 2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7417-140101077045296" Jul 14 18:13:21.179054 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:13:21.179026 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7417-140101077045296_94304cba-68d8-49b6-93f3-58ac89d7618d/test-curl-7417-140101077045296/0.log" Jul 14 18:13:21.185423 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:13:21.185401 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9d68c\" (UniqueName: \"kubernetes.io/projected/94304cba-68d8-49b6-93f3-58ac89d7618d-kube-api-access-9d68c\") pod \"94304cba-68d8-49b6-93f3-58ac89d7618d\" (UID: \"94304cba-68d8-49b6-93f3-58ac89d7618d\") " Jul 14 18:13:21.187382 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:13:21.187352 2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/94304cba-68d8-49b6-93f3-58ac89d7618d-kube-api-access-9d68c" (OuterVolumeSpecName: "kube-api-access-9d68c") pod "94304cba-68d8-49b6-93f3-58ac89d7618d" (UID: "94304cba-68d8-49b6-93f3-58ac89d7618d"). InnerVolumeSpecName "kube-api-access-9d68c". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 14 18:13:21.202102 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:13:21.202074 2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7417-140101077045296"] Jul 14 18:13:21.205999 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:13:21.205978 2552 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7417-140101077045296"] Jul 14 18:13:21.286811 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:13:21.286744 2552 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9d68c\" (UniqueName: \"kubernetes.io/projected/94304cba-68d8-49b6-93f3-58ac89d7618d-kube-api-access-9d68c\") on node \"ip-10-0-139-16.ec2.internal\" DevicePath \"\"" Jul 14 18:13:22.022112 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:13:22.022085 2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7417-140101077045296" Jul 14 18:13:22.022286 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:13:22.022118 2552 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="1c77510dfb8da8608db9b0f570b5e96d0f8669610d52dd5bc40df4d14fb6d8c5" Jul 14 18:13:22.031931 ip-10-0-139-16 kubenswrapper[2552]: E0714 18:13:22.031905 2552 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7417-140101077045296\" is forbidden: User \"system:node:ip-10-0-139-16.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-139-16.ec2.internal' and this object" podUID="94304cba-68d8-49b6-93f3-58ac89d7618d" pod="opendatahub/test-curl-7417-140101077045296" Jul 14 18:13:22.389540 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:13:22.389461 2552 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="94304cba-68d8-49b6-93f3-58ac89d7618d" path="/var/lib/kubelet/pods/94304cba-68d8-49b6-93f3-58ac89d7618d/volumes" Jul 14 18:13:34.481827 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:13:34.481739 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 18:13:37.706202 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:13:37.706168 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 18:13:44.421431 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:13:44.421397 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 18:13:49.054487 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:13:49.054445 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 18:13:55.212749 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:13:55.212715 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 18:13:55.312009 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:13:55.311972 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 18:13:59.724841 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:13:59.724808 2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-8bfa74-openshift-default-58f768484c-25tk5"] Jul 14 18:13:59.739983 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:13:59.739946 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 18:13:59.972833 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:13:59.972796 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 18:14:00.217890 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:14:00.217855 2552 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-a-8bfa74-openshift-default-58f768484c-25tk5" podUID="5113a00c-04a3-4f6b-bc0d-419d57d1fd9d" containerName="istio-proxy" containerID="cri-o://c0f6f55435dc6587158e4f24a1b17117920e2add4773d3f43b080f0d134b2567" gracePeriod=30 Jul 14 18:14:00.721916 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:14:00.721865 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 18:14:00.820818 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:14:00.820775 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 18:14:05.487678 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:14:05.487620 2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-8bfa74-openshift-default-58f768484c-25tk5" Jul 14 18:14:05.589471 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:14:05.589432 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ckhnm\" (UniqueName: \"kubernetes.io/projected/5113a00c-04a3-4f6b-bc0d-419d57d1fd9d-kube-api-access-ckhnm\") pod \"5113a00c-04a3-4f6b-bc0d-419d57d1fd9d\" (UID: \"5113a00c-04a3-4f6b-bc0d-419d57d1fd9d\") " Jul 14 18:14:05.589471 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:14:05.589481 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5113a00c-04a3-4f6b-bc0d-419d57d1fd9d-istio-token\") pod \"5113a00c-04a3-4f6b-bc0d-419d57d1fd9d\" (UID: \"5113a00c-04a3-4f6b-bc0d-419d57d1fd9d\") " Jul 14 18:14:05.589720 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:14:05.589517 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5113a00c-04a3-4f6b-bc0d-419d57d1fd9d-istiod-ca-cert\") pod \"5113a00c-04a3-4f6b-bc0d-419d57d1fd9d\" (UID: \"5113a00c-04a3-4f6b-bc0d-419d57d1fd9d\") " Jul 14 18:14:05.589720 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:14:05.589543 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5113a00c-04a3-4f6b-bc0d-419d57d1fd9d-workload-certs\") pod \"5113a00c-04a3-4f6b-bc0d-419d57d1fd9d\" (UID: \"5113a00c-04a3-4f6b-bc0d-419d57d1fd9d\") " Jul 14 18:14:05.589720 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:14:05.589585 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5113a00c-04a3-4f6b-bc0d-419d57d1fd9d-istio-envoy\") pod \"5113a00c-04a3-4f6b-bc0d-419d57d1fd9d\" (UID: \"5113a00c-04a3-4f6b-bc0d-419d57d1fd9d\") " Jul 14 18:14:05.589720 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:14:05.589605 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5113a00c-04a3-4f6b-bc0d-419d57d1fd9d-credential-socket\") pod \"5113a00c-04a3-4f6b-bc0d-419d57d1fd9d\" (UID: \"5113a00c-04a3-4f6b-bc0d-419d57d1fd9d\") " Jul 14 18:14:05.589720 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:14:05.589634 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5113a00c-04a3-4f6b-bc0d-419d57d1fd9d-istio-data\") pod \"5113a00c-04a3-4f6b-bc0d-419d57d1fd9d\" (UID: \"5113a00c-04a3-4f6b-bc0d-419d57d1fd9d\") " Jul 14 18:14:05.589720 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:14:05.589670 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5113a00c-04a3-4f6b-bc0d-419d57d1fd9d-istio-podinfo\") pod \"5113a00c-04a3-4f6b-bc0d-419d57d1fd9d\" (UID: \"5113a00c-04a3-4f6b-bc0d-419d57d1fd9d\") " Jul 14 18:14:05.589720 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:14:05.589709 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5113a00c-04a3-4f6b-bc0d-419d57d1fd9d-workload-socket\") pod \"5113a00c-04a3-4f6b-bc0d-419d57d1fd9d\" (UID: \"5113a00c-04a3-4f6b-bc0d-419d57d1fd9d\") " Jul 14 18:14:05.590089 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:14:05.589937 2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5113a00c-04a3-4f6b-bc0d-419d57d1fd9d-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "5113a00c-04a3-4f6b-bc0d-419d57d1fd9d" (UID: "5113a00c-04a3-4f6b-bc0d-419d57d1fd9d"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 14 18:14:05.590089 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:14:05.590040 2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5113a00c-04a3-4f6b-bc0d-419d57d1fd9d-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "5113a00c-04a3-4f6b-bc0d-419d57d1fd9d" (UID: "5113a00c-04a3-4f6b-bc0d-419d57d1fd9d"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 14 18:14:05.590192 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:14:05.590161 2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5113a00c-04a3-4f6b-bc0d-419d57d1fd9d-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "5113a00c-04a3-4f6b-bc0d-419d57d1fd9d" (UID: "5113a00c-04a3-4f6b-bc0d-419d57d1fd9d"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 14 18:14:05.590388 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:14:05.590357 2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5113a00c-04a3-4f6b-bc0d-419d57d1fd9d-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "5113a00c-04a3-4f6b-bc0d-419d57d1fd9d" (UID: "5113a00c-04a3-4f6b-bc0d-419d57d1fd9d"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 14 18:14:05.590594 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:14:05.590571 2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5113a00c-04a3-4f6b-bc0d-419d57d1fd9d-istio-data" (OuterVolumeSpecName: "istio-data") pod "5113a00c-04a3-4f6b-bc0d-419d57d1fd9d" (UID: "5113a00c-04a3-4f6b-bc0d-419d57d1fd9d"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 14 18:14:05.591875 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:14:05.591846 2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5113a00c-04a3-4f6b-bc0d-419d57d1fd9d-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "5113a00c-04a3-4f6b-bc0d-419d57d1fd9d" (UID: "5113a00c-04a3-4f6b-bc0d-419d57d1fd9d"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 14 18:14:05.591960 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:14:05.591904 2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/5113a00c-04a3-4f6b-bc0d-419d57d1fd9d-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "5113a00c-04a3-4f6b-bc0d-419d57d1fd9d" (UID: "5113a00c-04a3-4f6b-bc0d-419d57d1fd9d"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 14 18:14:05.592093 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:14:05.592080 2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5113a00c-04a3-4f6b-bc0d-419d57d1fd9d-istio-token" (OuterVolumeSpecName: "istio-token") pod "5113a00c-04a3-4f6b-bc0d-419d57d1fd9d" (UID: "5113a00c-04a3-4f6b-bc0d-419d57d1fd9d"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 14 18:14:05.592190 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:14:05.592174 2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5113a00c-04a3-4f6b-bc0d-419d57d1fd9d-kube-api-access-ckhnm" (OuterVolumeSpecName: "kube-api-access-ckhnm") pod "5113a00c-04a3-4f6b-bc0d-419d57d1fd9d" (UID: "5113a00c-04a3-4f6b-bc0d-419d57d1fd9d"). InnerVolumeSpecName "kube-api-access-ckhnm". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 14 18:14:05.690899 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:14:05.690850 2552 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5113a00c-04a3-4f6b-bc0d-419d57d1fd9d-istiod-ca-cert\") on node \"ip-10-0-139-16.ec2.internal\" DevicePath \"\"" Jul 14 18:14:05.690899 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:14:05.690892 2552 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5113a00c-04a3-4f6b-bc0d-419d57d1fd9d-workload-certs\") on node \"ip-10-0-139-16.ec2.internal\" DevicePath \"\"" Jul 14 18:14:05.690899 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:14:05.690901 2552 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5113a00c-04a3-4f6b-bc0d-419d57d1fd9d-istio-envoy\") on node \"ip-10-0-139-16.ec2.internal\" DevicePath \"\"" Jul 14 18:14:05.690899 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:14:05.690911 2552 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5113a00c-04a3-4f6b-bc0d-419d57d1fd9d-credential-socket\") on node \"ip-10-0-139-16.ec2.internal\" DevicePath \"\"" Jul 14 18:14:05.690899 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:14:05.690921 2552 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5113a00c-04a3-4f6b-bc0d-419d57d1fd9d-istio-data\") on node \"ip-10-0-139-16.ec2.internal\" DevicePath \"\"" Jul 14 18:14:05.691216 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:14:05.690930 2552 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5113a00c-04a3-4f6b-bc0d-419d57d1fd9d-istio-podinfo\") on node \"ip-10-0-139-16.ec2.internal\" DevicePath \"\"" Jul 14 18:14:05.691216 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:14:05.690942 2552 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5113a00c-04a3-4f6b-bc0d-419d57d1fd9d-workload-socket\") on node \"ip-10-0-139-16.ec2.internal\" DevicePath \"\"" Jul 14 18:14:05.691216 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:14:05.690950 2552 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ckhnm\" (UniqueName: \"kubernetes.io/projected/5113a00c-04a3-4f6b-bc0d-419d57d1fd9d-kube-api-access-ckhnm\") on node \"ip-10-0-139-16.ec2.internal\" DevicePath \"\"" Jul 14 18:14:05.691216 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:14:05.690960 2552 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5113a00c-04a3-4f6b-bc0d-419d57d1fd9d-istio-token\") on node \"ip-10-0-139-16.ec2.internal\" DevicePath \"\"" Jul 14 18:14:06.090797 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:14:06.090759 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 18:14:06.253844 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:14:06.253806 2552 generic.go:356] "Generic (PLEG): container finished" podID="5113a00c-04a3-4f6b-bc0d-419d57d1fd9d" containerID="c0f6f55435dc6587158e4f24a1b17117920e2add4773d3f43b080f0d134b2567" exitCode=0 Jul 14 18:14:06.254015 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:14:06.253851 2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-8bfa74-openshift-default-58f768484c-25tk5" Jul 14 18:14:06.254015 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:14:06.253889 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-8bfa74-openshift-default-58f768484c-25tk5" event={"ID":"5113a00c-04a3-4f6b-bc0d-419d57d1fd9d","Type":"ContainerDied","Data":"c0f6f55435dc6587158e4f24a1b17117920e2add4773d3f43b080f0d134b2567"} Jul 14 18:14:06.254015 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:14:06.253948 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-8bfa74-openshift-default-58f768484c-25tk5" event={"ID":"5113a00c-04a3-4f6b-bc0d-419d57d1fd9d","Type":"ContainerDied","Data":"967efe22f0b3cdf04e808a623566e6d897809cddfe3c2e7d108040dbe81be739"} Jul 14 18:14:06.254015 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:14:06.253977 2552 scope.go:117] "RemoveContainer" containerID="c0f6f55435dc6587158e4f24a1b17117920e2add4773d3f43b080f0d134b2567" Jul 14 18:14:06.263853 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:14:06.263836 2552 scope.go:117] "RemoveContainer" containerID="1bd0e2bda5654fd694d122565cfa855a892c7e6f5a204d255a3c64f8e93dbb8e" Jul 14 18:14:06.272186 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:14:06.272169 2552 scope.go:117] "RemoveContainer" containerID="c0f6f55435dc6587158e4f24a1b17117920e2add4773d3f43b080f0d134b2567" Jul 14 18:14:06.272490 ip-10-0-139-16 kubenswrapper[2552]: E0714 18:14:06.272471 2552 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c0f6f55435dc6587158e4f24a1b17117920e2add4773d3f43b080f0d134b2567\": container with ID starting with c0f6f55435dc6587158e4f24a1b17117920e2add4773d3f43b080f0d134b2567 not found: ID does not exist" containerID="c0f6f55435dc6587158e4f24a1b17117920e2add4773d3f43b080f0d134b2567" Jul 14 18:14:06.272553 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:14:06.272498 2552 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c0f6f55435dc6587158e4f24a1b17117920e2add4773d3f43b080f0d134b2567"} err="failed to get container status \"c0f6f55435dc6587158e4f24a1b17117920e2add4773d3f43b080f0d134b2567\": rpc error: code = NotFound desc = could not find container \"c0f6f55435dc6587158e4f24a1b17117920e2add4773d3f43b080f0d134b2567\": container with ID starting with c0f6f55435dc6587158e4f24a1b17117920e2add4773d3f43b080f0d134b2567 not found: ID does not exist" Jul 14 18:14:06.272553 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:14:06.272515 2552 scope.go:117] "RemoveContainer" containerID="1bd0e2bda5654fd694d122565cfa855a892c7e6f5a204d255a3c64f8e93dbb8e" Jul 14 18:14:06.272738 ip-10-0-139-16 kubenswrapper[2552]: E0714 18:14:06.272723 2552 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1bd0e2bda5654fd694d122565cfa855a892c7e6f5a204d255a3c64f8e93dbb8e\": container with ID starting with 1bd0e2bda5654fd694d122565cfa855a892c7e6f5a204d255a3c64f8e93dbb8e not found: ID does not exist" containerID="1bd0e2bda5654fd694d122565cfa855a892c7e6f5a204d255a3c64f8e93dbb8e" Jul 14 18:14:06.272776 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:14:06.272745 2552 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1bd0e2bda5654fd694d122565cfa855a892c7e6f5a204d255a3c64f8e93dbb8e"} err="failed to get container status \"1bd0e2bda5654fd694d122565cfa855a892c7e6f5a204d255a3c64f8e93dbb8e\": rpc error: code = NotFound desc = could not find container \"1bd0e2bda5654fd694d122565cfa855a892c7e6f5a204d255a3c64f8e93dbb8e\": container with ID starting with 1bd0e2bda5654fd694d122565cfa855a892c7e6f5a204d255a3c64f8e93dbb8e not found: ID does not exist" Jul 14 18:14:06.276127 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:14:06.276105 2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-8bfa74-openshift-default-58f768484c-25tk5"] Jul 14 18:14:06.280318 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:14:06.280298 2552 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-a-8bfa74-openshift-default-58f768484c-25tk5"] Jul 14 18:14:06.389841 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:14:06.389765 2552 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5113a00c-04a3-4f6b-bc0d-419d57d1fd9d" path="/var/lib/kubelet/pods/5113a00c-04a3-4f6b-bc0d-419d57d1fd9d/volumes" Jul 14 18:14:10.499193 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:14:10.499150 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 18:14:15.162400 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:14:15.162362 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 18:14:21.203692 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:14:21.203656 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 18:14:21.268756 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:14:21.268716 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 18:14:25.856927 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:14:25.856891 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 18:14:27.773763 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:14:27.773725 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 18:14:31.460951 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:14:31.460921 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-mb6zl_2b0ae02a-da46-4ba3-a091-d4e0ded190e2/manager/0.log" Jul 14 18:14:31.715149 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:14:31.715055 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-556ffcbcb6-jlfj5_0b5f6905-9a33-4e7d-8209-e87a91dbbb24/manager/0.log" Jul 14 18:14:31.971109 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:14:31.971025 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-sjtz5_2c067f3c-5c27-4a8e-aead-45a8c3833e28/manager/0.log" Jul 14 18:14:32.199028 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:14:32.199001 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7f54d68b84-rtrt4_cf97b0cc-a58a-428e-a4c1-c1168c8f2d80/copy-manifests/0.log" Jul 14 18:14:32.217123 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:14:32.217099 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7f54d68b84-rtrt4_cf97b0cc-a58a-428e-a4c1-c1168c8f2d80/manager/0.log" Jul 14 18:14:32.691904 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:14:32.691870 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-6df6d6cbc5-x67lq_798a9402-509e-4d58-9191-6d4a87205cc7/maas-api/0.log" Jul 14 18:14:32.806201 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:14:32.806177 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-29734185-dbvhb_3cf0d3ea-31a7-4d45-adaf-fa92cf4c671d/cleanup/0.log" Jul 14 18:14:34.356904 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:14:34.356865 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_postgres-69fb4594cf-g6lfc_e60a6d1d-4529-46f3-8556-cf25512cc582/postgres/0.log" Jul 14 18:14:35.763132 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:14:35.763096 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-7lg8t_578c2ea1-4395-42a4-ac6a-aa1bfb847ee9/manager/0.log" Jul 14 18:14:35.873632 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:14:35.873603 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-kp9dq_c031b503-06a2-4cd3-8d09-6ff2c9b9f022/manager/0.log" Jul 14 18:14:35.982074 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:14:35.982045 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-48sq8_8f4d41a0-b4cd-49ef-ae7d-c33708d00839/kuadrant-console-plugin/0.log" Jul 14 18:14:36.103785 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:14:36.103695 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-t79zt_a122f0fa-fe4a-47d6-842f-280a7cd439c9/registry-server/0.log" Jul 14 18:14:36.227452 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:14:36.227420 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-lb4ft_3e194672-6279-4ac2-949d-0d52b878e633/manager/0.log" Jul 14 18:14:37.145709 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:14:37.145673 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-6dfddfddb9-xqn5r_74153627-7131-4e58-9aa9-446a2d6d4f4d/kube-auth-proxy/0.log" Jul 14 18:14:37.270601 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:14:37.270441 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5896d4dd49-2mfg8_22e7ffc4-a033-449e-9329-aef67ebb6bef/istio-proxy/1.log" Jul 14 18:14:37.399802 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:14:37.399714 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-74584bb9f8-d6jgb_4508bbbe-c5a9-4879-a440-b1f0cf3c81bd/payload-pre-processing/0.log" Jul 14 18:14:37.529898 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:14:37.529865 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-f9b8d9b9b-xvclx_3c4cb565-7bf8-40e7-830f-52b1e50dfa6f/payload-processing/0.log" Jul 14 18:14:37.638631 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:14:37.638603 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-5484d54d6d-2b7v2_9a20f557-1033-431a-8986-88c97723b31c/router/0.log" Jul 14 18:14:37.974517 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:14:37.974487 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-67d8d5d6d-9bbdx_69154cb6-3596-4f8d-b0e6-cdd08c9005e5/main/0.log" Jul 14 18:14:38.087530 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:14:38.087500 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-59975d69f9-gk5p2_a4ff6801-75ad-4082-8db2-4bd025467345/main/0.log" Jul 14 18:14:38.310620 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:14:38.310543 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbh9xd5_d1825f28-d458-4672-b58f-76aaaaeae76b/main/0.log" Jul 14 18:14:42.321993 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:14:42.321955 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 18:14:42.423347 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:14:42.423290 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" limit=1024 Jul 14 18:14:45.109291 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:14:45.109254 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-c9lb7_91eea036-14a4-466b-9006-5c3f7e104bf4/global-pull-secret-syncer/0.log" Jul 14 18:14:45.180976 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:14:45.180944 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-8r8r6_6f839747-4a79-42e4-81ca-00b3b6645d7f/konnectivity-agent/0.log" Jul 14 18:14:45.328985 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:14:45.328953 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-139-16.ec2.internal_8df8d47ff6ebf83b9a6270b9d8e65671/haproxy/0.log" Jul 14 18:14:50.722864 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:14:50.722833 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-7lg8t_578c2ea1-4395-42a4-ac6a-aa1bfb847ee9/manager/0.log" Jul 14 18:14:50.748090 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:14:50.748069 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-kp9dq_c031b503-06a2-4cd3-8d09-6ff2c9b9f022/manager/0.log" Jul 14 18:14:50.771367 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:14:50.771340 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-48sq8_8f4d41a0-b4cd-49ef-ae7d-c33708d00839/kuadrant-console-plugin/0.log" Jul 14 18:14:50.828064 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:14:50.828038 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-t79zt_a122f0fa-fe4a-47d6-842f-280a7cd439c9/registry-server/0.log" Jul 14 18:14:50.980922 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:14:50.980816 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-lb4ft_3e194672-6279-4ac2-949d-0d52b878e633/manager/0.log" Jul 14 18:14:52.986923 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:14:52.986890 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-5f7f494dd4-hznkp_f60de25a-6c7c-41f4-87ce-de3f4eca5c3a/cluster-monitoring-operator/0.log" Jul 14 18:14:53.154570 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:14:53.154539 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-5rbv7_a30f0afb-84e8-44c9-b76f-ff620c6a36b7/node-exporter/0.log" Jul 14 18:14:53.173753 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:14:53.173734 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-5rbv7_a30f0afb-84e8-44c9-b76f-ff620c6a36b7/kube-rbac-proxy/0.log" Jul 14 18:14:53.193181 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:14:53.193162 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-5rbv7_a30f0afb-84e8-44c9-b76f-ff620c6a36b7/init-textfile/0.log" Jul 14 18:14:54.994497 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:14:54.994459 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-4c4r8/perf-node-gather-daemonset-svm84"] Jul 14 18:14:54.995108 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:14:54.995085 2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5113a00c-04a3-4f6b-bc0d-419d57d1fd9d" containerName="istio-proxy" Jul 14 18:14:54.995108 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:14:54.995109 2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="5113a00c-04a3-4f6b-bc0d-419d57d1fd9d" containerName="istio-proxy" Jul 14 18:14:54.995283 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:14:54.995120 2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="94304cba-68d8-49b6-93f3-58ac89d7618d" containerName="test-curl-7417-140101077045296" Jul 14 18:14:54.995283 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:14:54.995129 2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="94304cba-68d8-49b6-93f3-58ac89d7618d" containerName="test-curl-7417-140101077045296" Jul 14 18:14:54.995283 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:14:54.995268 2552 memory_manager.go:368] "RemoveStaleState removing state" podUID="94304cba-68d8-49b6-93f3-58ac89d7618d" containerName="test-curl-7417-140101077045296" Jul 14 18:14:54.995283 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:14:54.995283 2552 memory_manager.go:368] "RemoveStaleState removing state" podUID="5113a00c-04a3-4f6b-bc0d-419d57d1fd9d" containerName="istio-proxy" Jul 14 18:14:54.995505 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:14:54.995293 2552 memory_manager.go:368] "RemoveStaleState removing state" podUID="5113a00c-04a3-4f6b-bc0d-419d57d1fd9d" containerName="istio-proxy" Jul 14 18:14:54.998601 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:14:54.998578 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-4c4r8/perf-node-gather-daemonset-svm84" Jul 14 18:14:54.999909 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:14:54.999890 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-6cf856758c-85r72_e9d1e6ea-2ff1-4ea8-aee5-8f7bac1dcb0f/networking-console-plugin/0.log" Jul 14 18:14:55.001743 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:14:55.001726 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-4c4r8\"/\"openshift-service-ca.crt\"" Jul 14 18:14:55.002984 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:14:55.002941 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-4c4r8\"/\"kube-root-ca.crt\"" Jul 14 18:14:55.003093 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:14:55.003015 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-4c4r8\"/\"default-dockercfg-vpwkq\"" Jul 14 18:14:55.007848 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:14:55.007828 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-4c4r8/perf-node-gather-daemonset-svm84"] Jul 14 18:14:55.022124 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:14:55.022102 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ef26f546-480a-4bfb-a0a8-0abf5c50657b-sys\") pod \"perf-node-gather-daemonset-svm84\" (UID: \"ef26f546-480a-4bfb-a0a8-0abf5c50657b\") " pod="openshift-must-gather-4c4r8/perf-node-gather-daemonset-svm84" Jul 14 18:14:55.022212 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:14:55.022131 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/ef26f546-480a-4bfb-a0a8-0abf5c50657b-podres\") pod \"perf-node-gather-daemonset-svm84\" (UID: \"ef26f546-480a-4bfb-a0a8-0abf5c50657b\") " pod="openshift-must-gather-4c4r8/perf-node-gather-daemonset-svm84" Jul 14 18:14:55.022212 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:14:55.022167 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/ef26f546-480a-4bfb-a0a8-0abf5c50657b-proc\") pod \"perf-node-gather-daemonset-svm84\" (UID: \"ef26f546-480a-4bfb-a0a8-0abf5c50657b\") " pod="openshift-must-gather-4c4r8/perf-node-gather-daemonset-svm84" Jul 14 18:14:55.022212 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:14:55.022206 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wp528\" (UniqueName: \"kubernetes.io/projected/ef26f546-480a-4bfb-a0a8-0abf5c50657b-kube-api-access-wp528\") pod \"perf-node-gather-daemonset-svm84\" (UID: \"ef26f546-480a-4bfb-a0a8-0abf5c50657b\") " pod="openshift-must-gather-4c4r8/perf-node-gather-daemonset-svm84" Jul 14 18:14:55.022366 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:14:55.022235 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ef26f546-480a-4bfb-a0a8-0abf5c50657b-lib-modules\") pod \"perf-node-gather-daemonset-svm84\" (UID: \"ef26f546-480a-4bfb-a0a8-0abf5c50657b\") " pod="openshift-must-gather-4c4r8/perf-node-gather-daemonset-svm84" Jul 14 18:14:55.123468 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:14:55.123435 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ef26f546-480a-4bfb-a0a8-0abf5c50657b-sys\") pod \"perf-node-gather-daemonset-svm84\" (UID: \"ef26f546-480a-4bfb-a0a8-0abf5c50657b\") " pod="openshift-must-gather-4c4r8/perf-node-gather-daemonset-svm84" Jul 14 18:14:55.123660 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:14:55.123469 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/ef26f546-480a-4bfb-a0a8-0abf5c50657b-podres\") pod \"perf-node-gather-daemonset-svm84\" (UID: \"ef26f546-480a-4bfb-a0a8-0abf5c50657b\") " pod="openshift-must-gather-4c4r8/perf-node-gather-daemonset-svm84" Jul 14 18:14:55.123660 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:14:55.123509 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/ef26f546-480a-4bfb-a0a8-0abf5c50657b-proc\") pod \"perf-node-gather-daemonset-svm84\" (UID: \"ef26f546-480a-4bfb-a0a8-0abf5c50657b\") " pod="openshift-must-gather-4c4r8/perf-node-gather-daemonset-svm84" Jul 14 18:14:55.123660 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:14:55.123546 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wp528\" (UniqueName: \"kubernetes.io/projected/ef26f546-480a-4bfb-a0a8-0abf5c50657b-kube-api-access-wp528\") pod \"perf-node-gather-daemonset-svm84\" (UID: \"ef26f546-480a-4bfb-a0a8-0abf5c50657b\") " pod="openshift-must-gather-4c4r8/perf-node-gather-daemonset-svm84" Jul 14 18:14:55.123660 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:14:55.123557 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ef26f546-480a-4bfb-a0a8-0abf5c50657b-sys\") pod \"perf-node-gather-daemonset-svm84\" (UID: \"ef26f546-480a-4bfb-a0a8-0abf5c50657b\") " pod="openshift-must-gather-4c4r8/perf-node-gather-daemonset-svm84" Jul 14 18:14:55.123660 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:14:55.123575 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ef26f546-480a-4bfb-a0a8-0abf5c50657b-lib-modules\") pod \"perf-node-gather-daemonset-svm84\" (UID: \"ef26f546-480a-4bfb-a0a8-0abf5c50657b\") " pod="openshift-must-gather-4c4r8/perf-node-gather-daemonset-svm84" Jul 14 18:14:55.123660 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:14:55.123633 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/ef26f546-480a-4bfb-a0a8-0abf5c50657b-podres\") pod \"perf-node-gather-daemonset-svm84\" (UID: \"ef26f546-480a-4bfb-a0a8-0abf5c50657b\") " pod="openshift-must-gather-4c4r8/perf-node-gather-daemonset-svm84" Jul 14 18:14:55.123660 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:14:55.123639 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/ef26f546-480a-4bfb-a0a8-0abf5c50657b-proc\") pod \"perf-node-gather-daemonset-svm84\" (UID: \"ef26f546-480a-4bfb-a0a8-0abf5c50657b\") " pod="openshift-must-gather-4c4r8/perf-node-gather-daemonset-svm84" Jul 14 18:14:55.123957 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:14:55.123674 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ef26f546-480a-4bfb-a0a8-0abf5c50657b-lib-modules\") pod \"perf-node-gather-daemonset-svm84\" (UID: \"ef26f546-480a-4bfb-a0a8-0abf5c50657b\") " pod="openshift-must-gather-4c4r8/perf-node-gather-daemonset-svm84" Jul 14 18:14:55.131801 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:14:55.131782 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wp528\" (UniqueName: \"kubernetes.io/projected/ef26f546-480a-4bfb-a0a8-0abf5c50657b-kube-api-access-wp528\") pod \"perf-node-gather-daemonset-svm84\" (UID: \"ef26f546-480a-4bfb-a0a8-0abf5c50657b\") " pod="openshift-must-gather-4c4r8/perf-node-gather-daemonset-svm84" Jul 14 18:14:55.310443 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:14:55.310318 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-4c4r8/perf-node-gather-daemonset-svm84" Jul 14 18:14:55.470839 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:14:55.470813 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-4c4r8/perf-node-gather-daemonset-svm84"] Jul 14 18:14:55.472862 ip-10-0-139-16 kubenswrapper[2552]: W0714 18:14:55.472838 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podef26f546_480a_4bfb_a0a8_0abf5c50657b.slice/crio-15eb8649d278dc085dbcb22d3ee15eef41d52a57329f837b00d6520e6dfeca20 WatchSource:0}: Error finding container 15eb8649d278dc085dbcb22d3ee15eef41d52a57329f837b00d6520e6dfeca20: Status 404 returned error can't find the container with id 15eb8649d278dc085dbcb22d3ee15eef41d52a57329f837b00d6520e6dfeca20 Jul 14 18:14:55.503115 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:14:55.503087 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-4c4r8/perf-node-gather-daemonset-svm84" event={"ID":"ef26f546-480a-4bfb-a0a8-0abf5c50657b","Type":"ContainerStarted","Data":"15eb8649d278dc085dbcb22d3ee15eef41d52a57329f837b00d6520e6dfeca20"} Jul 14 18:14:55.666986 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:14:55.666960 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-gnw2z_b3c71861-4db9-4850-a44b-6f5d44a94235/console-operator/2.log" Jul 14 18:14:55.675129 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:14:55.675113 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-gnw2z_b3c71861-4db9-4850-a44b-6f5d44a94235/console-operator/3.log" Jul 14 18:14:56.509923 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:14:56.509888 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-4c4r8/perf-node-gather-daemonset-svm84" event={"ID":"ef26f546-480a-4bfb-a0a8-0abf5c50657b","Type":"ContainerStarted","Data":"b7d57b2b1c9e973ab408886b7421f545104eb4d62da150c295bc691ba44a93e6"} Jul 14 18:14:56.510318 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:14:56.510004 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-4c4r8/perf-node-gather-daemonset-svm84" Jul 14 18:14:56.527390 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:14:56.527319 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-4c4r8/perf-node-gather-daemonset-svm84" podStartSLOduration=2.527301988 podStartE2EDuration="2.527301988s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-14 18:14:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 18:14:56.526110439 +0000 UTC m=+2958.905224391" watchObservedRunningTime="2026-07-14 18:14:56.527301988 +0000 UTC m=+2958.906415943" Jul 14 18:14:56.838630 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:14:56.838544 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-78495597f6-7nwwb_fbb398bf-d6aa-4566-8bdb-a78349ea23c7/volume-data-source-validator/0.log" Jul 14 18:14:57.932904 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:14:57.932850 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-r7tpq_d1d42aeb-1ff1-42fd-a566-fea29b751242/dns/0.log" Jul 14 18:14:57.953161 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:14:57.953133 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-r7tpq_d1d42aeb-1ff1-42fd-a566-fea29b751242/kube-rbac-proxy/0.log" Jul 14 18:14:58.022204 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:14:58.022175 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-g4bts_6a962207-915e-43fc-80f6-3edd2d3451fc/dns-node-resolver/0.log" Jul 14 18:14:58.584281 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:14:58.584253 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-4t8fg_5b08dae7-1558-40a0-bb51-702d6974fc28/node-ca/0.log" Jul 14 18:14:59.709797 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:14:59.709767 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-6dfddfddb9-xqn5r_74153627-7131-4e58-9aa9-446a2d6d4f4d/kube-auth-proxy/0.log" Jul 14 18:14:59.738009 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:14:59.737982 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5896d4dd49-2mfg8_22e7ffc4-a033-449e-9329-aef67ebb6bef/istio-proxy/0.log" Jul 14 18:14:59.796228 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:14:59.796200 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5896d4dd49-2mfg8_22e7ffc4-a033-449e-9329-aef67ebb6bef/istio-proxy/1.log" Jul 14 18:14:59.833153 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:14:59.833114 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-74584bb9f8-d6jgb_4508bbbe-c5a9-4879-a440-b1f0cf3c81bd/payload-pre-processing/0.log" Jul 14 18:14:59.871423 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:14:59.871398 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-f9b8d9b9b-xvclx_3c4cb565-7bf8-40e7-830f-52b1e50dfa6f/payload-processing/0.log" Jul 14 18:14:59.898426 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:14:59.898400 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-5484d54d6d-2b7v2_9a20f557-1033-431a-8986-88c97723b31c/router/0.log" Jul 14 18:15:00.648224 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:15:00.648154 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-w4vkl_c3b4f75d-a278-455b-8de5-d9d580cc77ec/serve-healthcheck-canary/0.log" Jul 14 18:15:01.117168 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:15:01.117138 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-68d9dd94cf-dq264_5a0f3a9b-3347-43e5-910b-229e446543ad/insights-operator/0.log" Jul 14 18:15:01.118125 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:15:01.118097 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-68d9dd94cf-dq264_5a0f3a9b-3347-43e5-910b-229e446543ad/insights-operator/1.log" Jul 14 18:15:01.209338 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:15:01.209306 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-7tgt2_a616b344-63a5-4f64-a433-f2be1e21e745/kube-rbac-proxy/0.log" Jul 14 18:15:01.228826 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:15:01.228799 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-7tgt2_a616b344-63a5-4f64-a433-f2be1e21e745/exporter/0.log" Jul 14 18:15:01.248705 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:15:01.248682 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-7tgt2_a616b344-63a5-4f64-a433-f2be1e21e745/extractor/0.log" Jul 14 18:15:02.525765 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:15:02.525734 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-4c4r8/perf-node-gather-daemonset-svm84" Jul 14 18:15:03.405859 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:15:03.405825 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-mb6zl_2b0ae02a-da46-4ba3-a091-d4e0ded190e2/manager/0.log" Jul 14 18:15:03.843306 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:15:03.843275 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-556ffcbcb6-jlfj5_0b5f6905-9a33-4e7d-8209-e87a91dbbb24/manager/0.log" Jul 14 18:15:03.973794 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:15:03.973762 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-sjtz5_2c067f3c-5c27-4a8e-aead-45a8c3833e28/manager/0.log" Jul 14 18:15:04.147218 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:15:04.147128 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7f54d68b84-rtrt4_cf97b0cc-a58a-428e-a4c1-c1168c8f2d80/manager/0.log" Jul 14 18:15:04.163151 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:15:04.163126 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7f54d68b84-rtrt4_cf97b0cc-a58a-428e-a4c1-c1168c8f2d80/copy-manifests/0.log" Jul 14 18:15:06.054359 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:15:06.054318 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-6dfddfddb9-xqn5r_74153627-7131-4e58-9aa9-446a2d6d4f4d/kube-auth-proxy/0.log" Jul 14 18:15:06.075600 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:15:06.075564 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5896d4dd49-2mfg8_22e7ffc4-a033-449e-9329-aef67ebb6bef/istio-proxy/0.log" Jul 14 18:15:06.134718 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:15:06.134616 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5896d4dd49-2mfg8_22e7ffc4-a033-449e-9329-aef67ebb6bef/istio-proxy/1.log" Jul 14 18:15:06.163178 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:15:06.163143 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-74584bb9f8-d6jgb_4508bbbe-c5a9-4879-a440-b1f0cf3c81bd/payload-pre-processing/0.log" Jul 14 18:15:06.194806 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:15:06.194779 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-f9b8d9b9b-xvclx_3c4cb565-7bf8-40e7-830f-52b1e50dfa6f/payload-processing/0.log" Jul 14 18:15:06.210687 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:15:06.210650 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-5484d54d6d-2b7v2_9a20f557-1033-431a-8986-88c97723b31c/router/0.log" Jul 14 18:15:07.479405 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:15:07.479375 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-6dfddfddb9-xqn5r_74153627-7131-4e58-9aa9-446a2d6d4f4d/kube-auth-proxy/0.log" Jul 14 18:15:07.502390 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:15:07.502367 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5896d4dd49-2mfg8_22e7ffc4-a033-449e-9329-aef67ebb6bef/istio-proxy/0.log" Jul 14 18:15:07.560957 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:15:07.560930 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5896d4dd49-2mfg8_22e7ffc4-a033-449e-9329-aef67ebb6bef/istio-proxy/1.log" Jul 14 18:15:07.593137 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:15:07.593074 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-74584bb9f8-d6jgb_4508bbbe-c5a9-4879-a440-b1f0cf3c81bd/payload-pre-processing/0.log" Jul 14 18:15:07.622851 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:15:07.622818 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-f9b8d9b9b-xvclx_3c4cb565-7bf8-40e7-830f-52b1e50dfa6f/payload-processing/0.log" Jul 14 18:15:07.645311 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:15:07.645284 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-5484d54d6d-2b7v2_9a20f557-1033-431a-8986-88c97723b31c/router/0.log" Jul 14 18:15:10.505593 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:15:10.505550 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-7f59b54f6c-w28cd_258a76f8-f467-4a03-b3fa-b118cb969775/migrator/0.log" Jul 14 18:15:10.525534 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:15:10.525504 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-7f59b54f6c-w28cd_258a76f8-f467-4a03-b3fa-b118cb969775/graceful-termination/0.log" Jul 14 18:15:10.895507 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:15:10.895411 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-799cb7f958-6xn2k_62900e1e-659d-4c6e-9e31-2933f84ebc70/kube-storage-version-migrator-operator/1.log" Jul 14 18:15:10.896980 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:15:10.896955 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-799cb7f958-6xn2k_62900e1e-659d-4c6e-9e31-2933f84ebc70/kube-storage-version-migrator-operator/0.log" Jul 14 18:15:11.914279 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:15:11.914253 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-5zj72_d84237cc-b659-4943-b3da-ab9f602d4f86/kube-multus-additional-cni-plugins/0.log" Jul 14 18:15:11.934738 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:15:11.934718 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-5zj72_d84237cc-b659-4943-b3da-ab9f602d4f86/egress-router-binary-copy/0.log" Jul 14 18:15:11.954762 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:15:11.954729 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-5zj72_d84237cc-b659-4943-b3da-ab9f602d4f86/cni-plugins/0.log" Jul 14 18:15:11.974121 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:15:11.974094 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-5zj72_d84237cc-b659-4943-b3da-ab9f602d4f86/bond-cni-plugin/0.log" Jul 14 18:15:11.993873 ip-10-0-139-16 kubenswrapper[2552]: I0714 18:15:11.993831 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-5zj72_d84237cc-b659-4943-b3da-ab9f602d4f86/routeoverride-cni/0.log"