Jul 27 20:32:16.892708 ip-10-0-139-2 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Jul 27 20:32:16.892720 ip-10-0-139-2 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Jul 27 20:32:16.892726 ip-10-0-139-2 systemd[1]: kubelet.service: Failed with result 'resources'. Jul 27 20:32:16.892961 ip-10-0-139-2 systemd[1]: Failed to start Kubernetes Kubelet. Jul 27 20:32:26.993101 ip-10-0-139-2 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. Jul 27 20:32:26.993119 ip-10-0-139-2 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot dab03b89c9ba4fdab9aa71d4e4f033ff -- Jul 27 20:34:26.416616 ip-10-0-139-2 systemd[1]: Starting Kubernetes Kubelet... Jul 27 20:34:26.798637 ip-10-0-139-2 kubenswrapper[2572]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 27 20:34:26.798637 ip-10-0-139-2 kubenswrapper[2572]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 27 20:34:26.798637 ip-10-0-139-2 kubenswrapper[2572]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 27 20:34:26.798637 ip-10-0-139-2 kubenswrapper[2572]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 27 20:34:26.798637 ip-10-0-139-2 kubenswrapper[2572]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 27 20:34:26.799353 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:26.798693 2572 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 27 20:34:26.803359 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:34:26.803343 2572 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 27 20:34:26.803359 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:34:26.803358 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 27 20:34:26.803359 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:34:26.803362 2572 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 27 20:34:26.803540 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:34:26.803365 2572 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 27 20:34:26.803540 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:34:26.803369 2572 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 27 20:34:26.803540 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:34:26.803372 2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 27 20:34:26.803540 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:34:26.803376 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 27 20:34:26.803540 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:34:26.803379 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 27 20:34:26.803540 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:34:26.803383 2572 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 27 20:34:26.803540 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:34:26.803386 2572 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 27 20:34:26.803540 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:34:26.803388 2572 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 27 20:34:26.803540 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:34:26.803391 2572 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 27 20:34:26.803540 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:34:26.803393 2572 feature_gate.go:328] unrecognized feature gate: Example Jul 27 20:34:26.803540 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:34:26.803396 2572 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 27 20:34:26.803540 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:34:26.803399 2572 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 27 20:34:26.803540 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:34:26.803401 2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 27 20:34:26.803540 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:34:26.803404 2572 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 27 20:34:26.803540 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:34:26.803406 2572 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 27 20:34:26.803540 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:34:26.803409 2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 27 20:34:26.803540 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:34:26.803415 2572 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 27 20:34:26.803540 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:34:26.803418 2572 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 27 20:34:26.803540 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:34:26.803421 2572 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 27 20:34:26.803540 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:34:26.803423 2572 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 27 20:34:26.804017 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:34:26.803426 2572 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 27 20:34:26.804017 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:34:26.803428 2572 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 27 20:34:26.804017 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:34:26.803431 2572 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 27 20:34:26.804017 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:34:26.803434 2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 27 20:34:26.804017 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:34:26.803437 2572 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 27 20:34:26.804017 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:34:26.803440 2572 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 27 20:34:26.804017 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:34:26.803442 2572 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 27 20:34:26.804017 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:34:26.803445 2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 27 20:34:26.804017 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:34:26.803447 2572 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 27 20:34:26.804017 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:34:26.803450 2572 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 27 20:34:26.804017 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:34:26.803453 2572 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 27 20:34:26.804017 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:34:26.803455 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 27 20:34:26.804017 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:34:26.803459 2572 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 27 20:34:26.804017 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:34:26.803465 2572 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 27 20:34:26.804017 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:34:26.803468 2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 27 20:34:26.804017 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:34:26.803471 2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 27 20:34:26.804017 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:34:26.803475 2572 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 27 20:34:26.804017 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:34:26.803477 2572 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 27 20:34:26.804017 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:34:26.803480 2572 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 27 20:34:26.804529 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:34:26.803483 2572 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 27 20:34:26.804529 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:34:26.803486 2572 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 27 20:34:26.804529 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:34:26.803488 2572 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 27 20:34:26.804529 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:34:26.803491 2572 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 27 20:34:26.804529 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:34:26.803493 2572 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 27 20:34:26.804529 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:34:26.803496 2572 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 27 20:34:26.804529 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:34:26.803499 2572 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 27 20:34:26.804529 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:34:26.803501 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 27 20:34:26.804529 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:34:26.803504 2572 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 27 20:34:26.804529 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:34:26.803508 2572 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 27 20:34:26.804529 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:34:26.803515 2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 27 20:34:26.804529 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:34:26.803518 2572 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 27 20:34:26.804529 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:34:26.803521 2572 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 27 20:34:26.804529 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:34:26.803524 2572 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 27 20:34:26.804529 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:34:26.803527 2572 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 27 20:34:26.804529 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:34:26.803529 2572 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 27 20:34:26.804529 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:34:26.803532 2572 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 27 20:34:26.804529 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:34:26.803535 2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 27 20:34:26.804529 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:34:26.803538 2572 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 27 20:34:26.804529 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:34:26.803540 2572 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 27 20:34:26.805012 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:34:26.803543 2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 27 20:34:26.805012 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:34:26.803546 2572 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 27 20:34:26.805012 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:34:26.803548 2572 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 27 20:34:26.805012 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:34:26.803550 2572 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 27 20:34:26.805012 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:34:26.803553 2572 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 27 20:34:26.805012 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:34:26.803556 2572 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 27 20:34:26.805012 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:34:26.803559 2572 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 27 20:34:26.805012 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:34:26.803562 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 27 20:34:26.805012 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:34:26.803565 2572 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 27 20:34:26.805012 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:34:26.803568 2572 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 27 20:34:26.805012 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:34:26.803570 2572 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 27 20:34:26.805012 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:34:26.803573 2572 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 27 20:34:26.805012 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:34:26.803576 2572 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 27 20:34:26.805012 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:34:26.803579 2572 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 27 20:34:26.805012 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:34:26.803581 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 27 20:34:26.805012 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:34:26.803584 2572 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 27 20:34:26.805012 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:34:26.803586 2572 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 27 20:34:26.805012 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:34:26.803589 2572 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 27 20:34:26.805012 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:34:26.803592 2572 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 27 20:34:26.805524 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:34:26.803594 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 27 20:34:26.805524 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:34:26.803597 2572 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 27 20:34:26.805524 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:34:26.803599 2572 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 27 20:34:26.805524 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:34:26.803602 2572 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 27 20:34:26.805524 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:34:26.803605 2572 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 27 20:34:26.805524 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:34:26.803608 2572 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 27 20:34:26.805524 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:34:26.803611 2572 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 27 20:34:26.805524 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:34:26.803615 2572 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 27 20:34:26.805524 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:34:26.803618 2572 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 27 20:34:26.805524 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:34:26.803620 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 27 20:34:26.805524 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:34:26.803623 2572 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 27 20:34:26.805524 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:34:26.803625 2572 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 27 20:34:26.805524 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:34:26.803628 2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 27 20:34:26.805524 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:34:26.803630 2572 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 27 20:34:26.805524 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:34:26.803633 2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 27 20:34:26.805524 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:34:26.803635 2572 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 27 20:34:26.805524 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:34:26.803638 2572 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 27 20:34:26.805524 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:34:26.803640 2572 feature_gate.go:328] unrecognized feature gate: Example2 Jul 27 20:34:26.805524 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:34:26.804342 2572 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 27 20:34:26.805524 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:34:26.804350 2572 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 27 20:34:26.806040 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:34:26.804353 2572 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 27 20:34:26.806040 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:34:26.804355 2572 feature_gate.go:328] unrecognized feature gate: Example Jul 27 20:34:26.806040 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:34:26.804358 2572 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 27 20:34:26.806040 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:34:26.804361 2572 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 27 20:34:26.806040 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:34:26.804363 2572 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 27 20:34:26.806040 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:34:26.804366 2572 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 27 20:34:26.806040 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:34:26.804369 2572 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 27 20:34:26.806040 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:34:26.804372 2572 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 27 20:34:26.806040 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:34:26.804374 2572 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 27 20:34:26.806040 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:34:26.804377 2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 27 20:34:26.806040 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:34:26.804379 2572 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 27 20:34:26.806040 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:34:26.804382 2572 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 27 20:34:26.806040 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:34:26.804384 2572 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 27 20:34:26.806040 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:34:26.804387 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 27 20:34:26.806040 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:34:26.804389 2572 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 27 20:34:26.806040 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:34:26.804392 2572 feature_gate.go:328] unrecognized feature gate: Example2 Jul 27 20:34:26.806040 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:34:26.804394 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 27 20:34:26.806040 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:34:26.804397 2572 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 27 20:34:26.806040 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:34:26.804400 2572 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 27 20:34:26.806040 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:34:26.804403 2572 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 27 20:34:26.806040 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:34:26.804405 2572 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 27 20:34:26.806619 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:34:26.804407 2572 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 27 20:34:26.806619 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:34:26.804410 2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 27 20:34:26.806619 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:34:26.804413 2572 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 27 20:34:26.806619 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:34:26.804415 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 27 20:34:26.806619 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:34:26.804418 2572 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 27 20:34:26.806619 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:34:26.804420 2572 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 27 20:34:26.806619 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:34:26.804423 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 27 20:34:26.806619 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:34:26.804425 2572 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 27 20:34:26.806619 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:34:26.804428 2572 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 27 20:34:26.806619 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:34:26.804431 2572 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 27 20:34:26.806619 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:34:26.804434 2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 27 20:34:26.806619 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:34:26.804437 2572 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 27 20:34:26.806619 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:34:26.804439 2572 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 27 20:34:26.806619 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:34:26.804442 2572 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 27 20:34:26.806619 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:34:26.804445 2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 27 20:34:26.806619 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:34:26.804447 2572 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 27 20:34:26.806619 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:34:26.804449 2572 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 27 20:34:26.806619 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:34:26.804452 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 27 20:34:26.806619 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:34:26.804455 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 27 20:34:26.807083 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:34:26.804457 2572 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 27 20:34:26.807083 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:34:26.804460 2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 27 20:34:26.807083 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:34:26.804462 2572 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 27 20:34:26.807083 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:34:26.804464 2572 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 27 20:34:26.807083 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:34:26.804467 2572 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 27 20:34:26.807083 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:34:26.804471 2572 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 27 20:34:26.807083 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:34:26.804475 2572 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 27 20:34:26.807083 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:34:26.804478 2572 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 27 20:34:26.807083 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:34:26.804481 2572 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 27 20:34:26.807083 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:34:26.804483 2572 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 27 20:34:26.807083 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:34:26.804489 2572 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 27 20:34:26.807083 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:34:26.804491 2572 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 27 20:34:26.807083 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:34:26.804494 2572 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 27 20:34:26.807083 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:34:26.804497 2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 27 20:34:26.807083 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:34:26.804499 2572 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 27 20:34:26.807083 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:34:26.804502 2572 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 27 20:34:26.807083 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:34:26.804506 2572 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 27 20:34:26.807083 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:34:26.804509 2572 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 27 20:34:26.807083 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:34:26.804512 2572 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 27 20:34:26.807559 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:34:26.804515 2572 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 27 20:34:26.807559 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:34:26.804518 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 27 20:34:26.807559 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:34:26.804521 2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 27 20:34:26.807559 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:34:26.804525 2572 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 27 20:34:26.807559 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:34:26.804529 2572 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 27 20:34:26.807559 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:34:26.804532 2572 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 27 20:34:26.807559 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:34:26.804534 2572 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 27 20:34:26.807559 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:34:26.804537 2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 27 20:34:26.807559 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:34:26.804540 2572 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 27 20:34:26.807559 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:34:26.804543 2572 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 27 20:34:26.807559 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:34:26.804545 2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 27 20:34:26.807559 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:34:26.804548 2572 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 27 20:34:26.807559 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:34:26.804550 2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 27 20:34:26.807559 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:34:26.804553 2572 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 27 20:34:26.807559 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:34:26.804556 2572 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 27 20:34:26.807559 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:34:26.804559 2572 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 27 20:34:26.807559 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:34:26.804562 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 27 20:34:26.807559 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:34:26.804565 2572 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 27 20:34:26.807559 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:34:26.804568 2572 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 27 20:34:26.807559 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:34:26.804570 2572 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 27 20:34:26.808046 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:34:26.804573 2572 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 27 20:34:26.808046 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:34:26.804575 2572 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 27 20:34:26.808046 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:34:26.804579 2572 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 27 20:34:26.808046 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:34:26.804582 2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 27 20:34:26.808046 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:34:26.804586 2572 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 27 20:34:26.808046 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:34:26.804588 2572 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 27 20:34:26.808046 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:34:26.804591 2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 27 20:34:26.808046 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:34:26.804594 2572 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 27 20:34:26.808046 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:34:26.804596 2572 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 27 20:34:26.808046 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:34:26.804598 2572 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 27 20:34:26.808046 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:34:26.804601 2572 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 27 20:34:26.808046 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:34:26.804603 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 27 20:34:26.808046 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:34:26.804606 2572 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 27 20:34:26.808046 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:34:26.804608 2572 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 27 20:34:26.808046 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:34:26.804611 2572 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 27 20:34:26.808046 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:34:26.804616 2572 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 27 20:34:26.808046 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:34:26.804619 2572 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 27 20:34:26.808046 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:34:26.804622 2572 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 27 20:34:26.808046 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:34:26.804960 2572 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 27 20:34:26.808540 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:34:26.804964 2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 27 20:34:26.808540 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:34:26.804967 2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 27 20:34:26.808540 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:34:26.804970 2572 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 27 20:34:26.808540 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:34:26.804973 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 27 20:34:26.808540 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:34:26.804976 2572 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 27 20:34:26.808540 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:34:26.804979 2572 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 27 20:34:26.808540 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:34:26.804981 2572 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 27 20:34:26.808540 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:34:26.804984 2572 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 27 20:34:26.808540 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:34:26.804987 2572 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 27 20:34:26.808540 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:34:26.804989 2572 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 27 20:34:26.808540 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:34:26.804992 2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 27 20:34:26.808540 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:34:26.804994 2572 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 27 20:34:26.808540 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:34:26.804996 2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 27 20:34:26.808540 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:34:26.804999 2572 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 27 20:34:26.808540 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:34:26.805001 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 27 20:34:26.808540 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:34:26.805004 2572 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 27 20:34:26.808540 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:34:26.805007 2572 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 27 20:34:26.808540 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:34:26.805017 2572 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 27 20:34:26.808540 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:34:26.805020 2572 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 27 20:34:26.808540 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:34:26.805022 2572 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 27 20:34:26.809018 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:34:26.805025 2572 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 27 20:34:26.809018 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:34:26.805028 2572 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 27 20:34:26.809018 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:34:26.805030 2572 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 27 20:34:26.809018 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:34:26.805033 2572 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 27 20:34:26.809018 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:34:26.805035 2572 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 27 20:34:26.809018 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:34:26.805038 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 27 20:34:26.809018 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:34:26.805041 2572 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 27 20:34:26.809018 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:34:26.805045 2572 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 27 20:34:26.809018 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:34:26.805048 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 27 20:34:26.809018 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:34:26.805051 2572 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 27 20:34:26.809018 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:34:26.805054 2572 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 27 20:34:26.809018 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:34:26.805057 2572 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 27 20:34:26.809018 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:34:26.805060 2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 27 20:34:26.809018 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:34:26.805062 2572 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 27 20:34:26.809018 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:34:26.805064 2572 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 27 20:34:26.809018 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:34:26.805067 2572 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 27 20:34:26.809018 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:34:26.805069 2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 27 20:34:26.809018 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:34:26.805072 2572 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 27 20:34:26.809018 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:34:26.805075 2572 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 27 20:34:26.809490 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:34:26.805077 2572 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 27 20:34:26.809490 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:34:26.805080 2572 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 27 20:34:26.809490 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:34:26.805083 2572 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 27 20:34:26.809490 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:34:26.805085 2572 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 27 20:34:26.809490 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:34:26.805088 2572 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 27 20:34:26.809490 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:34:26.805090 2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 27 20:34:26.809490 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:34:26.805092 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 27 20:34:26.809490 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:34:26.805095 2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 27 20:34:26.809490 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:34:26.805097 2572 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 27 20:34:26.809490 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:34:26.805100 2572 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 27 20:34:26.809490 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:34:26.805104 2572 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 27 20:34:26.809490 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:34:26.805112 2572 feature_gate.go:328] unrecognized feature gate: Example Jul 27 20:34:26.809490 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:34:26.805116 2572 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 27 20:34:26.809490 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:34:26.805120 2572 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 27 20:34:26.809490 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:34:26.805123 2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 27 20:34:26.809490 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:34:26.805126 2572 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 27 20:34:26.809490 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:34:26.805129 2572 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 27 20:34:26.809490 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:34:26.805133 2572 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 27 20:34:26.809490 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:34:26.805136 2572 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 27 20:34:26.809959 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:34:26.805139 2572 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 27 20:34:26.809959 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:34:26.805142 2572 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 27 20:34:26.809959 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:34:26.805144 2572 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 27 20:34:26.809959 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:34:26.805147 2572 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 27 20:34:26.809959 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:34:26.805150 2572 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 27 20:34:26.809959 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:34:26.805152 2572 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 27 20:34:26.809959 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:34:26.805155 2572 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 27 20:34:26.809959 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:34:26.805157 2572 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 27 20:34:26.809959 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:34:26.805160 2572 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 27 20:34:26.809959 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:34:26.805168 2572 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 27 20:34:26.809959 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:34:26.805170 2572 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 27 20:34:26.809959 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:34:26.805173 2572 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 27 20:34:26.809959 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:34:26.805175 2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 27 20:34:26.809959 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:34:26.805178 2572 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 27 20:34:26.809959 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:34:26.805180 2572 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 27 20:34:26.809959 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:34:26.805183 2572 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 27 20:34:26.809959 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:34:26.805185 2572 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 27 20:34:26.809959 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:34:26.805188 2572 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 27 20:34:26.809959 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:34:26.805190 2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 27 20:34:26.810443 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:34:26.805193 2572 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 27 20:34:26.810443 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:34:26.805195 2572 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 27 20:34:26.810443 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:34:26.805198 2572 feature_gate.go:328] unrecognized feature gate: Example2 Jul 27 20:34:26.810443 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:34:26.805200 2572 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 27 20:34:26.810443 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:34:26.805202 2572 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 27 20:34:26.810443 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:34:26.805205 2572 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 27 20:34:26.810443 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:34:26.805213 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 27 20:34:26.810443 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:34:26.805216 2572 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 27 20:34:26.810443 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:34:26.805219 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 27 20:34:26.810443 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:34:26.805221 2572 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 27 20:34:26.810443 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:34:26.805224 2572 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 27 20:34:26.810443 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:34:26.805227 2572 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 27 20:34:26.810443 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:34:26.805230 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 27 20:34:26.810443 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:34:26.805232 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 27 20:34:26.810443 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:34:26.805235 2572 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 27 20:34:26.810443 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:34:26.805238 2572 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 27 20:34:26.810443 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:34:26.805241 2572 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 27 20:34:26.810443 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:34:26.805243 2572 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 27 20:34:26.810443 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:34:26.805246 2572 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 27 20:34:26.810443 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:34:26.805248 2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 27 20:34:26.810915 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:34:26.805251 2572 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 27 20:34:26.810915 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:26.805334 2572 flags.go:64] FLAG: --address="0.0.0.0" Jul 27 20:34:26.810915 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:26.805341 2572 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 27 20:34:26.810915 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:26.805347 2572 flags.go:64] FLAG: --anonymous-auth="true" Jul 27 20:34:26.810915 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:26.805351 2572 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 27 20:34:26.810915 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:26.805355 2572 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 27 20:34:26.810915 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:26.805358 2572 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 27 20:34:26.810915 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:26.805363 2572 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 27 20:34:26.810915 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:26.805367 2572 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 27 20:34:26.810915 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:26.805370 2572 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 27 20:34:26.810915 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:26.805373 2572 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 27 20:34:26.810915 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:26.805376 2572 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 27 20:34:26.810915 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:26.805379 2572 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 27 20:34:26.810915 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:26.805382 2572 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 27 20:34:26.810915 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:26.805385 2572 flags.go:64] FLAG: --cgroup-root="" Jul 27 20:34:26.810915 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:26.805388 2572 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 27 20:34:26.810915 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:26.805391 2572 flags.go:64] FLAG: --client-ca-file="" Jul 27 20:34:26.810915 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:26.805394 2572 flags.go:64] FLAG: --cloud-provider="external" Jul 27 20:34:26.810915 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:26.805397 2572 flags.go:64] FLAG: --cluster-dns="[]" Jul 27 20:34:26.810915 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:26.805402 2572 flags.go:64] FLAG: --cluster-domain="" Jul 27 20:34:26.810915 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:26.805405 2572 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 27 20:34:26.810915 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:26.805408 2572 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 27 20:34:26.810915 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:26.805411 2572 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 27 20:34:26.810915 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:26.805416 2572 flags.go:64] FLAG: --container-log-max-files="5" Jul 27 20:34:26.811501 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:26.805420 2572 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 27 20:34:26.811501 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:26.805422 2572 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 27 20:34:26.811501 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:26.805425 2572 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 27 20:34:26.811501 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:26.805429 2572 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 27 20:34:26.811501 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:26.805432 2572 flags.go:64] FLAG: --contention-profiling="false" Jul 27 20:34:26.811501 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:26.805435 2572 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 27 20:34:26.811501 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:26.805438 2572 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 27 20:34:26.811501 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:26.805441 2572 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 27 20:34:26.811501 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:26.805444 2572 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 27 20:34:26.811501 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:26.805448 2572 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 27 20:34:26.811501 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:26.805451 2572 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 27 20:34:26.811501 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:26.805454 2572 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 27 20:34:26.811501 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:26.805457 2572 flags.go:64] FLAG: --enable-load-reader="false" Jul 27 20:34:26.811501 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:26.805460 2572 flags.go:64] FLAG: --enable-server="true" Jul 27 20:34:26.811501 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:26.805462 2572 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 27 20:34:26.811501 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:26.805466 2572 flags.go:64] FLAG: --event-burst="100" Jul 27 20:34:26.811501 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:26.805469 2572 flags.go:64] FLAG: --event-qps="50" Jul 27 20:34:26.811501 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:26.805472 2572 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 27 20:34:26.811501 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:26.805475 2572 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 27 20:34:26.811501 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:26.805478 2572 flags.go:64] FLAG: --eviction-hard="" Jul 27 20:34:26.811501 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:26.805482 2572 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 27 20:34:26.811501 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:26.805485 2572 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 27 20:34:26.811501 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:26.805487 2572 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 27 20:34:26.811501 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:26.805490 2572 flags.go:64] FLAG: --eviction-soft="" Jul 27 20:34:26.811501 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:26.805493 2572 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 27 20:34:26.812175 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:26.805496 2572 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 27 20:34:26.812175 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:26.805499 2572 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 27 20:34:26.812175 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:26.805502 2572 flags.go:64] FLAG: --experimental-mounter-path="" Jul 27 20:34:26.812175 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:26.805505 2572 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 27 20:34:26.812175 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:26.805508 2572 flags.go:64] FLAG: --fail-swap-on="true" Jul 27 20:34:26.812175 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:26.805510 2572 flags.go:64] FLAG: --feature-gates="" Jul 27 20:34:26.812175 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:26.805515 2572 flags.go:64] FLAG: --file-check-frequency="20s" Jul 27 20:34:26.812175 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:26.805518 2572 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 27 20:34:26.812175 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:26.805521 2572 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 27 20:34:26.812175 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:26.805524 2572 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 27 20:34:26.812175 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:26.805529 2572 flags.go:64] FLAG: --healthz-port="10248" Jul 27 20:34:26.812175 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:26.805532 2572 flags.go:64] FLAG: --help="false" Jul 27 20:34:26.812175 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:26.805535 2572 flags.go:64] FLAG: --hostname-override="ip-10-0-139-2.ec2.internal" Jul 27 20:34:26.812175 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:26.805539 2572 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 27 20:34:26.812175 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:26.805542 2572 flags.go:64] FLAG: --http-check-frequency="20s" Jul 27 20:34:26.812175 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:26.805545 2572 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 27 20:34:26.812175 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:26.805548 2572 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 27 20:34:26.812175 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:26.805552 2572 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 27 20:34:26.812175 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:26.805555 2572 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 27 20:34:26.812175 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:26.805557 2572 flags.go:64] FLAG: --image-service-endpoint="" Jul 27 20:34:26.812175 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:26.805560 2572 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 27 20:34:26.812175 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:26.805563 2572 flags.go:64] FLAG: --kube-api-burst="100" Jul 27 20:34:26.812175 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:26.805566 2572 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 27 20:34:26.812783 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:26.805569 2572 flags.go:64] FLAG: --kube-api-qps="50" Jul 27 20:34:26.812783 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:26.805572 2572 flags.go:64] FLAG: --kube-reserved="" Jul 27 20:34:26.812783 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:26.805575 2572 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 27 20:34:26.812783 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:26.805577 2572 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 27 20:34:26.812783 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:26.805580 2572 flags.go:64] FLAG: --kubelet-cgroups="" Jul 27 20:34:26.812783 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:26.805583 2572 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 27 20:34:26.812783 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:26.805586 2572 flags.go:64] FLAG: --lock-file="" Jul 27 20:34:26.812783 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:26.805589 2572 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 27 20:34:26.812783 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:26.805592 2572 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 27 20:34:26.812783 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:26.805595 2572 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 27 20:34:26.812783 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:26.805600 2572 flags.go:64] FLAG: --log-json-split-stream="false" Jul 27 20:34:26.812783 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:26.805603 2572 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 27 20:34:26.812783 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:26.805605 2572 flags.go:64] FLAG: --log-text-split-stream="false" Jul 27 20:34:26.812783 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:26.805616 2572 flags.go:64] FLAG: --logging-format="text" Jul 27 20:34:26.812783 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:26.805619 2572 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 27 20:34:26.812783 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:26.805625 2572 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 27 20:34:26.812783 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:26.805627 2572 flags.go:64] FLAG: --manifest-url="" Jul 27 20:34:26.812783 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:26.805630 2572 flags.go:64] FLAG: --manifest-url-header="" Jul 27 20:34:26.812783 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:26.805638 2572 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 27 20:34:26.812783 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:26.805642 2572 flags.go:64] FLAG: --max-open-files="1000000" Jul 27 20:34:26.812783 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:26.805646 2572 flags.go:64] FLAG: --max-pods="110" Jul 27 20:34:26.812783 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:26.805649 2572 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 27 20:34:26.812783 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:26.805652 2572 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 27 20:34:26.812783 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:26.805655 2572 flags.go:64] FLAG: --memory-manager-policy="None" Jul 27 20:34:26.812783 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:26.805658 2572 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 27 20:34:26.813402 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:26.805660 2572 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 27 20:34:26.813402 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:26.805663 2572 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 27 20:34:26.813402 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:26.805666 2572 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 27 20:34:26.813402 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:26.805673 2572 flags.go:64] FLAG: --node-status-max-images="50" Jul 27 20:34:26.813402 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:26.805676 2572 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 27 20:34:26.813402 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:26.805679 2572 flags.go:64] FLAG: --oom-score-adj="-999" Jul 27 20:34:26.813402 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:26.805682 2572 flags.go:64] FLAG: --pod-cidr="" Jul 27 20:34:26.813402 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:26.805685 2572 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7505336a406394b8c1c77d14d890a9f628aa4cfff172312179cb9af8c28c30bb" Jul 27 20:34:26.813402 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:26.805690 2572 flags.go:64] FLAG: --pod-manifest-path="" Jul 27 20:34:26.813402 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:26.805693 2572 flags.go:64] FLAG: --pod-max-pids="-1" Jul 27 20:34:26.813402 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:26.805696 2572 flags.go:64] FLAG: --pods-per-core="0" Jul 27 20:34:26.813402 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:26.805699 2572 flags.go:64] FLAG: --port="10250" Jul 27 20:34:26.813402 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:26.805702 2572 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 27 20:34:26.813402 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:26.805705 2572 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-09cf9f52c99bc6871" Jul 27 20:34:26.813402 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:26.805708 2572 flags.go:64] FLAG: --qos-reserved="" Jul 27 20:34:26.813402 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:26.805711 2572 flags.go:64] FLAG: --read-only-port="10255" Jul 27 20:34:26.813402 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:26.805713 2572 flags.go:64] FLAG: --register-node="true" Jul 27 20:34:26.813402 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:26.805716 2572 flags.go:64] FLAG: --register-with-taints="" Jul 27 20:34:26.813402 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:26.805720 2572 flags.go:64] FLAG: --registry-burst="10" Jul 27 20:34:26.813402 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:26.805723 2572 flags.go:64] FLAG: --registry-qps="5" Jul 27 20:34:26.813402 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:26.805725 2572 flags.go:64] FLAG: --reserved-cpus="" Jul 27 20:34:26.813402 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:26.805736 2572 flags.go:64] FLAG: --reserved-memory="" Jul 27 20:34:26.813402 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:26.805739 2572 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 27 20:34:26.813402 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:26.805745 2572 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 27 20:34:26.813402 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:26.805748 2572 flags.go:64] FLAG: --rotate-certificates="false" Jul 27 20:34:26.814020 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:26.805751 2572 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 27 20:34:26.814020 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:26.805755 2572 flags.go:64] FLAG: --runonce="false" Jul 27 20:34:26.814020 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:26.805758 2572 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 27 20:34:26.814020 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:26.805761 2572 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 27 20:34:26.814020 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:26.805764 2572 flags.go:64] FLAG: --seccomp-default="false" Jul 27 20:34:26.814020 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:26.805767 2572 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 27 20:34:26.814020 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:26.805770 2572 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 27 20:34:26.814020 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:26.805773 2572 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 27 20:34:26.814020 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:26.805776 2572 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 27 20:34:26.814020 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:26.805779 2572 flags.go:64] FLAG: --storage-driver-password="root" Jul 27 20:34:26.814020 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:26.805782 2572 flags.go:64] FLAG: --storage-driver-secure="false" Jul 27 20:34:26.814020 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:26.805785 2572 flags.go:64] FLAG: --storage-driver-table="stats" Jul 27 20:34:26.814020 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:26.805787 2572 flags.go:64] FLAG: --storage-driver-user="root" Jul 27 20:34:26.814020 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:26.805790 2572 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 27 20:34:26.814020 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:26.805793 2572 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 27 20:34:26.814020 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:26.805796 2572 flags.go:64] FLAG: --system-cgroups="" Jul 27 20:34:26.814020 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:26.805799 2572 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 27 20:34:26.814020 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:26.805804 2572 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 27 20:34:26.814020 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:26.805807 2572 flags.go:64] FLAG: --tls-cert-file="" Jul 27 20:34:26.814020 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:26.805810 2572 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 27 20:34:26.814020 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:26.805816 2572 flags.go:64] FLAG: --tls-min-version="" Jul 27 20:34:26.814020 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:26.805819 2572 flags.go:64] FLAG: --tls-private-key-file="" Jul 27 20:34:26.814020 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:26.805822 2572 flags.go:64] FLAG: --topology-manager-policy="none" Jul 27 20:34:26.814020 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:26.805825 2572 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 27 20:34:26.814020 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:26.805828 2572 flags.go:64] FLAG: --topology-manager-scope="container" Jul 27 20:34:26.814624 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:26.805830 2572 flags.go:64] FLAG: --v="2" Jul 27 20:34:26.814624 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:26.805834 2572 flags.go:64] FLAG: --version="false" Jul 27 20:34:26.814624 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:26.805838 2572 flags.go:64] FLAG: --vmodule="" Jul 27 20:34:26.814624 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:26.805841 2572 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 27 20:34:26.814624 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:26.805850 2572 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 27 20:34:26.814624 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:34:26.805964 2572 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 27 20:34:26.814624 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:34:26.805967 2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 27 20:34:26.814624 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:34:26.805970 2572 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 27 20:34:26.814624 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:34:26.805975 2572 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 27 20:34:26.814624 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:34:26.805978 2572 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 27 20:34:26.814624 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:34:26.805981 2572 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 27 20:34:26.814624 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:34:26.805984 2572 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 27 20:34:26.814624 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:34:26.805986 2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 27 20:34:26.814624 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:34:26.805989 2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 27 20:34:26.814624 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:34:26.805991 2572 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 27 20:34:26.814624 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:34:26.805994 2572 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 27 20:34:26.814624 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:34:26.806003 2572 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 27 20:34:26.814624 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:34:26.806006 2572 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 27 20:34:26.814624 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:34:26.806009 2572 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 27 20:34:26.814624 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:34:26.806012 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 27 20:34:26.814624 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:34:26.806015 2572 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 27 20:34:26.815128 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:34:26.806019 2572 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 27 20:34:26.815128 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:34:26.806022 2572 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 27 20:34:26.815128 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:34:26.806025 2572 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 27 20:34:26.815128 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:34:26.806028 2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 27 20:34:26.815128 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:34:26.806031 2572 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 27 20:34:26.815128 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:34:26.806034 2572 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 27 20:34:26.815128 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:34:26.806036 2572 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 27 20:34:26.815128 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:34:26.806039 2572 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 27 20:34:26.815128 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:34:26.806042 2572 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 27 20:34:26.815128 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:34:26.806044 2572 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 27 20:34:26.815128 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:34:26.806047 2572 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 27 20:34:26.815128 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:34:26.806051 2572 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 27 20:34:26.815128 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:34:26.806055 2572 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 27 20:34:26.815128 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:34:26.806059 2572 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 27 20:34:26.815128 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:34:26.806063 2572 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 27 20:34:26.815128 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:34:26.806066 2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 27 20:34:26.815128 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:34:26.806071 2572 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 27 20:34:26.815128 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:34:26.806074 2572 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 27 20:34:26.815616 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:34:26.806076 2572 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 27 20:34:26.815616 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:34:26.806081 2572 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 27 20:34:26.815616 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:34:26.806084 2572 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 27 20:34:26.815616 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:34:26.806086 2572 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 27 20:34:26.815616 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:34:26.806089 2572 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 27 20:34:26.815616 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:34:26.806091 2572 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 27 20:34:26.815616 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:34:26.806094 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 27 20:34:26.815616 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:34:26.806097 2572 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 27 20:34:26.815616 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:34:26.806099 2572 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 27 20:34:26.815616 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:34:26.806102 2572 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 27 20:34:26.815616 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:34:26.806104 2572 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 27 20:34:26.815616 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:34:26.806106 2572 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 27 20:34:26.815616 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:34:26.806109 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 27 20:34:26.815616 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:34:26.806112 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 27 20:34:26.815616 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:34:26.806114 2572 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 27 20:34:26.815616 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:34:26.806117 2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 27 20:34:26.815616 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:34:26.806120 2572 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 27 20:34:26.815616 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:34:26.806122 2572 feature_gate.go:328] unrecognized feature gate: Example Jul 27 20:34:26.815616 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:34:26.806125 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 27 20:34:26.816075 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:34:26.806127 2572 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 27 20:34:26.816075 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:34:26.806129 2572 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 27 20:34:26.816075 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:34:26.806132 2572 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 27 20:34:26.816075 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:34:26.806135 2572 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 27 20:34:26.816075 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:34:26.806137 2572 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 27 20:34:26.816075 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:34:26.806139 2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 27 20:34:26.816075 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:34:26.806142 2572 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 27 20:34:26.816075 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:34:26.806145 2572 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 27 20:34:26.816075 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:34:26.806147 2572 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 27 20:34:26.816075 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:34:26.806149 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 27 20:34:26.816075 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:34:26.806152 2572 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 27 20:34:26.816075 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:34:26.806156 2572 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 27 20:34:26.816075 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:34:26.806159 2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 27 20:34:26.816075 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:34:26.806161 2572 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 27 20:34:26.816075 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:34:26.806165 2572 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 27 20:34:26.816075 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:34:26.806168 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 27 20:34:26.816075 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:34:26.806170 2572 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 27 20:34:26.816075 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:34:26.806173 2572 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 27 20:34:26.816075 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:34:26.806176 2572 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 27 20:34:26.816075 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:34:26.806178 2572 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 27 20:34:26.816587 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:34:26.806181 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 27 20:34:26.816587 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:34:26.806183 2572 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 27 20:34:26.816587 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:34:26.806186 2572 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 27 20:34:26.816587 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:34:26.806188 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 27 20:34:26.816587 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:34:26.806191 2572 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 27 20:34:26.816587 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:34:26.806193 2572 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 27 20:34:26.816587 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:34:26.806196 2572 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 27 20:34:26.816587 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:34:26.806199 2572 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 27 20:34:26.816587 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:34:26.806201 2572 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 27 20:34:26.816587 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:34:26.806204 2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 27 20:34:26.816587 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:34:26.806207 2572 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 27 20:34:26.816587 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:34:26.806210 2572 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 27 20:34:26.816587 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:34:26.806212 2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 27 20:34:26.816587 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:34:26.806214 2572 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 27 20:34:26.816587 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:34:26.806217 2572 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 27 20:34:26.816587 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:34:26.806219 2572 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 27 20:34:26.816587 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:34:26.806222 2572 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 27 20:34:26.816587 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:34:26.806224 2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 27 20:34:26.816587 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:34:26.806227 2572 feature_gate.go:328] unrecognized feature gate: Example2 Jul 27 20:34:26.816587 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:34:26.806229 2572 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 27 20:34:26.817100 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:34:26.806231 2572 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 27 20:34:26.817100 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:34:26.806234 2572 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 27 20:34:26.817100 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:34:26.806237 2572 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 27 20:34:26.817100 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:34:26.806240 2572 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 27 20:34:26.817100 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:34:26.806243 2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 27 20:34:26.817100 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:34:26.806246 2572 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 27 20:34:26.817100 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:26.806783 2572 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 27 20:34:26.817100 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:26.813136 2572 server.go:529] "Kubelet version" kubeletVersion="v1.34.9" Jul 27 20:34:26.817100 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:26.813150 2572 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 27 20:34:26.817100 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:26.813949 2572 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 27 20:34:26.817100 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:26.813961 2572 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 27 20:34:26.817100 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:34:26.814034 2572 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 27 20:34:26.817100 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:34:26.814039 2572 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 27 20:34:26.817100 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:34:26.814043 2572 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 27 20:34:26.817100 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:34:26.814046 2572 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 27 20:34:26.817495 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:34:26.814049 2572 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 27 20:34:26.817495 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:34:26.814052 2572 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 27 20:34:26.817495 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:34:26.814055 2572 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 27 20:34:26.817495 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:34:26.814058 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 27 20:34:26.817495 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:34:26.814060 2572 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 27 20:34:26.817495 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:34:26.814063 2572 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 27 20:34:26.817495 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:34:26.814066 2572 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 27 20:34:26.817495 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:34:26.814068 2572 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 27 20:34:26.817495 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:34:26.814071 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 27 20:34:26.817495 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:34:26.814073 2572 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 27 20:34:26.817495 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:34:26.814076 2572 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 27 20:34:26.817495 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:34:26.814079 2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 27 20:34:26.817495 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:34:26.814081 2572 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 27 20:34:26.817495 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:34:26.814084 2572 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 27 20:34:26.817495 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:34:26.814086 2572 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 27 20:34:26.817495 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:34:26.814089 2572 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 27 20:34:26.817495 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:34:26.814092 2572 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 27 20:34:26.817495 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:34:26.814096 2572 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 27 20:34:26.817495 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:34:26.814100 2572 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 27 20:34:26.817947 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:34:26.814105 2572 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 27 20:34:26.817947 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:34:26.814108 2572 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 27 20:34:26.817947 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:34:26.814111 2572 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 27 20:34:26.817947 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:34:26.814114 2572 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 27 20:34:26.817947 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:34:26.814117 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 27 20:34:26.817947 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:34:26.814120 2572 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 27 20:34:26.817947 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:34:26.814122 2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 27 20:34:26.817947 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:34:26.814125 2572 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 27 20:34:26.817947 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:34:26.814127 2572 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 27 20:34:26.817947 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:34:26.814130 2572 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 27 20:34:26.817947 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:34:26.814133 2572 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 27 20:34:26.817947 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:34:26.814136 2572 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 27 20:34:26.817947 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:34:26.814138 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 27 20:34:26.817947 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:34:26.814141 2572 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 27 20:34:26.817947 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:34:26.814143 2572 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 27 20:34:26.817947 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:34:26.814146 2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 27 20:34:26.817947 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:34:26.814149 2572 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 27 20:34:26.817947 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:34:26.814151 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 27 20:34:26.817947 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:34:26.814154 2572 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 27 20:34:26.818537 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:34:26.814157 2572 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 27 20:34:26.818537 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:34:26.814159 2572 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 27 20:34:26.818537 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:34:26.814161 2572 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 27 20:34:26.818537 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:34:26.814164 2572 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 27 20:34:26.818537 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:34:26.814167 2572 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 27 20:34:26.818537 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:34:26.814169 2572 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 27 20:34:26.818537 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:34:26.814172 2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 27 20:34:26.818537 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:34:26.814174 2572 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 27 20:34:26.818537 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:34:26.814177 2572 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 27 20:34:26.818537 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:34:26.814179 2572 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 27 20:34:26.818537 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:34:26.814182 2572 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 27 20:34:26.818537 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:34:26.814185 2572 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 27 20:34:26.818537 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:34:26.814188 2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 27 20:34:26.818537 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:34:26.814190 2572 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 27 20:34:26.818537 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:34:26.814194 2572 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 27 20:34:26.818537 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:34:26.814198 2572 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 27 20:34:26.818537 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:34:26.814201 2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 27 20:34:26.818537 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:34:26.814204 2572 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 27 20:34:26.818537 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:34:26.814206 2572 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 27 20:34:26.818537 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:34:26.814209 2572 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 27 20:34:26.819059 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:34:26.814211 2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 27 20:34:26.819059 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:34:26.814214 2572 feature_gate.go:328] unrecognized feature gate: Example2 Jul 27 20:34:26.819059 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:34:26.814216 2572 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 27 20:34:26.819059 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:34:26.814219 2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 27 20:34:26.819059 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:34:26.814221 2572 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 27 20:34:26.819059 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:34:26.814224 2572 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 27 20:34:26.819059 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:34:26.814226 2572 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 27 20:34:26.819059 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:34:26.814229 2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 27 20:34:26.819059 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:34:26.814231 2572 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 27 20:34:26.819059 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:34:26.814234 2572 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 27 20:34:26.819059 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:34:26.814236 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 27 20:34:26.819059 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:34:26.814239 2572 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 27 20:34:26.819059 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:34:26.814241 2572 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 27 20:34:26.819059 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:34:26.814244 2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 27 20:34:26.819059 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:34:26.814246 2572 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 27 20:34:26.819059 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:34:26.814249 2572 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 27 20:34:26.819059 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:34:26.814251 2572 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 27 20:34:26.819059 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:34:26.814254 2572 feature_gate.go:328] unrecognized feature gate: Example Jul 27 20:34:26.819059 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:34:26.814256 2572 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 27 20:34:26.819059 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:34:26.814259 2572 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 27 20:34:26.819589 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:34:26.814261 2572 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 27 20:34:26.819589 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:34:26.814264 2572 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 27 20:34:26.819589 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:34:26.814266 2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 27 20:34:26.819589 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:34:26.814269 2572 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 27 20:34:26.819589 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:34:26.814271 2572 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 27 20:34:26.819589 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:34:26.814274 2572 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 27 20:34:26.819589 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:34:26.814276 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 27 20:34:26.819589 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:34:26.814280 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 27 20:34:26.819589 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:34:26.814282 2572 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 27 20:34:26.819589 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:34:26.814285 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 27 20:34:26.819589 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:34:26.814288 2572 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 27 20:34:26.819589 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:34:26.814291 2572 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 27 20:34:26.819589 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:34:26.814293 2572 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 27 20:34:26.819589 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:34:26.814296 2572 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 27 20:34:26.819589 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:34:26.814298 2572 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 27 20:34:26.819589 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:34:26.814301 2572 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 27 20:34:26.819589 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:34:26.814304 2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 27 20:34:26.820005 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:26.814309 2572 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 27 20:34:26.820005 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:34:26.814432 2572 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 27 20:34:26.820005 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:34:26.814437 2572 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 27 20:34:26.820005 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:34:26.814440 2572 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 27 20:34:26.820005 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:34:26.814443 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 27 20:34:26.820005 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:34:26.814446 2572 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 27 20:34:26.820005 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:34:26.814449 2572 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 27 20:34:26.820005 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:34:26.814452 2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 27 20:34:26.820005 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:34:26.814454 2572 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 27 20:34:26.820005 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:34:26.814457 2572 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 27 20:34:26.820005 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:34:26.814460 2572 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 27 20:34:26.820005 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:34:26.814462 2572 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 27 20:34:26.820005 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:34:26.814465 2572 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 27 20:34:26.820005 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:34:26.814467 2572 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 27 20:34:26.820005 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:34:26.814470 2572 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 27 20:34:26.820498 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:34:26.814472 2572 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 27 20:34:26.820498 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:34:26.814475 2572 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 27 20:34:26.820498 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:34:26.814477 2572 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 27 20:34:26.820498 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:34:26.814480 2572 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 27 20:34:26.820498 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:34:26.814482 2572 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 27 20:34:26.820498 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:34:26.814485 2572 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 27 20:34:26.820498 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:34:26.814487 2572 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 27 20:34:26.820498 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:34:26.814490 2572 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 27 20:34:26.820498 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:34:26.814493 2572 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 27 20:34:26.820498 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:34:26.814496 2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 27 20:34:26.820498 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:34:26.814499 2572 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 27 20:34:26.820498 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:34:26.814502 2572 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 27 20:34:26.820498 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:34:26.814504 2572 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 27 20:34:26.820498 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:34:26.814507 2572 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 27 20:34:26.820498 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:34:26.814509 2572 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 27 20:34:26.820498 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:34:26.814512 2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 27 20:34:26.820498 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:34:26.814514 2572 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 27 20:34:26.820498 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:34:26.814517 2572 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 27 20:34:26.820498 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:34:26.814519 2572 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 27 20:34:26.820498 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:34:26.814522 2572 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 27 20:34:26.820980 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:34:26.814524 2572 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 27 20:34:26.820980 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:34:26.814527 2572 feature_gate.go:328] unrecognized feature gate: Example Jul 27 20:34:26.820980 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:34:26.814529 2572 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 27 20:34:26.820980 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:34:26.814532 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 27 20:34:26.820980 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:34:26.814534 2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 27 20:34:26.820980 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:34:26.814536 2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 27 20:34:26.820980 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:34:26.814539 2572 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 27 20:34:26.820980 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:34:26.814541 2572 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 27 20:34:26.820980 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:34:26.814544 2572 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 27 20:34:26.820980 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:34:26.814546 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 27 20:34:26.820980 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:34:26.814549 2572 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 27 20:34:26.820980 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:34:26.814551 2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 27 20:34:26.820980 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:34:26.814555 2572 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 27 20:34:26.820980 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:34:26.814558 2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 27 20:34:26.820980 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:34:26.814561 2572 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 27 20:34:26.820980 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:34:26.814564 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 27 20:34:26.820980 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:34:26.814566 2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 27 20:34:26.820980 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:34:26.814569 2572 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 27 20:34:26.820980 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:34:26.814572 2572 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 27 20:34:26.821830 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:34:26.814575 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 27 20:34:26.821830 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:34:26.814577 2572 feature_gate.go:328] unrecognized feature gate: Example2 Jul 27 20:34:26.821830 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:34:26.814580 2572 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 27 20:34:26.821830 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:34:26.814583 2572 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 27 20:34:26.821830 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:34:26.814585 2572 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 27 20:34:26.821830 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:34:26.814588 2572 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 27 20:34:26.821830 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:34:26.814590 2572 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 27 20:34:26.821830 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:34:26.814593 2572 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 27 20:34:26.821830 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:34:26.814595 2572 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 27 20:34:26.821830 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:34:26.814598 2572 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 27 20:34:26.821830 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:34:26.814600 2572 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 27 20:34:26.821830 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:34:26.814603 2572 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 27 20:34:26.821830 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:34:26.814605 2572 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 27 20:34:26.821830 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:34:26.814607 2572 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 27 20:34:26.821830 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:34:26.814610 2572 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 27 20:34:26.821830 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:34:26.814613 2572 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 27 20:34:26.821830 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:34:26.814616 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 27 20:34:26.821830 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:34:26.814618 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 27 20:34:26.821830 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:34:26.814621 2572 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 27 20:34:26.821830 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:34:26.814623 2572 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 27 20:34:26.822453 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:34:26.814626 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 27 20:34:26.822453 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:34:26.814628 2572 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 27 20:34:26.822453 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:34:26.814631 2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 27 20:34:26.822453 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:34:26.814634 2572 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 27 20:34:26.822453 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:34:26.814637 2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 27 20:34:26.822453 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:34:26.814639 2572 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 27 20:34:26.822453 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:34:26.814642 2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 27 20:34:26.822453 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:34:26.814644 2572 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 27 20:34:26.822453 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:34:26.814647 2572 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 27 20:34:26.822453 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:34:26.814649 2572 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 27 20:34:26.822453 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:34:26.814652 2572 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 27 20:34:26.822453 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:34:26.814655 2572 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 27 20:34:26.822453 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:34:26.814657 2572 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 27 20:34:26.822453 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:34:26.814660 2572 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 27 20:34:26.822453 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:34:26.814662 2572 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 27 20:34:26.822453 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:34:26.814665 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 27 20:34:26.822453 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:34:26.814667 2572 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 27 20:34:26.822453 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:34:26.814670 2572 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 27 20:34:26.822453 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:34:26.814672 2572 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 27 20:34:26.822453 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:34:26.814675 2572 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 27 20:34:26.823044 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:34:26.814677 2572 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 27 20:34:26.823044 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:34:26.814681 2572 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 27 20:34:26.823044 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:34:26.814684 2572 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 27 20:34:26.823044 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:34:26.814687 2572 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 27 20:34:26.823044 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:34:26.814689 2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 27 20:34:26.823044 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:34:26.814692 2572 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 27 20:34:26.823044 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:26.814697 2572 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 27 20:34:26.823044 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:26.814792 2572 server.go:962] "Client rotation is on, will bootstrap in background" Jul 27 20:34:26.823044 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:26.816745 2572 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 27 20:34:26.823044 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:26.818186 2572 server.go:1019] "Starting client certificate rotation" Jul 27 20:34:26.823044 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:26.818302 2572 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 27 20:34:26.823044 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:26.818370 2572 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 27 20:34:26.823044 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:26.820856 2572 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 27 20:34:26.823449 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:26.822309 2572 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 27 20:34:26.836241 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:26.836223 2572 log.go:25] "Validated CRI v1 runtime API" Jul 27 20:34:26.839904 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:26.839890 2572 log.go:25] "Validated CRI v1 image API" Jul 27 20:34:26.841492 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:26.841478 2572 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 27 20:34:26.845489 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:26.845472 2572 fs.go:135] Filesystem UUIDs: map[7853236f-8b5a-48a0-b442-fdc195b7e921:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 864431be-035a-4f7f-b96a-7bd2bab364ac:/dev/nvme0n1p3] Jul 27 20:34:26.845533 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:26.845489 2572 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 27 20:34:26.846493 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:26.846476 2572 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 27 20:34:26.850453 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:26.850348 2572 manager.go:216] Machine: {Timestamp:2026-07-27 20:34:26.848990992 +0000 UTC m=+0.318534008 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3100589 MemoryCapacity:33164492800 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2a2ab6542886571c36d4d8736e9c82 SystemUUID:ec2a2ab6-5428-8657-1c36-d4d8736e9c82 BootID:dab03b89-c9ba-4fda-b9aa-71d4e4f033ff Filesystems:[{Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582246400 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:a4:18:e9:9c:41 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:a4:18:e9:9c:41 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:1a:84:32:e2:23:37 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164492800 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 27 20:34:26.850453 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:26.850446 2572 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 27 20:34:26.850572 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:26.850544 2572 manager.go:232] Version: {KernelVersion:5.14.0-570.129.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260717-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 27 20:34:26.853691 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:26.853666 2572 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 27 20:34:26.853862 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:26.853695 2572 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-139-2.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 27 20:34:26.855145 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:26.855132 2572 topology_manager.go:138] "Creating topology manager with none policy" Jul 27 20:34:26.855210 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:26.855149 2572 container_manager_linux.go:309] "Creating device plugin manager" Jul 27 20:34:26.855210 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:26.855161 2572 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 27 20:34:26.855916 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:26.855904 2572 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 27 20:34:26.856808 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:26.856796 2572 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 27 20:34:26.858741 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:26.858727 2572 state_mem.go:36] "Initialized new in-memory state store" Jul 27 20:34:26.858873 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:26.858862 2572 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 27 20:34:26.858928 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:26.858900 2572 kubelet.go:486] "Attempting to sync node with API server" Jul 27 20:34:26.858928 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:26.858914 2572 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 27 20:34:26.859021 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:26.858933 2572 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 27 20:34:26.859021 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:26.858947 2572 kubelet.go:398] "Adding apiserver pod source" Jul 27 20:34:26.859021 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:26.858963 2572 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 27 20:34:26.859301 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:26.859287 2572 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 27 20:34:26.859389 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:26.859310 2572 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 27 20:34:26.862229 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:26.862210 2572 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1" Jul 27 20:34:26.864145 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:26.864130 2572 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 27 20:34:26.864198 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:26.864178 2572 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 27 20:34:26.865884 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:26.865872 2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 27 20:34:26.865923 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:26.865889 2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 27 20:34:26.865923 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:26.865896 2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 27 20:34:26.865923 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:26.865901 2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 27 20:34:26.865923 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:26.865911 2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 27 20:34:26.865923 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:26.865916 2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 27 20:34:26.865923 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:26.865923 2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 27 20:34:26.866084 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:26.865928 2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 27 20:34:26.866084 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:26.865938 2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 27 20:34:26.866084 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:26.865943 2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 27 20:34:26.866084 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:26.865952 2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 27 20:34:26.866084 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:26.865958 2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 27 20:34:26.867073 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:26.867057 2572 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-rrvbs" Jul 27 20:34:26.867402 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:26.867390 2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 27 20:34:26.867436 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:26.867403 2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 27 20:34:26.868598 ip-10-0-139-2 kubenswrapper[2572]: E0727 20:34:26.868578 2572 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-139-2.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 27 20:34:26.868598 ip-10-0-139-2 kubenswrapper[2572]: E0727 20:34:26.868578 2572 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 27 20:34:26.868867 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:26.868849 2572 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-139-2.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 27 20:34:26.870648 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:26.870634 2572 server.go:1268] "Started kubelet" Jul 27 20:34:26.870771 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:26.870694 2572 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 27 20:34:26.874242 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:26.874213 2572 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 27 20:34:26.876127 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:26.870705 2572 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 27 20:34:26.876127 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:26.875567 2572 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-rrvbs" Jul 27 20:34:26.876127 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:26.875802 2572 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 27 20:34:26.875201 ip-10-0-139-2 systemd[1]: Started Kubernetes Kubelet. Jul 27 20:34:26.877405 ip-10-0-139-2 kubenswrapper[2572]: E0727 20:34:26.877113 2572 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 27 20:34:26.877405 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:26.877353 2572 server.go:310] "Adding debug handlers to kubelet server" Jul 27 20:34:26.879427 ip-10-0-139-2 kubenswrapper[2572]: E0727 20:34:26.878572 2572 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-139-2.ec2.internal.18c63fd0765b7b26 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-139-2.ec2.internal,UID:ip-10-0-139-2.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-139-2.ec2.internal,},FirstTimestamp:2026-07-27 20:34:26.870434598 +0000 UTC m=+0.339977600,LastTimestamp:2026-07-27 20:34:26.870434598 +0000 UTC m=+0.339977600,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-139-2.ec2.internal,}" Jul 27 20:34:26.883171 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:26.883152 2572 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 27 20:34:26.883307 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:26.883155 2572 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 27 20:34:26.883307 ip-10-0-139-2 kubenswrapper[2572]: E0727 20:34:26.883243 2572 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-2.ec2.internal\" not found" Jul 27 20:34:26.883702 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:26.883684 2572 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 27 20:34:26.883702 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:26.883684 2572 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 27 20:34:26.883844 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:26.883715 2572 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 27 20:34:26.883844 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:26.883812 2572 reconstruct.go:97] "Volume reconstruction finished" Jul 27 20:34:26.883844 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:26.883822 2572 reconciler.go:29] "Reconciler: start to sync state" Jul 27 20:34:26.884534 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:26.884514 2572 factory.go:55] Registering systemd factory Jul 27 20:34:26.884534 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:26.884535 2572 factory.go:223] Registration of the systemd container factory successfully Jul 27 20:34:26.884754 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:26.884733 2572 factory.go:153] Registering CRI-O factory Jul 27 20:34:26.884754 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:26.884750 2572 factory.go:223] Registration of the crio container factory successfully Jul 27 20:34:26.884867 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:26.884800 2572 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 27 20:34:26.884867 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:26.884824 2572 factory.go:103] Registering Raw factory Jul 27 20:34:26.884867 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:26.884840 2572 manager.go:1196] Started watching for new ooms in manager Jul 27 20:34:26.885172 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:26.885160 2572 manager.go:349] Starting recovery of all containers Jul 27 20:34:26.894472 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:26.894458 2572 manager.go:354] Recovery completed Jul 27 20:34:26.894856 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:26.894836 2572 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 27 20:34:26.898476 ip-10-0-139-2 kubenswrapper[2572]: E0727 20:34:26.898456 2572 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-139-2.ec2.internal\" not found" node="ip-10-0-139-2.ec2.internal" Jul 27 20:34:26.899540 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:26.899529 2572 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 27 20:34:26.901209 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:26.901189 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-2.ec2.internal" event="NodeHasSufficientMemory" Jul 27 20:34:26.901278 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:26.901223 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-2.ec2.internal" event="NodeHasNoDiskPressure" Jul 27 20:34:26.901278 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:26.901236 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-2.ec2.internal" event="NodeHasSufficientPID" Jul 27 20:34:26.901792 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:26.901776 2572 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 27 20:34:26.901792 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:26.901786 2572 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 27 20:34:26.901792 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:26.901792 2572 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 27 20:34:26.901945 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:26.901811 2572 state_mem.go:36] "Initialized new in-memory state store" Jul 27 20:34:26.902510 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:26.902492 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-2.ec2.internal" event="NodeHasSufficientMemory" Jul 27 20:34:26.902570 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:26.902519 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-2.ec2.internal" event="NodeHasNoDiskPressure" Jul 27 20:34:26.902570 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:26.902540 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-2.ec2.internal" event="NodeHasSufficientPID" Jul 27 20:34:26.903470 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:26.903458 2572 policy_none.go:49] "None policy: Start" Jul 27 20:34:26.903518 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:26.903475 2572 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 27 20:34:26.903518 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:26.903485 2572 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 27 20:34:26.904546 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:26.904533 2572 policy_none.go:47] "Start" Jul 27 20:34:26.932968 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:26.932863 2572 manager.go:337] "Starting Device Plugin manager" Jul 27 20:34:26.933049 ip-10-0-139-2 kubenswrapper[2572]: E0727 20:34:26.932987 2572 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 27 20:34:26.933049 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:26.933000 2572 server.go:87] "Starting device plugin registration server" Jul 27 20:34:26.933221 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:26.933209 2572 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 27 20:34:26.933275 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:26.933222 2572 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 27 20:34:26.933369 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:26.933354 2572 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 27 20:34:26.933440 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:26.933429 2572 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 27 20:34:26.933493 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:26.933441 2572 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 27 20:34:26.934287 ip-10-0-139-2 kubenswrapper[2572]: E0727 20:34:26.934269 2572 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 27 20:34:26.934386 ip-10-0-139-2 kubenswrapper[2572]: E0727 20:34:26.934310 2572 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-139-2.ec2.internal\" not found" Jul 27 20:34:27.033527 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:27.033502 2572 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 27 20:34:27.034509 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:27.034301 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-2.ec2.internal" event="NodeHasSufficientMemory" Jul 27 20:34:27.034509 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:27.034355 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-2.ec2.internal" event="NodeHasNoDiskPressure" Jul 27 20:34:27.034509 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:27.034372 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-2.ec2.internal" event="NodeHasSufficientPID" Jul 27 20:34:27.034509 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:27.034404 2572 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-139-2.ec2.internal" Jul 27 20:34:27.045122 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:27.045107 2572 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-139-2.ec2.internal" Jul 27 20:34:27.045183 ip-10-0-139-2 kubenswrapper[2572]: E0727 20:34:27.045127 2572 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-139-2.ec2.internal\": node \"ip-10-0-139-2.ec2.internal\" not found" Jul 27 20:34:27.062415 ip-10-0-139-2 kubenswrapper[2572]: E0727 20:34:27.062355 2572 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-2.ec2.internal\" not found" Jul 27 20:34:27.070950 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:27.070926 2572 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 27 20:34:27.072009 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:27.071990 2572 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 27 20:34:27.072076 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:27.072025 2572 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 27 20:34:27.072076 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:27.072047 2572 kubelet.go:2448] "Starting kubelet main sync loop" Jul 27 20:34:27.072513 ip-10-0-139-2 kubenswrapper[2572]: E0727 20:34:27.072085 2572 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jul 27 20:34:27.074442 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:27.074428 2572 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 27 20:34:27.163422 ip-10-0-139-2 kubenswrapper[2572]: E0727 20:34:27.163402 2572 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-2.ec2.internal\" not found" Jul 27 20:34:27.172546 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:27.172526 2572 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-2.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-139-2.ec2.internal"] Jul 27 20:34:27.172589 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:27.172580 2572 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 27 20:34:27.174020 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:27.174008 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-2.ec2.internal" event="NodeHasSufficientMemory" Jul 27 20:34:27.174093 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:27.174036 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-2.ec2.internal" event="NodeHasNoDiskPressure" Jul 27 20:34:27.174093 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:27.174049 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-2.ec2.internal" event="NodeHasSufficientPID" Jul 27 20:34:27.175249 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:27.175229 2572 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 27 20:34:27.175345 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:27.175307 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-2.ec2.internal" Jul 27 20:34:27.175396 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:27.175360 2572 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 27 20:34:27.175942 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:27.175926 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-2.ec2.internal" event="NodeHasSufficientMemory" Jul 27 20:34:27.176003 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:27.175952 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-2.ec2.internal" event="NodeHasNoDiskPressure" Jul 27 20:34:27.176003 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:27.175961 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-2.ec2.internal" event="NodeHasSufficientPID" Jul 27 20:34:27.176088 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:27.175926 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-2.ec2.internal" event="NodeHasSufficientMemory" Jul 27 20:34:27.176088 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:27.176035 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-2.ec2.internal" event="NodeHasNoDiskPressure" Jul 27 20:34:27.176088 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:27.176050 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-2.ec2.internal" event="NodeHasSufficientPID" Jul 27 20:34:27.177251 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:27.177230 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-2.ec2.internal" Jul 27 20:34:27.177341 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:27.177263 2572 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 27 20:34:27.177991 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:27.177979 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-2.ec2.internal" event="NodeHasSufficientMemory" Jul 27 20:34:27.178040 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:27.178006 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-2.ec2.internal" event="NodeHasNoDiskPressure" Jul 27 20:34:27.178040 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:27.178017 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-2.ec2.internal" event="NodeHasSufficientPID" Jul 27 20:34:27.202843 ip-10-0-139-2 kubenswrapper[2572]: E0727 20:34:27.202820 2572 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-139-2.ec2.internal\" not found" node="ip-10-0-139-2.ec2.internal" Jul 27 20:34:27.206683 ip-10-0-139-2 kubenswrapper[2572]: E0727 20:34:27.206670 2572 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-139-2.ec2.internal\" not found" node="ip-10-0-139-2.ec2.internal" Jul 27 20:34:27.264241 ip-10-0-139-2 kubenswrapper[2572]: E0727 20:34:27.264220 2572 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-2.ec2.internal\" not found" Jul 27 20:34:27.284669 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:27.284648 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/da987494f0db492277bfb2ba8bab7ad0-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-139-2.ec2.internal\" (UID: \"da987494f0db492277bfb2ba8bab7ad0\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-2.ec2.internal" Jul 27 20:34:27.284749 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:27.284674 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/da987494f0db492277bfb2ba8bab7ad0-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-139-2.ec2.internal\" (UID: \"da987494f0db492277bfb2ba8bab7ad0\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-2.ec2.internal" Jul 27 20:34:27.284749 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:27.284691 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/d7c69f721554e48d394aa7e5598261af-config\") pod \"kube-apiserver-proxy-ip-10-0-139-2.ec2.internal\" (UID: \"d7c69f721554e48d394aa7e5598261af\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-139-2.ec2.internal" Jul 27 20:34:27.364983 ip-10-0-139-2 kubenswrapper[2572]: E0727 20:34:27.364931 2572 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-2.ec2.internal\" not found" Jul 27 20:34:27.385145 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:27.385128 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/da987494f0db492277bfb2ba8bab7ad0-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-139-2.ec2.internal\" (UID: \"da987494f0db492277bfb2ba8bab7ad0\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-2.ec2.internal" Jul 27 20:34:27.385193 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:27.385150 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/da987494f0db492277bfb2ba8bab7ad0-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-139-2.ec2.internal\" (UID: \"da987494f0db492277bfb2ba8bab7ad0\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-2.ec2.internal" Jul 27 20:34:27.385193 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:27.385164 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/d7c69f721554e48d394aa7e5598261af-config\") pod \"kube-apiserver-proxy-ip-10-0-139-2.ec2.internal\" (UID: \"d7c69f721554e48d394aa7e5598261af\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-139-2.ec2.internal" Jul 27 20:34:27.385250 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:27.385207 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/d7c69f721554e48d394aa7e5598261af-config\") pod \"kube-apiserver-proxy-ip-10-0-139-2.ec2.internal\" (UID: \"d7c69f721554e48d394aa7e5598261af\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-139-2.ec2.internal" Jul 27 20:34:27.385250 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:27.385222 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/da987494f0db492277bfb2ba8bab7ad0-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-139-2.ec2.internal\" (UID: \"da987494f0db492277bfb2ba8bab7ad0\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-2.ec2.internal" Jul 27 20:34:27.385310 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:27.385250 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/da987494f0db492277bfb2ba8bab7ad0-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-139-2.ec2.internal\" (UID: \"da987494f0db492277bfb2ba8bab7ad0\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-2.ec2.internal" Jul 27 20:34:27.465255 ip-10-0-139-2 kubenswrapper[2572]: E0727 20:34:27.465227 2572 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-2.ec2.internal\" not found" Jul 27 20:34:27.505567 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:27.505552 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-2.ec2.internal" Jul 27 20:34:27.509957 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:27.509937 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-2.ec2.internal" Jul 27 20:34:27.566193 ip-10-0-139-2 kubenswrapper[2572]: E0727 20:34:27.566158 2572 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-2.ec2.internal\" not found" Jul 27 20:34:27.666616 ip-10-0-139-2 kubenswrapper[2572]: E0727 20:34:27.666546 2572 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-2.ec2.internal\" not found" Jul 27 20:34:27.766937 ip-10-0-139-2 kubenswrapper[2572]: E0727 20:34:27.766902 2572 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-2.ec2.internal\" not found" Jul 27 20:34:27.817307 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:27.817280 2572 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 27 20:34:27.817724 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:27.817424 2572 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 27 20:34:27.817724 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:27.817446 2572 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 27 20:34:27.867658 ip-10-0-139-2 kubenswrapper[2572]: E0727 20:34:27.867633 2572 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-2.ec2.internal\" not found" Jul 27 20:34:27.880425 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:27.880398 2572 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-26 20:29:26 +0000 UTC" deadline="2028-02-11 04:34:34.235133393 +0000 UTC" Jul 27 20:34:27.880425 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:27.880424 2572 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13520h0m6.354713277s" Jul 27 20:34:27.932696 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:34:27.932669 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podda987494f0db492277bfb2ba8bab7ad0.slice/crio-49d4cff5f5e6f485455ea48f104c3696420cb109e01988060b55c9b1868d9d24 WatchSource:0}: Error finding container 49d4cff5f5e6f485455ea48f104c3696420cb109e01988060b55c9b1868d9d24: Status 404 returned error can't find the container with id 49d4cff5f5e6f485455ea48f104c3696420cb109e01988060b55c9b1868d9d24 Jul 27 20:34:27.936007 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:27.935994 2572 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 27 20:34:27.968544 ip-10-0-139-2 kubenswrapper[2572]: E0727 20:34:27.968524 2572 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-2.ec2.internal\" not found" Jul 27 20:34:28.068995 ip-10-0-139-2 kubenswrapper[2572]: E0727 20:34:28.068968 2572 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-2.ec2.internal\" not found" Jul 27 20:34:28.075018 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:28.074977 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-2.ec2.internal" event={"ID":"d7c69f721554e48d394aa7e5598261af","Type":"ContainerStarted","Data":"c41a8b683b29e1d2146a0c1f62766b0018b82846af768b3414da9fcb09c76e8b"} Jul 27 20:34:28.075882 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:28.075865 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-2.ec2.internal" event={"ID":"da987494f0db492277bfb2ba8bab7ad0","Type":"ContainerStarted","Data":"49d4cff5f5e6f485455ea48f104c3696420cb109e01988060b55c9b1868d9d24"} Jul 27 20:34:28.169251 ip-10-0-139-2 kubenswrapper[2572]: E0727 20:34:28.169221 2572 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-2.ec2.internal\" not found" Jul 27 20:34:28.248028 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:28.247958 2572 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 27 20:34:28.269491 ip-10-0-139-2 kubenswrapper[2572]: E0727 20:34:28.269464 2572 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-2.ec2.internal\" not found" Jul 27 20:34:28.354102 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:28.354074 2572 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 27 20:34:28.384065 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:28.384038 2572 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-2.ec2.internal" Jul 27 20:34:28.393175 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:28.393153 2572 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 27 20:34:28.394136 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:28.394117 2572 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-2.ec2.internal" Jul 27 20:34:28.400112 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:28.400091 2572 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 27 20:34:28.836701 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:28.836673 2572 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 27 20:34:28.845199 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:28.845178 2572 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 27 20:34:28.860573 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:28.860556 2572 apiserver.go:52] "Watching apiserver" Jul 27 20:34:28.866754 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:28.866734 2572 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 27 20:34:28.868567 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:28.868547 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nqf5j","openshift-cluster-node-tuning-operator/tuned-vclmr","openshift-dns/node-resolver-xrf29","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-2.ec2.internal","openshift-multus/multus-additional-cni-plugins-qsbl2","openshift-multus/multus-sm7zg","openshift-multus/network-metrics-daemon-87fvc","kube-system/konnectivity-agent-hbpp5","kube-system/kube-apiserver-proxy-ip-10-0-139-2.ec2.internal","openshift-image-registry/node-ca-jrnhm","openshift-network-diagnostics/network-check-target-j7dsg","openshift-network-operator/iptables-alerter-7x5hh","openshift-ovn-kubernetes/ovnkube-node-c4jxq","kube-system/global-pull-secret-syncer-pkjs2"] Jul 27 20:34:28.869879 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:28.869863 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-jrnhm" Jul 27 20:34:28.870989 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:28.870971 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-c4jxq" Jul 27 20:34:28.871691 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:28.871579 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-66gc5\"" Jul 27 20:34:28.871691 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:28.871579 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 27 20:34:28.871691 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:28.871659 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 27 20:34:28.871905 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:28.871698 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 27 20:34:28.872387 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:28.872368 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-xrf29" Jul 27 20:34:28.872834 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:28.872809 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 27 20:34:28.873004 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:28.872989 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 27 20:34:28.873004 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:28.872999 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 27 20:34:28.873129 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:28.873110 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 27 20:34:28.873230 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:28.873215 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-lf8k4\"" Jul 27 20:34:28.873567 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:28.873551 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 27 20:34:28.873642 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:28.873567 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pkjs2" Jul 27 20:34:28.873642 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:28.873631 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 27 20:34:28.873733 ip-10-0-139-2 kubenswrapper[2572]: E0727 20:34:28.873641 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pkjs2" podUID="bc590c0d-cfda-4a50-b9b4-3b84a5791324" Jul 27 20:34:28.874093 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:28.874043 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 27 20:34:28.874093 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:28.874069 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 27 20:34:28.874850 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:28.874834 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-xhggx\"" Jul 27 20:34:28.875055 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:28.875024 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-qsbl2" Jul 27 20:34:28.876007 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:28.875993 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-sm7zg" Jul 27 20:34:28.876546 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:28.876531 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-gt42k\"" Jul 27 20:34:28.876629 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:28.876586 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 27 20:34:28.876682 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:28.876636 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 27 20:34:28.876935 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:28.876920 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 27 20:34:28.877018 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:28.876948 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 27 20:34:28.877152 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:28.877133 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 27 20:34:28.877661 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:28.877386 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-hbpp5" Jul 27 20:34:28.877661 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:28.877477 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 27 20:34:28.877661 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:28.877531 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-znbkx\"" Jul 27 20:34:28.878828 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:28.878793 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-87fvc" Jul 27 20:34:28.878913 ip-10-0-139-2 kubenswrapper[2572]: E0727 20:34:28.878852 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-87fvc" podUID="d2fb5de3-00ca-444a-a828-e3938289b62d" Jul 27 20:34:28.879005 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:28.878990 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 27 20:34:28.879005 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:28.879000 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 27 20:34:28.879166 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:28.879152 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-9w6bg\"" Jul 27 20:34:28.880361 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:28.880346 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-vclmr" Jul 27 20:34:28.881494 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:28.881471 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nqf5j" Jul 27 20:34:28.882000 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:28.881981 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 27 20:34:28.882085 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:28.882065 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 27 20:34:28.882150 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:28.882083 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-xxwlh\"" Jul 27 20:34:28.882829 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:28.882814 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-j7dsg" Jul 27 20:34:28.882907 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:28.882865 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 27 20:34:28.882907 ip-10-0-139-2 kubenswrapper[2572]: E0727 20:34:28.882863 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-j7dsg" podUID="57b1ab27-a6ef-4880-8cc5-5cd5f9086755" Jul 27 20:34:28.883816 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:28.883799 2572 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 27 20:34:28.884966 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:28.884017 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-7x5hh" Jul 27 20:34:28.884966 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:28.884068 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 27 20:34:28.884966 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:28.884376 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-wmhvr\"" Jul 27 20:34:28.884966 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:28.884545 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 27 20:34:28.886246 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:28.886217 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 27 20:34:28.886525 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:28.886507 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-t9pwp\"" Jul 27 20:34:28.886877 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:28.886859 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 27 20:34:28.887689 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:28.887664 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 27 20:34:28.890674 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:28.890657 2572 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 27 20:34:28.890899 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:28.890883 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/49e86110-48a9-4fc4-bec1-b5c79908b452-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-c4jxq\" (UID: \"49e86110-48a9-4fc4-bec1-b5c79908b452\") " pod="openshift-ovn-kubernetes/ovnkube-node-c4jxq" Jul 27 20:34:28.890971 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:28.890912 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/49e86110-48a9-4fc4-bec1-b5c79908b452-ovnkube-script-lib\") pod \"ovnkube-node-c4jxq\" (UID: \"49e86110-48a9-4fc4-bec1-b5c79908b452\") " pod="openshift-ovn-kubernetes/ovnkube-node-c4jxq" Jul 27 20:34:28.890971 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:28.890935 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/83536de2-e5d6-4f8b-9ad4-abe6165a1039-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-qsbl2\" (UID: \"83536de2-e5d6-4f8b-9ad4-abe6165a1039\") " pod="openshift-multus/multus-additional-cni-plugins-qsbl2" Jul 27 20:34:28.890971 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:28.890955 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/2950235c-cbe6-4602-a643-5ba127fd1125-host-run-multus-certs\") pod \"multus-sm7zg\" (UID: \"2950235c-cbe6-4602-a643-5ba127fd1125\") " pod="openshift-multus/multus-sm7zg" Jul 27 20:34:28.891106 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:28.890975 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/3a0188fb-210b-4c68-9d2e-9e3b2efb5bb3-etc-systemd\") pod \"tuned-vclmr\" (UID: \"3a0188fb-210b-4c68-9d2e-9e3b2efb5bb3\") " pod="openshift-cluster-node-tuning-operator/tuned-vclmr" Jul 27 20:34:28.891106 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:28.890992 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/83536de2-e5d6-4f8b-9ad4-abe6165a1039-cnibin\") pod \"multus-additional-cni-plugins-qsbl2\" (UID: \"83536de2-e5d6-4f8b-9ad4-abe6165a1039\") " pod="openshift-multus/multus-additional-cni-plugins-qsbl2" Jul 27 20:34:28.891106 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:28.891011 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wh5zk\" (UniqueName: \"kubernetes.io/projected/2950235c-cbe6-4602-a643-5ba127fd1125-kube-api-access-wh5zk\") pod \"multus-sm7zg\" (UID: \"2950235c-cbe6-4602-a643-5ba127fd1125\") " pod="openshift-multus/multus-sm7zg" Jul 27 20:34:28.891106 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:28.891048 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/114b4c57-6d52-4a6a-bd88-4fe9f017e5e8-device-dir\") pod \"aws-ebs-csi-driver-node-nqf5j\" (UID: \"114b4c57-6d52-4a6a-bd88-4fe9f017e5e8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nqf5j" Jul 27 20:34:28.891106 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:28.891083 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/49e86110-48a9-4fc4-bec1-b5c79908b452-log-socket\") pod \"ovnkube-node-c4jxq\" (UID: \"49e86110-48a9-4fc4-bec1-b5c79908b452\") " pod="openshift-ovn-kubernetes/ovnkube-node-c4jxq" Jul 27 20:34:28.891353 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:28.891107 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/83536de2-e5d6-4f8b-9ad4-abe6165a1039-cni-binary-copy\") pod \"multus-additional-cni-plugins-qsbl2\" (UID: \"83536de2-e5d6-4f8b-9ad4-abe6165a1039\") " pod="openshift-multus/multus-additional-cni-plugins-qsbl2" Jul 27 20:34:28.891353 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:28.891133 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/2950235c-cbe6-4602-a643-5ba127fd1125-host-var-lib-cni-multus\") pod \"multus-sm7zg\" (UID: \"2950235c-cbe6-4602-a643-5ba127fd1125\") " pod="openshift-multus/multus-sm7zg" Jul 27 20:34:28.891353 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:28.891155 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2950235c-cbe6-4602-a643-5ba127fd1125-host-var-lib-kubelet\") pod \"multus-sm7zg\" (UID: \"2950235c-cbe6-4602-a643-5ba127fd1125\") " pod="openshift-multus/multus-sm7zg" Jul 27 20:34:28.891353 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:28.891174 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2950235c-cbe6-4602-a643-5ba127fd1125-etc-kubernetes\") pod \"multus-sm7zg\" (UID: \"2950235c-cbe6-4602-a643-5ba127fd1125\") " pod="openshift-multus/multus-sm7zg" Jul 27 20:34:28.891353 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:28.891204 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/84e2598f-0da6-4f38-8dda-46b8c0fbd329-host\") pod \"node-ca-jrnhm\" (UID: \"84e2598f-0da6-4f38-8dda-46b8c0fbd329\") " pod="openshift-image-registry/node-ca-jrnhm" Jul 27 20:34:28.891353 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:28.891223 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/49e86110-48a9-4fc4-bec1-b5c79908b452-run-ovn\") pod \"ovnkube-node-c4jxq\" (UID: \"49e86110-48a9-4fc4-bec1-b5c79908b452\") " pod="openshift-ovn-kubernetes/ovnkube-node-c4jxq" Jul 27 20:34:28.891353 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:28.891238 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7331b999-e372-4a69-854a-11042f5892c3-tmp-dir\") pod \"node-resolver-xrf29\" (UID: \"7331b999-e372-4a69-854a-11042f5892c3\") " pod="openshift-dns/node-resolver-xrf29" Jul 27 20:34:28.891353 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:28.891256 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/2950235c-cbe6-4602-a643-5ba127fd1125-cni-binary-copy\") pod \"multus-sm7zg\" (UID: \"2950235c-cbe6-4602-a643-5ba127fd1125\") " pod="openshift-multus/multus-sm7zg" Jul 27 20:34:28.891353 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:28.891277 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/2950235c-cbe6-4602-a643-5ba127fd1125-multus-socket-dir-parent\") pod \"multus-sm7zg\" (UID: \"2950235c-cbe6-4602-a643-5ba127fd1125\") " pod="openshift-multus/multus-sm7zg" Jul 27 20:34:28.891353 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:28.891299 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/2950235c-cbe6-4602-a643-5ba127fd1125-multus-conf-dir\") pod \"multus-sm7zg\" (UID: \"2950235c-cbe6-4602-a643-5ba127fd1125\") " pod="openshift-multus/multus-sm7zg" Jul 27 20:34:28.891353 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:28.891341 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d2fb5de3-00ca-444a-a828-e3938289b62d-metrics-certs\") pod \"network-metrics-daemon-87fvc\" (UID: \"d2fb5de3-00ca-444a-a828-e3938289b62d\") " pod="openshift-multus/network-metrics-daemon-87fvc" Jul 27 20:34:28.891808 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:28.891375 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/4cfaeb7a-c49a-4371-94b1-206c7298d061-iptables-alerter-script\") pod \"iptables-alerter-7x5hh\" (UID: \"4cfaeb7a-c49a-4371-94b1-206c7298d061\") " pod="openshift-network-operator/iptables-alerter-7x5hh" Jul 27 20:34:28.891808 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:28.891413 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fvkr4\" (UniqueName: \"kubernetes.io/projected/4cfaeb7a-c49a-4371-94b1-206c7298d061-kube-api-access-fvkr4\") pod \"iptables-alerter-7x5hh\" (UID: \"4cfaeb7a-c49a-4371-94b1-206c7298d061\") " pod="openshift-network-operator/iptables-alerter-7x5hh" Jul 27 20:34:28.891808 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:28.891441 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/49e86110-48a9-4fc4-bec1-b5c79908b452-host-kubelet\") pod \"ovnkube-node-c4jxq\" (UID: \"49e86110-48a9-4fc4-bec1-b5c79908b452\") " pod="openshift-ovn-kubernetes/ovnkube-node-c4jxq" Jul 27 20:34:28.891808 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:28.891464 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/49e86110-48a9-4fc4-bec1-b5c79908b452-run-systemd\") pod \"ovnkube-node-c4jxq\" (UID: \"49e86110-48a9-4fc4-bec1-b5c79908b452\") " pod="openshift-ovn-kubernetes/ovnkube-node-c4jxq" Jul 27 20:34:28.891808 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:28.891499 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/bc590c0d-cfda-4a50-b9b4-3b84a5791324-kubelet-config\") pod \"global-pull-secret-syncer-pkjs2\" (UID: \"bc590c0d-cfda-4a50-b9b4-3b84a5791324\") " pod="kube-system/global-pull-secret-syncer-pkjs2" Jul 27 20:34:28.891808 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:28.891525 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jfhxs\" (UniqueName: \"kubernetes.io/projected/57b1ab27-a6ef-4880-8cc5-5cd5f9086755-kube-api-access-jfhxs\") pod \"network-check-target-j7dsg\" (UID: \"57b1ab27-a6ef-4880-8cc5-5cd5f9086755\") " pod="openshift-network-diagnostics/network-check-target-j7dsg" Jul 27 20:34:28.891808 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:28.891559 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/2950235c-cbe6-4602-a643-5ba127fd1125-cnibin\") pod \"multus-sm7zg\" (UID: \"2950235c-cbe6-4602-a643-5ba127fd1125\") " pod="openshift-multus/multus-sm7zg" Jul 27 20:34:28.891808 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:28.891590 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/2950235c-cbe6-4602-a643-5ba127fd1125-hostroot\") pod \"multus-sm7zg\" (UID: \"2950235c-cbe6-4602-a643-5ba127fd1125\") " pod="openshift-multus/multus-sm7zg" Jul 27 20:34:28.891808 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:28.891610 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3a0188fb-210b-4c68-9d2e-9e3b2efb5bb3-sys\") pod \"tuned-vclmr\" (UID: \"3a0188fb-210b-4c68-9d2e-9e3b2efb5bb3\") " pod="openshift-cluster-node-tuning-operator/tuned-vclmr" Jul 27 20:34:28.891808 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:28.891631 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3a0188fb-210b-4c68-9d2e-9e3b2efb5bb3-var-lib-kubelet\") pod \"tuned-vclmr\" (UID: \"3a0188fb-210b-4c68-9d2e-9e3b2efb5bb3\") " pod="openshift-cluster-node-tuning-operator/tuned-vclmr" Jul 27 20:34:28.891808 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:28.891651 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/84e2598f-0da6-4f38-8dda-46b8c0fbd329-serviceca\") pod \"node-ca-jrnhm\" (UID: \"84e2598f-0da6-4f38-8dda-46b8c0fbd329\") " pod="openshift-image-registry/node-ca-jrnhm" Jul 27 20:34:28.891808 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:28.891697 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/49e86110-48a9-4fc4-bec1-b5c79908b452-env-overrides\") pod \"ovnkube-node-c4jxq\" (UID: \"49e86110-48a9-4fc4-bec1-b5c79908b452\") " pod="openshift-ovn-kubernetes/ovnkube-node-c4jxq" Jul 27 20:34:28.891808 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:28.891717 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/83536de2-e5d6-4f8b-9ad4-abe6165a1039-os-release\") pod \"multus-additional-cni-plugins-qsbl2\" (UID: \"83536de2-e5d6-4f8b-9ad4-abe6165a1039\") " pod="openshift-multus/multus-additional-cni-plugins-qsbl2" Jul 27 20:34:28.891808 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:28.891740 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/2950235c-cbe6-4602-a643-5ba127fd1125-host-run-netns\") pod \"multus-sm7zg\" (UID: \"2950235c-cbe6-4602-a643-5ba127fd1125\") " pod="openshift-multus/multus-sm7zg" Jul 27 20:34:28.891808 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:28.891761 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/3a0188fb-210b-4c68-9d2e-9e3b2efb5bb3-run\") pod \"tuned-vclmr\" (UID: \"3a0188fb-210b-4c68-9d2e-9e3b2efb5bb3\") " pod="openshift-cluster-node-tuning-operator/tuned-vclmr" Jul 27 20:34:28.891808 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:28.891780 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/3a0188fb-210b-4c68-9d2e-9e3b2efb5bb3-etc-tuned\") pod \"tuned-vclmr\" (UID: \"3a0188fb-210b-4c68-9d2e-9e3b2efb5bb3\") " pod="openshift-cluster-node-tuning-operator/tuned-vclmr" Jul 27 20:34:28.891808 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:28.891808 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/49e86110-48a9-4fc4-bec1-b5c79908b452-node-log\") pod \"ovnkube-node-c4jxq\" (UID: \"49e86110-48a9-4fc4-bec1-b5c79908b452\") " pod="openshift-ovn-kubernetes/ovnkube-node-c4jxq" Jul 27 20:34:28.892478 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:28.891827 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/bc590c0d-cfda-4a50-b9b4-3b84a5791324-dbus\") pod \"global-pull-secret-syncer-pkjs2\" (UID: \"bc590c0d-cfda-4a50-b9b4-3b84a5791324\") " pod="kube-system/global-pull-secret-syncer-pkjs2" Jul 27 20:34:28.892478 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:28.891847 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/114b4c57-6d52-4a6a-bd88-4fe9f017e5e8-sys-fs\") pod \"aws-ebs-csi-driver-node-nqf5j\" (UID: \"114b4c57-6d52-4a6a-bd88-4fe9f017e5e8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nqf5j" Jul 27 20:34:28.892478 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:28.891866 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/49e86110-48a9-4fc4-bec1-b5c79908b452-systemd-units\") pod \"ovnkube-node-c4jxq\" (UID: \"49e86110-48a9-4fc4-bec1-b5c79908b452\") " pod="openshift-ovn-kubernetes/ovnkube-node-c4jxq" Jul 27 20:34:28.892478 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:28.891907 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/49e86110-48a9-4fc4-bec1-b5c79908b452-var-lib-openvswitch\") pod \"ovnkube-node-c4jxq\" (UID: \"49e86110-48a9-4fc4-bec1-b5c79908b452\") " pod="openshift-ovn-kubernetes/ovnkube-node-c4jxq" Jul 27 20:34:28.892478 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:28.891936 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vszt7\" (UniqueName: \"kubernetes.io/projected/49e86110-48a9-4fc4-bec1-b5c79908b452-kube-api-access-vszt7\") pod \"ovnkube-node-c4jxq\" (UID: \"49e86110-48a9-4fc4-bec1-b5c79908b452\") " pod="openshift-ovn-kubernetes/ovnkube-node-c4jxq" Jul 27 20:34:28.892478 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:28.891960 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/83536de2-e5d6-4f8b-9ad4-abe6165a1039-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-qsbl2\" (UID: \"83536de2-e5d6-4f8b-9ad4-abe6165a1039\") " pod="openshift-multus/multus-additional-cni-plugins-qsbl2" Jul 27 20:34:28.892478 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:28.891993 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/2950235c-cbe6-4602-a643-5ba127fd1125-host-var-lib-cni-bin\") pod \"multus-sm7zg\" (UID: \"2950235c-cbe6-4602-a643-5ba127fd1125\") " pod="openshift-multus/multus-sm7zg" Jul 27 20:34:28.892478 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:28.892015 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3a0188fb-210b-4c68-9d2e-9e3b2efb5bb3-etc-kubernetes\") pod \"tuned-vclmr\" (UID: \"3a0188fb-210b-4c68-9d2e-9e3b2efb5bb3\") " pod="openshift-cluster-node-tuning-operator/tuned-vclmr" Jul 27 20:34:28.892478 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:28.892055 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/49e86110-48a9-4fc4-bec1-b5c79908b452-host-slash\") pod \"ovnkube-node-c4jxq\" (UID: \"49e86110-48a9-4fc4-bec1-b5c79908b452\") " pod="openshift-ovn-kubernetes/ovnkube-node-c4jxq" Jul 27 20:34:28.892478 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:28.892080 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/49e86110-48a9-4fc4-bec1-b5c79908b452-host-run-netns\") pod \"ovnkube-node-c4jxq\" (UID: \"49e86110-48a9-4fc4-bec1-b5c79908b452\") " pod="openshift-ovn-kubernetes/ovnkube-node-c4jxq" Jul 27 20:34:28.892478 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:28.892131 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2950235c-cbe6-4602-a643-5ba127fd1125-multus-cni-dir\") pod \"multus-sm7zg\" (UID: \"2950235c-cbe6-4602-a643-5ba127fd1125\") " pod="openshift-multus/multus-sm7zg" Jul 27 20:34:28.892478 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:28.892158 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/3a0188fb-210b-4c68-9d2e-9e3b2efb5bb3-etc-modprobe-d\") pod \"tuned-vclmr\" (UID: \"3a0188fb-210b-4c68-9d2e-9e3b2efb5bb3\") " pod="openshift-cluster-node-tuning-operator/tuned-vclmr" Jul 27 20:34:28.892478 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:28.892202 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/3a0188fb-210b-4c68-9d2e-9e3b2efb5bb3-etc-sysctl-d\") pod \"tuned-vclmr\" (UID: \"3a0188fb-210b-4c68-9d2e-9e3b2efb5bb3\") " pod="openshift-cluster-node-tuning-operator/tuned-vclmr" Jul 27 20:34:28.892478 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:28.892247 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/49e86110-48a9-4fc4-bec1-b5c79908b452-run-openvswitch\") pod \"ovnkube-node-c4jxq\" (UID: \"49e86110-48a9-4fc4-bec1-b5c79908b452\") " pod="openshift-ovn-kubernetes/ovnkube-node-c4jxq" Jul 27 20:34:28.892478 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:28.892282 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/7331b999-e372-4a69-854a-11042f5892c3-hosts-file\") pod \"node-resolver-xrf29\" (UID: \"7331b999-e372-4a69-854a-11042f5892c3\") " pod="openshift-dns/node-resolver-xrf29" Jul 27 20:34:28.892478 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:28.892327 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w5t2f\" (UniqueName: \"kubernetes.io/projected/7331b999-e372-4a69-854a-11042f5892c3-kube-api-access-w5t2f\") pod \"node-resolver-xrf29\" (UID: \"7331b999-e372-4a69-854a-11042f5892c3\") " pod="openshift-dns/node-resolver-xrf29" Jul 27 20:34:28.893106 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:28.892356 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/2950235c-cbe6-4602-a643-5ba127fd1125-multus-daemon-config\") pod \"multus-sm7zg\" (UID: \"2950235c-cbe6-4602-a643-5ba127fd1125\") " pod="openshift-multus/multus-sm7zg" Jul 27 20:34:28.893106 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:28.892376 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sbzzq\" (UniqueName: \"kubernetes.io/projected/d2fb5de3-00ca-444a-a828-e3938289b62d-kube-api-access-sbzzq\") pod \"network-metrics-daemon-87fvc\" (UID: \"d2fb5de3-00ca-444a-a828-e3938289b62d\") " pod="openshift-multus/network-metrics-daemon-87fvc" Jul 27 20:34:28.893106 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:28.892399 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/83536de2-e5d6-4f8b-9ad4-abe6165a1039-tuning-conf-dir\") pod \"multus-additional-cni-plugins-qsbl2\" (UID: \"83536de2-e5d6-4f8b-9ad4-abe6165a1039\") " pod="openshift-multus/multus-additional-cni-plugins-qsbl2" Jul 27 20:34:28.893106 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:28.892423 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/3a0188fb-210b-4c68-9d2e-9e3b2efb5bb3-lib-modules\") pod \"tuned-vclmr\" (UID: \"3a0188fb-210b-4c68-9d2e-9e3b2efb5bb3\") " pod="openshift-cluster-node-tuning-operator/tuned-vclmr" Jul 27 20:34:28.893106 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:28.892465 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3a0188fb-210b-4c68-9d2e-9e3b2efb5bb3-tmp\") pod \"tuned-vclmr\" (UID: \"3a0188fb-210b-4c68-9d2e-9e3b2efb5bb3\") " pod="openshift-cluster-node-tuning-operator/tuned-vclmr" Jul 27 20:34:28.893106 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:28.892494 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/114b4c57-6d52-4a6a-bd88-4fe9f017e5e8-socket-dir\") pod \"aws-ebs-csi-driver-node-nqf5j\" (UID: \"114b4c57-6d52-4a6a-bd88-4fe9f017e5e8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nqf5j" Jul 27 20:34:28.893106 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:28.892525 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9x4bq\" (UniqueName: \"kubernetes.io/projected/84e2598f-0da6-4f38-8dda-46b8c0fbd329-kube-api-access-9x4bq\") pod \"node-ca-jrnhm\" (UID: \"84e2598f-0da6-4f38-8dda-46b8c0fbd329\") " pod="openshift-image-registry/node-ca-jrnhm" Jul 27 20:34:28.893106 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:28.892548 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/49e86110-48a9-4fc4-bec1-b5c79908b452-etc-openvswitch\") pod \"ovnkube-node-c4jxq\" (UID: \"49e86110-48a9-4fc4-bec1-b5c79908b452\") " pod="openshift-ovn-kubernetes/ovnkube-node-c4jxq" Jul 27 20:34:28.893106 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:28.892570 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lqk97\" (UniqueName: \"kubernetes.io/projected/83536de2-e5d6-4f8b-9ad4-abe6165a1039-kube-api-access-lqk97\") pod \"multus-additional-cni-plugins-qsbl2\" (UID: \"83536de2-e5d6-4f8b-9ad4-abe6165a1039\") " pod="openshift-multus/multus-additional-cni-plugins-qsbl2" Jul 27 20:34:28.893106 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:28.892637 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/3a0188fb-210b-4c68-9d2e-9e3b2efb5bb3-etc-sysctl-conf\") pod \"tuned-vclmr\" (UID: \"3a0188fb-210b-4c68-9d2e-9e3b2efb5bb3\") " pod="openshift-cluster-node-tuning-operator/tuned-vclmr" Jul 27 20:34:28.893106 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:28.892727 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/3a0188fb-210b-4c68-9d2e-9e3b2efb5bb3-host\") pod \"tuned-vclmr\" (UID: \"3a0188fb-210b-4c68-9d2e-9e3b2efb5bb3\") " pod="openshift-cluster-node-tuning-operator/tuned-vclmr" Jul 27 20:34:28.893106 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:28.892759 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/114b4c57-6d52-4a6a-bd88-4fe9f017e5e8-registration-dir\") pod \"aws-ebs-csi-driver-node-nqf5j\" (UID: \"114b4c57-6d52-4a6a-bd88-4fe9f017e5e8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nqf5j" Jul 27 20:34:28.893106 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:28.892783 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/114b4c57-6d52-4a6a-bd88-4fe9f017e5e8-etc-selinux\") pod \"aws-ebs-csi-driver-node-nqf5j\" (UID: \"114b4c57-6d52-4a6a-bd88-4fe9f017e5e8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nqf5j" Jul 27 20:34:28.893106 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:28.892806 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/49e86110-48a9-4fc4-bec1-b5c79908b452-ovnkube-config\") pod \"ovnkube-node-c4jxq\" (UID: \"49e86110-48a9-4fc4-bec1-b5c79908b452\") " pod="openshift-ovn-kubernetes/ovnkube-node-c4jxq" Jul 27 20:34:28.893106 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:28.892827 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/e2759622-0ab6-46b7-b434-f0a0f8942dfe-agent-certs\") pod \"konnectivity-agent-hbpp5\" (UID: \"e2759622-0ab6-46b7-b434-f0a0f8942dfe\") " pod="kube-system/konnectivity-agent-hbpp5" Jul 27 20:34:28.893106 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:28.892847 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/e2759622-0ab6-46b7-b434-f0a0f8942dfe-konnectivity-ca\") pod \"konnectivity-agent-hbpp5\" (UID: \"e2759622-0ab6-46b7-b434-f0a0f8942dfe\") " pod="kube-system/konnectivity-agent-hbpp5" Jul 27 20:34:28.893760 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:28.892868 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fnjf6\" (UniqueName: \"kubernetes.io/projected/114b4c57-6d52-4a6a-bd88-4fe9f017e5e8-kube-api-access-fnjf6\") pod \"aws-ebs-csi-driver-node-nqf5j\" (UID: \"114b4c57-6d52-4a6a-bd88-4fe9f017e5e8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nqf5j" Jul 27 20:34:28.893760 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:28.892888 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/4cfaeb7a-c49a-4371-94b1-206c7298d061-host-slash\") pod \"iptables-alerter-7x5hh\" (UID: \"4cfaeb7a-c49a-4371-94b1-206c7298d061\") " pod="openshift-network-operator/iptables-alerter-7x5hh" Jul 27 20:34:28.893760 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:28.892909 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/49e86110-48a9-4fc4-bec1-b5c79908b452-host-run-ovn-kubernetes\") pod \"ovnkube-node-c4jxq\" (UID: \"49e86110-48a9-4fc4-bec1-b5c79908b452\") " pod="openshift-ovn-kubernetes/ovnkube-node-c4jxq" Jul 27 20:34:28.893760 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:28.892928 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/49e86110-48a9-4fc4-bec1-b5c79908b452-host-cni-bin\") pod \"ovnkube-node-c4jxq\" (UID: \"49e86110-48a9-4fc4-bec1-b5c79908b452\") " pod="openshift-ovn-kubernetes/ovnkube-node-c4jxq" Jul 27 20:34:28.893760 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:28.892948 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2950235c-cbe6-4602-a643-5ba127fd1125-system-cni-dir\") pod \"multus-sm7zg\" (UID: \"2950235c-cbe6-4602-a643-5ba127fd1125\") " pod="openshift-multus/multus-sm7zg" Jul 27 20:34:28.893760 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:28.892967 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/2950235c-cbe6-4602-a643-5ba127fd1125-os-release\") pod \"multus-sm7zg\" (UID: \"2950235c-cbe6-4602-a643-5ba127fd1125\") " pod="openshift-multus/multus-sm7zg" Jul 27 20:34:28.893760 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:28.892987 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/3a0188fb-210b-4c68-9d2e-9e3b2efb5bb3-etc-sysconfig\") pod \"tuned-vclmr\" (UID: \"3a0188fb-210b-4c68-9d2e-9e3b2efb5bb3\") " pod="openshift-cluster-node-tuning-operator/tuned-vclmr" Jul 27 20:34:28.893760 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:28.893007 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/49e86110-48a9-4fc4-bec1-b5c79908b452-ovn-node-metrics-cert\") pod \"ovnkube-node-c4jxq\" (UID: \"49e86110-48a9-4fc4-bec1-b5c79908b452\") " pod="openshift-ovn-kubernetes/ovnkube-node-c4jxq" Jul 27 20:34:28.893760 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:28.893027 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/83536de2-e5d6-4f8b-9ad4-abe6165a1039-system-cni-dir\") pod \"multus-additional-cni-plugins-qsbl2\" (UID: \"83536de2-e5d6-4f8b-9ad4-abe6165a1039\") " pod="openshift-multus/multus-additional-cni-plugins-qsbl2" Jul 27 20:34:28.893760 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:28.893061 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/bc590c0d-cfda-4a50-b9b4-3b84a5791324-original-pull-secret\") pod \"global-pull-secret-syncer-pkjs2\" (UID: \"bc590c0d-cfda-4a50-b9b4-3b84a5791324\") " pod="kube-system/global-pull-secret-syncer-pkjs2" Jul 27 20:34:28.893760 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:28.893122 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/2950235c-cbe6-4602-a643-5ba127fd1125-host-run-k8s-cni-cncf-io\") pod \"multus-sm7zg\" (UID: \"2950235c-cbe6-4602-a643-5ba127fd1125\") " pod="openshift-multus/multus-sm7zg" Jul 27 20:34:28.893760 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:28.893144 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x9hzz\" (UniqueName: \"kubernetes.io/projected/3a0188fb-210b-4c68-9d2e-9e3b2efb5bb3-kube-api-access-x9hzz\") pod \"tuned-vclmr\" (UID: \"3a0188fb-210b-4c68-9d2e-9e3b2efb5bb3\") " pod="openshift-cluster-node-tuning-operator/tuned-vclmr" Jul 27 20:34:28.893760 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:28.893162 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/114b4c57-6d52-4a6a-bd88-4fe9f017e5e8-kubelet-dir\") pod \"aws-ebs-csi-driver-node-nqf5j\" (UID: \"114b4c57-6d52-4a6a-bd88-4fe9f017e5e8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nqf5j" Jul 27 20:34:28.893760 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:28.893182 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/49e86110-48a9-4fc4-bec1-b5c79908b452-host-cni-netd\") pod \"ovnkube-node-c4jxq\" (UID: \"49e86110-48a9-4fc4-bec1-b5c79908b452\") " pod="openshift-ovn-kubernetes/ovnkube-node-c4jxq" Jul 27 20:34:28.909616 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:28.909569 2572 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-qh7sb" Jul 27 20:34:28.915013 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:28.914997 2572 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-qh7sb" Jul 27 20:34:28.984528 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:28.984501 2572 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 27 20:34:28.993486 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:28.993457 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/49e86110-48a9-4fc4-bec1-b5c79908b452-ovn-node-metrics-cert\") pod \"ovnkube-node-c4jxq\" (UID: \"49e86110-48a9-4fc4-bec1-b5c79908b452\") " pod="openshift-ovn-kubernetes/ovnkube-node-c4jxq" Jul 27 20:34:28.993602 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:28.993494 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/83536de2-e5d6-4f8b-9ad4-abe6165a1039-system-cni-dir\") pod \"multus-additional-cni-plugins-qsbl2\" (UID: \"83536de2-e5d6-4f8b-9ad4-abe6165a1039\") " pod="openshift-multus/multus-additional-cni-plugins-qsbl2" Jul 27 20:34:28.993602 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:28.993522 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/bc590c0d-cfda-4a50-b9b4-3b84a5791324-original-pull-secret\") pod \"global-pull-secret-syncer-pkjs2\" (UID: \"bc590c0d-cfda-4a50-b9b4-3b84a5791324\") " pod="kube-system/global-pull-secret-syncer-pkjs2" Jul 27 20:34:28.993602 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:28.993569 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/2950235c-cbe6-4602-a643-5ba127fd1125-host-run-k8s-cni-cncf-io\") pod \"multus-sm7zg\" (UID: \"2950235c-cbe6-4602-a643-5ba127fd1125\") " pod="openshift-multus/multus-sm7zg" Jul 27 20:34:28.993746 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:28.993592 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x9hzz\" (UniqueName: \"kubernetes.io/projected/3a0188fb-210b-4c68-9d2e-9e3b2efb5bb3-kube-api-access-x9hzz\") pod \"tuned-vclmr\" (UID: \"3a0188fb-210b-4c68-9d2e-9e3b2efb5bb3\") " pod="openshift-cluster-node-tuning-operator/tuned-vclmr" Jul 27 20:34:28.993746 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:28.993623 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/114b4c57-6d52-4a6a-bd88-4fe9f017e5e8-kubelet-dir\") pod \"aws-ebs-csi-driver-node-nqf5j\" (UID: \"114b4c57-6d52-4a6a-bd88-4fe9f017e5e8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nqf5j" Jul 27 20:34:28.993746 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:28.993644 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/49e86110-48a9-4fc4-bec1-b5c79908b452-host-cni-netd\") pod \"ovnkube-node-c4jxq\" (UID: \"49e86110-48a9-4fc4-bec1-b5c79908b452\") " pod="openshift-ovn-kubernetes/ovnkube-node-c4jxq" Jul 27 20:34:28.993746 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:28.993649 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/2950235c-cbe6-4602-a643-5ba127fd1125-host-run-k8s-cni-cncf-io\") pod \"multus-sm7zg\" (UID: \"2950235c-cbe6-4602-a643-5ba127fd1125\") " pod="openshift-multus/multus-sm7zg" Jul 27 20:34:28.993746 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:28.993714 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/114b4c57-6d52-4a6a-bd88-4fe9f017e5e8-kubelet-dir\") pod \"aws-ebs-csi-driver-node-nqf5j\" (UID: \"114b4c57-6d52-4a6a-bd88-4fe9f017e5e8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nqf5j" Jul 27 20:34:28.993746 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:28.993713 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/49e86110-48a9-4fc4-bec1-b5c79908b452-host-cni-netd\") pod \"ovnkube-node-c4jxq\" (UID: \"49e86110-48a9-4fc4-bec1-b5c79908b452\") " pod="openshift-ovn-kubernetes/ovnkube-node-c4jxq" Jul 27 20:34:28.993746 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:28.993664 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/49e86110-48a9-4fc4-bec1-b5c79908b452-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-c4jxq\" (UID: \"49e86110-48a9-4fc4-bec1-b5c79908b452\") " pod="openshift-ovn-kubernetes/ovnkube-node-c4jxq" Jul 27 20:34:28.994033 ip-10-0-139-2 kubenswrapper[2572]: E0727 20:34:28.993793 2572 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 27 20:34:28.994033 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:28.993793 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/49e86110-48a9-4fc4-bec1-b5c79908b452-ovnkube-script-lib\") pod \"ovnkube-node-c4jxq\" (UID: \"49e86110-48a9-4fc4-bec1-b5c79908b452\") " pod="openshift-ovn-kubernetes/ovnkube-node-c4jxq" Jul 27 20:34:28.994033 ip-10-0-139-2 kubenswrapper[2572]: E0727 20:34:28.993859 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bc590c0d-cfda-4a50-b9b4-3b84a5791324-original-pull-secret podName:bc590c0d-cfda-4a50-b9b4-3b84a5791324 nodeName:}" failed. No retries permitted until 2026-07-27 20:34:29.493838078 +0000 UTC m=+2.963381083 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/bc590c0d-cfda-4a50-b9b4-3b84a5791324-original-pull-secret") pod "global-pull-secret-syncer-pkjs2" (UID: "bc590c0d-cfda-4a50-b9b4-3b84a5791324") : object "kube-system"/"original-pull-secret" not registered Jul 27 20:34:28.994033 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:28.993859 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/49e86110-48a9-4fc4-bec1-b5c79908b452-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-c4jxq\" (UID: \"49e86110-48a9-4fc4-bec1-b5c79908b452\") " pod="openshift-ovn-kubernetes/ovnkube-node-c4jxq" Jul 27 20:34:28.994033 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:28.993878 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/83536de2-e5d6-4f8b-9ad4-abe6165a1039-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-qsbl2\" (UID: \"83536de2-e5d6-4f8b-9ad4-abe6165a1039\") " pod="openshift-multus/multus-additional-cni-plugins-qsbl2" Jul 27 20:34:28.994033 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:28.993932 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/2950235c-cbe6-4602-a643-5ba127fd1125-host-run-multus-certs\") pod \"multus-sm7zg\" (UID: \"2950235c-cbe6-4602-a643-5ba127fd1125\") " pod="openshift-multus/multus-sm7zg" Jul 27 20:34:28.994033 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:28.993922 2572 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 27 20:34:28.994033 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:28.993941 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/83536de2-e5d6-4f8b-9ad4-abe6165a1039-system-cni-dir\") pod \"multus-additional-cni-plugins-qsbl2\" (UID: \"83536de2-e5d6-4f8b-9ad4-abe6165a1039\") " pod="openshift-multus/multus-additional-cni-plugins-qsbl2" Jul 27 20:34:28.994033 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:28.993991 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/3a0188fb-210b-4c68-9d2e-9e3b2efb5bb3-etc-systemd\") pod \"tuned-vclmr\" (UID: \"3a0188fb-210b-4c68-9d2e-9e3b2efb5bb3\") " pod="openshift-cluster-node-tuning-operator/tuned-vclmr" Jul 27 20:34:28.994428 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:28.994073 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/2950235c-cbe6-4602-a643-5ba127fd1125-host-run-multus-certs\") pod \"multus-sm7zg\" (UID: \"2950235c-cbe6-4602-a643-5ba127fd1125\") " pod="openshift-multus/multus-sm7zg" Jul 27 20:34:28.994428 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:28.994089 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/3a0188fb-210b-4c68-9d2e-9e3b2efb5bb3-etc-systemd\") pod \"tuned-vclmr\" (UID: \"3a0188fb-210b-4c68-9d2e-9e3b2efb5bb3\") " pod="openshift-cluster-node-tuning-operator/tuned-vclmr" Jul 27 20:34:28.994625 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:28.994590 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/83536de2-e5d6-4f8b-9ad4-abe6165a1039-cnibin\") pod \"multus-additional-cni-plugins-qsbl2\" (UID: \"83536de2-e5d6-4f8b-9ad4-abe6165a1039\") " pod="openshift-multus/multus-additional-cni-plugins-qsbl2" Jul 27 20:34:28.994683 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:28.994639 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wh5zk\" (UniqueName: \"kubernetes.io/projected/2950235c-cbe6-4602-a643-5ba127fd1125-kube-api-access-wh5zk\") pod \"multus-sm7zg\" (UID: \"2950235c-cbe6-4602-a643-5ba127fd1125\") " pod="openshift-multus/multus-sm7zg" Jul 27 20:34:28.994683 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:28.994646 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/49e86110-48a9-4fc4-bec1-b5c79908b452-ovnkube-script-lib\") pod \"ovnkube-node-c4jxq\" (UID: \"49e86110-48a9-4fc4-bec1-b5c79908b452\") " pod="openshift-ovn-kubernetes/ovnkube-node-c4jxq" Jul 27 20:34:28.994777 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:28.994697 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/114b4c57-6d52-4a6a-bd88-4fe9f017e5e8-device-dir\") pod \"aws-ebs-csi-driver-node-nqf5j\" (UID: \"114b4c57-6d52-4a6a-bd88-4fe9f017e5e8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nqf5j" Jul 27 20:34:28.994777 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:28.994733 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/49e86110-48a9-4fc4-bec1-b5c79908b452-log-socket\") pod \"ovnkube-node-c4jxq\" (UID: \"49e86110-48a9-4fc4-bec1-b5c79908b452\") " pod="openshift-ovn-kubernetes/ovnkube-node-c4jxq" Jul 27 20:34:28.994777 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:28.994758 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/83536de2-e5d6-4f8b-9ad4-abe6165a1039-cni-binary-copy\") pod \"multus-additional-cni-plugins-qsbl2\" (UID: \"83536de2-e5d6-4f8b-9ad4-abe6165a1039\") " pod="openshift-multus/multus-additional-cni-plugins-qsbl2" Jul 27 20:34:28.994905 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:28.994792 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/2950235c-cbe6-4602-a643-5ba127fd1125-host-var-lib-cni-multus\") pod \"multus-sm7zg\" (UID: \"2950235c-cbe6-4602-a643-5ba127fd1125\") " pod="openshift-multus/multus-sm7zg" Jul 27 20:34:28.994905 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:28.994845 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2950235c-cbe6-4602-a643-5ba127fd1125-host-var-lib-kubelet\") pod \"multus-sm7zg\" (UID: \"2950235c-cbe6-4602-a643-5ba127fd1125\") " pod="openshift-multus/multus-sm7zg" Jul 27 20:34:28.994905 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:28.994871 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2950235c-cbe6-4602-a643-5ba127fd1125-etc-kubernetes\") pod \"multus-sm7zg\" (UID: \"2950235c-cbe6-4602-a643-5ba127fd1125\") " pod="openshift-multus/multus-sm7zg" Jul 27 20:34:28.994905 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:28.994891 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/84e2598f-0da6-4f38-8dda-46b8c0fbd329-host\") pod \"node-ca-jrnhm\" (UID: \"84e2598f-0da6-4f38-8dda-46b8c0fbd329\") " pod="openshift-image-registry/node-ca-jrnhm" Jul 27 20:34:28.995073 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:28.994951 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/49e86110-48a9-4fc4-bec1-b5c79908b452-run-ovn\") pod \"ovnkube-node-c4jxq\" (UID: \"49e86110-48a9-4fc4-bec1-b5c79908b452\") " pod="openshift-ovn-kubernetes/ovnkube-node-c4jxq" Jul 27 20:34:28.995073 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:28.994969 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2950235c-cbe6-4602-a643-5ba127fd1125-host-var-lib-kubelet\") pod \"multus-sm7zg\" (UID: \"2950235c-cbe6-4602-a643-5ba127fd1125\") " pod="openshift-multus/multus-sm7zg" Jul 27 20:34:28.995073 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:28.994977 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7331b999-e372-4a69-854a-11042f5892c3-tmp-dir\") pod \"node-resolver-xrf29\" (UID: \"7331b999-e372-4a69-854a-11042f5892c3\") " pod="openshift-dns/node-resolver-xrf29" Jul 27 20:34:28.995073 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:28.995044 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/2950235c-cbe6-4602-a643-5ba127fd1125-host-var-lib-cni-multus\") pod \"multus-sm7zg\" (UID: \"2950235c-cbe6-4602-a643-5ba127fd1125\") " pod="openshift-multus/multus-sm7zg" Jul 27 20:34:28.995073 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:28.995056 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/83536de2-e5d6-4f8b-9ad4-abe6165a1039-cnibin\") pod \"multus-additional-cni-plugins-qsbl2\" (UID: \"83536de2-e5d6-4f8b-9ad4-abe6165a1039\") " pod="openshift-multus/multus-additional-cni-plugins-qsbl2" Jul 27 20:34:28.995298 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:28.995086 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/2950235c-cbe6-4602-a643-5ba127fd1125-cni-binary-copy\") pod \"multus-sm7zg\" (UID: \"2950235c-cbe6-4602-a643-5ba127fd1125\") " pod="openshift-multus/multus-sm7zg" Jul 27 20:34:28.995298 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:28.995112 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/2950235c-cbe6-4602-a643-5ba127fd1125-multus-socket-dir-parent\") pod \"multus-sm7zg\" (UID: \"2950235c-cbe6-4602-a643-5ba127fd1125\") " pod="openshift-multus/multus-sm7zg" Jul 27 20:34:28.995298 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:28.995135 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/2950235c-cbe6-4602-a643-5ba127fd1125-multus-conf-dir\") pod \"multus-sm7zg\" (UID: \"2950235c-cbe6-4602-a643-5ba127fd1125\") " pod="openshift-multus/multus-sm7zg" Jul 27 20:34:28.995298 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:28.995154 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/83536de2-e5d6-4f8b-9ad4-abe6165a1039-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-qsbl2\" (UID: \"83536de2-e5d6-4f8b-9ad4-abe6165a1039\") " pod="openshift-multus/multus-additional-cni-plugins-qsbl2" Jul 27 20:34:28.995298 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:28.995197 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d2fb5de3-00ca-444a-a828-e3938289b62d-metrics-certs\") pod \"network-metrics-daemon-87fvc\" (UID: \"d2fb5de3-00ca-444a-a828-e3938289b62d\") " pod="openshift-multus/network-metrics-daemon-87fvc" Jul 27 20:34:28.995298 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:28.994960 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/114b4c57-6d52-4a6a-bd88-4fe9f017e5e8-device-dir\") pod \"aws-ebs-csi-driver-node-nqf5j\" (UID: \"114b4c57-6d52-4a6a-bd88-4fe9f017e5e8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nqf5j" Jul 27 20:34:28.995298 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:28.995273 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/49e86110-48a9-4fc4-bec1-b5c79908b452-log-socket\") pod \"ovnkube-node-c4jxq\" (UID: \"49e86110-48a9-4fc4-bec1-b5c79908b452\") " pod="openshift-ovn-kubernetes/ovnkube-node-c4jxq" Jul 27 20:34:28.995633 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:28.995288 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/4cfaeb7a-c49a-4371-94b1-206c7298d061-iptables-alerter-script\") pod \"iptables-alerter-7x5hh\" (UID: \"4cfaeb7a-c49a-4371-94b1-206c7298d061\") " pod="openshift-network-operator/iptables-alerter-7x5hh" Jul 27 20:34:28.995633 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:28.995346 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/49e86110-48a9-4fc4-bec1-b5c79908b452-run-ovn\") pod \"ovnkube-node-c4jxq\" (UID: \"49e86110-48a9-4fc4-bec1-b5c79908b452\") " pod="openshift-ovn-kubernetes/ovnkube-node-c4jxq" Jul 27 20:34:28.995633 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:28.995357 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7331b999-e372-4a69-854a-11042f5892c3-tmp-dir\") pod \"node-resolver-xrf29\" (UID: \"7331b999-e372-4a69-854a-11042f5892c3\") " pod="openshift-dns/node-resolver-xrf29" Jul 27 20:34:28.995633 ip-10-0-139-2 kubenswrapper[2572]: E0727 20:34:28.995350 2572 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 27 20:34:28.995633 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:28.995380 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2950235c-cbe6-4602-a643-5ba127fd1125-etc-kubernetes\") pod \"multus-sm7zg\" (UID: \"2950235c-cbe6-4602-a643-5ba127fd1125\") " pod="openshift-multus/multus-sm7zg" Jul 27 20:34:28.995633 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:28.995359 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fvkr4\" (UniqueName: \"kubernetes.io/projected/4cfaeb7a-c49a-4371-94b1-206c7298d061-kube-api-access-fvkr4\") pod \"iptables-alerter-7x5hh\" (UID: \"4cfaeb7a-c49a-4371-94b1-206c7298d061\") " pod="openshift-network-operator/iptables-alerter-7x5hh" Jul 27 20:34:28.995633 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:28.995392 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/83536de2-e5d6-4f8b-9ad4-abe6165a1039-cni-binary-copy\") pod \"multus-additional-cni-plugins-qsbl2\" (UID: \"83536de2-e5d6-4f8b-9ad4-abe6165a1039\") " pod="openshift-multus/multus-additional-cni-plugins-qsbl2" Jul 27 20:34:28.995633 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:28.995416 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/49e86110-48a9-4fc4-bec1-b5c79908b452-host-kubelet\") pod \"ovnkube-node-c4jxq\" (UID: \"49e86110-48a9-4fc4-bec1-b5c79908b452\") " pod="openshift-ovn-kubernetes/ovnkube-node-c4jxq" Jul 27 20:34:28.995633 ip-10-0-139-2 kubenswrapper[2572]: E0727 20:34:28.995423 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d2fb5de3-00ca-444a-a828-e3938289b62d-metrics-certs podName:d2fb5de3-00ca-444a-a828-e3938289b62d nodeName:}" failed. No retries permitted until 2026-07-27 20:34:29.495408012 +0000 UTC m=+2.964951012 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d2fb5de3-00ca-444a-a828-e3938289b62d-metrics-certs") pod "network-metrics-daemon-87fvc" (UID: "d2fb5de3-00ca-444a-a828-e3938289b62d") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 27 20:34:28.995633 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:28.995448 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/49e86110-48a9-4fc4-bec1-b5c79908b452-host-kubelet\") pod \"ovnkube-node-c4jxq\" (UID: \"49e86110-48a9-4fc4-bec1-b5c79908b452\") " pod="openshift-ovn-kubernetes/ovnkube-node-c4jxq" Jul 27 20:34:28.995633 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:28.995448 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/84e2598f-0da6-4f38-8dda-46b8c0fbd329-host\") pod \"node-ca-jrnhm\" (UID: \"84e2598f-0da6-4f38-8dda-46b8c0fbd329\") " pod="openshift-image-registry/node-ca-jrnhm" Jul 27 20:34:28.995633 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:28.995490 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/49e86110-48a9-4fc4-bec1-b5c79908b452-run-systemd\") pod \"ovnkube-node-c4jxq\" (UID: \"49e86110-48a9-4fc4-bec1-b5c79908b452\") " pod="openshift-ovn-kubernetes/ovnkube-node-c4jxq" Jul 27 20:34:28.995633 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:28.995551 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/bc590c0d-cfda-4a50-b9b4-3b84a5791324-kubelet-config\") pod \"global-pull-secret-syncer-pkjs2\" (UID: \"bc590c0d-cfda-4a50-b9b4-3b84a5791324\") " pod="kube-system/global-pull-secret-syncer-pkjs2" Jul 27 20:34:28.995633 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:28.995474 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/2950235c-cbe6-4602-a643-5ba127fd1125-multus-conf-dir\") pod \"multus-sm7zg\" (UID: \"2950235c-cbe6-4602-a643-5ba127fd1125\") " pod="openshift-multus/multus-sm7zg" Jul 27 20:34:28.995633 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:28.995605 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jfhxs\" (UniqueName: \"kubernetes.io/projected/57b1ab27-a6ef-4880-8cc5-5cd5f9086755-kube-api-access-jfhxs\") pod \"network-check-target-j7dsg\" (UID: \"57b1ab27-a6ef-4880-8cc5-5cd5f9086755\") " pod="openshift-network-diagnostics/network-check-target-j7dsg" Jul 27 20:34:28.995633 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:28.995611 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/2950235c-cbe6-4602-a643-5ba127fd1125-multus-socket-dir-parent\") pod \"multus-sm7zg\" (UID: \"2950235c-cbe6-4602-a643-5ba127fd1125\") " pod="openshift-multus/multus-sm7zg" Jul 27 20:34:28.996328 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:28.995653 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/49e86110-48a9-4fc4-bec1-b5c79908b452-run-systemd\") pod \"ovnkube-node-c4jxq\" (UID: \"49e86110-48a9-4fc4-bec1-b5c79908b452\") " pod="openshift-ovn-kubernetes/ovnkube-node-c4jxq" Jul 27 20:34:28.996328 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:28.995685 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/2950235c-cbe6-4602-a643-5ba127fd1125-cnibin\") pod \"multus-sm7zg\" (UID: \"2950235c-cbe6-4602-a643-5ba127fd1125\") " pod="openshift-multus/multus-sm7zg" Jul 27 20:34:28.996328 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:28.995702 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/bc590c0d-cfda-4a50-b9b4-3b84a5791324-kubelet-config\") pod \"global-pull-secret-syncer-pkjs2\" (UID: \"bc590c0d-cfda-4a50-b9b4-3b84a5791324\") " pod="kube-system/global-pull-secret-syncer-pkjs2" Jul 27 20:34:28.996328 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:28.995707 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/2950235c-cbe6-4602-a643-5ba127fd1125-hostroot\") pod \"multus-sm7zg\" (UID: \"2950235c-cbe6-4602-a643-5ba127fd1125\") " pod="openshift-multus/multus-sm7zg" Jul 27 20:34:28.996328 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:28.995744 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/2950235c-cbe6-4602-a643-5ba127fd1125-hostroot\") pod \"multus-sm7zg\" (UID: \"2950235c-cbe6-4602-a643-5ba127fd1125\") " pod="openshift-multus/multus-sm7zg" Jul 27 20:34:28.996328 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:28.995742 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3a0188fb-210b-4c68-9d2e-9e3b2efb5bb3-sys\") pod \"tuned-vclmr\" (UID: \"3a0188fb-210b-4c68-9d2e-9e3b2efb5bb3\") " pod="openshift-cluster-node-tuning-operator/tuned-vclmr" Jul 27 20:34:28.996328 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:28.995799 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/2950235c-cbe6-4602-a643-5ba127fd1125-cnibin\") pod \"multus-sm7zg\" (UID: \"2950235c-cbe6-4602-a643-5ba127fd1125\") " pod="openshift-multus/multus-sm7zg" Jul 27 20:34:28.996328 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:28.995790 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3a0188fb-210b-4c68-9d2e-9e3b2efb5bb3-var-lib-kubelet\") pod \"tuned-vclmr\" (UID: \"3a0188fb-210b-4c68-9d2e-9e3b2efb5bb3\") " pod="openshift-cluster-node-tuning-operator/tuned-vclmr" Jul 27 20:34:28.996328 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:28.995844 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/84e2598f-0da6-4f38-8dda-46b8c0fbd329-serviceca\") pod \"node-ca-jrnhm\" (UID: \"84e2598f-0da6-4f38-8dda-46b8c0fbd329\") " pod="openshift-image-registry/node-ca-jrnhm" Jul 27 20:34:28.996328 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:28.995846 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3a0188fb-210b-4c68-9d2e-9e3b2efb5bb3-sys\") pod \"tuned-vclmr\" (UID: \"3a0188fb-210b-4c68-9d2e-9e3b2efb5bb3\") " pod="openshift-cluster-node-tuning-operator/tuned-vclmr" Jul 27 20:34:28.996328 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:28.995897 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/49e86110-48a9-4fc4-bec1-b5c79908b452-env-overrides\") pod \"ovnkube-node-c4jxq\" (UID: \"49e86110-48a9-4fc4-bec1-b5c79908b452\") " pod="openshift-ovn-kubernetes/ovnkube-node-c4jxq" Jul 27 20:34:28.996328 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:28.995909 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/4cfaeb7a-c49a-4371-94b1-206c7298d061-iptables-alerter-script\") pod \"iptables-alerter-7x5hh\" (UID: \"4cfaeb7a-c49a-4371-94b1-206c7298d061\") " pod="openshift-network-operator/iptables-alerter-7x5hh" Jul 27 20:34:28.996328 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:28.995910 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3a0188fb-210b-4c68-9d2e-9e3b2efb5bb3-var-lib-kubelet\") pod \"tuned-vclmr\" (UID: \"3a0188fb-210b-4c68-9d2e-9e3b2efb5bb3\") " pod="openshift-cluster-node-tuning-operator/tuned-vclmr" Jul 27 20:34:28.996328 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:28.995959 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/83536de2-e5d6-4f8b-9ad4-abe6165a1039-os-release\") pod \"multus-additional-cni-plugins-qsbl2\" (UID: \"83536de2-e5d6-4f8b-9ad4-abe6165a1039\") " pod="openshift-multus/multus-additional-cni-plugins-qsbl2" Jul 27 20:34:28.996328 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:28.996028 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/2950235c-cbe6-4602-a643-5ba127fd1125-host-run-netns\") pod \"multus-sm7zg\" (UID: \"2950235c-cbe6-4602-a643-5ba127fd1125\") " pod="openshift-multus/multus-sm7zg" Jul 27 20:34:28.996328 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:28.996051 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/3a0188fb-210b-4c68-9d2e-9e3b2efb5bb3-run\") pod \"tuned-vclmr\" (UID: \"3a0188fb-210b-4c68-9d2e-9e3b2efb5bb3\") " pod="openshift-cluster-node-tuning-operator/tuned-vclmr" Jul 27 20:34:28.996328 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:28.996073 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/3a0188fb-210b-4c68-9d2e-9e3b2efb5bb3-etc-tuned\") pod \"tuned-vclmr\" (UID: \"3a0188fb-210b-4c68-9d2e-9e3b2efb5bb3\") " pod="openshift-cluster-node-tuning-operator/tuned-vclmr" Jul 27 20:34:28.996328 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:28.996093 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/49e86110-48a9-4fc4-bec1-b5c79908b452-node-log\") pod \"ovnkube-node-c4jxq\" (UID: \"49e86110-48a9-4fc4-bec1-b5c79908b452\") " pod="openshift-ovn-kubernetes/ovnkube-node-c4jxq" Jul 27 20:34:28.997109 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:28.996115 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/bc590c0d-cfda-4a50-b9b4-3b84a5791324-dbus\") pod \"global-pull-secret-syncer-pkjs2\" (UID: \"bc590c0d-cfda-4a50-b9b4-3b84a5791324\") " pod="kube-system/global-pull-secret-syncer-pkjs2" Jul 27 20:34:28.997109 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:28.996112 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/83536de2-e5d6-4f8b-9ad4-abe6165a1039-os-release\") pod \"multus-additional-cni-plugins-qsbl2\" (UID: \"83536de2-e5d6-4f8b-9ad4-abe6165a1039\") " pod="openshift-multus/multus-additional-cni-plugins-qsbl2" Jul 27 20:34:28.997109 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:28.996151 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/114b4c57-6d52-4a6a-bd88-4fe9f017e5e8-sys-fs\") pod \"aws-ebs-csi-driver-node-nqf5j\" (UID: \"114b4c57-6d52-4a6a-bd88-4fe9f017e5e8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nqf5j" Jul 27 20:34:28.997109 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:28.996172 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/49e86110-48a9-4fc4-bec1-b5c79908b452-systemd-units\") pod \"ovnkube-node-c4jxq\" (UID: \"49e86110-48a9-4fc4-bec1-b5c79908b452\") " pod="openshift-ovn-kubernetes/ovnkube-node-c4jxq" Jul 27 20:34:28.997109 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:28.996198 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/49e86110-48a9-4fc4-bec1-b5c79908b452-var-lib-openvswitch\") pod \"ovnkube-node-c4jxq\" (UID: \"49e86110-48a9-4fc4-bec1-b5c79908b452\") " pod="openshift-ovn-kubernetes/ovnkube-node-c4jxq" Jul 27 20:34:28.997109 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:28.996234 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/2950235c-cbe6-4602-a643-5ba127fd1125-cni-binary-copy\") pod \"multus-sm7zg\" (UID: \"2950235c-cbe6-4602-a643-5ba127fd1125\") " pod="openshift-multus/multus-sm7zg" Jul 27 20:34:28.997109 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:28.996227 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vszt7\" (UniqueName: \"kubernetes.io/projected/49e86110-48a9-4fc4-bec1-b5c79908b452-kube-api-access-vszt7\") pod \"ovnkube-node-c4jxq\" (UID: \"49e86110-48a9-4fc4-bec1-b5c79908b452\") " pod="openshift-ovn-kubernetes/ovnkube-node-c4jxq" Jul 27 20:34:28.997109 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:28.996340 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/114b4c57-6d52-4a6a-bd88-4fe9f017e5e8-sys-fs\") pod \"aws-ebs-csi-driver-node-nqf5j\" (UID: \"114b4c57-6d52-4a6a-bd88-4fe9f017e5e8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nqf5j" Jul 27 20:34:28.997109 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:28.996384 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/49e86110-48a9-4fc4-bec1-b5c79908b452-node-log\") pod \"ovnkube-node-c4jxq\" (UID: \"49e86110-48a9-4fc4-bec1-b5c79908b452\") " pod="openshift-ovn-kubernetes/ovnkube-node-c4jxq" Jul 27 20:34:28.997109 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:28.996404 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/83536de2-e5d6-4f8b-9ad4-abe6165a1039-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-qsbl2\" (UID: \"83536de2-e5d6-4f8b-9ad4-abe6165a1039\") " pod="openshift-multus/multus-additional-cni-plugins-qsbl2" Jul 27 20:34:28.997109 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:28.996415 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/84e2598f-0da6-4f38-8dda-46b8c0fbd329-serviceca\") pod \"node-ca-jrnhm\" (UID: \"84e2598f-0da6-4f38-8dda-46b8c0fbd329\") " pod="openshift-image-registry/node-ca-jrnhm" Jul 27 20:34:28.997109 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:28.996439 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/2950235c-cbe6-4602-a643-5ba127fd1125-host-run-netns\") pod \"multus-sm7zg\" (UID: \"2950235c-cbe6-4602-a643-5ba127fd1125\") " pod="openshift-multus/multus-sm7zg" Jul 27 20:34:28.997109 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:28.996415 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/49e86110-48a9-4fc4-bec1-b5c79908b452-env-overrides\") pod \"ovnkube-node-c4jxq\" (UID: \"49e86110-48a9-4fc4-bec1-b5c79908b452\") " pod="openshift-ovn-kubernetes/ovnkube-node-c4jxq" Jul 27 20:34:28.997109 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:28.996444 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/2950235c-cbe6-4602-a643-5ba127fd1125-host-var-lib-cni-bin\") pod \"multus-sm7zg\" (UID: \"2950235c-cbe6-4602-a643-5ba127fd1125\") " pod="openshift-multus/multus-sm7zg" Jul 27 20:34:28.997109 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:28.996471 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/bc590c0d-cfda-4a50-b9b4-3b84a5791324-dbus\") pod \"global-pull-secret-syncer-pkjs2\" (UID: \"bc590c0d-cfda-4a50-b9b4-3b84a5791324\") " pod="kube-system/global-pull-secret-syncer-pkjs2" Jul 27 20:34:28.997109 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:28.996479 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/49e86110-48a9-4fc4-bec1-b5c79908b452-systemd-units\") pod \"ovnkube-node-c4jxq\" (UID: \"49e86110-48a9-4fc4-bec1-b5c79908b452\") " pod="openshift-ovn-kubernetes/ovnkube-node-c4jxq" Jul 27 20:34:28.997109 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:28.996526 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/3a0188fb-210b-4c68-9d2e-9e3b2efb5bb3-run\") pod \"tuned-vclmr\" (UID: \"3a0188fb-210b-4c68-9d2e-9e3b2efb5bb3\") " pod="openshift-cluster-node-tuning-operator/tuned-vclmr" Jul 27 20:34:28.997109 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:28.996536 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/49e86110-48a9-4fc4-bec1-b5c79908b452-var-lib-openvswitch\") pod \"ovnkube-node-c4jxq\" (UID: \"49e86110-48a9-4fc4-bec1-b5c79908b452\") " pod="openshift-ovn-kubernetes/ovnkube-node-c4jxq" Jul 27 20:34:28.997890 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:28.996551 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/2950235c-cbe6-4602-a643-5ba127fd1125-host-var-lib-cni-bin\") pod \"multus-sm7zg\" (UID: \"2950235c-cbe6-4602-a643-5ba127fd1125\") " pod="openshift-multus/multus-sm7zg" Jul 27 20:34:28.997890 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:28.996537 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3a0188fb-210b-4c68-9d2e-9e3b2efb5bb3-etc-kubernetes\") pod \"tuned-vclmr\" (UID: \"3a0188fb-210b-4c68-9d2e-9e3b2efb5bb3\") " pod="openshift-cluster-node-tuning-operator/tuned-vclmr" Jul 27 20:34:28.997890 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:28.996588 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/49e86110-48a9-4fc4-bec1-b5c79908b452-host-slash\") pod \"ovnkube-node-c4jxq\" (UID: \"49e86110-48a9-4fc4-bec1-b5c79908b452\") " pod="openshift-ovn-kubernetes/ovnkube-node-c4jxq" Jul 27 20:34:28.997890 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:28.996599 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3a0188fb-210b-4c68-9d2e-9e3b2efb5bb3-etc-kubernetes\") pod \"tuned-vclmr\" (UID: \"3a0188fb-210b-4c68-9d2e-9e3b2efb5bb3\") " pod="openshift-cluster-node-tuning-operator/tuned-vclmr" Jul 27 20:34:28.997890 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:28.996611 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/49e86110-48a9-4fc4-bec1-b5c79908b452-host-run-netns\") pod \"ovnkube-node-c4jxq\" (UID: \"49e86110-48a9-4fc4-bec1-b5c79908b452\") " pod="openshift-ovn-kubernetes/ovnkube-node-c4jxq" Jul 27 20:34:28.997890 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:28.996634 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/49e86110-48a9-4fc4-bec1-b5c79908b452-host-slash\") pod \"ovnkube-node-c4jxq\" (UID: \"49e86110-48a9-4fc4-bec1-b5c79908b452\") " pod="openshift-ovn-kubernetes/ovnkube-node-c4jxq" Jul 27 20:34:28.997890 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:28.996655 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2950235c-cbe6-4602-a643-5ba127fd1125-multus-cni-dir\") pod \"multus-sm7zg\" (UID: \"2950235c-cbe6-4602-a643-5ba127fd1125\") " pod="openshift-multus/multus-sm7zg" Jul 27 20:34:28.997890 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:28.996678 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/3a0188fb-210b-4c68-9d2e-9e3b2efb5bb3-etc-modprobe-d\") pod \"tuned-vclmr\" (UID: \"3a0188fb-210b-4c68-9d2e-9e3b2efb5bb3\") " pod="openshift-cluster-node-tuning-operator/tuned-vclmr" Jul 27 20:34:28.997890 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:28.996687 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/49e86110-48a9-4fc4-bec1-b5c79908b452-host-run-netns\") pod \"ovnkube-node-c4jxq\" (UID: \"49e86110-48a9-4fc4-bec1-b5c79908b452\") " pod="openshift-ovn-kubernetes/ovnkube-node-c4jxq" Jul 27 20:34:28.997890 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:28.996717 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/3a0188fb-210b-4c68-9d2e-9e3b2efb5bb3-etc-sysctl-d\") pod \"tuned-vclmr\" (UID: \"3a0188fb-210b-4c68-9d2e-9e3b2efb5bb3\") " pod="openshift-cluster-node-tuning-operator/tuned-vclmr" Jul 27 20:34:28.997890 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:28.996745 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2950235c-cbe6-4602-a643-5ba127fd1125-multus-cni-dir\") pod \"multus-sm7zg\" (UID: \"2950235c-cbe6-4602-a643-5ba127fd1125\") " pod="openshift-multus/multus-sm7zg" Jul 27 20:34:28.997890 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:28.996739 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/49e86110-48a9-4fc4-bec1-b5c79908b452-run-openvswitch\") pod \"ovnkube-node-c4jxq\" (UID: \"49e86110-48a9-4fc4-bec1-b5c79908b452\") " pod="openshift-ovn-kubernetes/ovnkube-node-c4jxq" Jul 27 20:34:28.997890 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:28.996781 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/7331b999-e372-4a69-854a-11042f5892c3-hosts-file\") pod \"node-resolver-xrf29\" (UID: \"7331b999-e372-4a69-854a-11042f5892c3\") " pod="openshift-dns/node-resolver-xrf29" Jul 27 20:34:28.997890 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:28.996802 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/3a0188fb-210b-4c68-9d2e-9e3b2efb5bb3-etc-modprobe-d\") pod \"tuned-vclmr\" (UID: \"3a0188fb-210b-4c68-9d2e-9e3b2efb5bb3\") " pod="openshift-cluster-node-tuning-operator/tuned-vclmr" Jul 27 20:34:28.997890 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:28.996813 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/49e86110-48a9-4fc4-bec1-b5c79908b452-run-openvswitch\") pod \"ovnkube-node-c4jxq\" (UID: \"49e86110-48a9-4fc4-bec1-b5c79908b452\") " pod="openshift-ovn-kubernetes/ovnkube-node-c4jxq" Jul 27 20:34:28.997890 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:28.996832 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/3a0188fb-210b-4c68-9d2e-9e3b2efb5bb3-etc-sysctl-d\") pod \"tuned-vclmr\" (UID: \"3a0188fb-210b-4c68-9d2e-9e3b2efb5bb3\") " pod="openshift-cluster-node-tuning-operator/tuned-vclmr" Jul 27 20:34:28.997890 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:28.996814 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w5t2f\" (UniqueName: \"kubernetes.io/projected/7331b999-e372-4a69-854a-11042f5892c3-kube-api-access-w5t2f\") pod \"node-resolver-xrf29\" (UID: \"7331b999-e372-4a69-854a-11042f5892c3\") " pod="openshift-dns/node-resolver-xrf29" Jul 27 20:34:28.997890 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:28.996856 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/7331b999-e372-4a69-854a-11042f5892c3-hosts-file\") pod \"node-resolver-xrf29\" (UID: \"7331b999-e372-4a69-854a-11042f5892c3\") " pod="openshift-dns/node-resolver-xrf29" Jul 27 20:34:28.998746 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:28.996872 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/2950235c-cbe6-4602-a643-5ba127fd1125-multus-daemon-config\") pod \"multus-sm7zg\" (UID: \"2950235c-cbe6-4602-a643-5ba127fd1125\") " pod="openshift-multus/multus-sm7zg" Jul 27 20:34:28.998746 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:28.996897 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sbzzq\" (UniqueName: \"kubernetes.io/projected/d2fb5de3-00ca-444a-a828-e3938289b62d-kube-api-access-sbzzq\") pod \"network-metrics-daemon-87fvc\" (UID: \"d2fb5de3-00ca-444a-a828-e3938289b62d\") " pod="openshift-multus/network-metrics-daemon-87fvc" Jul 27 20:34:28.998746 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:28.996903 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/83536de2-e5d6-4f8b-9ad4-abe6165a1039-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-qsbl2\" (UID: \"83536de2-e5d6-4f8b-9ad4-abe6165a1039\") " pod="openshift-multus/multus-additional-cni-plugins-qsbl2" Jul 27 20:34:28.998746 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:28.996940 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/83536de2-e5d6-4f8b-9ad4-abe6165a1039-tuning-conf-dir\") pod \"multus-additional-cni-plugins-qsbl2\" (UID: \"83536de2-e5d6-4f8b-9ad4-abe6165a1039\") " pod="openshift-multus/multus-additional-cni-plugins-qsbl2" Jul 27 20:34:28.998746 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:28.996998 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/3a0188fb-210b-4c68-9d2e-9e3b2efb5bb3-lib-modules\") pod \"tuned-vclmr\" (UID: \"3a0188fb-210b-4c68-9d2e-9e3b2efb5bb3\") " pod="openshift-cluster-node-tuning-operator/tuned-vclmr" Jul 27 20:34:28.998746 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:28.997024 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3a0188fb-210b-4c68-9d2e-9e3b2efb5bb3-tmp\") pod \"tuned-vclmr\" (UID: \"3a0188fb-210b-4c68-9d2e-9e3b2efb5bb3\") " pod="openshift-cluster-node-tuning-operator/tuned-vclmr" Jul 27 20:34:28.998746 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:28.997052 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/114b4c57-6d52-4a6a-bd88-4fe9f017e5e8-socket-dir\") pod \"aws-ebs-csi-driver-node-nqf5j\" (UID: \"114b4c57-6d52-4a6a-bd88-4fe9f017e5e8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nqf5j" Jul 27 20:34:28.998746 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:28.997072 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9x4bq\" (UniqueName: \"kubernetes.io/projected/84e2598f-0da6-4f38-8dda-46b8c0fbd329-kube-api-access-9x4bq\") pod \"node-ca-jrnhm\" (UID: \"84e2598f-0da6-4f38-8dda-46b8c0fbd329\") " pod="openshift-image-registry/node-ca-jrnhm" Jul 27 20:34:28.998746 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:28.997116 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/49e86110-48a9-4fc4-bec1-b5c79908b452-etc-openvswitch\") pod \"ovnkube-node-c4jxq\" (UID: \"49e86110-48a9-4fc4-bec1-b5c79908b452\") " pod="openshift-ovn-kubernetes/ovnkube-node-c4jxq" Jul 27 20:34:28.998746 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:28.997138 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lqk97\" (UniqueName: \"kubernetes.io/projected/83536de2-e5d6-4f8b-9ad4-abe6165a1039-kube-api-access-lqk97\") pod \"multus-additional-cni-plugins-qsbl2\" (UID: \"83536de2-e5d6-4f8b-9ad4-abe6165a1039\") " pod="openshift-multus/multus-additional-cni-plugins-qsbl2" Jul 27 20:34:28.998746 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:28.997174 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/83536de2-e5d6-4f8b-9ad4-abe6165a1039-tuning-conf-dir\") pod \"multus-additional-cni-plugins-qsbl2\" (UID: \"83536de2-e5d6-4f8b-9ad4-abe6165a1039\") " pod="openshift-multus/multus-additional-cni-plugins-qsbl2" Jul 27 20:34:28.998746 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:28.997349 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/3a0188fb-210b-4c68-9d2e-9e3b2efb5bb3-lib-modules\") pod \"tuned-vclmr\" (UID: \"3a0188fb-210b-4c68-9d2e-9e3b2efb5bb3\") " pod="openshift-cluster-node-tuning-operator/tuned-vclmr" Jul 27 20:34:28.998746 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:28.997411 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/2950235c-cbe6-4602-a643-5ba127fd1125-multus-daemon-config\") pod \"multus-sm7zg\" (UID: \"2950235c-cbe6-4602-a643-5ba127fd1125\") " pod="openshift-multus/multus-sm7zg" Jul 27 20:34:28.998746 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:28.997438 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/3a0188fb-210b-4c68-9d2e-9e3b2efb5bb3-etc-sysctl-conf\") pod \"tuned-vclmr\" (UID: \"3a0188fb-210b-4c68-9d2e-9e3b2efb5bb3\") " pod="openshift-cluster-node-tuning-operator/tuned-vclmr" Jul 27 20:34:28.998746 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:28.997452 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/114b4c57-6d52-4a6a-bd88-4fe9f017e5e8-socket-dir\") pod \"aws-ebs-csi-driver-node-nqf5j\" (UID: \"114b4c57-6d52-4a6a-bd88-4fe9f017e5e8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nqf5j" Jul 27 20:34:28.998746 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:28.997470 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/49e86110-48a9-4fc4-bec1-b5c79908b452-etc-openvswitch\") pod \"ovnkube-node-c4jxq\" (UID: \"49e86110-48a9-4fc4-bec1-b5c79908b452\") " pod="openshift-ovn-kubernetes/ovnkube-node-c4jxq" Jul 27 20:34:28.998746 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:28.997485 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/3a0188fb-210b-4c68-9d2e-9e3b2efb5bb3-host\") pod \"tuned-vclmr\" (UID: \"3a0188fb-210b-4c68-9d2e-9e3b2efb5bb3\") " pod="openshift-cluster-node-tuning-operator/tuned-vclmr" Jul 27 20:34:28.999454 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:28.997509 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/114b4c57-6d52-4a6a-bd88-4fe9f017e5e8-registration-dir\") pod \"aws-ebs-csi-driver-node-nqf5j\" (UID: \"114b4c57-6d52-4a6a-bd88-4fe9f017e5e8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nqf5j" Jul 27 20:34:28.999454 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:28.997539 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/114b4c57-6d52-4a6a-bd88-4fe9f017e5e8-etc-selinux\") pod \"aws-ebs-csi-driver-node-nqf5j\" (UID: \"114b4c57-6d52-4a6a-bd88-4fe9f017e5e8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nqf5j" Jul 27 20:34:28.999454 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:28.997561 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/3a0188fb-210b-4c68-9d2e-9e3b2efb5bb3-etc-sysctl-conf\") pod \"tuned-vclmr\" (UID: \"3a0188fb-210b-4c68-9d2e-9e3b2efb5bb3\") " pod="openshift-cluster-node-tuning-operator/tuned-vclmr" Jul 27 20:34:28.999454 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:28.997972 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/49e86110-48a9-4fc4-bec1-b5c79908b452-ovnkube-config\") pod \"ovnkube-node-c4jxq\" (UID: \"49e86110-48a9-4fc4-bec1-b5c79908b452\") " pod="openshift-ovn-kubernetes/ovnkube-node-c4jxq" Jul 27 20:34:28.999454 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:28.998022 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/e2759622-0ab6-46b7-b434-f0a0f8942dfe-agent-certs\") pod \"konnectivity-agent-hbpp5\" (UID: \"e2759622-0ab6-46b7-b434-f0a0f8942dfe\") " pod="kube-system/konnectivity-agent-hbpp5" Jul 27 20:34:28.999454 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:28.998044 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/e2759622-0ab6-46b7-b434-f0a0f8942dfe-konnectivity-ca\") pod \"konnectivity-agent-hbpp5\" (UID: \"e2759622-0ab6-46b7-b434-f0a0f8942dfe\") " pod="kube-system/konnectivity-agent-hbpp5" Jul 27 20:34:28.999454 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:28.998090 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fnjf6\" (UniqueName: \"kubernetes.io/projected/114b4c57-6d52-4a6a-bd88-4fe9f017e5e8-kube-api-access-fnjf6\") pod \"aws-ebs-csi-driver-node-nqf5j\" (UID: \"114b4c57-6d52-4a6a-bd88-4fe9f017e5e8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nqf5j" Jul 27 20:34:28.999454 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:28.998117 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/4cfaeb7a-c49a-4371-94b1-206c7298d061-host-slash\") pod \"iptables-alerter-7x5hh\" (UID: \"4cfaeb7a-c49a-4371-94b1-206c7298d061\") " pod="openshift-network-operator/iptables-alerter-7x5hh" Jul 27 20:34:28.999454 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:28.998150 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/49e86110-48a9-4fc4-bec1-b5c79908b452-host-run-ovn-kubernetes\") pod \"ovnkube-node-c4jxq\" (UID: \"49e86110-48a9-4fc4-bec1-b5c79908b452\") " pod="openshift-ovn-kubernetes/ovnkube-node-c4jxq" Jul 27 20:34:28.999454 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:28.998196 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/49e86110-48a9-4fc4-bec1-b5c79908b452-host-cni-bin\") pod \"ovnkube-node-c4jxq\" (UID: \"49e86110-48a9-4fc4-bec1-b5c79908b452\") " pod="openshift-ovn-kubernetes/ovnkube-node-c4jxq" Jul 27 20:34:28.999454 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:28.998227 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2950235c-cbe6-4602-a643-5ba127fd1125-system-cni-dir\") pod \"multus-sm7zg\" (UID: \"2950235c-cbe6-4602-a643-5ba127fd1125\") " pod="openshift-multus/multus-sm7zg" Jul 27 20:34:28.999454 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:28.998281 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/2950235c-cbe6-4602-a643-5ba127fd1125-os-release\") pod \"multus-sm7zg\" (UID: \"2950235c-cbe6-4602-a643-5ba127fd1125\") " pod="openshift-multus/multus-sm7zg" Jul 27 20:34:28.999454 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:28.998341 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/3a0188fb-210b-4c68-9d2e-9e3b2efb5bb3-etc-sysconfig\") pod \"tuned-vclmr\" (UID: \"3a0188fb-210b-4c68-9d2e-9e3b2efb5bb3\") " pod="openshift-cluster-node-tuning-operator/tuned-vclmr" Jul 27 20:34:28.999454 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:28.998422 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/114b4c57-6d52-4a6a-bd88-4fe9f017e5e8-etc-selinux\") pod \"aws-ebs-csi-driver-node-nqf5j\" (UID: \"114b4c57-6d52-4a6a-bd88-4fe9f017e5e8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nqf5j" Jul 27 20:34:28.999454 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:28.998526 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/49e86110-48a9-4fc4-bec1-b5c79908b452-host-run-ovn-kubernetes\") pod \"ovnkube-node-c4jxq\" (UID: \"49e86110-48a9-4fc4-bec1-b5c79908b452\") " pod="openshift-ovn-kubernetes/ovnkube-node-c4jxq" Jul 27 20:34:28.999454 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:28.998570 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/3a0188fb-210b-4c68-9d2e-9e3b2efb5bb3-etc-sysconfig\") pod \"tuned-vclmr\" (UID: \"3a0188fb-210b-4c68-9d2e-9e3b2efb5bb3\") " pod="openshift-cluster-node-tuning-operator/tuned-vclmr" Jul 27 20:34:28.999454 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:28.998621 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/49e86110-48a9-4fc4-bec1-b5c79908b452-host-cni-bin\") pod \"ovnkube-node-c4jxq\" (UID: \"49e86110-48a9-4fc4-bec1-b5c79908b452\") " pod="openshift-ovn-kubernetes/ovnkube-node-c4jxq" Jul 27 20:34:28.999916 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:28.998672 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2950235c-cbe6-4602-a643-5ba127fd1125-system-cni-dir\") pod \"multus-sm7zg\" (UID: \"2950235c-cbe6-4602-a643-5ba127fd1125\") " pod="openshift-multus/multus-sm7zg" Jul 27 20:34:28.999916 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:28.998743 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/2950235c-cbe6-4602-a643-5ba127fd1125-os-release\") pod \"multus-sm7zg\" (UID: \"2950235c-cbe6-4602-a643-5ba127fd1125\") " pod="openshift-multus/multus-sm7zg" Jul 27 20:34:28.999916 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:28.998784 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/114b4c57-6d52-4a6a-bd88-4fe9f017e5e8-registration-dir\") pod \"aws-ebs-csi-driver-node-nqf5j\" (UID: \"114b4c57-6d52-4a6a-bd88-4fe9f017e5e8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nqf5j" Jul 27 20:34:28.999916 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:28.997570 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/3a0188fb-210b-4c68-9d2e-9e3b2efb5bb3-host\") pod \"tuned-vclmr\" (UID: \"3a0188fb-210b-4c68-9d2e-9e3b2efb5bb3\") " pod="openshift-cluster-node-tuning-operator/tuned-vclmr" Jul 27 20:34:28.999916 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:28.998793 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/4cfaeb7a-c49a-4371-94b1-206c7298d061-host-slash\") pod \"iptables-alerter-7x5hh\" (UID: \"4cfaeb7a-c49a-4371-94b1-206c7298d061\") " pod="openshift-network-operator/iptables-alerter-7x5hh" Jul 27 20:34:28.999916 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:28.998908 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/e2759622-0ab6-46b7-b434-f0a0f8942dfe-konnectivity-ca\") pod \"konnectivity-agent-hbpp5\" (UID: \"e2759622-0ab6-46b7-b434-f0a0f8942dfe\") " pod="kube-system/konnectivity-agent-hbpp5" Jul 27 20:34:28.999916 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:28.999028 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/3a0188fb-210b-4c68-9d2e-9e3b2efb5bb3-etc-tuned\") pod \"tuned-vclmr\" (UID: \"3a0188fb-210b-4c68-9d2e-9e3b2efb5bb3\") " pod="openshift-cluster-node-tuning-operator/tuned-vclmr" Jul 27 20:34:28.999916 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:28.999365 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/49e86110-48a9-4fc4-bec1-b5c79908b452-ovnkube-config\") pod \"ovnkube-node-c4jxq\" (UID: \"49e86110-48a9-4fc4-bec1-b5c79908b452\") " pod="openshift-ovn-kubernetes/ovnkube-node-c4jxq" Jul 27 20:34:28.999916 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:28.999430 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3a0188fb-210b-4c68-9d2e-9e3b2efb5bb3-tmp\") pod \"tuned-vclmr\" (UID: \"3a0188fb-210b-4c68-9d2e-9e3b2efb5bb3\") " pod="openshift-cluster-node-tuning-operator/tuned-vclmr" Jul 27 20:34:29.002076 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:29.001904 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/49e86110-48a9-4fc4-bec1-b5c79908b452-ovn-node-metrics-cert\") pod \"ovnkube-node-c4jxq\" (UID: \"49e86110-48a9-4fc4-bec1-b5c79908b452\") " pod="openshift-ovn-kubernetes/ovnkube-node-c4jxq" Jul 27 20:34:29.002175 ip-10-0-139-2 kubenswrapper[2572]: E0727 20:34:29.002154 2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 27 20:34:29.002253 ip-10-0-139-2 kubenswrapper[2572]: E0727 20:34:29.002182 2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 27 20:34:29.002253 ip-10-0-139-2 kubenswrapper[2572]: E0727 20:34:29.002202 2572 projected.go:196] Error preparing data for projected volume kube-api-access-jfhxs for pod openshift-network-diagnostics/network-check-target-j7dsg: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 27 20:34:29.002401 ip-10-0-139-2 kubenswrapper[2572]: E0727 20:34:29.002379 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/57b1ab27-a6ef-4880-8cc5-5cd5f9086755-kube-api-access-jfhxs podName:57b1ab27-a6ef-4880-8cc5-5cd5f9086755 nodeName:}" failed. No retries permitted until 2026-07-27 20:34:29.502354696 +0000 UTC m=+2.971897719 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-jfhxs" (UniqueName: "kubernetes.io/projected/57b1ab27-a6ef-4880-8cc5-5cd5f9086755-kube-api-access-jfhxs") pod "network-check-target-j7dsg" (UID: "57b1ab27-a6ef-4880-8cc5-5cd5f9086755") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 27 20:34:29.006899 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:29.006420 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fvkr4\" (UniqueName: \"kubernetes.io/projected/4cfaeb7a-c49a-4371-94b1-206c7298d061-kube-api-access-fvkr4\") pod \"iptables-alerter-7x5hh\" (UID: \"4cfaeb7a-c49a-4371-94b1-206c7298d061\") " pod="openshift-network-operator/iptables-alerter-7x5hh" Jul 27 20:34:29.006899 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:29.006445 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x9hzz\" (UniqueName: \"kubernetes.io/projected/3a0188fb-210b-4c68-9d2e-9e3b2efb5bb3-kube-api-access-x9hzz\") pod \"tuned-vclmr\" (UID: \"3a0188fb-210b-4c68-9d2e-9e3b2efb5bb3\") " pod="openshift-cluster-node-tuning-operator/tuned-vclmr" Jul 27 20:34:29.006899 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:29.006425 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wh5zk\" (UniqueName: \"kubernetes.io/projected/2950235c-cbe6-4602-a643-5ba127fd1125-kube-api-access-wh5zk\") pod \"multus-sm7zg\" (UID: \"2950235c-cbe6-4602-a643-5ba127fd1125\") " pod="openshift-multus/multus-sm7zg" Jul 27 20:34:29.006899 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:29.006482 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lqk97\" (UniqueName: \"kubernetes.io/projected/83536de2-e5d6-4f8b-9ad4-abe6165a1039-kube-api-access-lqk97\") pod \"multus-additional-cni-plugins-qsbl2\" (UID: \"83536de2-e5d6-4f8b-9ad4-abe6165a1039\") " pod="openshift-multus/multus-additional-cni-plugins-qsbl2" Jul 27 20:34:29.006899 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:29.006693 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/e2759622-0ab6-46b7-b434-f0a0f8942dfe-agent-certs\") pod \"konnectivity-agent-hbpp5\" (UID: \"e2759622-0ab6-46b7-b434-f0a0f8942dfe\") " pod="kube-system/konnectivity-agent-hbpp5" Jul 27 20:34:29.006899 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:29.006832 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w5t2f\" (UniqueName: \"kubernetes.io/projected/7331b999-e372-4a69-854a-11042f5892c3-kube-api-access-w5t2f\") pod \"node-resolver-xrf29\" (UID: \"7331b999-e372-4a69-854a-11042f5892c3\") " pod="openshift-dns/node-resolver-xrf29" Jul 27 20:34:29.006899 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:29.006856 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9x4bq\" (UniqueName: \"kubernetes.io/projected/84e2598f-0da6-4f38-8dda-46b8c0fbd329-kube-api-access-9x4bq\") pod \"node-ca-jrnhm\" (UID: \"84e2598f-0da6-4f38-8dda-46b8c0fbd329\") " pod="openshift-image-registry/node-ca-jrnhm" Jul 27 20:34:29.006899 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:29.006856 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sbzzq\" (UniqueName: \"kubernetes.io/projected/d2fb5de3-00ca-444a-a828-e3938289b62d-kube-api-access-sbzzq\") pod \"network-metrics-daemon-87fvc\" (UID: \"d2fb5de3-00ca-444a-a828-e3938289b62d\") " pod="openshift-multus/network-metrics-daemon-87fvc" Jul 27 20:34:29.008043 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:29.008023 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fnjf6\" (UniqueName: \"kubernetes.io/projected/114b4c57-6d52-4a6a-bd88-4fe9f017e5e8-kube-api-access-fnjf6\") pod \"aws-ebs-csi-driver-node-nqf5j\" (UID: \"114b4c57-6d52-4a6a-bd88-4fe9f017e5e8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nqf5j" Jul 27 20:34:29.008308 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:29.008285 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vszt7\" (UniqueName: \"kubernetes.io/projected/49e86110-48a9-4fc4-bec1-b5c79908b452-kube-api-access-vszt7\") pod \"ovnkube-node-c4jxq\" (UID: \"49e86110-48a9-4fc4-bec1-b5c79908b452\") " pod="openshift-ovn-kubernetes/ovnkube-node-c4jxq" Jul 27 20:34:29.181226 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:29.181159 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-jrnhm" Jul 27 20:34:29.189771 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:29.189730 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-c4jxq" Jul 27 20:34:29.197125 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:29.197105 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-xrf29" Jul 27 20:34:29.201683 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:29.201665 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-qsbl2" Jul 27 20:34:29.208363 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:29.208345 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-sm7zg" Jul 27 20:34:29.213682 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:29.213666 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-hbpp5" Jul 27 20:34:29.220043 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:29.220028 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-vclmr" Jul 27 20:34:29.226403 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:29.226388 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nqf5j" Jul 27 20:34:29.232423 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:29.232408 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-7x5hh" Jul 27 20:34:29.500740 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:29.500671 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/bc590c0d-cfda-4a50-b9b4-3b84a5791324-original-pull-secret\") pod \"global-pull-secret-syncer-pkjs2\" (UID: \"bc590c0d-cfda-4a50-b9b4-3b84a5791324\") " pod="kube-system/global-pull-secret-syncer-pkjs2" Jul 27 20:34:29.500740 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:29.500710 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d2fb5de3-00ca-444a-a828-e3938289b62d-metrics-certs\") pod \"network-metrics-daemon-87fvc\" (UID: \"d2fb5de3-00ca-444a-a828-e3938289b62d\") " pod="openshift-multus/network-metrics-daemon-87fvc" Jul 27 20:34:29.500909 ip-10-0-139-2 kubenswrapper[2572]: E0727 20:34:29.500810 2572 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 27 20:34:29.500909 ip-10-0-139-2 kubenswrapper[2572]: E0727 20:34:29.500866 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bc590c0d-cfda-4a50-b9b4-3b84a5791324-original-pull-secret podName:bc590c0d-cfda-4a50-b9b4-3b84a5791324 nodeName:}" failed. No retries permitted until 2026-07-27 20:34:30.500851879 +0000 UTC m=+3.970394869 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/bc590c0d-cfda-4a50-b9b4-3b84a5791324-original-pull-secret") pod "global-pull-secret-syncer-pkjs2" (UID: "bc590c0d-cfda-4a50-b9b4-3b84a5791324") : object "kube-system"/"original-pull-secret" not registered Jul 27 20:34:29.500909 ip-10-0-139-2 kubenswrapper[2572]: E0727 20:34:29.500811 2572 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 27 20:34:29.501009 ip-10-0-139-2 kubenswrapper[2572]: E0727 20:34:29.500921 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d2fb5de3-00ca-444a-a828-e3938289b62d-metrics-certs podName:d2fb5de3-00ca-444a-a828-e3938289b62d nodeName:}" failed. No retries permitted until 2026-07-27 20:34:30.500909475 +0000 UTC m=+3.970452466 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d2fb5de3-00ca-444a-a828-e3938289b62d-metrics-certs") pod "network-metrics-daemon-87fvc" (UID: "d2fb5de3-00ca-444a-a828-e3938289b62d") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 27 20:34:29.602013 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:29.601986 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jfhxs\" (UniqueName: \"kubernetes.io/projected/57b1ab27-a6ef-4880-8cc5-5cd5f9086755-kube-api-access-jfhxs\") pod \"network-check-target-j7dsg\" (UID: \"57b1ab27-a6ef-4880-8cc5-5cd5f9086755\") " pod="openshift-network-diagnostics/network-check-target-j7dsg" Jul 27 20:34:29.602147 ip-10-0-139-2 kubenswrapper[2572]: E0727 20:34:29.602099 2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 27 20:34:29.602147 ip-10-0-139-2 kubenswrapper[2572]: E0727 20:34:29.602112 2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 27 20:34:29.602147 ip-10-0-139-2 kubenswrapper[2572]: E0727 20:34:29.602120 2572 projected.go:196] Error preparing data for projected volume kube-api-access-jfhxs for pod openshift-network-diagnostics/network-check-target-j7dsg: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 27 20:34:29.602258 ip-10-0-139-2 kubenswrapper[2572]: E0727 20:34:29.602169 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/57b1ab27-a6ef-4880-8cc5-5cd5f9086755-kube-api-access-jfhxs podName:57b1ab27-a6ef-4880-8cc5-5cd5f9086755 nodeName:}" failed. No retries permitted until 2026-07-27 20:34:30.602151535 +0000 UTC m=+4.071694521 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-jfhxs" (UniqueName: "kubernetes.io/projected/57b1ab27-a6ef-4880-8cc5-5cd5f9086755-kube-api-access-jfhxs") pod "network-check-target-j7dsg" (UID: "57b1ab27-a6ef-4880-8cc5-5cd5f9086755") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 27 20:34:29.615988 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:34:29.615965 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod83536de2_e5d6_4f8b_9ad4_abe6165a1039.slice/crio-926ca260a443f7d642c7561e8b51e4415744aeef033a1c1f0203416951f48faa WatchSource:0}: Error finding container 926ca260a443f7d642c7561e8b51e4415744aeef033a1c1f0203416951f48faa: Status 404 returned error can't find the container with id 926ca260a443f7d642c7561e8b51e4415744aeef033a1c1f0203416951f48faa Jul 27 20:34:29.616990 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:34:29.616957 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7331b999_e372_4a69_854a_11042f5892c3.slice/crio-09180b9a8cbb505af2f4cea70b21704c82c5c2faf6eda7d6e0fe563d2b30428a WatchSource:0}: Error finding container 09180b9a8cbb505af2f4cea70b21704c82c5c2faf6eda7d6e0fe563d2b30428a: Status 404 returned error can't find the container with id 09180b9a8cbb505af2f4cea70b21704c82c5c2faf6eda7d6e0fe563d2b30428a Jul 27 20:34:29.617370 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:34:29.617348 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod84e2598f_0da6_4f38_8dda_46b8c0fbd329.slice/crio-5a561f5f6d3e533890729a929150521393d745334faf4c6e439549246cdbc77d WatchSource:0}: Error finding container 5a561f5f6d3e533890729a929150521393d745334faf4c6e439549246cdbc77d: Status 404 returned error can't find the container with id 5a561f5f6d3e533890729a929150521393d745334faf4c6e439549246cdbc77d Jul 27 20:34:29.618007 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:34:29.617975 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod49e86110_48a9_4fc4_bec1_b5c79908b452.slice/crio-1a81429c5fbab15d72c81a66bad2bcd22b71022cd217b0cce5116cebaa7726e4 WatchSource:0}: Error finding container 1a81429c5fbab15d72c81a66bad2bcd22b71022cd217b0cce5116cebaa7726e4: Status 404 returned error can't find the container with id 1a81429c5fbab15d72c81a66bad2bcd22b71022cd217b0cce5116cebaa7726e4 Jul 27 20:34:29.619419 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:34:29.619402 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3a0188fb_210b_4c68_9d2e_9e3b2efb5bb3.slice/crio-89e68d7e5435fdbaf6c96e4f829ff86dc476ea6123d37a4bc548cf660770b1f5 WatchSource:0}: Error finding container 89e68d7e5435fdbaf6c96e4f829ff86dc476ea6123d37a4bc548cf660770b1f5: Status 404 returned error can't find the container with id 89e68d7e5435fdbaf6c96e4f829ff86dc476ea6123d37a4bc548cf660770b1f5 Jul 27 20:34:29.619969 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:34:29.619945 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod114b4c57_6d52_4a6a_bd88_4fe9f017e5e8.slice/crio-793bd426094063c7a833533491f237e38a53036466ecc9f5fbc71d597c06a56e WatchSource:0}: Error finding container 793bd426094063c7a833533491f237e38a53036466ecc9f5fbc71d597c06a56e: Status 404 returned error can't find the container with id 793bd426094063c7a833533491f237e38a53036466ecc9f5fbc71d597c06a56e Jul 27 20:34:29.622361 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:34:29.622338 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode2759622_0ab6_46b7_b434_f0a0f8942dfe.slice/crio-dc6f5d02e7493a383f996e57bf6a374543ad7e23eec8cc9de569588ce6779c76 WatchSource:0}: Error finding container dc6f5d02e7493a383f996e57bf6a374543ad7e23eec8cc9de569588ce6779c76: Status 404 returned error can't find the container with id dc6f5d02e7493a383f996e57bf6a374543ad7e23eec8cc9de569588ce6779c76 Jul 27 20:34:29.623298 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:34:29.623280 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2950235c_cbe6_4602_a643_5ba127fd1125.slice/crio-fc5d913c104ab479b89f41c77626e6d40bb42a2a776eb01a68ef96b4fb6e3432 WatchSource:0}: Error finding container fc5d913c104ab479b89f41c77626e6d40bb42a2a776eb01a68ef96b4fb6e3432: Status 404 returned error can't find the container with id fc5d913c104ab479b89f41c77626e6d40bb42a2a776eb01a68ef96b4fb6e3432 Jul 27 20:34:29.625207 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:34:29.624912 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4cfaeb7a_c49a_4371_94b1_206c7298d061.slice/crio-f2caf6bb5ef84773d2d6a457c9f845fea3e0b42653e5a36c22ede74b0e7084af WatchSource:0}: Error finding container f2caf6bb5ef84773d2d6a457c9f845fea3e0b42653e5a36c22ede74b0e7084af: Status 404 returned error can't find the container with id f2caf6bb5ef84773d2d6a457c9f845fea3e0b42653e5a36c22ede74b0e7084af Jul 27 20:34:29.917771 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:29.917588 2572 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-26 20:29:28 +0000 UTC" deadline="2028-03-14 12:18:31.884551504 +0000 UTC" Jul 27 20:34:29.917771 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:29.917768 2572 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14295h44m1.966788648s" Jul 27 20:34:30.073265 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:30.073156 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pkjs2" Jul 27 20:34:30.073411 ip-10-0-139-2 kubenswrapper[2572]: E0727 20:34:30.073278 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pkjs2" podUID="bc590c0d-cfda-4a50-b9b4-3b84a5791324" Jul 27 20:34:30.073693 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:30.073665 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-j7dsg" Jul 27 20:34:30.073797 ip-10-0-139-2 kubenswrapper[2572]: E0727 20:34:30.073760 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-j7dsg" podUID="57b1ab27-a6ef-4880-8cc5-5cd5f9086755" Jul 27 20:34:30.086809 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:30.086049 2572 generic.go:356] "Generic (PLEG): container finished" podID="da987494f0db492277bfb2ba8bab7ad0" containerID="bcb929353d9259a1738141da71dbf8e98058b2b79e3ef510120e9b20d787aff2" exitCode=0 Jul 27 20:34:30.086809 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:30.086119 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-2.ec2.internal" event={"ID":"da987494f0db492277bfb2ba8bab7ad0","Type":"ContainerDied","Data":"bcb929353d9259a1738141da71dbf8e98058b2b79e3ef510120e9b20d787aff2"} Jul 27 20:34:30.098285 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:30.098063 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-7x5hh" event={"ID":"4cfaeb7a-c49a-4371-94b1-206c7298d061","Type":"ContainerStarted","Data":"f2caf6bb5ef84773d2d6a457c9f845fea3e0b42653e5a36c22ede74b0e7084af"} Jul 27 20:34:30.110116 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:30.110045 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-hbpp5" event={"ID":"e2759622-0ab6-46b7-b434-f0a0f8942dfe","Type":"ContainerStarted","Data":"dc6f5d02e7493a383f996e57bf6a374543ad7e23eec8cc9de569588ce6779c76"} Jul 27 20:34:30.115609 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:30.115543 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nqf5j" event={"ID":"114b4c57-6d52-4a6a-bd88-4fe9f017e5e8","Type":"ContainerStarted","Data":"793bd426094063c7a833533491f237e38a53036466ecc9f5fbc71d597c06a56e"} Jul 27 20:34:30.122084 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:30.122058 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-c4jxq" event={"ID":"49e86110-48a9-4fc4-bec1-b5c79908b452","Type":"ContainerStarted","Data":"1a81429c5fbab15d72c81a66bad2bcd22b71022cd217b0cce5116cebaa7726e4"} Jul 27 20:34:30.126476 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:30.126451 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-qsbl2" event={"ID":"83536de2-e5d6-4f8b-9ad4-abe6165a1039","Type":"ContainerStarted","Data":"926ca260a443f7d642c7561e8b51e4415744aeef033a1c1f0203416951f48faa"} Jul 27 20:34:30.132079 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:30.132043 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-2.ec2.internal" event={"ID":"d7c69f721554e48d394aa7e5598261af","Type":"ContainerStarted","Data":"ab4f319bf64e2bd68df4481e786c354c898acedb2ed375cc528553bdb85b5796"} Jul 27 20:34:30.149875 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:30.149848 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-sm7zg" event={"ID":"2950235c-cbe6-4602-a643-5ba127fd1125","Type":"ContainerStarted","Data":"fc5d913c104ab479b89f41c77626e6d40bb42a2a776eb01a68ef96b4fb6e3432"} Jul 27 20:34:30.162377 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:30.162281 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-vclmr" event={"ID":"3a0188fb-210b-4c68-9d2e-9e3b2efb5bb3","Type":"ContainerStarted","Data":"89e68d7e5435fdbaf6c96e4f829ff86dc476ea6123d37a4bc548cf660770b1f5"} Jul 27 20:34:30.181851 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:30.181800 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-jrnhm" event={"ID":"84e2598f-0da6-4f38-8dda-46b8c0fbd329","Type":"ContainerStarted","Data":"5a561f5f6d3e533890729a929150521393d745334faf4c6e439549246cdbc77d"} Jul 27 20:34:30.190625 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:30.190600 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-xrf29" event={"ID":"7331b999-e372-4a69-854a-11042f5892c3","Type":"ContainerStarted","Data":"09180b9a8cbb505af2f4cea70b21704c82c5c2faf6eda7d6e0fe563d2b30428a"} Jul 27 20:34:30.512006 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:30.511927 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/bc590c0d-cfda-4a50-b9b4-3b84a5791324-original-pull-secret\") pod \"global-pull-secret-syncer-pkjs2\" (UID: \"bc590c0d-cfda-4a50-b9b4-3b84a5791324\") " pod="kube-system/global-pull-secret-syncer-pkjs2" Jul 27 20:34:30.512006 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:30.511986 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d2fb5de3-00ca-444a-a828-e3938289b62d-metrics-certs\") pod \"network-metrics-daemon-87fvc\" (UID: \"d2fb5de3-00ca-444a-a828-e3938289b62d\") " pod="openshift-multus/network-metrics-daemon-87fvc" Jul 27 20:34:30.512241 ip-10-0-139-2 kubenswrapper[2572]: E0727 20:34:30.512095 2572 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 27 20:34:30.512241 ip-10-0-139-2 kubenswrapper[2572]: E0727 20:34:30.512151 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d2fb5de3-00ca-444a-a828-e3938289b62d-metrics-certs podName:d2fb5de3-00ca-444a-a828-e3938289b62d nodeName:}" failed. No retries permitted until 2026-07-27 20:34:32.512134472 +0000 UTC m=+5.981677470 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d2fb5de3-00ca-444a-a828-e3938289b62d-metrics-certs") pod "network-metrics-daemon-87fvc" (UID: "d2fb5de3-00ca-444a-a828-e3938289b62d") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 27 20:34:30.512538 ip-10-0-139-2 kubenswrapper[2572]: E0727 20:34:30.512520 2572 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 27 20:34:30.512604 ip-10-0-139-2 kubenswrapper[2572]: E0727 20:34:30.512575 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bc590c0d-cfda-4a50-b9b4-3b84a5791324-original-pull-secret podName:bc590c0d-cfda-4a50-b9b4-3b84a5791324 nodeName:}" failed. No retries permitted until 2026-07-27 20:34:32.512561346 +0000 UTC m=+5.982104345 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/bc590c0d-cfda-4a50-b9b4-3b84a5791324-original-pull-secret") pod "global-pull-secret-syncer-pkjs2" (UID: "bc590c0d-cfda-4a50-b9b4-3b84a5791324") : object "kube-system"/"original-pull-secret" not registered Jul 27 20:34:30.612998 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:30.612963 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jfhxs\" (UniqueName: \"kubernetes.io/projected/57b1ab27-a6ef-4880-8cc5-5cd5f9086755-kube-api-access-jfhxs\") pod \"network-check-target-j7dsg\" (UID: \"57b1ab27-a6ef-4880-8cc5-5cd5f9086755\") " pod="openshift-network-diagnostics/network-check-target-j7dsg" Jul 27 20:34:30.613160 ip-10-0-139-2 kubenswrapper[2572]: E0727 20:34:30.613150 2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 27 20:34:30.613216 ip-10-0-139-2 kubenswrapper[2572]: E0727 20:34:30.613167 2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 27 20:34:30.613216 ip-10-0-139-2 kubenswrapper[2572]: E0727 20:34:30.613179 2572 projected.go:196] Error preparing data for projected volume kube-api-access-jfhxs for pod openshift-network-diagnostics/network-check-target-j7dsg: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 27 20:34:30.613344 ip-10-0-139-2 kubenswrapper[2572]: E0727 20:34:30.613234 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/57b1ab27-a6ef-4880-8cc5-5cd5f9086755-kube-api-access-jfhxs podName:57b1ab27-a6ef-4880-8cc5-5cd5f9086755 nodeName:}" failed. No retries permitted until 2026-07-27 20:34:32.613216779 +0000 UTC m=+6.082759768 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-jfhxs" (UniqueName: "kubernetes.io/projected/57b1ab27-a6ef-4880-8cc5-5cd5f9086755-kube-api-access-jfhxs") pod "network-check-target-j7dsg" (UID: "57b1ab27-a6ef-4880-8cc5-5cd5f9086755") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 27 20:34:30.918533 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:30.918416 2572 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-26 20:29:28 +0000 UTC" deadline="2028-02-15 06:04:36.513512972 +0000 UTC" Jul 27 20:34:30.918533 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:30.918481 2572 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13617h30m5.595035829s" Jul 27 20:34:31.075076 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:31.074946 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-87fvc" Jul 27 20:34:31.075237 ip-10-0-139-2 kubenswrapper[2572]: E0727 20:34:31.075080 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-87fvc" podUID="d2fb5de3-00ca-444a-a828-e3938289b62d" Jul 27 20:34:31.211134 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:31.210747 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-2.ec2.internal" event={"ID":"da987494f0db492277bfb2ba8bab7ad0","Type":"ContainerStarted","Data":"25bc8aebbcc207f7c3e210fa00d7ede700f49c89ed76523c0297ba0ce3455593"} Jul 27 20:34:31.225932 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:31.225876 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-2.ec2.internal" podStartSLOduration=3.225856988 podStartE2EDuration="3.225856988s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 20:34:28 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:34:30.148487035 +0000 UTC m=+3.618030027" watchObservedRunningTime="2026-07-27 20:34:31.225856988 +0000 UTC m=+4.695400000" Jul 27 20:34:32.072998 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:32.072946 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pkjs2" Jul 27 20:34:32.073506 ip-10-0-139-2 kubenswrapper[2572]: E0727 20:34:32.073075 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pkjs2" podUID="bc590c0d-cfda-4a50-b9b4-3b84a5791324" Jul 27 20:34:32.073573 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:32.073514 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-j7dsg" Jul 27 20:34:32.073629 ip-10-0-139-2 kubenswrapper[2572]: E0727 20:34:32.073610 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-j7dsg" podUID="57b1ab27-a6ef-4880-8cc5-5cd5f9086755" Jul 27 20:34:32.527504 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:32.527415 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d2fb5de3-00ca-444a-a828-e3938289b62d-metrics-certs\") pod \"network-metrics-daemon-87fvc\" (UID: \"d2fb5de3-00ca-444a-a828-e3938289b62d\") " pod="openshift-multus/network-metrics-daemon-87fvc" Jul 27 20:34:32.527504 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:32.527487 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/bc590c0d-cfda-4a50-b9b4-3b84a5791324-original-pull-secret\") pod \"global-pull-secret-syncer-pkjs2\" (UID: \"bc590c0d-cfda-4a50-b9b4-3b84a5791324\") " pod="kube-system/global-pull-secret-syncer-pkjs2" Jul 27 20:34:32.527730 ip-10-0-139-2 kubenswrapper[2572]: E0727 20:34:32.527599 2572 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 27 20:34:32.527730 ip-10-0-139-2 kubenswrapper[2572]: E0727 20:34:32.527648 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bc590c0d-cfda-4a50-b9b4-3b84a5791324-original-pull-secret podName:bc590c0d-cfda-4a50-b9b4-3b84a5791324 nodeName:}" failed. No retries permitted until 2026-07-27 20:34:36.527632059 +0000 UTC m=+9.997175055 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/bc590c0d-cfda-4a50-b9b4-3b84a5791324-original-pull-secret") pod "global-pull-secret-syncer-pkjs2" (UID: "bc590c0d-cfda-4a50-b9b4-3b84a5791324") : object "kube-system"/"original-pull-secret" not registered Jul 27 20:34:32.528019 ip-10-0-139-2 kubenswrapper[2572]: E0727 20:34:32.528000 2572 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 27 20:34:32.528094 ip-10-0-139-2 kubenswrapper[2572]: E0727 20:34:32.528053 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d2fb5de3-00ca-444a-a828-e3938289b62d-metrics-certs podName:d2fb5de3-00ca-444a-a828-e3938289b62d nodeName:}" failed. No retries permitted until 2026-07-27 20:34:36.52804046 +0000 UTC m=+9.997583467 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d2fb5de3-00ca-444a-a828-e3938289b62d-metrics-certs") pod "network-metrics-daemon-87fvc" (UID: "d2fb5de3-00ca-444a-a828-e3938289b62d") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 27 20:34:32.628623 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:32.628590 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jfhxs\" (UniqueName: \"kubernetes.io/projected/57b1ab27-a6ef-4880-8cc5-5cd5f9086755-kube-api-access-jfhxs\") pod \"network-check-target-j7dsg\" (UID: \"57b1ab27-a6ef-4880-8cc5-5cd5f9086755\") " pod="openshift-network-diagnostics/network-check-target-j7dsg" Jul 27 20:34:32.628904 ip-10-0-139-2 kubenswrapper[2572]: E0727 20:34:32.628885 2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 27 20:34:32.628962 ip-10-0-139-2 kubenswrapper[2572]: E0727 20:34:32.628912 2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 27 20:34:32.628962 ip-10-0-139-2 kubenswrapper[2572]: E0727 20:34:32.628926 2572 projected.go:196] Error preparing data for projected volume kube-api-access-jfhxs for pod openshift-network-diagnostics/network-check-target-j7dsg: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 27 20:34:32.629075 ip-10-0-139-2 kubenswrapper[2572]: E0727 20:34:32.628985 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/57b1ab27-a6ef-4880-8cc5-5cd5f9086755-kube-api-access-jfhxs podName:57b1ab27-a6ef-4880-8cc5-5cd5f9086755 nodeName:}" failed. No retries permitted until 2026-07-27 20:34:36.628966635 +0000 UTC m=+10.098509647 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-jfhxs" (UniqueName: "kubernetes.io/projected/57b1ab27-a6ef-4880-8cc5-5cd5f9086755-kube-api-access-jfhxs") pod "network-check-target-j7dsg" (UID: "57b1ab27-a6ef-4880-8cc5-5cd5f9086755") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 27 20:34:33.072615 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:33.072463 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-87fvc" Jul 27 20:34:33.072796 ip-10-0-139-2 kubenswrapper[2572]: E0727 20:34:33.072628 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-87fvc" podUID="d2fb5de3-00ca-444a-a828-e3938289b62d" Jul 27 20:34:34.073443 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:34.072947 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pkjs2" Jul 27 20:34:34.073443 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:34.072962 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-j7dsg" Jul 27 20:34:34.073443 ip-10-0-139-2 kubenswrapper[2572]: E0727 20:34:34.073079 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pkjs2" podUID="bc590c0d-cfda-4a50-b9b4-3b84a5791324" Jul 27 20:34:34.073443 ip-10-0-139-2 kubenswrapper[2572]: E0727 20:34:34.073210 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-j7dsg" podUID="57b1ab27-a6ef-4880-8cc5-5cd5f9086755" Jul 27 20:34:35.072596 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:35.072565 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-87fvc" Jul 27 20:34:35.072761 ip-10-0-139-2 kubenswrapper[2572]: E0727 20:34:35.072709 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-87fvc" podUID="d2fb5de3-00ca-444a-a828-e3938289b62d" Jul 27 20:34:36.072687 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:36.072650 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-j7dsg" Jul 27 20:34:36.073098 ip-10-0-139-2 kubenswrapper[2572]: E0727 20:34:36.072787 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-j7dsg" podUID="57b1ab27-a6ef-4880-8cc5-5cd5f9086755" Jul 27 20:34:36.073098 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:36.072882 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pkjs2" Jul 27 20:34:36.073098 ip-10-0-139-2 kubenswrapper[2572]: E0727 20:34:36.072989 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pkjs2" podUID="bc590c0d-cfda-4a50-b9b4-3b84a5791324" Jul 27 20:34:36.565878 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:36.565802 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/bc590c0d-cfda-4a50-b9b4-3b84a5791324-original-pull-secret\") pod \"global-pull-secret-syncer-pkjs2\" (UID: \"bc590c0d-cfda-4a50-b9b4-3b84a5791324\") " pod="kube-system/global-pull-secret-syncer-pkjs2" Jul 27 20:34:36.565878 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:36.565865 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d2fb5de3-00ca-444a-a828-e3938289b62d-metrics-certs\") pod \"network-metrics-daemon-87fvc\" (UID: \"d2fb5de3-00ca-444a-a828-e3938289b62d\") " pod="openshift-multus/network-metrics-daemon-87fvc" Jul 27 20:34:36.566097 ip-10-0-139-2 kubenswrapper[2572]: E0727 20:34:36.565985 2572 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 27 20:34:36.566097 ip-10-0-139-2 kubenswrapper[2572]: E0727 20:34:36.565985 2572 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 27 20:34:36.566097 ip-10-0-139-2 kubenswrapper[2572]: E0727 20:34:36.566046 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d2fb5de3-00ca-444a-a828-e3938289b62d-metrics-certs podName:d2fb5de3-00ca-444a-a828-e3938289b62d nodeName:}" failed. No retries permitted until 2026-07-27 20:34:44.566028036 +0000 UTC m=+18.035571026 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d2fb5de3-00ca-444a-a828-e3938289b62d-metrics-certs") pod "network-metrics-daemon-87fvc" (UID: "d2fb5de3-00ca-444a-a828-e3938289b62d") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 27 20:34:36.566097 ip-10-0-139-2 kubenswrapper[2572]: E0727 20:34:36.566067 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bc590c0d-cfda-4a50-b9b4-3b84a5791324-original-pull-secret podName:bc590c0d-cfda-4a50-b9b4-3b84a5791324 nodeName:}" failed. No retries permitted until 2026-07-27 20:34:44.566056458 +0000 UTC m=+18.035599448 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/bc590c0d-cfda-4a50-b9b4-3b84a5791324-original-pull-secret") pod "global-pull-secret-syncer-pkjs2" (UID: "bc590c0d-cfda-4a50-b9b4-3b84a5791324") : object "kube-system"/"original-pull-secret" not registered Jul 27 20:34:36.666551 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:36.666478 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jfhxs\" (UniqueName: \"kubernetes.io/projected/57b1ab27-a6ef-4880-8cc5-5cd5f9086755-kube-api-access-jfhxs\") pod \"network-check-target-j7dsg\" (UID: \"57b1ab27-a6ef-4880-8cc5-5cd5f9086755\") " pod="openshift-network-diagnostics/network-check-target-j7dsg" Jul 27 20:34:36.666726 ip-10-0-139-2 kubenswrapper[2572]: E0727 20:34:36.666698 2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 27 20:34:36.666726 ip-10-0-139-2 kubenswrapper[2572]: E0727 20:34:36.666716 2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 27 20:34:36.666839 ip-10-0-139-2 kubenswrapper[2572]: E0727 20:34:36.666728 2572 projected.go:196] Error preparing data for projected volume kube-api-access-jfhxs for pod openshift-network-diagnostics/network-check-target-j7dsg: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 27 20:34:36.666839 ip-10-0-139-2 kubenswrapper[2572]: E0727 20:34:36.666787 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/57b1ab27-a6ef-4880-8cc5-5cd5f9086755-kube-api-access-jfhxs podName:57b1ab27-a6ef-4880-8cc5-5cd5f9086755 nodeName:}" failed. No retries permitted until 2026-07-27 20:34:44.666768689 +0000 UTC m=+18.136311680 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-jfhxs" (UniqueName: "kubernetes.io/projected/57b1ab27-a6ef-4880-8cc5-5cd5f9086755-kube-api-access-jfhxs") pod "network-check-target-j7dsg" (UID: "57b1ab27-a6ef-4880-8cc5-5cd5f9086755") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 27 20:34:37.073697 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:37.073668 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-87fvc" Jul 27 20:34:37.074133 ip-10-0-139-2 kubenswrapper[2572]: E0727 20:34:37.073780 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-87fvc" podUID="d2fb5de3-00ca-444a-a828-e3938289b62d" Jul 27 20:34:38.073384 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:38.072904 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pkjs2" Jul 27 20:34:38.073384 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:38.072928 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-j7dsg" Jul 27 20:34:38.073384 ip-10-0-139-2 kubenswrapper[2572]: E0727 20:34:38.073034 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pkjs2" podUID="bc590c0d-cfda-4a50-b9b4-3b84a5791324" Jul 27 20:34:38.073384 ip-10-0-139-2 kubenswrapper[2572]: E0727 20:34:38.073272 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-j7dsg" podUID="57b1ab27-a6ef-4880-8cc5-5cd5f9086755" Jul 27 20:34:39.073127 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:39.073090 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-87fvc" Jul 27 20:34:39.073578 ip-10-0-139-2 kubenswrapper[2572]: E0727 20:34:39.073233 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-87fvc" podUID="d2fb5de3-00ca-444a-a828-e3938289b62d" Jul 27 20:34:40.072784 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:40.072752 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pkjs2" Jul 27 20:34:40.072784 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:40.072790 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-j7dsg" Jul 27 20:34:40.072989 ip-10-0-139-2 kubenswrapper[2572]: E0727 20:34:40.072866 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pkjs2" podUID="bc590c0d-cfda-4a50-b9b4-3b84a5791324" Jul 27 20:34:40.073037 ip-10-0-139-2 kubenswrapper[2572]: E0727 20:34:40.073000 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-j7dsg" podUID="57b1ab27-a6ef-4880-8cc5-5cd5f9086755" Jul 27 20:34:41.072372 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:41.072344 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-87fvc" Jul 27 20:34:41.072871 ip-10-0-139-2 kubenswrapper[2572]: E0727 20:34:41.072481 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-87fvc" podUID="d2fb5de3-00ca-444a-a828-e3938289b62d" Jul 27 20:34:42.072796 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:42.072760 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pkjs2" Jul 27 20:34:42.073185 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:42.072762 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-j7dsg" Jul 27 20:34:42.073185 ip-10-0-139-2 kubenswrapper[2572]: E0727 20:34:42.072886 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pkjs2" podUID="bc590c0d-cfda-4a50-b9b4-3b84a5791324" Jul 27 20:34:42.073185 ip-10-0-139-2 kubenswrapper[2572]: E0727 20:34:42.072978 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-j7dsg" podUID="57b1ab27-a6ef-4880-8cc5-5cd5f9086755" Jul 27 20:34:43.072985 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:43.072954 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-87fvc" Jul 27 20:34:43.073463 ip-10-0-139-2 kubenswrapper[2572]: E0727 20:34:43.073104 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-87fvc" podUID="d2fb5de3-00ca-444a-a828-e3938289b62d" Jul 27 20:34:44.072409 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:44.072375 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pkjs2" Jul 27 20:34:44.072409 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:44.072407 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-j7dsg" Jul 27 20:34:44.072739 ip-10-0-139-2 kubenswrapper[2572]: E0727 20:34:44.072506 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pkjs2" podUID="bc590c0d-cfda-4a50-b9b4-3b84a5791324" Jul 27 20:34:44.072739 ip-10-0-139-2 kubenswrapper[2572]: E0727 20:34:44.072627 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-j7dsg" podUID="57b1ab27-a6ef-4880-8cc5-5cd5f9086755" Jul 27 20:34:44.625849 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:44.625817 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/bc590c0d-cfda-4a50-b9b4-3b84a5791324-original-pull-secret\") pod \"global-pull-secret-syncer-pkjs2\" (UID: \"bc590c0d-cfda-4a50-b9b4-3b84a5791324\") " pod="kube-system/global-pull-secret-syncer-pkjs2" Jul 27 20:34:44.626265 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:44.625870 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d2fb5de3-00ca-444a-a828-e3938289b62d-metrics-certs\") pod \"network-metrics-daemon-87fvc\" (UID: \"d2fb5de3-00ca-444a-a828-e3938289b62d\") " pod="openshift-multus/network-metrics-daemon-87fvc" Jul 27 20:34:44.626265 ip-10-0-139-2 kubenswrapper[2572]: E0727 20:34:44.625982 2572 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 27 20:34:44.626265 ip-10-0-139-2 kubenswrapper[2572]: E0727 20:34:44.626041 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bc590c0d-cfda-4a50-b9b4-3b84a5791324-original-pull-secret podName:bc590c0d-cfda-4a50-b9b4-3b84a5791324 nodeName:}" failed. No retries permitted until 2026-07-27 20:35:00.626020689 +0000 UTC m=+34.095563693 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/bc590c0d-cfda-4a50-b9b4-3b84a5791324-original-pull-secret") pod "global-pull-secret-syncer-pkjs2" (UID: "bc590c0d-cfda-4a50-b9b4-3b84a5791324") : object "kube-system"/"original-pull-secret" not registered Jul 27 20:34:44.626265 ip-10-0-139-2 kubenswrapper[2572]: E0727 20:34:44.626068 2572 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 27 20:34:44.626265 ip-10-0-139-2 kubenswrapper[2572]: E0727 20:34:44.626107 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d2fb5de3-00ca-444a-a828-e3938289b62d-metrics-certs podName:d2fb5de3-00ca-444a-a828-e3938289b62d nodeName:}" failed. No retries permitted until 2026-07-27 20:35:00.626093926 +0000 UTC m=+34.095636927 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d2fb5de3-00ca-444a-a828-e3938289b62d-metrics-certs") pod "network-metrics-daemon-87fvc" (UID: "d2fb5de3-00ca-444a-a828-e3938289b62d") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 27 20:34:44.727054 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:44.727023 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jfhxs\" (UniqueName: \"kubernetes.io/projected/57b1ab27-a6ef-4880-8cc5-5cd5f9086755-kube-api-access-jfhxs\") pod \"network-check-target-j7dsg\" (UID: \"57b1ab27-a6ef-4880-8cc5-5cd5f9086755\") " pod="openshift-network-diagnostics/network-check-target-j7dsg" Jul 27 20:34:44.727226 ip-10-0-139-2 kubenswrapper[2572]: E0727 20:34:44.727207 2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 27 20:34:44.727291 ip-10-0-139-2 kubenswrapper[2572]: E0727 20:34:44.727233 2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 27 20:34:44.727291 ip-10-0-139-2 kubenswrapper[2572]: E0727 20:34:44.727246 2572 projected.go:196] Error preparing data for projected volume kube-api-access-jfhxs for pod openshift-network-diagnostics/network-check-target-j7dsg: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 27 20:34:44.727382 ip-10-0-139-2 kubenswrapper[2572]: E0727 20:34:44.727303 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/57b1ab27-a6ef-4880-8cc5-5cd5f9086755-kube-api-access-jfhxs podName:57b1ab27-a6ef-4880-8cc5-5cd5f9086755 nodeName:}" failed. No retries permitted until 2026-07-27 20:35:00.727284268 +0000 UTC m=+34.196827282 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-jfhxs" (UniqueName: "kubernetes.io/projected/57b1ab27-a6ef-4880-8cc5-5cd5f9086755-kube-api-access-jfhxs") pod "network-check-target-j7dsg" (UID: "57b1ab27-a6ef-4880-8cc5-5cd5f9086755") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 27 20:34:45.072742 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:45.072667 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-87fvc" Jul 27 20:34:45.072884 ip-10-0-139-2 kubenswrapper[2572]: E0727 20:34:45.072788 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-87fvc" podUID="d2fb5de3-00ca-444a-a828-e3938289b62d" Jul 27 20:34:46.072591 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:46.072558 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pkjs2" Jul 27 20:34:46.073062 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:46.072570 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-j7dsg" Jul 27 20:34:46.073062 ip-10-0-139-2 kubenswrapper[2572]: E0727 20:34:46.072686 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pkjs2" podUID="bc590c0d-cfda-4a50-b9b4-3b84a5791324" Jul 27 20:34:46.073062 ip-10-0-139-2 kubenswrapper[2572]: E0727 20:34:46.072783 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-j7dsg" podUID="57b1ab27-a6ef-4880-8cc5-5cd5f9086755" Jul 27 20:34:47.073853 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:47.073825 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-87fvc" Jul 27 20:34:47.074249 ip-10-0-139-2 kubenswrapper[2572]: E0727 20:34:47.073928 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-87fvc" podUID="d2fb5de3-00ca-444a-a828-e3938289b62d" Jul 27 20:34:48.074366 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:48.073713 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pkjs2" Jul 27 20:34:48.074366 ip-10-0-139-2 kubenswrapper[2572]: E0727 20:34:48.073839 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pkjs2" podUID="bc590c0d-cfda-4a50-b9b4-3b84a5791324" Jul 27 20:34:48.074366 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:48.074207 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-j7dsg" Jul 27 20:34:48.074366 ip-10-0-139-2 kubenswrapper[2572]: E0727 20:34:48.074306 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-j7dsg" podUID="57b1ab27-a6ef-4880-8cc5-5cd5f9086755" Jul 27 20:34:48.243943 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:48.243733 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-hbpp5" event={"ID":"e2759622-0ab6-46b7-b434-f0a0f8942dfe","Type":"ContainerStarted","Data":"6375853487ce9b9b8b95d1e7319bc0ff20801b58d95dda31bad923cdd995bb4e"} Jul 27 20:34:48.245591 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:48.245566 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nqf5j" event={"ID":"114b4c57-6d52-4a6a-bd88-4fe9f017e5e8","Type":"ContainerStarted","Data":"3b342b8ea5409e579d8178083e26b3822d645e31c723a4eccf039bb7cb191b8f"} Jul 27 20:34:48.247820 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:48.247256 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-c4jxq" event={"ID":"49e86110-48a9-4fc4-bec1-b5c79908b452","Type":"ContainerStarted","Data":"39243dcb38b04b8bb5cb82a0f1408d3ffb2b15d4e65cc8196eb1edb294139106"} Jul 27 20:34:48.247820 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:48.247356 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-c4jxq" event={"ID":"49e86110-48a9-4fc4-bec1-b5c79908b452","Type":"ContainerStarted","Data":"8984a7a6310ca055efdb6fff95fb194b467e87452f2187c6644e68fa639d9167"} Jul 27 20:34:48.250311 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:48.250219 2572 generic.go:356] "Generic (PLEG): container finished" podID="83536de2-e5d6-4f8b-9ad4-abe6165a1039" containerID="4d82622f7a1e56ec217c1daf1a03983757e896f1f338c6bde061568ae1ef760a" exitCode=0 Jul 27 20:34:48.250311 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:48.250301 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-qsbl2" event={"ID":"83536de2-e5d6-4f8b-9ad4-abe6165a1039","Type":"ContainerDied","Data":"4d82622f7a1e56ec217c1daf1a03983757e896f1f338c6bde061568ae1ef760a"} Jul 27 20:34:48.252577 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:48.252163 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-sm7zg" event={"ID":"2950235c-cbe6-4602-a643-5ba127fd1125","Type":"ContainerStarted","Data":"f3326cf88798c618380ae1d2b42e73f7cc79c09752b9843bb5d3b3c8101e68e3"} Jul 27 20:34:48.254480 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:48.254454 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-vclmr" event={"ID":"3a0188fb-210b-4c68-9d2e-9e3b2efb5bb3","Type":"ContainerStarted","Data":"d9427dcfd8551ebf8f02b2f3ae5dee7070cb85b3548181b6f2da3fe0aaa1fd30"} Jul 27 20:34:48.255765 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:48.255745 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-jrnhm" event={"ID":"84e2598f-0da6-4f38-8dda-46b8c0fbd329","Type":"ContainerStarted","Data":"b959c92575abaa019b86776b60489f60da366cfc6148aa76e22b83b052ec055f"} Jul 27 20:34:48.257309 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:48.257290 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-xrf29" event={"ID":"7331b999-e372-4a69-854a-11042f5892c3","Type":"ContainerStarted","Data":"3aa410f75742c3e7892ebc46a3733c3a07bf8394ec8ee031ab3357c701413814"} Jul 27 20:34:48.259030 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:48.258996 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-2.ec2.internal" podStartSLOduration=20.258984399 podStartE2EDuration="20.258984399s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 20:34:28 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:34:31.226481585 +0000 UTC m=+4.696024596" watchObservedRunningTime="2026-07-27 20:34:48.258984399 +0000 UTC m=+21.728527409" Jul 27 20:34:48.259234 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:48.259215 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-hbpp5" podStartSLOduration=3.9229425620000002 podStartE2EDuration="22.259210069s" totalImagesPullingTime="18.336267507s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 20:34:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:34:48.258833066 +0000 UTC m=+21.728376067" watchObservedRunningTime="2026-07-27 20:34:48.259210069 +0000 UTC m=+21.728753079" Jul 27 20:34:48.273017 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:48.272980 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-xrf29" podStartSLOduration=3.921386353 podStartE2EDuration="22.272966777s" totalImagesPullingTime="18.351580424s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 20:34:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:34:48.272731804 +0000 UTC m=+21.742274813" watchObservedRunningTime="2026-07-27 20:34:48.272966777 +0000 UTC m=+21.742509787" Jul 27 20:34:48.289744 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:48.289657 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-jrnhm" podStartSLOduration=3.942678775 podStartE2EDuration="22.28964377s" totalImagesPullingTime="18.346964995s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 20:34:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:34:48.289211218 +0000 UTC m=+21.758754229" watchObservedRunningTime="2026-07-27 20:34:48.28964377 +0000 UTC m=+21.759186780" Jul 27 20:34:48.323442 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:48.323403 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-sm7zg" podStartSLOduration=3.930524465 podStartE2EDuration="22.323387818s" totalImagesPullingTime="18.392863353s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 20:34:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:34:48.323240627 +0000 UTC m=+21.792783630" watchObservedRunningTime="2026-07-27 20:34:48.323387818 +0000 UTC m=+21.792930828" Jul 27 20:34:48.337655 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:48.337621 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-vclmr" podStartSLOduration=3.99831772 podStartE2EDuration="22.337607344s" totalImagesPullingTime="18.339289624s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 20:34:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:34:48.337262885 +0000 UTC m=+21.806805894" watchObservedRunningTime="2026-07-27 20:34:48.337607344 +0000 UTC m=+21.807150353" Jul 27 20:34:49.076872 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:49.076844 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-87fvc" Jul 27 20:34:49.077851 ip-10-0-139-2 kubenswrapper[2572]: E0727 20:34:49.076981 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-87fvc" podUID="d2fb5de3-00ca-444a-a828-e3938289b62d" Jul 27 20:34:49.263621 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:49.263551 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-c4jxq" event={"ID":"49e86110-48a9-4fc4-bec1-b5c79908b452","Type":"ContainerStarted","Data":"91250e4c887daaef23da1989d1f61e91000b27fc333cf885f48d282b17e14313"} Jul 27 20:34:49.263621 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:49.263626 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-c4jxq" event={"ID":"49e86110-48a9-4fc4-bec1-b5c79908b452","Type":"ContainerStarted","Data":"a8adaad465208c601b928e7fa4476aa954ae9cea3cbde9c4ad6ea376a268bfe9"} Jul 27 20:34:49.263860 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:49.263662 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-c4jxq" event={"ID":"49e86110-48a9-4fc4-bec1-b5c79908b452","Type":"ContainerStarted","Data":"9b1ca378a3e7e0e4c2924ef6cec5e287245051dae42ed367a452bb0b16bc36b1"} Jul 27 20:34:49.263860 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:49.263692 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-c4jxq" event={"ID":"49e86110-48a9-4fc4-bec1-b5c79908b452","Type":"ContainerStarted","Data":"35ac9b0dae87bd267127eb96db4bb19adebcfc69b7d1ee81e4e50e68b6d693b4"} Jul 27 20:34:49.264986 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:49.264957 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-7x5hh" event={"ID":"4cfaeb7a-c49a-4371-94b1-206c7298d061","Type":"ContainerStarted","Data":"40e01a84c747c787e65d1fe7d33356f29dd97c5deae09982da794d1add1d7f12"} Jul 27 20:34:49.283423 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:49.283381 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-7x5hh" podStartSLOduration=4.943607125 podStartE2EDuration="23.28336669s" totalImagesPullingTime="18.339759565s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 20:34:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:34:49.282891794 +0000 UTC m=+22.752434808" watchObservedRunningTime="2026-07-27 20:34:49.28336669 +0000 UTC m=+22.752909699" Jul 27 20:34:49.560933 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:49.560911 2572 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 27 20:34:49.945739 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:49.945570 2572 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-27T20:34:49.560928817Z","UUID":"606645ff-0547-4c86-b7d7-19399a9b1f88","Handler":null,"Name":"","Endpoint":""} Jul 27 20:34:49.948739 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:49.948071 2572 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 27 20:34:49.948739 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:49.948117 2572 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 27 20:34:50.073097 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:50.073060 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pkjs2" Jul 27 20:34:50.073262 ip-10-0-139-2 kubenswrapper[2572]: E0727 20:34:50.073177 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pkjs2" podUID="bc590c0d-cfda-4a50-b9b4-3b84a5791324" Jul 27 20:34:50.073262 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:50.073214 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-j7dsg" Jul 27 20:34:50.073372 ip-10-0-139-2 kubenswrapper[2572]: E0727 20:34:50.073287 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-j7dsg" podUID="57b1ab27-a6ef-4880-8cc5-5cd5f9086755" Jul 27 20:34:50.270390 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:50.270290 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nqf5j" event={"ID":"114b4c57-6d52-4a6a-bd88-4fe9f017e5e8","Type":"ContainerStarted","Data":"630897fa05caa6c4261f6277367c84f92a52875af8141f6792205d42d541a966"} Jul 27 20:34:51.072696 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:51.072651 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-87fvc" Jul 27 20:34:51.072873 ip-10-0-139-2 kubenswrapper[2572]: E0727 20:34:51.072786 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-87fvc" podUID="d2fb5de3-00ca-444a-a828-e3938289b62d" Jul 27 20:34:52.072483 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:52.072452 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-j7dsg" Jul 27 20:34:52.072861 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:52.072452 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pkjs2" Jul 27 20:34:52.072861 ip-10-0-139-2 kubenswrapper[2572]: E0727 20:34:52.072563 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-j7dsg" podUID="57b1ab27-a6ef-4880-8cc5-5cd5f9086755" Jul 27 20:34:52.072861 ip-10-0-139-2 kubenswrapper[2572]: E0727 20:34:52.072626 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pkjs2" podUID="bc590c0d-cfda-4a50-b9b4-3b84a5791324" Jul 27 20:34:52.277152 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:52.277122 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nqf5j" event={"ID":"114b4c57-6d52-4a6a-bd88-4fe9f017e5e8","Type":"ContainerStarted","Data":"56086b7e2a0c751cf7777bd024faa0c95c8f1015d3aa547afeea7f83a2d4d15b"} Jul 27 20:34:52.281523 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:52.281497 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-c4jxq" event={"ID":"49e86110-48a9-4fc4-bec1-b5c79908b452","Type":"ContainerStarted","Data":"23555fd0ae851d60e7522dcead66264c9def1897a5a395959f9978d075d728fe"} Jul 27 20:34:52.309628 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:52.309585 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nqf5j" podStartSLOduration=5.726913843 podStartE2EDuration="26.309573349s" totalImagesPullingTime="20.582659506s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 20:34:26 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:34:52.308850488 +0000 UTC m=+25.778393488" watchObservedRunningTime="2026-07-27 20:34:52.309573349 +0000 UTC m=+25.779116358" Jul 27 20:34:52.812889 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:52.812830 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-hbpp5" Jul 27 20:34:52.813852 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:52.813828 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-hbpp5" Jul 27 20:34:53.072828 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:53.072764 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-87fvc" Jul 27 20:34:53.073354 ip-10-0-139-2 kubenswrapper[2572]: E0727 20:34:53.072868 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-87fvc" podUID="d2fb5de3-00ca-444a-a828-e3938289b62d" Jul 27 20:34:53.285013 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:53.284979 2572 generic.go:356] "Generic (PLEG): container finished" podID="83536de2-e5d6-4f8b-9ad4-abe6165a1039" containerID="730a0052bba0ae8174d59243772f16b100642bb8901154a39a3497ee93dc1b50" exitCode=0 Jul 27 20:34:53.285176 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:53.285052 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-qsbl2" event={"ID":"83536de2-e5d6-4f8b-9ad4-abe6165a1039","Type":"ContainerDied","Data":"730a0052bba0ae8174d59243772f16b100642bb8901154a39a3497ee93dc1b50"} Jul 27 20:34:53.285428 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:53.285411 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-hbpp5" Jul 27 20:34:53.286007 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:53.285846 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-hbpp5" Jul 27 20:34:54.072552 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:54.072522 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pkjs2" Jul 27 20:34:54.072552 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:54.072556 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-j7dsg" Jul 27 20:34:54.072784 ip-10-0-139-2 kubenswrapper[2572]: E0727 20:34:54.072626 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pkjs2" podUID="bc590c0d-cfda-4a50-b9b4-3b84a5791324" Jul 27 20:34:54.072784 ip-10-0-139-2 kubenswrapper[2572]: E0727 20:34:54.072753 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-j7dsg" podUID="57b1ab27-a6ef-4880-8cc5-5cd5f9086755" Jul 27 20:34:55.073435 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:55.073171 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-87fvc" Jul 27 20:34:55.073890 ip-10-0-139-2 kubenswrapper[2572]: E0727 20:34:55.073548 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-87fvc" podUID="d2fb5de3-00ca-444a-a828-e3938289b62d" Jul 27 20:34:55.292949 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:55.292880 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-c4jxq" event={"ID":"49e86110-48a9-4fc4-bec1-b5c79908b452","Type":"ContainerStarted","Data":"862682516b7a99091515142abca4c43ef9ab8d960f806fa179a252ede5a7af7f"} Jul 27 20:34:55.293188 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:55.293163 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-c4jxq" Jul 27 20:34:55.293345 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:55.293239 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-c4jxq" Jul 27 20:34:55.295176 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:55.295140 2572 generic.go:356] "Generic (PLEG): container finished" podID="83536de2-e5d6-4f8b-9ad4-abe6165a1039" containerID="9ce2e18d34d3c411827c72cb94980616128dffafd3750af1bba540cb1a9ad4ba" exitCode=0 Jul 27 20:34:55.295261 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:55.295201 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-qsbl2" event={"ID":"83536de2-e5d6-4f8b-9ad4-abe6165a1039","Type":"ContainerDied","Data":"9ce2e18d34d3c411827c72cb94980616128dffafd3750af1bba540cb1a9ad4ba"} Jul 27 20:34:55.311210 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:55.311188 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-c4jxq" Jul 27 20:34:55.311306 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:55.311281 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-c4jxq" Jul 27 20:34:55.317820 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:55.317782 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-c4jxq" podStartSLOduration=10.915098448 podStartE2EDuration="29.317771042s" totalImagesPullingTime="18.402672594s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 20:34:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:34:55.316854264 +0000 UTC m=+28.786397275" watchObservedRunningTime="2026-07-27 20:34:55.317771042 +0000 UTC m=+28.787314052" Jul 27 20:34:56.072522 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:56.072479 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-j7dsg" Jul 27 20:34:56.072668 ip-10-0-139-2 kubenswrapper[2572]: E0727 20:34:56.072593 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-j7dsg" podUID="57b1ab27-a6ef-4880-8cc5-5cd5f9086755" Jul 27 20:34:56.072713 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:56.072669 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pkjs2" Jul 27 20:34:56.072808 ip-10-0-139-2 kubenswrapper[2572]: E0727 20:34:56.072785 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pkjs2" podUID="bc590c0d-cfda-4a50-b9b4-3b84a5791324" Jul 27 20:34:56.298367 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:56.298341 2572 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Jul 27 20:34:56.378767 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:56.378702 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-pkjs2"] Jul 27 20:34:56.378870 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:56.378817 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pkjs2" Jul 27 20:34:56.378950 ip-10-0-139-2 kubenswrapper[2572]: E0727 20:34:56.378926 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pkjs2" podUID="bc590c0d-cfda-4a50-b9b4-3b84a5791324" Jul 27 20:34:56.382774 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:56.382750 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-j7dsg"] Jul 27 20:34:56.382928 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:56.382800 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-87fvc"] Jul 27 20:34:56.382928 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:56.382886 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-87fvc" Jul 27 20:34:56.383030 ip-10-0-139-2 kubenswrapper[2572]: E0727 20:34:56.382983 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-87fvc" podUID="d2fb5de3-00ca-444a-a828-e3938289b62d" Jul 27 20:34:56.383082 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:56.383036 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-j7dsg" Jul 27 20:34:56.383138 ip-10-0-139-2 kubenswrapper[2572]: E0727 20:34:56.383105 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-j7dsg" podUID="57b1ab27-a6ef-4880-8cc5-5cd5f9086755" Jul 27 20:34:56.509142 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:56.509117 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-c4jxq" Jul 27 20:34:57.302910 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:57.302728 2572 generic.go:356] "Generic (PLEG): container finished" podID="83536de2-e5d6-4f8b-9ad4-abe6165a1039" containerID="fce8d3a9d2c342f3e0d5e65d86222c082323a25bfb0fd40c318f8b8cddf93da0" exitCode=0 Jul 27 20:34:57.303584 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:57.302816 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-qsbl2" event={"ID":"83536de2-e5d6-4f8b-9ad4-abe6165a1039","Type":"ContainerDied","Data":"fce8d3a9d2c342f3e0d5e65d86222c082323a25bfb0fd40c318f8b8cddf93da0"} Jul 27 20:34:58.072942 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:58.072910 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-87fvc" Jul 27 20:34:58.073108 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:58.072908 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pkjs2" Jul 27 20:34:58.073108 ip-10-0-139-2 kubenswrapper[2572]: E0727 20:34:58.073050 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-87fvc" podUID="d2fb5de3-00ca-444a-a828-e3938289b62d" Jul 27 20:34:58.073108 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:58.072911 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-j7dsg" Jul 27 20:34:58.073250 ip-10-0-139-2 kubenswrapper[2572]: E0727 20:34:58.073126 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pkjs2" podUID="bc590c0d-cfda-4a50-b9b4-3b84a5791324" Jul 27 20:34:58.073250 ip-10-0-139-2 kubenswrapper[2572]: E0727 20:34:58.073172 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-j7dsg" podUID="57b1ab27-a6ef-4880-8cc5-5cd5f9086755" Jul 27 20:34:59.848036 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:59.847964 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-2.ec2.internal" event="NodeReady" Jul 27 20:34:59.848573 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:59.848107 2572 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 27 20:34:59.892091 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:59.892059 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-w5k72"] Jul 27 20:34:59.894687 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:59.894666 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-w5k72" Jul 27 20:34:59.895205 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:59.895172 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-8hg9x"] Jul 27 20:34:59.897795 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:59.896817 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 27 20:34:59.897795 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:59.897041 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-89mzs\"" Jul 27 20:34:59.897795 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:59.897054 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-8hg9x" Jul 27 20:34:59.897795 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:59.897431 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 27 20:34:59.899354 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:59.899336 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 27 20:34:59.899767 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:59.899747 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-pmzfn\"" Jul 27 20:34:59.899846 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:59.899773 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 27 20:34:59.899934 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:59.899751 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 27 20:34:59.905428 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:59.905409 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-w5k72"] Jul 27 20:34:59.907145 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:34:59.907100 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-8hg9x"] Jul 27 20:35:00.048701 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:35:00.048667 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m6wmj\" (UniqueName: \"kubernetes.io/projected/020c2b0f-251f-48ce-b2bb-7f5006effa41-kube-api-access-m6wmj\") pod \"dns-default-w5k72\" (UID: \"020c2b0f-251f-48ce-b2bb-7f5006effa41\") " pod="openshift-dns/dns-default-w5k72" Jul 27 20:35:00.048881 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:35:00.048730 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/020c2b0f-251f-48ce-b2bb-7f5006effa41-tmp-dir\") pod \"dns-default-w5k72\" (UID: \"020c2b0f-251f-48ce-b2bb-7f5006effa41\") " pod="openshift-dns/dns-default-w5k72" Jul 27 20:35:00.048881 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:35:00.048757 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/90e4b45e-4cd9-4f54-bcd8-f3cc60b2ba83-cert\") pod \"ingress-canary-8hg9x\" (UID: \"90e4b45e-4cd9-4f54-bcd8-f3cc60b2ba83\") " pod="openshift-ingress-canary/ingress-canary-8hg9x" Jul 27 20:35:00.048881 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:35:00.048806 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/020c2b0f-251f-48ce-b2bb-7f5006effa41-metrics-tls\") pod \"dns-default-w5k72\" (UID: \"020c2b0f-251f-48ce-b2bb-7f5006effa41\") " pod="openshift-dns/dns-default-w5k72" Jul 27 20:35:00.048881 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:35:00.048865 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f9cbk\" (UniqueName: \"kubernetes.io/projected/90e4b45e-4cd9-4f54-bcd8-f3cc60b2ba83-kube-api-access-f9cbk\") pod \"ingress-canary-8hg9x\" (UID: \"90e4b45e-4cd9-4f54-bcd8-f3cc60b2ba83\") " pod="openshift-ingress-canary/ingress-canary-8hg9x" Jul 27 20:35:00.049062 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:35:00.048983 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/020c2b0f-251f-48ce-b2bb-7f5006effa41-config-volume\") pod \"dns-default-w5k72\" (UID: \"020c2b0f-251f-48ce-b2bb-7f5006effa41\") " pod="openshift-dns/dns-default-w5k72" Jul 27 20:35:00.072744 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:35:00.072712 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-87fvc" Jul 27 20:35:00.072862 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:35:00.072747 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-j7dsg" Jul 27 20:35:00.072862 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:35:00.072712 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pkjs2" Jul 27 20:35:00.075007 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:35:00.074986 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 27 20:35:00.075123 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:35:00.075042 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 27 20:35:00.075123 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:35:00.075055 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-5wzbh\"" Jul 27 20:35:00.075123 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:35:00.075116 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 27 20:35:00.075281 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:35:00.075183 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-z8hwp\"" Jul 27 20:35:00.075392 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:35:00.075376 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 27 20:35:00.150338 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:35:00.150247 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/020c2b0f-251f-48ce-b2bb-7f5006effa41-tmp-dir\") pod \"dns-default-w5k72\" (UID: \"020c2b0f-251f-48ce-b2bb-7f5006effa41\") " pod="openshift-dns/dns-default-w5k72" Jul 27 20:35:00.150338 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:35:00.150294 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/90e4b45e-4cd9-4f54-bcd8-f3cc60b2ba83-cert\") pod \"ingress-canary-8hg9x\" (UID: \"90e4b45e-4cd9-4f54-bcd8-f3cc60b2ba83\") " pod="openshift-ingress-canary/ingress-canary-8hg9x" Jul 27 20:35:00.150605 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:35:00.150342 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/020c2b0f-251f-48ce-b2bb-7f5006effa41-metrics-tls\") pod \"dns-default-w5k72\" (UID: \"020c2b0f-251f-48ce-b2bb-7f5006effa41\") " pod="openshift-dns/dns-default-w5k72" Jul 27 20:35:00.150605 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:35:00.150378 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f9cbk\" (UniqueName: \"kubernetes.io/projected/90e4b45e-4cd9-4f54-bcd8-f3cc60b2ba83-kube-api-access-f9cbk\") pod \"ingress-canary-8hg9x\" (UID: \"90e4b45e-4cd9-4f54-bcd8-f3cc60b2ba83\") " pod="openshift-ingress-canary/ingress-canary-8hg9x" Jul 27 20:35:00.150605 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:35:00.150411 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/020c2b0f-251f-48ce-b2bb-7f5006effa41-config-volume\") pod \"dns-default-w5k72\" (UID: \"020c2b0f-251f-48ce-b2bb-7f5006effa41\") " pod="openshift-dns/dns-default-w5k72" Jul 27 20:35:00.150605 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:35:00.150435 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m6wmj\" (UniqueName: \"kubernetes.io/projected/020c2b0f-251f-48ce-b2bb-7f5006effa41-kube-api-access-m6wmj\") pod \"dns-default-w5k72\" (UID: \"020c2b0f-251f-48ce-b2bb-7f5006effa41\") " pod="openshift-dns/dns-default-w5k72" Jul 27 20:35:00.150605 ip-10-0-139-2 kubenswrapper[2572]: E0727 20:35:00.150516 2572 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 27 20:35:00.150605 ip-10-0-139-2 kubenswrapper[2572]: E0727 20:35:00.150588 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/020c2b0f-251f-48ce-b2bb-7f5006effa41-metrics-tls podName:020c2b0f-251f-48ce-b2bb-7f5006effa41 nodeName:}" failed. No retries permitted until 2026-07-27 20:35:00.650567015 +0000 UTC m=+34.120110017 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/020c2b0f-251f-48ce-b2bb-7f5006effa41-metrics-tls") pod "dns-default-w5k72" (UID: "020c2b0f-251f-48ce-b2bb-7f5006effa41") : secret "dns-default-metrics-tls" not found Jul 27 20:35:00.150986 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:35:00.150623 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/020c2b0f-251f-48ce-b2bb-7f5006effa41-tmp-dir\") pod \"dns-default-w5k72\" (UID: \"020c2b0f-251f-48ce-b2bb-7f5006effa41\") " pod="openshift-dns/dns-default-w5k72" Jul 27 20:35:00.151093 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:35:00.151064 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/020c2b0f-251f-48ce-b2bb-7f5006effa41-config-volume\") pod \"dns-default-w5k72\" (UID: \"020c2b0f-251f-48ce-b2bb-7f5006effa41\") " pod="openshift-dns/dns-default-w5k72" Jul 27 20:35:00.154835 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:35:00.154815 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/90e4b45e-4cd9-4f54-bcd8-f3cc60b2ba83-cert\") pod \"ingress-canary-8hg9x\" (UID: \"90e4b45e-4cd9-4f54-bcd8-f3cc60b2ba83\") " pod="openshift-ingress-canary/ingress-canary-8hg9x" Jul 27 20:35:00.158110 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:35:00.158063 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m6wmj\" (UniqueName: \"kubernetes.io/projected/020c2b0f-251f-48ce-b2bb-7f5006effa41-kube-api-access-m6wmj\") pod \"dns-default-w5k72\" (UID: \"020c2b0f-251f-48ce-b2bb-7f5006effa41\") " pod="openshift-dns/dns-default-w5k72" Jul 27 20:35:00.158620 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:35:00.158596 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f9cbk\" (UniqueName: \"kubernetes.io/projected/90e4b45e-4cd9-4f54-bcd8-f3cc60b2ba83-kube-api-access-f9cbk\") pod \"ingress-canary-8hg9x\" (UID: \"90e4b45e-4cd9-4f54-bcd8-f3cc60b2ba83\") " pod="openshift-ingress-canary/ingress-canary-8hg9x" Jul 27 20:35:00.215542 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:35:00.215510 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-8hg9x" Jul 27 20:35:00.654952 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:35:00.654917 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/bc590c0d-cfda-4a50-b9b4-3b84a5791324-original-pull-secret\") pod \"global-pull-secret-syncer-pkjs2\" (UID: \"bc590c0d-cfda-4a50-b9b4-3b84a5791324\") " pod="kube-system/global-pull-secret-syncer-pkjs2" Jul 27 20:35:00.655114 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:35:00.654972 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/020c2b0f-251f-48ce-b2bb-7f5006effa41-metrics-tls\") pod \"dns-default-w5k72\" (UID: \"020c2b0f-251f-48ce-b2bb-7f5006effa41\") " pod="openshift-dns/dns-default-w5k72" Jul 27 20:35:00.655114 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:35:00.655013 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d2fb5de3-00ca-444a-a828-e3938289b62d-metrics-certs\") pod \"network-metrics-daemon-87fvc\" (UID: \"d2fb5de3-00ca-444a-a828-e3938289b62d\") " pod="openshift-multus/network-metrics-daemon-87fvc" Jul 27 20:35:00.655206 ip-10-0-139-2 kubenswrapper[2572]: E0727 20:35:00.655125 2572 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jul 27 20:35:00.655206 ip-10-0-139-2 kubenswrapper[2572]: E0727 20:35:00.655182 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d2fb5de3-00ca-444a-a828-e3938289b62d-metrics-certs podName:d2fb5de3-00ca-444a-a828-e3938289b62d nodeName:}" failed. No retries permitted until 2026-07-27 20:35:32.655167851 +0000 UTC m=+66.124710840 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d2fb5de3-00ca-444a-a828-e3938289b62d-metrics-certs") pod "network-metrics-daemon-87fvc" (UID: "d2fb5de3-00ca-444a-a828-e3938289b62d") : secret "metrics-daemon-secret" not found Jul 27 20:35:00.655309 ip-10-0-139-2 kubenswrapper[2572]: E0727 20:35:00.655123 2572 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 27 20:35:00.655309 ip-10-0-139-2 kubenswrapper[2572]: E0727 20:35:00.655281 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/020c2b0f-251f-48ce-b2bb-7f5006effa41-metrics-tls podName:020c2b0f-251f-48ce-b2bb-7f5006effa41 nodeName:}" failed. No retries permitted until 2026-07-27 20:35:01.655255434 +0000 UTC m=+35.124798438 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/020c2b0f-251f-48ce-b2bb-7f5006effa41-metrics-tls") pod "dns-default-w5k72" (UID: "020c2b0f-251f-48ce-b2bb-7f5006effa41") : secret "dns-default-metrics-tls" not found Jul 27 20:35:00.657515 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:35:00.657495 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/bc590c0d-cfda-4a50-b9b4-3b84a5791324-original-pull-secret\") pod \"global-pull-secret-syncer-pkjs2\" (UID: \"bc590c0d-cfda-4a50-b9b4-3b84a5791324\") " pod="kube-system/global-pull-secret-syncer-pkjs2" Jul 27 20:35:00.689483 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:35:00.689458 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pkjs2" Jul 27 20:35:00.755952 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:35:00.755921 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jfhxs\" (UniqueName: \"kubernetes.io/projected/57b1ab27-a6ef-4880-8cc5-5cd5f9086755-kube-api-access-jfhxs\") pod \"network-check-target-j7dsg\" (UID: \"57b1ab27-a6ef-4880-8cc5-5cd5f9086755\") " pod="openshift-network-diagnostics/network-check-target-j7dsg" Jul 27 20:35:00.758897 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:35:00.758874 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jfhxs\" (UniqueName: \"kubernetes.io/projected/57b1ab27-a6ef-4880-8cc5-5cd5f9086755-kube-api-access-jfhxs\") pod \"network-check-target-j7dsg\" (UID: \"57b1ab27-a6ef-4880-8cc5-5cd5f9086755\") " pod="openshift-network-diagnostics/network-check-target-j7dsg" Jul 27 20:35:00.995116 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:35:00.995028 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-j7dsg" Jul 27 20:35:01.258205 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:35:01.258045 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-pkjs2"] Jul 27 20:35:01.261552 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:35:01.261483 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-8hg9x"] Jul 27 20:35:01.262534 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:35:01.262517 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-j7dsg"] Jul 27 20:35:01.263070 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:35:01.263049 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbc590c0d_cfda_4a50_b9b4_3b84a5791324.slice/crio-12ac2216d9e036985af60f2fecc84dce32638868523b79880e2b27f996e9c0e1 WatchSource:0}: Error finding container 12ac2216d9e036985af60f2fecc84dce32638868523b79880e2b27f996e9c0e1: Status 404 returned error can't find the container with id 12ac2216d9e036985af60f2fecc84dce32638868523b79880e2b27f996e9c0e1 Jul 27 20:35:01.265988 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:35:01.265966 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod90e4b45e_4cd9_4f54_bcd8_f3cc60b2ba83.slice/crio-2b0841a655df5b82cb2e655ff6b8d50be6f2bb3f85a72d11e049125325ca6e57 WatchSource:0}: Error finding container 2b0841a655df5b82cb2e655ff6b8d50be6f2bb3f85a72d11e049125325ca6e57: Status 404 returned error can't find the container with id 2b0841a655df5b82cb2e655ff6b8d50be6f2bb3f85a72d11e049125325ca6e57 Jul 27 20:35:01.266279 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:35:01.266259 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod57b1ab27_a6ef_4880_8cc5_5cd5f9086755.slice/crio-9641d51351b8708ab14c9c9baa52f57c3f5e5a890db9f891eb39519c87c43ffa WatchSource:0}: Error finding container 9641d51351b8708ab14c9c9baa52f57c3f5e5a890db9f891eb39519c87c43ffa: Status 404 returned error can't find the container with id 9641d51351b8708ab14c9c9baa52f57c3f5e5a890db9f891eb39519c87c43ffa Jul 27 20:35:01.313904 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:35:01.313875 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-8hg9x" event={"ID":"90e4b45e-4cd9-4f54-bcd8-f3cc60b2ba83","Type":"ContainerStarted","Data":"2b0841a655df5b82cb2e655ff6b8d50be6f2bb3f85a72d11e049125325ca6e57"} Jul 27 20:35:01.315123 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:35:01.315089 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-pkjs2" event={"ID":"bc590c0d-cfda-4a50-b9b4-3b84a5791324","Type":"ContainerStarted","Data":"12ac2216d9e036985af60f2fecc84dce32638868523b79880e2b27f996e9c0e1"} Jul 27 20:35:01.316245 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:35:01.316223 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-j7dsg" event={"ID":"57b1ab27-a6ef-4880-8cc5-5cd5f9086755","Type":"ContainerStarted","Data":"9641d51351b8708ab14c9c9baa52f57c3f5e5a890db9f891eb39519c87c43ffa"} Jul 27 20:35:01.319289 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:35:01.319265 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-qsbl2" event={"ID":"83536de2-e5d6-4f8b-9ad4-abe6165a1039","Type":"ContainerStarted","Data":"248eff305ca11b47e487420202fe6136c4ec2bc8535dc64a39a116a5020179cf"} Jul 27 20:35:01.663182 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:35:01.663093 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/020c2b0f-251f-48ce-b2bb-7f5006effa41-metrics-tls\") pod \"dns-default-w5k72\" (UID: \"020c2b0f-251f-48ce-b2bb-7f5006effa41\") " pod="openshift-dns/dns-default-w5k72" Jul 27 20:35:01.663332 ip-10-0-139-2 kubenswrapper[2572]: E0727 20:35:01.663276 2572 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 27 20:35:01.663387 ip-10-0-139-2 kubenswrapper[2572]: E0727 20:35:01.663378 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/020c2b0f-251f-48ce-b2bb-7f5006effa41-metrics-tls podName:020c2b0f-251f-48ce-b2bb-7f5006effa41 nodeName:}" failed. No retries permitted until 2026-07-27 20:35:03.663352917 +0000 UTC m=+37.132895931 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/020c2b0f-251f-48ce-b2bb-7f5006effa41-metrics-tls") pod "dns-default-w5k72" (UID: "020c2b0f-251f-48ce-b2bb-7f5006effa41") : secret "dns-default-metrics-tls" not found Jul 27 20:35:02.209017 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:35:02.208981 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbpp5_e2759622-0ab6-46b7-b434-f0a0f8942dfe/konnectivity-agent/0.log" limit=1024 Jul 27 20:35:02.297568 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:35:02.297518 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbpp5_e2759622-0ab6-46b7-b434-f0a0f8942dfe/konnectivity-agent/0.log" limit=1024 Jul 27 20:35:02.328913 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:35:02.328783 2572 generic.go:356] "Generic (PLEG): container finished" podID="83536de2-e5d6-4f8b-9ad4-abe6165a1039" containerID="248eff305ca11b47e487420202fe6136c4ec2bc8535dc64a39a116a5020179cf" exitCode=0 Jul 27 20:35:02.328913 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:35:02.328826 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-qsbl2" event={"ID":"83536de2-e5d6-4f8b-9ad4-abe6165a1039","Type":"ContainerDied","Data":"248eff305ca11b47e487420202fe6136c4ec2bc8535dc64a39a116a5020179cf"} Jul 27 20:35:03.336356 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:35:03.336231 2572 generic.go:356] "Generic (PLEG): container finished" podID="83536de2-e5d6-4f8b-9ad4-abe6165a1039" containerID="12876141fe40a347e85ab5fb81e910c1824f75bf9c49ba7d40fdd431239c797b" exitCode=0 Jul 27 20:35:03.336356 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:35:03.336287 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-qsbl2" event={"ID":"83536de2-e5d6-4f8b-9ad4-abe6165a1039","Type":"ContainerDied","Data":"12876141fe40a347e85ab5fb81e910c1824f75bf9c49ba7d40fdd431239c797b"} Jul 27 20:35:03.544104 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:35:03.544062 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbpp5_e2759622-0ab6-46b7-b434-f0a0f8942dfe/konnectivity-agent/0.log" limit=1024 Jul 27 20:35:03.678416 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:35:03.678309 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/020c2b0f-251f-48ce-b2bb-7f5006effa41-metrics-tls\") pod \"dns-default-w5k72\" (UID: \"020c2b0f-251f-48ce-b2bb-7f5006effa41\") " pod="openshift-dns/dns-default-w5k72" Jul 27 20:35:03.678572 ip-10-0-139-2 kubenswrapper[2572]: E0727 20:35:03.678464 2572 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 27 20:35:03.678572 ip-10-0-139-2 kubenswrapper[2572]: E0727 20:35:03.678540 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/020c2b0f-251f-48ce-b2bb-7f5006effa41-metrics-tls podName:020c2b0f-251f-48ce-b2bb-7f5006effa41 nodeName:}" failed. No retries permitted until 2026-07-27 20:35:07.678520682 +0000 UTC m=+41.148063677 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/020c2b0f-251f-48ce-b2bb-7f5006effa41-metrics-tls") pod "dns-default-w5k72" (UID: "020c2b0f-251f-48ce-b2bb-7f5006effa41") : secret "dns-default-metrics-tls" not found Jul 27 20:35:06.281427 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:35:06.281158 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbpp5_e2759622-0ab6-46b7-b434-f0a0f8942dfe/konnectivity-agent/0.log" limit=1024 Jul 27 20:35:06.379702 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:35:06.379670 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbpp5_e2759622-0ab6-46b7-b434-f0a0f8942dfe/konnectivity-agent/0.log" limit=1024 Jul 27 20:35:06.518734 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:35:06.518690 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbpp5_e2759622-0ab6-46b7-b434-f0a0f8942dfe/konnectivity-agent/0.log" limit=1024 Jul 27 20:35:06.576459 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:35:06.576380 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbpp5_e2759622-0ab6-46b7-b434-f0a0f8942dfe/konnectivity-agent/0.log" limit=1024 Jul 27 20:35:07.009150 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:35:07.009116 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbpp5_e2759622-0ab6-46b7-b434-f0a0f8942dfe/konnectivity-agent/0.log" limit=1024 Jul 27 20:35:07.024060 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:35:07.024032 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-6865c9967-kp6jj"] Jul 27 20:35:07.039190 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:35:07.039169 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-6865c9967-kp6jj"] Jul 27 20:35:07.039302 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:35:07.039281 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-6865c9967-kp6jj" Jul 27 20:35:07.041447 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:35:07.041425 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\"" Jul 27 20:35:07.041447 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:35:07.041425 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-lbnxw\"" Jul 27 20:35:07.041699 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:35:07.041686 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\"" Jul 27 20:35:07.101091 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:35:07.101054 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbpp5_e2759622-0ab6-46b7-b434-f0a0f8942dfe/konnectivity-agent/0.log" limit=1024 Jul 27 20:35:07.199580 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:35:07.199554 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9dk5h\" (UniqueName: \"kubernetes.io/projected/2caee9ab-bf91-460d-b776-a163046deeb8-kube-api-access-9dk5h\") pod \"migrator-6865c9967-kp6jj\" (UID: \"2caee9ab-bf91-460d-b776-a163046deeb8\") " pod="openshift-kube-storage-version-migrator/migrator-6865c9967-kp6jj" Jul 27 20:35:07.204095 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:35:07.204042 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbpp5_e2759622-0ab6-46b7-b434-f0a0f8942dfe/konnectivity-agent/0.log" limit=1024 Jul 27 20:35:07.300765 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:35:07.300740 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9dk5h\" (UniqueName: \"kubernetes.io/projected/2caee9ab-bf91-460d-b776-a163046deeb8-kube-api-access-9dk5h\") pod \"migrator-6865c9967-kp6jj\" (UID: \"2caee9ab-bf91-460d-b776-a163046deeb8\") " pod="openshift-kube-storage-version-migrator/migrator-6865c9967-kp6jj" Jul 27 20:35:07.310418 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:35:07.310391 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9dk5h\" (UniqueName: \"kubernetes.io/projected/2caee9ab-bf91-460d-b776-a163046deeb8-kube-api-access-9dk5h\") pod \"migrator-6865c9967-kp6jj\" (UID: \"2caee9ab-bf91-460d-b776-a163046deeb8\") " pod="openshift-kube-storage-version-migrator/migrator-6865c9967-kp6jj" Jul 27 20:35:07.347574 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:35:07.347551 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-6865c9967-kp6jj" Jul 27 20:35:07.348889 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:35:07.348864 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-8hg9x" event={"ID":"90e4b45e-4cd9-4f54-bcd8-f3cc60b2ba83","Type":"ContainerStarted","Data":"150a381211b840a8bdf33e2d999f036c14809847799c6165de213b2b53bd3024"} Jul 27 20:35:07.351491 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:35:07.351465 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-j7dsg" event={"ID":"57b1ab27-a6ef-4880-8cc5-5cd5f9086755","Type":"ContainerStarted","Data":"33c831e79d65a1e9ada2d08874c3b66390a9720022b06dadb54a4aa8bf07135d"} Jul 27 20:35:07.351630 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:35:07.351615 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-j7dsg" Jul 27 20:35:07.355195 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:35:07.355174 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-qsbl2" event={"ID":"83536de2-e5d6-4f8b-9ad4-abe6165a1039","Type":"ContainerStarted","Data":"825cac58341fec98a10577b003f407b59ab76fb01104e043de1331c2b2ebf760"} Jul 27 20:35:07.368423 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:35:07.368386 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-8hg9x" podStartSLOduration=2.453465123 podStartE2EDuration="8.368372331s" totalImagesPullingTime="5.914907208s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 20:34:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:35:07.367877699 +0000 UTC m=+40.837420710" watchObservedRunningTime="2026-07-27 20:35:07.368372331 +0000 UTC m=+40.837915341" Jul 27 20:35:07.383032 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:35:07.382982 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-j7dsg" podStartSLOduration=35.469629807 podStartE2EDuration="41.382965894s" totalImagesPullingTime="5.913336087s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 20:34:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:35:07.38242679 +0000 UTC m=+40.851969831" watchObservedRunningTime="2026-07-27 20:35:07.382965894 +0000 UTC m=+40.852508904" Jul 27 20:35:07.405615 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:35:07.404881 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-qsbl2" podStartSLOduration=12.643289542 podStartE2EDuration="41.404859585s" totalImagesPullingTime="28.761570043s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 20:34:26 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:35:07.403893144 +0000 UTC m=+40.873436156" watchObservedRunningTime="2026-07-27 20:35:07.404859585 +0000 UTC m=+40.874402597" Jul 27 20:35:07.525139 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:35:07.525109 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-6865c9967-kp6jj"] Jul 27 20:35:07.526595 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:35:07.526570 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbpp5_e2759622-0ab6-46b7-b434-f0a0f8942dfe/konnectivity-agent/0.log" limit=1024 Jul 27 20:35:07.528786 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:35:07.528745 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2caee9ab_bf91_460d_b776_a163046deeb8.slice/crio-ff8c4968115ecc7335826038b1a63aebe8774b55bacb83d79eaa8e430ba4b969 WatchSource:0}: Error finding container ff8c4968115ecc7335826038b1a63aebe8774b55bacb83d79eaa8e430ba4b969: Status 404 returned error can't find the container with id ff8c4968115ecc7335826038b1a63aebe8774b55bacb83d79eaa8e430ba4b969 Jul 27 20:35:07.626452 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:35:07.626420 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbpp5_e2759622-0ab6-46b7-b434-f0a0f8942dfe/konnectivity-agent/0.log" limit=1024 Jul 27 20:35:07.703803 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:35:07.703776 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/020c2b0f-251f-48ce-b2bb-7f5006effa41-metrics-tls\") pod \"dns-default-w5k72\" (UID: \"020c2b0f-251f-48ce-b2bb-7f5006effa41\") " pod="openshift-dns/dns-default-w5k72" Jul 27 20:35:07.703933 ip-10-0-139-2 kubenswrapper[2572]: E0727 20:35:07.703906 2572 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 27 20:35:07.703978 ip-10-0-139-2 kubenswrapper[2572]: E0727 20:35:07.703956 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/020c2b0f-251f-48ce-b2bb-7f5006effa41-metrics-tls podName:020c2b0f-251f-48ce-b2bb-7f5006effa41 nodeName:}" failed. No retries permitted until 2026-07-27 20:35:15.703942698 +0000 UTC m=+49.173485686 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/020c2b0f-251f-48ce-b2bb-7f5006effa41-metrics-tls") pod "dns-default-w5k72" (UID: "020c2b0f-251f-48ce-b2bb-7f5006effa41") : secret "dns-default-metrics-tls" not found Jul 27 20:35:08.358644 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:35:08.358608 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-pkjs2" event={"ID":"bc590c0d-cfda-4a50-b9b4-3b84a5791324","Type":"ContainerStarted","Data":"bac473f2ec5d2d8f951fb1129c99bb4e919522fa78f36043ba42e08d94833508"} Jul 27 20:35:08.359776 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:35:08.359751 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-6865c9967-kp6jj" event={"ID":"2caee9ab-bf91-460d-b776-a163046deeb8","Type":"ContainerStarted","Data":"ff8c4968115ecc7335826038b1a63aebe8774b55bacb83d79eaa8e430ba4b969"} Jul 27 20:35:08.371789 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:35:08.371729 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-pkjs2" podStartSLOduration=36.44193567 podStartE2EDuration="42.371715857s" totalImagesPullingTime="5.929780187s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 20:34:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:35:08.37166004 +0000 UTC m=+41.841203055" watchObservedRunningTime="2026-07-27 20:35:08.371715857 +0000 UTC m=+41.841258859" Jul 27 20:35:08.683966 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:35:08.683871 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbpp5_e2759622-0ab6-46b7-b434-f0a0f8942dfe/konnectivity-agent/0.log" limit=1024 Jul 27 20:35:08.785497 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:35:08.785450 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbpp5_e2759622-0ab6-46b7-b434-f0a0f8942dfe/konnectivity-agent/0.log" limit=1024 Jul 27 20:35:09.504981 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:35:09.504949 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbpp5_e2759622-0ab6-46b7-b434-f0a0f8942dfe/konnectivity-agent/0.log" limit=1024 Jul 27 20:35:10.366359 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:35:10.366313 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-6865c9967-kp6jj" event={"ID":"2caee9ab-bf91-460d-b776-a163046deeb8","Type":"ContainerStarted","Data":"5cf1ce5eb95d470a1cc6b395b93d48dbdd74d7bf6fc66d57b4e70eaf5e9e8283"} Jul 27 20:35:10.366495 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:35:10.366377 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-6865c9967-kp6jj" event={"ID":"2caee9ab-bf91-460d-b776-a163046deeb8","Type":"ContainerStarted","Data":"b56aee48dd98b79bcc1f0f1d4809261aaa97cf0cd1ac12a3d9df09031b126f19"} Jul 27 20:35:10.382230 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:35:10.382185 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-6865c9967-kp6jj" podStartSLOduration=1.300884742 podStartE2EDuration="3.382170823s" totalImagesPullingTime="2.081286081s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 20:35:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:35:10.381454496 +0000 UTC m=+43.850997507" watchObservedRunningTime="2026-07-27 20:35:10.382170823 +0000 UTC m=+43.851713832" Jul 27 20:35:10.814288 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:35:10.814262 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbpp5_e2759622-0ab6-46b7-b434-f0a0f8942dfe/konnectivity-agent/0.log" limit=1024 Jul 27 20:35:10.914166 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:35:10.914127 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbpp5_e2759622-0ab6-46b7-b434-f0a0f8942dfe/konnectivity-agent/0.log" limit=1024 Jul 27 20:35:12.772108 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:35:12.772076 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbpp5_e2759622-0ab6-46b7-b434-f0a0f8942dfe/konnectivity-agent/0.log" limit=1024 Jul 27 20:35:12.872264 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:35:12.872233 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbpp5_e2759622-0ab6-46b7-b434-f0a0f8942dfe/konnectivity-agent/0.log" limit=1024 Jul 27 20:35:12.973573 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:35:12.973551 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbpp5_e2759622-0ab6-46b7-b434-f0a0f8942dfe/konnectivity-agent/0.log" limit=1024 Jul 27 20:35:13.073117 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:35:13.073055 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbpp5_e2759622-0ab6-46b7-b434-f0a0f8942dfe/konnectivity-agent/0.log" limit=1024 Jul 27 20:35:13.173023 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:35:13.172995 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbpp5_e2759622-0ab6-46b7-b434-f0a0f8942dfe/konnectivity-agent/0.log" limit=1024 Jul 27 20:35:13.275520 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:35:13.275492 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbpp5_e2759622-0ab6-46b7-b434-f0a0f8942dfe/konnectivity-agent/0.log" limit=1024 Jul 27 20:35:13.348965 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:35:13.348906 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbpp5_e2759622-0ab6-46b7-b434-f0a0f8942dfe/konnectivity-agent/0.log" limit=1024 Jul 27 20:35:13.469012 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:35:13.468988 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbpp5_e2759622-0ab6-46b7-b434-f0a0f8942dfe/konnectivity-agent/0.log" limit=1024 Jul 27 20:35:14.006236 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:35:14.006206 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbpp5_e2759622-0ab6-46b7-b434-f0a0f8942dfe/konnectivity-agent/0.log" limit=1024 Jul 27 20:35:14.105958 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:35:14.105935 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbpp5_e2759622-0ab6-46b7-b434-f0a0f8942dfe/konnectivity-agent/0.log" limit=1024 Jul 27 20:35:14.474542 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:35:14.474516 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbpp5_e2759622-0ab6-46b7-b434-f0a0f8942dfe/konnectivity-agent/0.log" limit=1024 Jul 27 20:35:14.865280 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:35:14.865254 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbpp5_e2759622-0ab6-46b7-b434-f0a0f8942dfe/konnectivity-agent/0.log" limit=1024 Jul 27 20:35:15.067365 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:35:15.067333 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbpp5_e2759622-0ab6-46b7-b434-f0a0f8942dfe/konnectivity-agent/0.log" limit=1024 Jul 27 20:35:15.269375 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:35:15.269352 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbpp5_e2759622-0ab6-46b7-b434-f0a0f8942dfe/konnectivity-agent/0.log" limit=1024 Jul 27 20:35:15.469889 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:35:15.469860 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbpp5_e2759622-0ab6-46b7-b434-f0a0f8942dfe/konnectivity-agent/0.log" limit=1024 Jul 27 20:35:15.754582 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:35:15.754510 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/020c2b0f-251f-48ce-b2bb-7f5006effa41-metrics-tls\") pod \"dns-default-w5k72\" (UID: \"020c2b0f-251f-48ce-b2bb-7f5006effa41\") " pod="openshift-dns/dns-default-w5k72" Jul 27 20:35:15.754706 ip-10-0-139-2 kubenswrapper[2572]: E0727 20:35:15.754623 2572 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 27 20:35:15.754706 ip-10-0-139-2 kubenswrapper[2572]: E0727 20:35:15.754684 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/020c2b0f-251f-48ce-b2bb-7f5006effa41-metrics-tls podName:020c2b0f-251f-48ce-b2bb-7f5006effa41 nodeName:}" failed. No retries permitted until 2026-07-27 20:35:31.754670783 +0000 UTC m=+65.224213774 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/020c2b0f-251f-48ce-b2bb-7f5006effa41-metrics-tls") pod "dns-default-w5k72" (UID: "020c2b0f-251f-48ce-b2bb-7f5006effa41") : secret "dns-default-metrics-tls" not found Jul 27 20:35:16.268449 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:35:16.268418 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbpp5_e2759622-0ab6-46b7-b434-f0a0f8942dfe/konnectivity-agent/0.log" limit=1024 Jul 27 20:35:16.466081 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:35:16.466047 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbpp5_e2759622-0ab6-46b7-b434-f0a0f8942dfe/konnectivity-agent/0.log" limit=1024 Jul 27 20:35:16.661371 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:35:16.661285 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbpp5_e2759622-0ab6-46b7-b434-f0a0f8942dfe/konnectivity-agent/0.log" limit=1024 Jul 27 20:35:16.722783 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:35:16.722759 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbpp5_e2759622-0ab6-46b7-b434-f0a0f8942dfe/konnectivity-agent/0.log" limit=1024 Jul 27 20:35:17.068805 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:35:17.068777 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbpp5_e2759622-0ab6-46b7-b434-f0a0f8942dfe/konnectivity-agent/0.log" limit=1024 Jul 27 20:35:17.480368 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:35:17.480287 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbpp5_e2759622-0ab6-46b7-b434-f0a0f8942dfe/konnectivity-agent/0.log" limit=1024 Jul 27 20:35:17.579938 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:35:17.579913 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbpp5_e2759622-0ab6-46b7-b434-f0a0f8942dfe/konnectivity-agent/0.log" limit=1024 Jul 27 20:35:17.863858 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:35:17.863825 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbpp5_e2759622-0ab6-46b7-b434-f0a0f8942dfe/konnectivity-agent/0.log" limit=1024 Jul 27 20:35:18.070382 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:35:18.070354 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbpp5_e2759622-0ab6-46b7-b434-f0a0f8942dfe/konnectivity-agent/0.log" limit=1024 Jul 27 20:35:18.465221 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:35:18.465188 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbpp5_e2759622-0ab6-46b7-b434-f0a0f8942dfe/konnectivity-agent/0.log" limit=1024 Jul 27 20:35:18.970056 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:35:18.970015 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbpp5_e2759622-0ab6-46b7-b434-f0a0f8942dfe/konnectivity-agent/0.log" limit=1024 Jul 27 20:35:19.268008 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:35:19.267980 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbpp5_e2759622-0ab6-46b7-b434-f0a0f8942dfe/konnectivity-agent/0.log" limit=1024 Jul 27 20:35:19.463726 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:35:19.463697 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbpp5_e2759622-0ab6-46b7-b434-f0a0f8942dfe/konnectivity-agent/0.log" limit=1024 Jul 27 20:35:19.866201 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:35:19.866171 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbpp5_e2759622-0ab6-46b7-b434-f0a0f8942dfe/konnectivity-agent/0.log" limit=1024 Jul 27 20:35:20.071958 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:35:20.071927 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbpp5_e2759622-0ab6-46b7-b434-f0a0f8942dfe/konnectivity-agent/0.log" limit=1024 Jul 27 20:35:20.173683 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:35:20.173616 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbpp5_e2759622-0ab6-46b7-b434-f0a0f8942dfe/konnectivity-agent/0.log" limit=1024 Jul 27 20:35:20.281309 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:35:20.281284 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbpp5_e2759622-0ab6-46b7-b434-f0a0f8942dfe/konnectivity-agent/0.log" limit=1024 Jul 27 20:35:20.675087 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:35:20.675060 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbpp5_e2759622-0ab6-46b7-b434-f0a0f8942dfe/konnectivity-agent/0.log" limit=1024 Jul 27 20:35:21.463607 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:35:21.463570 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbpp5_e2759622-0ab6-46b7-b434-f0a0f8942dfe/konnectivity-agent/0.log" limit=1024 Jul 27 20:35:21.667767 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:35:21.667744 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbpp5_e2759622-0ab6-46b7-b434-f0a0f8942dfe/konnectivity-agent/0.log" limit=1024 Jul 27 20:35:21.865440 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:35:21.865413 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbpp5_e2759622-0ab6-46b7-b434-f0a0f8942dfe/konnectivity-agent/0.log" limit=1024 Jul 27 20:35:22.064609 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:35:22.064585 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbpp5_e2759622-0ab6-46b7-b434-f0a0f8942dfe/konnectivity-agent/0.log" limit=1024 Jul 27 20:35:22.271666 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:35:22.271640 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbpp5_e2759622-0ab6-46b7-b434-f0a0f8942dfe/konnectivity-agent/0.log" limit=1024 Jul 27 20:35:22.876629 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:35:22.876600 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbpp5_e2759622-0ab6-46b7-b434-f0a0f8942dfe/konnectivity-agent/0.log" limit=1024 Jul 27 20:35:23.070397 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:35:23.070369 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbpp5_e2759622-0ab6-46b7-b434-f0a0f8942dfe/konnectivity-agent/0.log" limit=1024 Jul 27 20:35:28.316169 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:35:28.316132 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-c4jxq" Jul 27 20:35:28.718128 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:35:28.718057 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-5885fdb759-hmsn4"] Jul 27 20:35:28.720510 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:35:28.720494 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5885fdb759-hmsn4" Jul 27 20:35:28.722807 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:35:28.722784 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-hmtt8\"" Jul 27 20:35:28.722911 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:35:28.722812 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\"" Jul 27 20:35:28.722911 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:35:28.722785 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 27 20:35:28.722911 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:35:28.722858 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\"" Jul 27 20:35:28.723088 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:35:28.722914 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 27 20:35:28.728254 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:35:28.728229 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\"" Jul 27 20:35:28.731593 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:35:28.731575 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5885fdb759-hmsn4"] Jul 27 20:35:28.734274 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:35:28.734255 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-787769d5b-p95hv"] Jul 27 20:35:28.736252 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:35:28.736237 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-787769d5b-p95hv" Jul 27 20:35:28.738427 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:35:28.738408 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\"" Jul 27 20:35:28.738427 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:35:28.738418 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\"" Jul 27 20:35:28.738573 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:35:28.738407 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\"" Jul 27 20:35:28.738573 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:35:28.738410 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Jul 27 20:35:28.738573 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:35:28.738410 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\"" Jul 27 20:35:28.738838 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:35:28.738820 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Jul 27 20:35:28.738906 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:35:28.738888 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Jul 27 20:35:28.751629 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:35:28.751606 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-787769d5b-p95hv"] Jul 27 20:35:28.839342 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:35:28.839303 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/d41386c0-1e68-44e5-992c-1bb4a72c4a07-hub\") pod \"cluster-proxy-proxy-agent-787769d5b-p95hv\" (UID: \"d41386c0-1e68-44e5-992c-1bb4a72c4a07\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-787769d5b-p95hv" Jul 27 20:35:28.839478 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:35:28.839355 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/d41386c0-1e68-44e5-992c-1bb4a72c4a07-ca\") pod \"cluster-proxy-proxy-agent-787769d5b-p95hv\" (UID: \"d41386c0-1e68-44e5-992c-1bb4a72c4a07\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-787769d5b-p95hv" Jul 27 20:35:28.839478 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:35:28.839380 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/d41386c0-1e68-44e5-992c-1bb4a72c4a07-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-787769d5b-p95hv\" (UID: \"d41386c0-1e68-44e5-992c-1bb4a72c4a07\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-787769d5b-p95hv" Jul 27 20:35:28.839478 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:35:28.839437 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/d41386c0-1e68-44e5-992c-1bb4a72c4a07-additional-service-ca\") pod \"cluster-proxy-proxy-agent-787769d5b-p95hv\" (UID: \"d41386c0-1e68-44e5-992c-1bb4a72c4a07\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-787769d5b-p95hv" Jul 27 20:35:28.839578 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:35:28.839487 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-phhs9\" (UniqueName: \"kubernetes.io/projected/5bf027b2-e887-41cd-a84c-7a027003ae96-kube-api-access-phhs9\") pod \"insights-operator-5885fdb759-hmsn4\" (UID: \"5bf027b2-e887-41cd-a84c-7a027003ae96\") " pod="openshift-insights/insights-operator-5885fdb759-hmsn4" Jul 27 20:35:28.839578 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:35:28.839509 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/d41386c0-1e68-44e5-992c-1bb4a72c4a07-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-787769d5b-p95hv\" (UID: \"d41386c0-1e68-44e5-992c-1bb4a72c4a07\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-787769d5b-p95hv" Jul 27 20:35:28.839578 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:35:28.839538 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5bf027b2-e887-41cd-a84c-7a027003ae96-tmp\") pod \"insights-operator-5885fdb759-hmsn4\" (UID: \"5bf027b2-e887-41cd-a84c-7a027003ae96\") " pod="openshift-insights/insights-operator-5885fdb759-hmsn4" Jul 27 20:35:28.839578 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:35:28.839565 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/5bf027b2-e887-41cd-a84c-7a027003ae96-snapshots\") pod \"insights-operator-5885fdb759-hmsn4\" (UID: \"5bf027b2-e887-41cd-a84c-7a027003ae96\") " pod="openshift-insights/insights-operator-5885fdb759-hmsn4" Jul 27 20:35:28.839693 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:35:28.839615 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hzgml\" (UniqueName: \"kubernetes.io/projected/d41386c0-1e68-44e5-992c-1bb4a72c4a07-kube-api-access-hzgml\") pod \"cluster-proxy-proxy-agent-787769d5b-p95hv\" (UID: \"d41386c0-1e68-44e5-992c-1bb4a72c4a07\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-787769d5b-p95hv" Jul 27 20:35:28.839693 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:35:28.839634 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5bf027b2-e887-41cd-a84c-7a027003ae96-trusted-ca-bundle\") pod \"insights-operator-5885fdb759-hmsn4\" (UID: \"5bf027b2-e887-41cd-a84c-7a027003ae96\") " pod="openshift-insights/insights-operator-5885fdb759-hmsn4" Jul 27 20:35:28.839693 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:35:28.839647 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5bf027b2-e887-41cd-a84c-7a027003ae96-service-ca-bundle\") pod \"insights-operator-5885fdb759-hmsn4\" (UID: \"5bf027b2-e887-41cd-a84c-7a027003ae96\") " pod="openshift-insights/insights-operator-5885fdb759-hmsn4" Jul 27 20:35:28.839693 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:35:28.839668 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/5bf027b2-e887-41cd-a84c-7a027003ae96-serving-cert\") pod \"insights-operator-5885fdb759-hmsn4\" (UID: \"5bf027b2-e887-41cd-a84c-7a027003ae96\") " pod="openshift-insights/insights-operator-5885fdb759-hmsn4" Jul 27 20:35:28.884975 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:35:28.884949 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-7949c779f6-665wf"] Jul 27 20:35:28.886918 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:35:28.886903 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7949c779f6-665wf" Jul 27 20:35:28.888821 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:35:28.888798 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jul 27 20:35:28.888953 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:35:28.888935 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jul 27 20:35:28.889024 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:35:28.888935 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-hj2k5\"" Jul 27 20:35:28.889024 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:35:28.888955 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jul 27 20:35:28.895620 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:35:28.895599 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jul 27 20:35:28.898235 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:35:28.898216 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbpp5_e2759622-0ab6-46b7-b434-f0a0f8942dfe/konnectivity-agent/0.log" limit=1024 Jul 27 20:35:28.903001 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:35:28.902983 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-7949c779f6-665wf"] Jul 27 20:35:28.940405 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:35:28.940381 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/5bf027b2-e887-41cd-a84c-7a027003ae96-snapshots\") pod \"insights-operator-5885fdb759-hmsn4\" (UID: \"5bf027b2-e887-41cd-a84c-7a027003ae96\") " pod="openshift-insights/insights-operator-5885fdb759-hmsn4" Jul 27 20:35:28.940613 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:35:28.940438 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hzgml\" (UniqueName: \"kubernetes.io/projected/d41386c0-1e68-44e5-992c-1bb4a72c4a07-kube-api-access-hzgml\") pod \"cluster-proxy-proxy-agent-787769d5b-p95hv\" (UID: \"d41386c0-1e68-44e5-992c-1bb4a72c4a07\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-787769d5b-p95hv" Jul 27 20:35:28.940613 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:35:28.940464 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5bf027b2-e887-41cd-a84c-7a027003ae96-trusted-ca-bundle\") pod \"insights-operator-5885fdb759-hmsn4\" (UID: \"5bf027b2-e887-41cd-a84c-7a027003ae96\") " pod="openshift-insights/insights-operator-5885fdb759-hmsn4" Jul 27 20:35:28.940613 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:35:28.940486 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5bf027b2-e887-41cd-a84c-7a027003ae96-service-ca-bundle\") pod \"insights-operator-5885fdb759-hmsn4\" (UID: \"5bf027b2-e887-41cd-a84c-7a027003ae96\") " pod="openshift-insights/insights-operator-5885fdb759-hmsn4" Jul 27 20:35:28.940613 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:35:28.940524 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/5bf027b2-e887-41cd-a84c-7a027003ae96-serving-cert\") pod \"insights-operator-5885fdb759-hmsn4\" (UID: \"5bf027b2-e887-41cd-a84c-7a027003ae96\") " pod="openshift-insights/insights-operator-5885fdb759-hmsn4" Jul 27 20:35:28.940613 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:35:28.940555 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/d41386c0-1e68-44e5-992c-1bb4a72c4a07-hub\") pod \"cluster-proxy-proxy-agent-787769d5b-p95hv\" (UID: \"d41386c0-1e68-44e5-992c-1bb4a72c4a07\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-787769d5b-p95hv" Jul 27 20:35:28.940613 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:35:28.940601 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/d41386c0-1e68-44e5-992c-1bb4a72c4a07-ca\") pod \"cluster-proxy-proxy-agent-787769d5b-p95hv\" (UID: \"d41386c0-1e68-44e5-992c-1bb4a72c4a07\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-787769d5b-p95hv" Jul 27 20:35:28.940936 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:35:28.940626 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/d41386c0-1e68-44e5-992c-1bb4a72c4a07-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-787769d5b-p95hv\" (UID: \"d41386c0-1e68-44e5-992c-1bb4a72c4a07\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-787769d5b-p95hv" Jul 27 20:35:28.940936 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:35:28.940653 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/d41386c0-1e68-44e5-992c-1bb4a72c4a07-additional-service-ca\") pod \"cluster-proxy-proxy-agent-787769d5b-p95hv\" (UID: \"d41386c0-1e68-44e5-992c-1bb4a72c4a07\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-787769d5b-p95hv" Jul 27 20:35:28.940936 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:35:28.940684 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-phhs9\" (UniqueName: \"kubernetes.io/projected/5bf027b2-e887-41cd-a84c-7a027003ae96-kube-api-access-phhs9\") pod \"insights-operator-5885fdb759-hmsn4\" (UID: \"5bf027b2-e887-41cd-a84c-7a027003ae96\") " pod="openshift-insights/insights-operator-5885fdb759-hmsn4" Jul 27 20:35:28.940936 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:35:28.940715 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/d41386c0-1e68-44e5-992c-1bb4a72c4a07-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-787769d5b-p95hv\" (UID: \"d41386c0-1e68-44e5-992c-1bb4a72c4a07\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-787769d5b-p95hv" Jul 27 20:35:28.940936 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:35:28.940754 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5bf027b2-e887-41cd-a84c-7a027003ae96-tmp\") pod \"insights-operator-5885fdb759-hmsn4\" (UID: \"5bf027b2-e887-41cd-a84c-7a027003ae96\") " pod="openshift-insights/insights-operator-5885fdb759-hmsn4" Jul 27 20:35:28.941237 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:35:28.941214 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/5bf027b2-e887-41cd-a84c-7a027003ae96-snapshots\") pod \"insights-operator-5885fdb759-hmsn4\" (UID: \"5bf027b2-e887-41cd-a84c-7a027003ae96\") " pod="openshift-insights/insights-operator-5885fdb759-hmsn4" Jul 27 20:35:28.941384 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:35:28.941360 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5bf027b2-e887-41cd-a84c-7a027003ae96-service-ca-bundle\") pod \"insights-operator-5885fdb759-hmsn4\" (UID: \"5bf027b2-e887-41cd-a84c-7a027003ae96\") " pod="openshift-insights/insights-operator-5885fdb759-hmsn4" Jul 27 20:35:28.941659 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:35:28.941634 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5bf027b2-e887-41cd-a84c-7a027003ae96-tmp\") pod \"insights-operator-5885fdb759-hmsn4\" (UID: \"5bf027b2-e887-41cd-a84c-7a027003ae96\") " pod="openshift-insights/insights-operator-5885fdb759-hmsn4" Jul 27 20:35:28.942043 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:35:28.942011 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5bf027b2-e887-41cd-a84c-7a027003ae96-trusted-ca-bundle\") pod \"insights-operator-5885fdb759-hmsn4\" (UID: \"5bf027b2-e887-41cd-a84c-7a027003ae96\") " pod="openshift-insights/insights-operator-5885fdb759-hmsn4" Jul 27 20:35:28.942043 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:35:28.942030 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/d41386c0-1e68-44e5-992c-1bb4a72c4a07-additional-service-ca\") pod \"cluster-proxy-proxy-agent-787769d5b-p95hv\" (UID: \"d41386c0-1e68-44e5-992c-1bb4a72c4a07\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-787769d5b-p95hv" Jul 27 20:35:28.943457 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:35:28.943434 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/d41386c0-1e68-44e5-992c-1bb4a72c4a07-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-787769d5b-p95hv\" (UID: \"d41386c0-1e68-44e5-992c-1bb4a72c4a07\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-787769d5b-p95hv" Jul 27 20:35:28.943457 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:35:28.943445 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/5bf027b2-e887-41cd-a84c-7a027003ae96-serving-cert\") pod \"insights-operator-5885fdb759-hmsn4\" (UID: \"5bf027b2-e887-41cd-a84c-7a027003ae96\") " pod="openshift-insights/insights-operator-5885fdb759-hmsn4" Jul 27 20:35:28.943610 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:35:28.943575 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/d41386c0-1e68-44e5-992c-1bb4a72c4a07-hub\") pod \"cluster-proxy-proxy-agent-787769d5b-p95hv\" (UID: \"d41386c0-1e68-44e5-992c-1bb4a72c4a07\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-787769d5b-p95hv" Jul 27 20:35:28.943705 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:35:28.943687 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/d41386c0-1e68-44e5-992c-1bb4a72c4a07-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-787769d5b-p95hv\" (UID: \"d41386c0-1e68-44e5-992c-1bb4a72c4a07\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-787769d5b-p95hv" Jul 27 20:35:28.943740 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:35:28.943726 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/d41386c0-1e68-44e5-992c-1bb4a72c4a07-ca\") pod \"cluster-proxy-proxy-agent-787769d5b-p95hv\" (UID: \"d41386c0-1e68-44e5-992c-1bb4a72c4a07\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-787769d5b-p95hv" Jul 27 20:35:28.957586 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:35:28.957561 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-phhs9\" (UniqueName: \"kubernetes.io/projected/5bf027b2-e887-41cd-a84c-7a027003ae96-kube-api-access-phhs9\") pod \"insights-operator-5885fdb759-hmsn4\" (UID: \"5bf027b2-e887-41cd-a84c-7a027003ae96\") " pod="openshift-insights/insights-operator-5885fdb759-hmsn4" Jul 27 20:35:28.965389 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:35:28.965369 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hzgml\" (UniqueName: \"kubernetes.io/projected/d41386c0-1e68-44e5-992c-1bb4a72c4a07-kube-api-access-hzgml\") pod \"cluster-proxy-proxy-agent-787769d5b-p95hv\" (UID: \"d41386c0-1e68-44e5-992c-1bb4a72c4a07\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-787769d5b-p95hv" Jul 27 20:35:29.030540 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:35:29.030508 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5885fdb759-hmsn4" Jul 27 20:35:29.041360 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:35:29.041292 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/f8ea75ef-7df9-4274-8e01-134ce40330a2-image-registry-private-configuration\") pod \"image-registry-7949c779f6-665wf\" (UID: \"f8ea75ef-7df9-4274-8e01-134ce40330a2\") " pod="openshift-image-registry/image-registry-7949c779f6-665wf" Jul 27 20:35:29.041360 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:35:29.041352 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/f8ea75ef-7df9-4274-8e01-134ce40330a2-ca-trust-extracted\") pod \"image-registry-7949c779f6-665wf\" (UID: \"f8ea75ef-7df9-4274-8e01-134ce40330a2\") " pod="openshift-image-registry/image-registry-7949c779f6-665wf" Jul 27 20:35:29.041449 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:35:29.041375 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/f8ea75ef-7df9-4274-8e01-134ce40330a2-registry-certificates\") pod \"image-registry-7949c779f6-665wf\" (UID: \"f8ea75ef-7df9-4274-8e01-134ce40330a2\") " pod="openshift-image-registry/image-registry-7949c779f6-665wf" Jul 27 20:35:29.041449 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:35:29.041390 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qpldw\" (UniqueName: \"kubernetes.io/projected/f8ea75ef-7df9-4274-8e01-134ce40330a2-kube-api-access-qpldw\") pod \"image-registry-7949c779f6-665wf\" (UID: \"f8ea75ef-7df9-4274-8e01-134ce40330a2\") " pod="openshift-image-registry/image-registry-7949c779f6-665wf" Jul 27 20:35:29.041449 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:35:29.041408 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/f8ea75ef-7df9-4274-8e01-134ce40330a2-installation-pull-secrets\") pod \"image-registry-7949c779f6-665wf\" (UID: \"f8ea75ef-7df9-4274-8e01-134ce40330a2\") " pod="openshift-image-registry/image-registry-7949c779f6-665wf" Jul 27 20:35:29.041570 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:35:29.041466 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/f8ea75ef-7df9-4274-8e01-134ce40330a2-trusted-ca\") pod \"image-registry-7949c779f6-665wf\" (UID: \"f8ea75ef-7df9-4274-8e01-134ce40330a2\") " pod="openshift-image-registry/image-registry-7949c779f6-665wf" Jul 27 20:35:29.041570 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:35:29.041503 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f8ea75ef-7df9-4274-8e01-134ce40330a2-bound-sa-token\") pod \"image-registry-7949c779f6-665wf\" (UID: \"f8ea75ef-7df9-4274-8e01-134ce40330a2\") " pod="openshift-image-registry/image-registry-7949c779f6-665wf" Jul 27 20:35:29.041647 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:35:29.041617 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f8ea75ef-7df9-4274-8e01-134ce40330a2-registry-tls\") pod \"image-registry-7949c779f6-665wf\" (UID: \"f8ea75ef-7df9-4274-8e01-134ce40330a2\") " pod="openshift-image-registry/image-registry-7949c779f6-665wf" Jul 27 20:35:29.054478 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:35:29.054443 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-787769d5b-p95hv" Jul 27 20:35:29.095162 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:35:29.095087 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbpp5_e2759622-0ab6-46b7-b434-f0a0f8942dfe/konnectivity-agent/0.log" limit=1024 Jul 27 20:35:29.142824 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:35:29.142749 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f8ea75ef-7df9-4274-8e01-134ce40330a2-registry-tls\") pod \"image-registry-7949c779f6-665wf\" (UID: \"f8ea75ef-7df9-4274-8e01-134ce40330a2\") " pod="openshift-image-registry/image-registry-7949c779f6-665wf" Jul 27 20:35:29.142824 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:35:29.142818 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/f8ea75ef-7df9-4274-8e01-134ce40330a2-image-registry-private-configuration\") pod \"image-registry-7949c779f6-665wf\" (UID: \"f8ea75ef-7df9-4274-8e01-134ce40330a2\") " pod="openshift-image-registry/image-registry-7949c779f6-665wf" Jul 27 20:35:29.142997 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:35:29.142858 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/f8ea75ef-7df9-4274-8e01-134ce40330a2-ca-trust-extracted\") pod \"image-registry-7949c779f6-665wf\" (UID: \"f8ea75ef-7df9-4274-8e01-134ce40330a2\") " pod="openshift-image-registry/image-registry-7949c779f6-665wf" Jul 27 20:35:29.142997 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:35:29.142882 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/f8ea75ef-7df9-4274-8e01-134ce40330a2-registry-certificates\") pod \"image-registry-7949c779f6-665wf\" (UID: \"f8ea75ef-7df9-4274-8e01-134ce40330a2\") " pod="openshift-image-registry/image-registry-7949c779f6-665wf" Jul 27 20:35:29.142997 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:35:29.142905 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qpldw\" (UniqueName: \"kubernetes.io/projected/f8ea75ef-7df9-4274-8e01-134ce40330a2-kube-api-access-qpldw\") pod \"image-registry-7949c779f6-665wf\" (UID: \"f8ea75ef-7df9-4274-8e01-134ce40330a2\") " pod="openshift-image-registry/image-registry-7949c779f6-665wf" Jul 27 20:35:29.142997 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:35:29.142932 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/f8ea75ef-7df9-4274-8e01-134ce40330a2-installation-pull-secrets\") pod \"image-registry-7949c779f6-665wf\" (UID: \"f8ea75ef-7df9-4274-8e01-134ce40330a2\") " pod="openshift-image-registry/image-registry-7949c779f6-665wf" Jul 27 20:35:29.142997 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:35:29.142983 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/f8ea75ef-7df9-4274-8e01-134ce40330a2-trusted-ca\") pod \"image-registry-7949c779f6-665wf\" (UID: \"f8ea75ef-7df9-4274-8e01-134ce40330a2\") " pod="openshift-image-registry/image-registry-7949c779f6-665wf" Jul 27 20:35:29.143241 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:35:29.143026 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f8ea75ef-7df9-4274-8e01-134ce40330a2-bound-sa-token\") pod \"image-registry-7949c779f6-665wf\" (UID: \"f8ea75ef-7df9-4274-8e01-134ce40330a2\") " pod="openshift-image-registry/image-registry-7949c779f6-665wf" Jul 27 20:35:29.143829 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:35:29.143778 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/f8ea75ef-7df9-4274-8e01-134ce40330a2-ca-trust-extracted\") pod \"image-registry-7949c779f6-665wf\" (UID: \"f8ea75ef-7df9-4274-8e01-134ce40330a2\") " pod="openshift-image-registry/image-registry-7949c779f6-665wf" Jul 27 20:35:29.143829 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:35:29.143810 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/f8ea75ef-7df9-4274-8e01-134ce40330a2-registry-certificates\") pod \"image-registry-7949c779f6-665wf\" (UID: \"f8ea75ef-7df9-4274-8e01-134ce40330a2\") " pod="openshift-image-registry/image-registry-7949c779f6-665wf" Jul 27 20:35:29.144921 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:35:29.144893 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/f8ea75ef-7df9-4274-8e01-134ce40330a2-trusted-ca\") pod \"image-registry-7949c779f6-665wf\" (UID: \"f8ea75ef-7df9-4274-8e01-134ce40330a2\") " pod="openshift-image-registry/image-registry-7949c779f6-665wf" Jul 27 20:35:29.145761 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:35:29.145718 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/f8ea75ef-7df9-4274-8e01-134ce40330a2-image-registry-private-configuration\") pod \"image-registry-7949c779f6-665wf\" (UID: \"f8ea75ef-7df9-4274-8e01-134ce40330a2\") " pod="openshift-image-registry/image-registry-7949c779f6-665wf" Jul 27 20:35:29.146212 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:35:29.146191 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/f8ea75ef-7df9-4274-8e01-134ce40330a2-installation-pull-secrets\") pod \"image-registry-7949c779f6-665wf\" (UID: \"f8ea75ef-7df9-4274-8e01-134ce40330a2\") " pod="openshift-image-registry/image-registry-7949c779f6-665wf" Jul 27 20:35:29.146742 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:35:29.146616 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f8ea75ef-7df9-4274-8e01-134ce40330a2-registry-tls\") pod \"image-registry-7949c779f6-665wf\" (UID: \"f8ea75ef-7df9-4274-8e01-134ce40330a2\") " pod="openshift-image-registry/image-registry-7949c779f6-665wf" Jul 27 20:35:29.157878 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:35:29.157857 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qpldw\" (UniqueName: \"kubernetes.io/projected/f8ea75ef-7df9-4274-8e01-134ce40330a2-kube-api-access-qpldw\") pod \"image-registry-7949c779f6-665wf\" (UID: \"f8ea75ef-7df9-4274-8e01-134ce40330a2\") " pod="openshift-image-registry/image-registry-7949c779f6-665wf" Jul 27 20:35:29.158388 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:35:29.158371 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f8ea75ef-7df9-4274-8e01-134ce40330a2-bound-sa-token\") pod \"image-registry-7949c779f6-665wf\" (UID: \"f8ea75ef-7df9-4274-8e01-134ce40330a2\") " pod="openshift-image-registry/image-registry-7949c779f6-665wf" Jul 27 20:35:29.165612 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:35:29.165585 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5885fdb759-hmsn4"] Jul 27 20:35:29.170095 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:35:29.170073 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5bf027b2_e887_41cd_a84c_7a027003ae96.slice/crio-e7fdec39a9deefaa8c06f53851efa09f5c8184cba7a620d448c075aa48a1749c WatchSource:0}: Error finding container e7fdec39a9deefaa8c06f53851efa09f5c8184cba7a620d448c075aa48a1749c: Status 404 returned error can't find the container with id e7fdec39a9deefaa8c06f53851efa09f5c8184cba7a620d448c075aa48a1749c Jul 27 20:35:29.189756 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:35:29.189736 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-787769d5b-p95hv"] Jul 27 20:35:29.192721 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:35:29.192691 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd41386c0_1e68_44e5_992c_1bb4a72c4a07.slice/crio-53a6d769798b5868fdb7b9d6c2a80f2c81578f4b8217bbc00fb060f8deb6a8a8 WatchSource:0}: Error finding container 53a6d769798b5868fdb7b9d6c2a80f2c81578f4b8217bbc00fb060f8deb6a8a8: Status 404 returned error can't find the container with id 53a6d769798b5868fdb7b9d6c2a80f2c81578f4b8217bbc00fb060f8deb6a8a8 Jul 27 20:35:29.196661 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:35:29.196574 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7949c779f6-665wf" Jul 27 20:35:29.197445 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:35:29.197426 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbpp5_e2759622-0ab6-46b7-b434-f0a0f8942dfe/konnectivity-agent/0.log" limit=1024 Jul 27 20:35:29.318069 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:35:29.317994 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-7949c779f6-665wf"] Jul 27 20:35:29.320785 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:35:29.320756 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf8ea75ef_7df9_4274_8e01_134ce40330a2.slice/crio-627f6b8bca6a002e0268a102c02af85ab53e97e500952fc7944ffca28c1f6e4a WatchSource:0}: Error finding container 627f6b8bca6a002e0268a102c02af85ab53e97e500952fc7944ffca28c1f6e4a: Status 404 returned error can't find the container with id 627f6b8bca6a002e0268a102c02af85ab53e97e500952fc7944ffca28c1f6e4a Jul 27 20:35:29.417185 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:35:29.417147 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7949c779f6-665wf" event={"ID":"f8ea75ef-7df9-4274-8e01-134ce40330a2","Type":"ContainerStarted","Data":"3290b386cf6d834b790ec90adfadaa8cca4e61428c89d188d20e331152bcd0c3"} Jul 27 20:35:29.417368 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:35:29.417197 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7949c779f6-665wf" event={"ID":"f8ea75ef-7df9-4274-8e01-134ce40330a2","Type":"ContainerStarted","Data":"627f6b8bca6a002e0268a102c02af85ab53e97e500952fc7944ffca28c1f6e4a"} Jul 27 20:35:29.417368 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:35:29.417216 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-7949c779f6-665wf" Jul 27 20:35:29.418251 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:35:29.418230 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-787769d5b-p95hv" event={"ID":"d41386c0-1e68-44e5-992c-1bb4a72c4a07","Type":"ContainerStarted","Data":"53a6d769798b5868fdb7b9d6c2a80f2c81578f4b8217bbc00fb060f8deb6a8a8"} Jul 27 20:35:29.419275 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:35:29.419256 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5885fdb759-hmsn4" event={"ID":"5bf027b2-e887-41cd-a84c-7a027003ae96","Type":"ContainerStarted","Data":"e7fdec39a9deefaa8c06f53851efa09f5c8184cba7a620d448c075aa48a1749c"} Jul 27 20:35:29.436803 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:35:29.436750 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-7949c779f6-665wf" podStartSLOduration=1.43673097 podStartE2EDuration="1.43673097s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 20:35:28 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:35:29.435580096 +0000 UTC m=+62.905123106" watchObservedRunningTime="2026-07-27 20:35:29.43673097 +0000 UTC m=+62.906273962" Jul 27 20:35:29.827884 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:35:29.827848 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbpp5_e2759622-0ab6-46b7-b434-f0a0f8942dfe/konnectivity-agent/0.log" limit=1024 Jul 27 20:35:30.233462 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:35:30.233388 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbpp5_e2759622-0ab6-46b7-b434-f0a0f8942dfe/konnectivity-agent/0.log" limit=1024 Jul 27 20:35:30.300391 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:35:30.300363 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbpp5_e2759622-0ab6-46b7-b434-f0a0f8942dfe/konnectivity-agent/0.log" limit=1024 Jul 27 20:35:31.017272 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:35:31.017238 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbpp5_e2759622-0ab6-46b7-b434-f0a0f8942dfe/konnectivity-agent/0.log" limit=1024 Jul 27 20:35:31.087957 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:35:31.087925 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbpp5_e2759622-0ab6-46b7-b434-f0a0f8942dfe/konnectivity-agent/0.log" limit=1024 Jul 27 20:35:31.420508 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:35:31.420471 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbpp5_e2759622-0ab6-46b7-b434-f0a0f8942dfe/konnectivity-agent/0.log" limit=1024 Jul 27 20:35:31.434087 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:35:31.434052 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5885fdb759-hmsn4" event={"ID":"5bf027b2-e887-41cd-a84c-7a027003ae96","Type":"ContainerStarted","Data":"5d83436b90fd98fb97bc7725a6a2e03244ae316038b8fcd4ce9d5e4b435a2741"} Jul 27 20:35:31.450603 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:35:31.450559 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-5885fdb759-hmsn4" podStartSLOduration=1.454488071 podStartE2EDuration="3.450546158s" totalImagesPullingTime="1.996058087s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 20:35:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:35:31.449420591 +0000 UTC m=+64.918963603" watchObservedRunningTime="2026-07-27 20:35:31.450546158 +0000 UTC m=+64.920089168" Jul 27 20:35:31.521780 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:35:31.521699 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbpp5_e2759622-0ab6-46b7-b434-f0a0f8942dfe/konnectivity-agent/0.log" limit=1024 Jul 27 20:35:31.765012 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:35:31.764830 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/020c2b0f-251f-48ce-b2bb-7f5006effa41-metrics-tls\") pod \"dns-default-w5k72\" (UID: \"020c2b0f-251f-48ce-b2bb-7f5006effa41\") " pod="openshift-dns/dns-default-w5k72" Jul 27 20:35:31.767727 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:35:31.767673 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/020c2b0f-251f-48ce-b2bb-7f5006effa41-metrics-tls\") pod \"dns-default-w5k72\" (UID: \"020c2b0f-251f-48ce-b2bb-7f5006effa41\") " pod="openshift-dns/dns-default-w5k72" Jul 27 20:35:32.011133 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:35:32.011043 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-89mzs\"" Jul 27 20:35:32.019549 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:35:32.019495 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-w5k72" Jul 27 20:35:32.122026 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:35:32.120360 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-59bwv"] Jul 27 20:35:32.147976 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:35:32.147860 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-59bwv"] Jul 27 20:35:32.148099 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:35:32.148011 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-59bwv" Jul 27 20:35:32.153406 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:35:32.150306 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-t5cnl\"" Jul 27 20:35:32.153406 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:35:32.152586 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 27 20:35:32.153406 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:35:32.152767 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 27 20:35:32.159794 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:35:32.159738 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbpp5_e2759622-0ab6-46b7-b434-f0a0f8942dfe/konnectivity-agent/0.log" limit=1024 Jul 27 20:35:32.167949 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:35:32.167925 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/59206a62-e80f-4339-9698-16334b19fdba-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-59bwv\" (UID: \"59206a62-e80f-4339-9698-16334b19fdba\") " pod="openshift-insights/insights-runtime-extractor-59bwv" Jul 27 20:35:32.168061 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:35:32.167977 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/59206a62-e80f-4339-9698-16334b19fdba-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-59bwv\" (UID: \"59206a62-e80f-4339-9698-16334b19fdba\") " pod="openshift-insights/insights-runtime-extractor-59bwv" Jul 27 20:35:32.168061 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:35:32.168012 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/59206a62-e80f-4339-9698-16334b19fdba-crio-socket\") pod \"insights-runtime-extractor-59bwv\" (UID: \"59206a62-e80f-4339-9698-16334b19fdba\") " pod="openshift-insights/insights-runtime-extractor-59bwv" Jul 27 20:35:32.168061 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:35:32.168029 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/59206a62-e80f-4339-9698-16334b19fdba-data-volume\") pod \"insights-runtime-extractor-59bwv\" (UID: \"59206a62-e80f-4339-9698-16334b19fdba\") " pod="openshift-insights/insights-runtime-extractor-59bwv" Jul 27 20:35:32.168061 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:35:32.168056 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6bxbq\" (UniqueName: \"kubernetes.io/projected/59206a62-e80f-4339-9698-16334b19fdba-kube-api-access-6bxbq\") pod \"insights-runtime-extractor-59bwv\" (UID: \"59206a62-e80f-4339-9698-16334b19fdba\") " pod="openshift-insights/insights-runtime-extractor-59bwv" Jul 27 20:35:32.206472 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:35:32.205812 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-w5k72"] Jul 27 20:35:32.225968 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:35:32.225927 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbpp5_e2759622-0ab6-46b7-b434-f0a0f8942dfe/konnectivity-agent/0.log" limit=1024 Jul 27 20:35:32.268407 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:35:32.268378 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/59206a62-e80f-4339-9698-16334b19fdba-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-59bwv\" (UID: \"59206a62-e80f-4339-9698-16334b19fdba\") " pod="openshift-insights/insights-runtime-extractor-59bwv" Jul 27 20:35:32.268569 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:35:32.268420 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/59206a62-e80f-4339-9698-16334b19fdba-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-59bwv\" (UID: \"59206a62-e80f-4339-9698-16334b19fdba\") " pod="openshift-insights/insights-runtime-extractor-59bwv" Jul 27 20:35:32.268569 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:35:32.268464 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/59206a62-e80f-4339-9698-16334b19fdba-crio-socket\") pod \"insights-runtime-extractor-59bwv\" (UID: \"59206a62-e80f-4339-9698-16334b19fdba\") " pod="openshift-insights/insights-runtime-extractor-59bwv" Jul 27 20:35:32.268569 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:35:32.268487 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/59206a62-e80f-4339-9698-16334b19fdba-data-volume\") pod \"insights-runtime-extractor-59bwv\" (UID: \"59206a62-e80f-4339-9698-16334b19fdba\") " pod="openshift-insights/insights-runtime-extractor-59bwv" Jul 27 20:35:32.268569 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:35:32.268532 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6bxbq\" (UniqueName: \"kubernetes.io/projected/59206a62-e80f-4339-9698-16334b19fdba-kube-api-access-6bxbq\") pod \"insights-runtime-extractor-59bwv\" (UID: \"59206a62-e80f-4339-9698-16334b19fdba\") " pod="openshift-insights/insights-runtime-extractor-59bwv" Jul 27 20:35:32.268930 ip-10-0-139-2 kubenswrapper[2572]: E0727 20:35:32.268908 2572 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 27 20:35:32.269053 ip-10-0-139-2 kubenswrapper[2572]: E0727 20:35:32.268977 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/59206a62-e80f-4339-9698-16334b19fdba-insights-runtime-extractor-tls podName:59206a62-e80f-4339-9698-16334b19fdba nodeName:}" failed. No retries permitted until 2026-07-27 20:35:32.768955718 +0000 UTC m=+66.238498775 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/59206a62-e80f-4339-9698-16334b19fdba-insights-runtime-extractor-tls") pod "insights-runtime-extractor-59bwv" (UID: "59206a62-e80f-4339-9698-16334b19fdba") : secret "insights-runtime-extractor-tls" not found Jul 27 20:35:32.269201 ip-10-0-139-2 kubenswrapper[2572]: E0727 20:35:32.269183 2572 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 27 20:35:32.269303 ip-10-0-139-2 kubenswrapper[2572]: E0727 20:35:32.269239 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/59206a62-e80f-4339-9698-16334b19fdba-kube-rbac-proxy-cm podName:59206a62-e80f-4339-9698-16334b19fdba nodeName:}" failed. No retries permitted until 2026-07-27 20:35:32.769225692 +0000 UTC m=+66.238768700 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/59206a62-e80f-4339-9698-16334b19fdba-kube-rbac-proxy-cm") pod "insights-runtime-extractor-59bwv" (UID: "59206a62-e80f-4339-9698-16334b19fdba") : configmap "kube-rbac-proxy" not found Jul 27 20:35:32.269303 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:35:32.269287 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/59206a62-e80f-4339-9698-16334b19fdba-crio-socket\") pod \"insights-runtime-extractor-59bwv\" (UID: \"59206a62-e80f-4339-9698-16334b19fdba\") " pod="openshift-insights/insights-runtime-extractor-59bwv" Jul 27 20:35:32.269587 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:35:32.269564 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/59206a62-e80f-4339-9698-16334b19fdba-data-volume\") pod \"insights-runtime-extractor-59bwv\" (UID: \"59206a62-e80f-4339-9698-16334b19fdba\") " pod="openshift-insights/insights-runtime-extractor-59bwv" Jul 27 20:35:32.278398 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:35:32.278379 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6bxbq\" (UniqueName: \"kubernetes.io/projected/59206a62-e80f-4339-9698-16334b19fdba-kube-api-access-6bxbq\") pod \"insights-runtime-extractor-59bwv\" (UID: \"59206a62-e80f-4339-9698-16334b19fdba\") " pod="openshift-insights/insights-runtime-extractor-59bwv" Jul 27 20:35:32.672269 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:35:32.672181 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d2fb5de3-00ca-444a-a828-e3938289b62d-metrics-certs\") pod \"network-metrics-daemon-87fvc\" (UID: \"d2fb5de3-00ca-444a-a828-e3938289b62d\") " pod="openshift-multus/network-metrics-daemon-87fvc" Jul 27 20:35:32.674969 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:35:32.674944 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d2fb5de3-00ca-444a-a828-e3938289b62d-metrics-certs\") pod \"network-metrics-daemon-87fvc\" (UID: \"d2fb5de3-00ca-444a-a828-e3938289b62d\") " pod="openshift-multus/network-metrics-daemon-87fvc" Jul 27 20:35:32.773237 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:35:32.773190 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/59206a62-e80f-4339-9698-16334b19fdba-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-59bwv\" (UID: \"59206a62-e80f-4339-9698-16334b19fdba\") " pod="openshift-insights/insights-runtime-extractor-59bwv" Jul 27 20:35:32.773428 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:35:32.773244 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/59206a62-e80f-4339-9698-16334b19fdba-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-59bwv\" (UID: \"59206a62-e80f-4339-9698-16334b19fdba\") " pod="openshift-insights/insights-runtime-extractor-59bwv" Jul 27 20:35:32.773428 ip-10-0-139-2 kubenswrapper[2572]: E0727 20:35:32.773371 2572 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 27 20:35:32.773548 ip-10-0-139-2 kubenswrapper[2572]: E0727 20:35:32.773432 2572 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 27 20:35:32.773548 ip-10-0-139-2 kubenswrapper[2572]: E0727 20:35:32.773438 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/59206a62-e80f-4339-9698-16334b19fdba-kube-rbac-proxy-cm podName:59206a62-e80f-4339-9698-16334b19fdba nodeName:}" failed. No retries permitted until 2026-07-27 20:35:33.773419833 +0000 UTC m=+67.242962839 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/59206a62-e80f-4339-9698-16334b19fdba-kube-rbac-proxy-cm") pod "insights-runtime-extractor-59bwv" (UID: "59206a62-e80f-4339-9698-16334b19fdba") : configmap "kube-rbac-proxy" not found Jul 27 20:35:32.773548 ip-10-0-139-2 kubenswrapper[2572]: E0727 20:35:32.773510 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/59206a62-e80f-4339-9698-16334b19fdba-insights-runtime-extractor-tls podName:59206a62-e80f-4339-9698-16334b19fdba nodeName:}" failed. No retries permitted until 2026-07-27 20:35:33.773495011 +0000 UTC m=+67.243037999 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/59206a62-e80f-4339-9698-16334b19fdba-insights-runtime-extractor-tls") pod "insights-runtime-extractor-59bwv" (UID: "59206a62-e80f-4339-9698-16334b19fdba") : secret "insights-runtime-extractor-tls" not found Jul 27 20:35:32.785804 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:35:32.785776 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-5wzbh\"" Jul 27 20:35:32.794718 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:35:32.794689 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-87fvc" Jul 27 20:35:32.830274 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:35:32.830249 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbpp5_e2759622-0ab6-46b7-b434-f0a0f8942dfe/konnectivity-agent/0.log" limit=1024 Jul 27 20:35:32.933467 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:35:32.933378 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbpp5_e2759622-0ab6-46b7-b434-f0a0f8942dfe/konnectivity-agent/0.log" limit=1024 Jul 27 20:35:32.987030 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:35:32.986999 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod020c2b0f_251f_48ce_b2bb_7f5006effa41.slice/crio-88219f7dc6f6c6d2d1231edaf7d7604d2ffd15e3cc96da489037dacce3dad4f5 WatchSource:0}: Error finding container 88219f7dc6f6c6d2d1231edaf7d7604d2ffd15e3cc96da489037dacce3dad4f5: Status 404 returned error can't find the container with id 88219f7dc6f6c6d2d1231edaf7d7604d2ffd15e3cc96da489037dacce3dad4f5 Jul 27 20:35:32.994813 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:35:32.994787 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbpp5_e2759622-0ab6-46b7-b434-f0a0f8942dfe/konnectivity-agent/0.log" limit=1024 Jul 27 20:35:33.117674 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:35:33.117646 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-87fvc"] Jul 27 20:35:33.121025 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:35:33.120990 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd2fb5de3_00ca_444a_a828_e3938289b62d.slice/crio-6e517a99a83d9d9f618643c928d73fe73d954576d9445657590d035e0be4263e WatchSource:0}: Error finding container 6e517a99a83d9d9f618643c928d73fe73d954576d9445657590d035e0be4263e: Status 404 returned error can't find the container with id 6e517a99a83d9d9f618643c928d73fe73d954576d9445657590d035e0be4263e Jul 27 20:35:33.259615 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:35:33.259539 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbpp5_e2759622-0ab6-46b7-b434-f0a0f8942dfe/konnectivity-agent/0.log" limit=1024 Jul 27 20:35:33.361619 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:35:33.361569 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbpp5_e2759622-0ab6-46b7-b434-f0a0f8942dfe/konnectivity-agent/0.log" limit=1024 Jul 27 20:35:33.444391 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:35:33.444355 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-87fvc" event={"ID":"d2fb5de3-00ca-444a-a828-e3938289b62d","Type":"ContainerStarted","Data":"6e517a99a83d9d9f618643c928d73fe73d954576d9445657590d035e0be4263e"} Jul 27 20:35:33.448339 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:35:33.448281 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-w5k72" event={"ID":"020c2b0f-251f-48ce-b2bb-7f5006effa41","Type":"ContainerStarted","Data":"88219f7dc6f6c6d2d1231edaf7d7604d2ffd15e3cc96da489037dacce3dad4f5"} Jul 27 20:35:33.462463 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:35:33.462439 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbpp5_e2759622-0ab6-46b7-b434-f0a0f8942dfe/konnectivity-agent/0.log" limit=1024 Jul 27 20:35:33.536205 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:35:33.536171 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbpp5_e2759622-0ab6-46b7-b434-f0a0f8942dfe/konnectivity-agent/0.log" limit=1024 Jul 27 20:35:33.604075 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:35:33.604043 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbpp5_e2759622-0ab6-46b7-b434-f0a0f8942dfe/konnectivity-agent/0.log" limit=1024 Jul 27 20:35:33.740252 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:35:33.740218 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbpp5_e2759622-0ab6-46b7-b434-f0a0f8942dfe/konnectivity-agent/0.log" limit=1024 Jul 27 20:35:33.781331 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:35:33.781292 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/59206a62-e80f-4339-9698-16334b19fdba-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-59bwv\" (UID: \"59206a62-e80f-4339-9698-16334b19fdba\") " pod="openshift-insights/insights-runtime-extractor-59bwv" Jul 27 20:35:33.781493 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:35:33.781348 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/59206a62-e80f-4339-9698-16334b19fdba-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-59bwv\" (UID: \"59206a62-e80f-4339-9698-16334b19fdba\") " pod="openshift-insights/insights-runtime-extractor-59bwv" Jul 27 20:35:33.781493 ip-10-0-139-2 kubenswrapper[2572]: E0727 20:35:33.781442 2572 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 27 20:35:33.781654 ip-10-0-139-2 kubenswrapper[2572]: E0727 20:35:33.781509 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/59206a62-e80f-4339-9698-16334b19fdba-kube-rbac-proxy-cm podName:59206a62-e80f-4339-9698-16334b19fdba nodeName:}" failed. No retries permitted until 2026-07-27 20:35:35.781489143 +0000 UTC m=+69.251032145 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/59206a62-e80f-4339-9698-16334b19fdba-kube-rbac-proxy-cm") pod "insights-runtime-extractor-59bwv" (UID: "59206a62-e80f-4339-9698-16334b19fdba") : configmap "kube-rbac-proxy" not found Jul 27 20:35:33.781654 ip-10-0-139-2 kubenswrapper[2572]: E0727 20:35:33.781527 2572 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 27 20:35:33.781654 ip-10-0-139-2 kubenswrapper[2572]: E0727 20:35:33.781598 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/59206a62-e80f-4339-9698-16334b19fdba-insights-runtime-extractor-tls podName:59206a62-e80f-4339-9698-16334b19fdba nodeName:}" failed. No retries permitted until 2026-07-27 20:35:35.781579979 +0000 UTC m=+69.251123118 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/59206a62-e80f-4339-9698-16334b19fdba-insights-runtime-extractor-tls") pod "insights-runtime-extractor-59bwv" (UID: "59206a62-e80f-4339-9698-16334b19fdba") : secret "insights-runtime-extractor-tls" not found Jul 27 20:35:33.916641 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:35:33.916530 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbpp5_e2759622-0ab6-46b7-b434-f0a0f8942dfe/konnectivity-agent/0.log" limit=1024 Jul 27 20:35:34.143640 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:35:34.143603 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbpp5_e2759622-0ab6-46b7-b434-f0a0f8942dfe/konnectivity-agent/0.log" limit=1024 Jul 27 20:35:34.201170 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:35:34.201095 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbpp5_e2759622-0ab6-46b7-b434-f0a0f8942dfe/konnectivity-agent/0.log" limit=1024 Jul 27 20:35:34.410496 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:35:34.410474 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-xrf29_7331b999-e372-4a69-854a-11042f5892c3/dns-node-resolver/0.log" Jul 27 20:35:34.455004 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:35:34.454923 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-787769d5b-p95hv" event={"ID":"d41386c0-1e68-44e5-992c-1bb4a72c4a07","Type":"ContainerStarted","Data":"c18191c67f3f7555e504eb1b398c53e6be01d003ebc2ac660f84317484af7f25"} Jul 27 20:35:34.526689 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:35:34.526661 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbpp5_e2759622-0ab6-46b7-b434-f0a0f8942dfe/konnectivity-agent/0.log" limit=1024 Jul 27 20:35:34.611493 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:35:34.611412 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-7949c779f6-665wf_f8ea75ef-7df9-4274-8e01-134ce40330a2/registry/0.log" Jul 27 20:35:34.929653 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:35:34.929618 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbpp5_e2759622-0ab6-46b7-b434-f0a0f8942dfe/konnectivity-agent/0.log" limit=1024 Jul 27 20:35:35.010431 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:35:35.010406 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-jrnhm_84e2598f-0da6-4f38-8dda-46b8c0fbd329/node-ca/0.log" Jul 27 20:35:35.030096 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:35:35.030070 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbpp5_e2759622-0ab6-46b7-b434-f0a0f8942dfe/konnectivity-agent/0.log" limit=1024 Jul 27 20:35:35.131779 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:35:35.131749 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbpp5_e2759622-0ab6-46b7-b434-f0a0f8942dfe/konnectivity-agent/0.log" limit=1024 Jul 27 20:35:35.199891 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:35:35.199822 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbpp5_e2759622-0ab6-46b7-b434-f0a0f8942dfe/konnectivity-agent/0.log" limit=1024 Jul 27 20:35:35.460350 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:35:35.460247 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-87fvc" event={"ID":"d2fb5de3-00ca-444a-a828-e3938289b62d","Type":"ContainerStarted","Data":"25e1184ef6b6bc1693d3328f4312bd0a54de19f6a99e8faa9407a66d27f96eef"} Jul 27 20:35:35.460350 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:35:35.460311 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-87fvc" event={"ID":"d2fb5de3-00ca-444a-a828-e3938289b62d","Type":"ContainerStarted","Data":"6777d4fd15f18c91f529a55335441b8d489977d8468944b9c2269d3f508dff60"} Jul 27 20:35:35.462629 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:35:35.462599 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-787769d5b-p95hv" event={"ID":"d41386c0-1e68-44e5-992c-1bb4a72c4a07","Type":"ContainerStarted","Data":"787e2dfa89ea82669faf1d7867ac00773019f44e86b79618c9d71415b1b9f771"} Jul 27 20:35:35.462629 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:35:35.462643 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-787769d5b-p95hv" event={"ID":"d41386c0-1e68-44e5-992c-1bb4a72c4a07","Type":"ContainerStarted","Data":"cb8c39ebfff16116bb1efae8300c287b6ece8ca5c5a68146d4367f60250264dd"} Jul 27 20:35:35.475946 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:35:35.475902 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-87fvc" podStartSLOduration=67.61513511 podStartE2EDuration="1m9.475890356s" totalImagesPullingTime="1.860755246s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 20:34:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:35:35.474743739 +0000 UTC m=+68.944286751" watchObservedRunningTime="2026-07-27 20:35:35.475890356 +0000 UTC m=+68.945433366" Jul 27 20:35:35.493235 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:35:35.493193 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-787769d5b-p95hv" podStartSLOduration=2.296814258 podStartE2EDuration="7.493176807s" totalImagesPullingTime="5.196362549s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 20:35:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:35:35.492617994 +0000 UTC m=+68.962161005" watchObservedRunningTime="2026-07-27 20:35:35.493176807 +0000 UTC m=+68.962719817" Jul 27 20:35:35.577182 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:35:35.577146 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbpp5_e2759622-0ab6-46b7-b434-f0a0f8942dfe/konnectivity-agent/0.log" limit=1024 Jul 27 20:35:35.676404 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:35:35.676372 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbpp5_e2759622-0ab6-46b7-b434-f0a0f8942dfe/konnectivity-agent/0.log" limit=1024 Jul 27 20:35:35.796577 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:35:35.796553 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/59206a62-e80f-4339-9698-16334b19fdba-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-59bwv\" (UID: \"59206a62-e80f-4339-9698-16334b19fdba\") " pod="openshift-insights/insights-runtime-extractor-59bwv" Jul 27 20:35:35.796691 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:35:35.796592 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/59206a62-e80f-4339-9698-16334b19fdba-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-59bwv\" (UID: \"59206a62-e80f-4339-9698-16334b19fdba\") " pod="openshift-insights/insights-runtime-extractor-59bwv" Jul 27 20:35:35.796691 ip-10-0-139-2 kubenswrapper[2572]: E0727 20:35:35.796645 2572 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 27 20:35:35.796775 ip-10-0-139-2 kubenswrapper[2572]: E0727 20:35:35.796693 2572 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 27 20:35:35.796775 ip-10-0-139-2 kubenswrapper[2572]: E0727 20:35:35.796698 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/59206a62-e80f-4339-9698-16334b19fdba-insights-runtime-extractor-tls podName:59206a62-e80f-4339-9698-16334b19fdba nodeName:}" failed. No retries permitted until 2026-07-27 20:35:39.796681782 +0000 UTC m=+73.266224770 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/59206a62-e80f-4339-9698-16334b19fdba-insights-runtime-extractor-tls") pod "insights-runtime-extractor-59bwv" (UID: "59206a62-e80f-4339-9698-16334b19fdba") : secret "insights-runtime-extractor-tls" not found Jul 27 20:35:35.796775 ip-10-0-139-2 kubenswrapper[2572]: E0727 20:35:35.796741 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/59206a62-e80f-4339-9698-16334b19fdba-kube-rbac-proxy-cm podName:59206a62-e80f-4339-9698-16334b19fdba nodeName:}" failed. No retries permitted until 2026-07-27 20:35:39.796730368 +0000 UTC m=+73.266273360 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/59206a62-e80f-4339-9698-16334b19fdba-kube-rbac-proxy-cm") pod "insights-runtime-extractor-59bwv" (UID: "59206a62-e80f-4339-9698-16334b19fdba") : configmap "kube-rbac-proxy" not found Jul 27 20:35:36.010292 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:35:36.010195 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-8hg9x_90e4b45e-4cd9-4f54-bcd8-f3cc60b2ba83/serve-healthcheck-canary/0.log" Jul 27 20:35:36.467813 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:35:36.467784 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-w5k72" event={"ID":"020c2b0f-251f-48ce-b2bb-7f5006effa41","Type":"ContainerStarted","Data":"8ba6cef6f6f89dff69f578eda478e3765a15ea76490ed7ba3fc340e6f977eada"} Jul 27 20:35:36.468183 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:35:36.467836 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-w5k72" event={"ID":"020c2b0f-251f-48ce-b2bb-7f5006effa41","Type":"ContainerStarted","Data":"48f558a07321f07728b8644f0db22e69fb2837bbbb181b5636433db89426bf65"} Jul 27 20:35:36.484599 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:35:36.484558 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-w5k72" podStartSLOduration=34.831467644 podStartE2EDuration="37.484543517s" totalImagesPullingTime="2.653075873s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 20:34:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:35:36.482956517 +0000 UTC m=+69.952499543" watchObservedRunningTime="2026-07-27 20:35:36.484543517 +0000 UTC m=+69.954086526" Jul 27 20:35:37.304782 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:35:37.304751 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbpp5_e2759622-0ab6-46b7-b434-f0a0f8942dfe/konnectivity-agent/0.log" limit=1024 Jul 27 20:35:37.406742 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:35:37.406709 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbpp5_e2759622-0ab6-46b7-b434-f0a0f8942dfe/konnectivity-agent/0.log" limit=1024 Jul 27 20:35:37.470513 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:35:37.470489 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-w5k72" Jul 27 20:35:37.791481 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:35:37.791420 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbpp5_e2759622-0ab6-46b7-b434-f0a0f8942dfe/konnectivity-agent/0.log" limit=1024 Jul 27 20:35:37.850759 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:35:37.850728 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbpp5_e2759622-0ab6-46b7-b434-f0a0f8942dfe/konnectivity-agent/0.log" limit=1024 Jul 27 20:35:38.024755 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:35:38.024729 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbpp5_e2759622-0ab6-46b7-b434-f0a0f8942dfe/konnectivity-agent/0.log" limit=1024 Jul 27 20:35:38.094542 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:35:38.094439 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbpp5_e2759622-0ab6-46b7-b434-f0a0f8942dfe/konnectivity-agent/0.log" limit=1024 Jul 27 20:35:38.280644 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:35:38.280619 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbpp5_e2759622-0ab6-46b7-b434-f0a0f8942dfe/konnectivity-agent/0.log" limit=1024 Jul 27 20:35:38.361937 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:35:38.361875 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-j7dsg" Jul 27 20:35:39.239174 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:35:39.239146 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbpp5_e2759622-0ab6-46b7-b434-f0a0f8942dfe/konnectivity-agent/0.log" limit=1024 Jul 27 20:35:39.340706 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:35:39.340680 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbpp5_e2759622-0ab6-46b7-b434-f0a0f8942dfe/konnectivity-agent/0.log" limit=1024 Jul 27 20:35:39.394349 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:35:39.394306 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbpp5_e2759622-0ab6-46b7-b434-f0a0f8942dfe/konnectivity-agent/0.log" limit=1024 Jul 27 20:35:39.826171 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:35:39.826132 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/59206a62-e80f-4339-9698-16334b19fdba-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-59bwv\" (UID: \"59206a62-e80f-4339-9698-16334b19fdba\") " pod="openshift-insights/insights-runtime-extractor-59bwv" Jul 27 20:35:39.826369 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:35:39.826183 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/59206a62-e80f-4339-9698-16334b19fdba-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-59bwv\" (UID: \"59206a62-e80f-4339-9698-16334b19fdba\") " pod="openshift-insights/insights-runtime-extractor-59bwv" Jul 27 20:35:39.826369 ip-10-0-139-2 kubenswrapper[2572]: E0727 20:35:39.826279 2572 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 27 20:35:39.826369 ip-10-0-139-2 kubenswrapper[2572]: E0727 20:35:39.826291 2572 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 27 20:35:39.826534 ip-10-0-139-2 kubenswrapper[2572]: E0727 20:35:39.826372 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/59206a62-e80f-4339-9698-16334b19fdba-insights-runtime-extractor-tls podName:59206a62-e80f-4339-9698-16334b19fdba nodeName:}" failed. No retries permitted until 2026-07-27 20:35:47.82635071 +0000 UTC m=+81.295893698 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/59206a62-e80f-4339-9698-16334b19fdba-insights-runtime-extractor-tls") pod "insights-runtime-extractor-59bwv" (UID: "59206a62-e80f-4339-9698-16334b19fdba") : secret "insights-runtime-extractor-tls" not found Jul 27 20:35:39.826534 ip-10-0-139-2 kubenswrapper[2572]: E0727 20:35:39.826389 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/59206a62-e80f-4339-9698-16334b19fdba-kube-rbac-proxy-cm podName:59206a62-e80f-4339-9698-16334b19fdba nodeName:}" failed. No retries permitted until 2026-07-27 20:35:47.826382321 +0000 UTC m=+81.295925309 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/59206a62-e80f-4339-9698-16334b19fdba-kube-rbac-proxy-cm") pod "insights-runtime-extractor-59bwv" (UID: "59206a62-e80f-4339-9698-16334b19fdba") : configmap "kube-rbac-proxy" not found Jul 27 20:35:43.621104 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:35:43.621073 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbpp5_e2759622-0ab6-46b7-b434-f0a0f8942dfe/konnectivity-agent/0.log" limit=1024 Jul 27 20:35:43.998514 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:35:43.998440 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbpp5_e2759622-0ab6-46b7-b434-f0a0f8942dfe/konnectivity-agent/0.log" limit=1024 Jul 27 20:35:44.098692 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:35:44.098667 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbpp5_e2759622-0ab6-46b7-b434-f0a0f8942dfe/konnectivity-agent/0.log" limit=1024 Jul 27 20:35:44.197439 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:35:44.197400 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbpp5_e2759622-0ab6-46b7-b434-f0a0f8942dfe/konnectivity-agent/0.log" limit=1024 Jul 27 20:35:44.259796 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:35:44.259735 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbpp5_e2759622-0ab6-46b7-b434-f0a0f8942dfe/konnectivity-agent/0.log" limit=1024 Jul 27 20:35:45.219099 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:35:45.219068 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbpp5_e2759622-0ab6-46b7-b434-f0a0f8942dfe/konnectivity-agent/0.log" limit=1024 Jul 27 20:35:45.427365 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:35:45.427332 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbpp5_e2759622-0ab6-46b7-b434-f0a0f8942dfe/konnectivity-agent/0.log" limit=1024 Jul 27 20:35:46.241004 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:35:46.240972 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbpp5_e2759622-0ab6-46b7-b434-f0a0f8942dfe/konnectivity-agent/0.log" limit=1024 Jul 27 20:35:46.351706 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:35:46.351671 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbpp5_e2759622-0ab6-46b7-b434-f0a0f8942dfe/konnectivity-agent/0.log" limit=1024 Jul 27 20:35:46.431643 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:35:46.431622 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbpp5_e2759622-0ab6-46b7-b434-f0a0f8942dfe/konnectivity-agent/0.log" limit=1024 Jul 27 20:35:46.469045 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:35:46.469020 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-ghqck"] Jul 27 20:35:46.471062 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:35:46.471048 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-ghqck" Jul 27 20:35:46.473024 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:35:46.473008 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-f459l\"" Jul 27 20:35:46.473024 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:35:46.473013 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 27 20:35:46.473164 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:35:46.473022 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 27 20:35:46.473526 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:35:46.473513 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 27 20:35:46.473785 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:35:46.473770 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 27 20:35:46.473785 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:35:46.473779 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 27 20:35:46.473917 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:35:46.473800 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 27 20:35:46.571774 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:35:46.571751 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/fec4efe4-fd6d-4f34-a256-e7322a07cef0-node-exporter-tls\") pod \"node-exporter-ghqck\" (UID: \"fec4efe4-fd6d-4f34-a256-e7322a07cef0\") " pod="openshift-monitoring/node-exporter-ghqck" Jul 27 20:35:46.571884 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:35:46.571790 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/fec4efe4-fd6d-4f34-a256-e7322a07cef0-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-ghqck\" (UID: \"fec4efe4-fd6d-4f34-a256-e7322a07cef0\") " pod="openshift-monitoring/node-exporter-ghqck" Jul 27 20:35:46.571884 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:35:46.571812 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/fec4efe4-fd6d-4f34-a256-e7322a07cef0-node-exporter-accelerators-collector-config\") pod \"node-exporter-ghqck\" (UID: \"fec4efe4-fd6d-4f34-a256-e7322a07cef0\") " pod="openshift-monitoring/node-exporter-ghqck" Jul 27 20:35:46.571884 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:35:46.571831 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/fec4efe4-fd6d-4f34-a256-e7322a07cef0-node-exporter-wtmp\") pod \"node-exporter-ghqck\" (UID: \"fec4efe4-fd6d-4f34-a256-e7322a07cef0\") " pod="openshift-monitoring/node-exporter-ghqck" Jul 27 20:35:46.571981 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:35:46.571893 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dnxxk\" (UniqueName: \"kubernetes.io/projected/fec4efe4-fd6d-4f34-a256-e7322a07cef0-kube-api-access-dnxxk\") pod \"node-exporter-ghqck\" (UID: \"fec4efe4-fd6d-4f34-a256-e7322a07cef0\") " pod="openshift-monitoring/node-exporter-ghqck" Jul 27 20:35:46.571981 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:35:46.571934 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fec4efe4-fd6d-4f34-a256-e7322a07cef0-metrics-client-ca\") pod \"node-exporter-ghqck\" (UID: \"fec4efe4-fd6d-4f34-a256-e7322a07cef0\") " pod="openshift-monitoring/node-exporter-ghqck" Jul 27 20:35:46.571981 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:35:46.571955 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/fec4efe4-fd6d-4f34-a256-e7322a07cef0-node-exporter-textfile\") pod \"node-exporter-ghqck\" (UID: \"fec4efe4-fd6d-4f34-a256-e7322a07cef0\") " pod="openshift-monitoring/node-exporter-ghqck" Jul 27 20:35:46.571981 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:35:46.571972 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/fec4efe4-fd6d-4f34-a256-e7322a07cef0-root\") pod \"node-exporter-ghqck\" (UID: \"fec4efe4-fd6d-4f34-a256-e7322a07cef0\") " pod="openshift-monitoring/node-exporter-ghqck" Jul 27 20:35:46.572097 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:35:46.571999 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/fec4efe4-fd6d-4f34-a256-e7322a07cef0-sys\") pod \"node-exporter-ghqck\" (UID: \"fec4efe4-fd6d-4f34-a256-e7322a07cef0\") " pod="openshift-monitoring/node-exporter-ghqck" Jul 27 20:35:46.650597 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:35:46.650574 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbpp5_e2759622-0ab6-46b7-b434-f0a0f8942dfe/konnectivity-agent/0.log" limit=1024 Jul 27 20:35:46.672837 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:35:46.672816 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/fec4efe4-fd6d-4f34-a256-e7322a07cef0-node-exporter-tls\") pod \"node-exporter-ghqck\" (UID: \"fec4efe4-fd6d-4f34-a256-e7322a07cef0\") " pod="openshift-monitoring/node-exporter-ghqck" Jul 27 20:35:46.672896 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:35:46.672851 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/fec4efe4-fd6d-4f34-a256-e7322a07cef0-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-ghqck\" (UID: \"fec4efe4-fd6d-4f34-a256-e7322a07cef0\") " pod="openshift-monitoring/node-exporter-ghqck" Jul 27 20:35:46.672896 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:35:46.672871 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/fec4efe4-fd6d-4f34-a256-e7322a07cef0-node-exporter-accelerators-collector-config\") pod \"node-exporter-ghqck\" (UID: \"fec4efe4-fd6d-4f34-a256-e7322a07cef0\") " pod="openshift-monitoring/node-exporter-ghqck" Jul 27 20:35:46.673005 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:35:46.672988 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/fec4efe4-fd6d-4f34-a256-e7322a07cef0-node-exporter-wtmp\") pod \"node-exporter-ghqck\" (UID: \"fec4efe4-fd6d-4f34-a256-e7322a07cef0\") " pod="openshift-monitoring/node-exporter-ghqck" Jul 27 20:35:46.673052 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:35:46.673030 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dnxxk\" (UniqueName: \"kubernetes.io/projected/fec4efe4-fd6d-4f34-a256-e7322a07cef0-kube-api-access-dnxxk\") pod \"node-exporter-ghqck\" (UID: \"fec4efe4-fd6d-4f34-a256-e7322a07cef0\") " pod="openshift-monitoring/node-exporter-ghqck" Jul 27 20:35:46.673099 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:35:46.673073 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fec4efe4-fd6d-4f34-a256-e7322a07cef0-metrics-client-ca\") pod \"node-exporter-ghqck\" (UID: \"fec4efe4-fd6d-4f34-a256-e7322a07cef0\") " pod="openshift-monitoring/node-exporter-ghqck" Jul 27 20:35:46.673154 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:35:46.673099 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/fec4efe4-fd6d-4f34-a256-e7322a07cef0-node-exporter-textfile\") pod \"node-exporter-ghqck\" (UID: \"fec4efe4-fd6d-4f34-a256-e7322a07cef0\") " pod="openshift-monitoring/node-exporter-ghqck" Jul 27 20:35:46.673154 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:35:46.673122 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/fec4efe4-fd6d-4f34-a256-e7322a07cef0-root\") pod \"node-exporter-ghqck\" (UID: \"fec4efe4-fd6d-4f34-a256-e7322a07cef0\") " pod="openshift-monitoring/node-exporter-ghqck" Jul 27 20:35:46.673154 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:35:46.673151 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/fec4efe4-fd6d-4f34-a256-e7322a07cef0-sys\") pod \"node-exporter-ghqck\" (UID: \"fec4efe4-fd6d-4f34-a256-e7322a07cef0\") " pod="openshift-monitoring/node-exporter-ghqck" Jul 27 20:35:46.673288 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:35:46.673175 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/fec4efe4-fd6d-4f34-a256-e7322a07cef0-node-exporter-wtmp\") pod \"node-exporter-ghqck\" (UID: \"fec4efe4-fd6d-4f34-a256-e7322a07cef0\") " pod="openshift-monitoring/node-exporter-ghqck" Jul 27 20:35:46.673288 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:35:46.673230 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/fec4efe4-fd6d-4f34-a256-e7322a07cef0-sys\") pod \"node-exporter-ghqck\" (UID: \"fec4efe4-fd6d-4f34-a256-e7322a07cef0\") " pod="openshift-monitoring/node-exporter-ghqck" Jul 27 20:35:46.673288 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:35:46.673280 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/fec4efe4-fd6d-4f34-a256-e7322a07cef0-root\") pod \"node-exporter-ghqck\" (UID: \"fec4efe4-fd6d-4f34-a256-e7322a07cef0\") " pod="openshift-monitoring/node-exporter-ghqck" Jul 27 20:35:46.673437 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:35:46.673424 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/fec4efe4-fd6d-4f34-a256-e7322a07cef0-node-exporter-accelerators-collector-config\") pod \"node-exporter-ghqck\" (UID: \"fec4efe4-fd6d-4f34-a256-e7322a07cef0\") " pod="openshift-monitoring/node-exporter-ghqck" Jul 27 20:35:46.673513 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:35:46.673493 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/fec4efe4-fd6d-4f34-a256-e7322a07cef0-node-exporter-textfile\") pod \"node-exporter-ghqck\" (UID: \"fec4efe4-fd6d-4f34-a256-e7322a07cef0\") " pod="openshift-monitoring/node-exporter-ghqck" Jul 27 20:35:46.673636 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:35:46.673616 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fec4efe4-fd6d-4f34-a256-e7322a07cef0-metrics-client-ca\") pod \"node-exporter-ghqck\" (UID: \"fec4efe4-fd6d-4f34-a256-e7322a07cef0\") " pod="openshift-monitoring/node-exporter-ghqck" Jul 27 20:35:46.675153 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:35:46.675135 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/fec4efe4-fd6d-4f34-a256-e7322a07cef0-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-ghqck\" (UID: \"fec4efe4-fd6d-4f34-a256-e7322a07cef0\") " pod="openshift-monitoring/node-exporter-ghqck" Jul 27 20:35:46.675234 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:35:46.675219 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/fec4efe4-fd6d-4f34-a256-e7322a07cef0-node-exporter-tls\") pod \"node-exporter-ghqck\" (UID: \"fec4efe4-fd6d-4f34-a256-e7322a07cef0\") " pod="openshift-monitoring/node-exporter-ghqck" Jul 27 20:35:46.679681 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:35:46.679658 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dnxxk\" (UniqueName: \"kubernetes.io/projected/fec4efe4-fd6d-4f34-a256-e7322a07cef0-kube-api-access-dnxxk\") pod \"node-exporter-ghqck\" (UID: \"fec4efe4-fd6d-4f34-a256-e7322a07cef0\") " pod="openshift-monitoring/node-exporter-ghqck" Jul 27 20:35:46.779978 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:35:46.779955 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-ghqck" Jul 27 20:35:46.786399 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:35:46.786373 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbpp5_e2759622-0ab6-46b7-b434-f0a0f8942dfe/konnectivity-agent/0.log" limit=1024 Jul 27 20:35:46.789115 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:35:46.789096 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfec4efe4_fd6d_4f34_a256_e7322a07cef0.slice/crio-8963315af3aa0b50a493a4f2f38268a268b4b6d019de27cfe8cfaaa30056d297 WatchSource:0}: Error finding container 8963315af3aa0b50a493a4f2f38268a268b4b6d019de27cfe8cfaaa30056d297: Status 404 returned error can't find the container with id 8963315af3aa0b50a493a4f2f38268a268b4b6d019de27cfe8cfaaa30056d297 Jul 27 20:35:46.954481 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:35:46.954400 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbpp5_e2759622-0ab6-46b7-b434-f0a0f8942dfe/konnectivity-agent/0.log" limit=1024 Jul 27 20:35:47.186554 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:35:47.186520 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbpp5_e2759622-0ab6-46b7-b434-f0a0f8942dfe/konnectivity-agent/0.log" limit=1024 Jul 27 20:35:47.298404 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:35:47.298369 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbpp5_e2759622-0ab6-46b7-b434-f0a0f8942dfe/konnectivity-agent/0.log" limit=1024 Jul 27 20:35:47.404377 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:35:47.404347 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbpp5_e2759622-0ab6-46b7-b434-f0a0f8942dfe/konnectivity-agent/0.log" limit=1024 Jul 27 20:35:47.475140 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:35:47.475108 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-w5k72" Jul 27 20:35:47.486168 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:35:47.486141 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbpp5_e2759622-0ab6-46b7-b434-f0a0f8942dfe/konnectivity-agent/0.log" limit=1024 Jul 27 20:35:47.501363 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:35:47.501314 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-ghqck" event={"ID":"fec4efe4-fd6d-4f34-a256-e7322a07cef0","Type":"ContainerStarted","Data":"8963315af3aa0b50a493a4f2f38268a268b4b6d019de27cfe8cfaaa30056d297"} Jul 27 20:35:47.771241 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:35:47.771208 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbpp5_e2759622-0ab6-46b7-b434-f0a0f8942dfe/konnectivity-agent/0.log" limit=1024 Jul 27 20:35:47.881380 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:35:47.881349 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/59206a62-e80f-4339-9698-16334b19fdba-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-59bwv\" (UID: \"59206a62-e80f-4339-9698-16334b19fdba\") " pod="openshift-insights/insights-runtime-extractor-59bwv" Jul 27 20:35:47.881487 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:35:47.881418 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/59206a62-e80f-4339-9698-16334b19fdba-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-59bwv\" (UID: \"59206a62-e80f-4339-9698-16334b19fdba\") " pod="openshift-insights/insights-runtime-extractor-59bwv" Jul 27 20:35:47.881843 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:35:47.881826 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/59206a62-e80f-4339-9698-16334b19fdba-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-59bwv\" (UID: \"59206a62-e80f-4339-9698-16334b19fdba\") " pod="openshift-insights/insights-runtime-extractor-59bwv" Jul 27 20:35:47.883333 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:35:47.883304 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/59206a62-e80f-4339-9698-16334b19fdba-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-59bwv\" (UID: \"59206a62-e80f-4339-9698-16334b19fdba\") " pod="openshift-insights/insights-runtime-extractor-59bwv" Jul 27 20:35:48.061269 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:35:48.061249 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-59bwv" Jul 27 20:35:48.177334 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:35:48.177288 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-59bwv"] Jul 27 20:35:48.180160 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:35:48.180131 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod59206a62_e80f_4339_9698_16334b19fdba.slice/crio-6c913932f2332bf0d3bbf337c9a9f2359e512adb13b90ccb9aefdc44b9cdd2da WatchSource:0}: Error finding container 6c913932f2332bf0d3bbf337c9a9f2359e512adb13b90ccb9aefdc44b9cdd2da: Status 404 returned error can't find the container with id 6c913932f2332bf0d3bbf337c9a9f2359e512adb13b90ccb9aefdc44b9cdd2da Jul 27 20:35:48.506181 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:35:48.506038 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-59bwv" event={"ID":"59206a62-e80f-4339-9698-16334b19fdba","Type":"ContainerStarted","Data":"6c913932f2332bf0d3bbf337c9a9f2359e512adb13b90ccb9aefdc44b9cdd2da"} Jul 27 20:35:48.507587 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:35:48.507565 2572 generic.go:356] "Generic (PLEG): container finished" podID="fec4efe4-fd6d-4f34-a256-e7322a07cef0" containerID="1fcbef92c2f16750a83500cb6400ddb9e64272eb430d488415d53ad9ce2d4283" exitCode=0 Jul 27 20:35:48.507707 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:35:48.507637 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-ghqck" event={"ID":"fec4efe4-fd6d-4f34-a256-e7322a07cef0","Type":"ContainerDied","Data":"1fcbef92c2f16750a83500cb6400ddb9e64272eb430d488415d53ad9ce2d4283"} Jul 27 20:35:49.366457 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:35:49.366421 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbpp5_e2759622-0ab6-46b7-b434-f0a0f8942dfe/konnectivity-agent/0.log" limit=1024 Jul 27 20:35:49.459046 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:35:49.459014 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbpp5_e2759622-0ab6-46b7-b434-f0a0f8942dfe/konnectivity-agent/0.log" limit=1024 Jul 27 20:35:49.513883 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:35:49.513849 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-ghqck" event={"ID":"fec4efe4-fd6d-4f34-a256-e7322a07cef0","Type":"ContainerStarted","Data":"dd6a692629d38d35cb543a323e3cf93488ae6b190247cce0a9a608c0176617d9"} Jul 27 20:35:49.514286 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:35:49.513907 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-ghqck" event={"ID":"fec4efe4-fd6d-4f34-a256-e7322a07cef0","Type":"ContainerStarted","Data":"30e882b4b3ebd1da203dbc9d0ad93e5af08c25d6cc59be9d678f3ecb1932de59"} Jul 27 20:35:49.533539 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:35:49.533491 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-ghqck" podStartSLOduration=2.59787476 podStartE2EDuration="3.533475564s" totalImagesPullingTime="874.782814ms" totalInitContainerRuntime="60.81799ms" isStatefulPod=true podCreationTimestamp="2026-07-27 20:35:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:35:49.532178831 +0000 UTC m=+83.001721859" watchObservedRunningTime="2026-07-27 20:35:49.533475564 +0000 UTC m=+83.003018573" Jul 27 20:35:49.752071 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:35:49.751979 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbpp5_e2759622-0ab6-46b7-b434-f0a0f8942dfe/konnectivity-agent/0.log" limit=1024 Jul 27 20:35:49.863111 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:35:49.863082 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbpp5_e2759622-0ab6-46b7-b434-f0a0f8942dfe/konnectivity-agent/0.log" limit=1024 Jul 27 20:35:49.986392 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:35:49.986360 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbpp5_e2759622-0ab6-46b7-b434-f0a0f8942dfe/konnectivity-agent/0.log" limit=1024 Jul 27 20:35:50.429243 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:35:50.429210 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-7949c779f6-665wf" Jul 27 20:35:50.557232 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:35:50.557196 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbpp5_e2759622-0ab6-46b7-b434-f0a0f8942dfe/konnectivity-agent/0.log" limit=1024 Jul 27 20:35:50.657679 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:35:50.657648 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbpp5_e2759622-0ab6-46b7-b434-f0a0f8942dfe/konnectivity-agent/0.log" limit=1024 Jul 27 20:35:51.197303 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:35:51.197272 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbpp5_e2759622-0ab6-46b7-b434-f0a0f8942dfe/konnectivity-agent/0.log" limit=1024 Jul 27 20:35:51.277209 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:35:51.277168 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbpp5_e2759622-0ab6-46b7-b434-f0a0f8942dfe/konnectivity-agent/0.log" limit=1024 Jul 27 20:35:51.602409 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:35:51.602367 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbpp5_e2759622-0ab6-46b7-b434-f0a0f8942dfe/konnectivity-agent/0.log" limit=1024 Jul 27 20:35:52.666442 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:35:52.666406 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbpp5_e2759622-0ab6-46b7-b434-f0a0f8942dfe/konnectivity-agent/0.log" limit=1024 Jul 27 20:35:52.672050 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:35:52.672023 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 27 20:35:52.677373 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:35:52.677350 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 27 20:35:52.680292 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:35:52.680252 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jul 27 20:35:52.680292 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:35:52.680266 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jul 27 20:35:52.680292 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:35:52.680270 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jul 27 20:35:52.680292 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:35:52.680270 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-whjxs\"" Jul 27 20:35:52.680692 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:35:52.680558 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jul 27 20:35:52.680692 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:35:52.680628 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jul 27 20:35:52.680872 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:35:52.680790 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jul 27 20:35:52.680872 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:35:52.680803 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jul 27 20:35:52.680872 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:35:52.680851 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jul 27 20:35:52.681025 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:35:52.681005 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jul 27 20:35:52.681093 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:35:52.681065 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jul 27 20:35:52.681268 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:35:52.681237 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jul 27 20:35:52.681837 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:35:52.681505 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-etp9shnfa56qe\"" Jul 27 20:35:52.681837 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:35:52.681625 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jul 27 20:35:52.681837 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:35:52.681638 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jul 27 20:35:52.684120 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:35:52.684096 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jul 27 20:35:52.687096 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:35:52.687078 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jul 27 20:35:52.691702 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:35:52.691680 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 27 20:35:52.722659 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:35:52.722629 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/e3ecc8ab-d5eb-4cba-a99e-67040fbb452e-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"e3ecc8ab-d5eb-4cba-a99e-67040fbb452e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 20:35:52.722761 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:35:52.722676 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/e3ecc8ab-d5eb-4cba-a99e-67040fbb452e-config-out\") pod \"prometheus-k8s-0\" (UID: \"e3ecc8ab-d5eb-4cba-a99e-67040fbb452e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 20:35:52.722761 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:35:52.722739 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/e3ecc8ab-d5eb-4cba-a99e-67040fbb452e-config\") pod \"prometheus-k8s-0\" (UID: \"e3ecc8ab-d5eb-4cba-a99e-67040fbb452e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 20:35:52.722883 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:35:52.722776 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/e3ecc8ab-d5eb-4cba-a99e-67040fbb452e-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"e3ecc8ab-d5eb-4cba-a99e-67040fbb452e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 20:35:52.722883 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:35:52.722803 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/e3ecc8ab-d5eb-4cba-a99e-67040fbb452e-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"e3ecc8ab-d5eb-4cba-a99e-67040fbb452e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 20:35:52.722883 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:35:52.722860 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d6zjq\" (UniqueName: \"kubernetes.io/projected/e3ecc8ab-d5eb-4cba-a99e-67040fbb452e-kube-api-access-d6zjq\") pod \"prometheus-k8s-0\" (UID: \"e3ecc8ab-d5eb-4cba-a99e-67040fbb452e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 20:35:52.723083 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:35:52.722906 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/e3ecc8ab-d5eb-4cba-a99e-67040fbb452e-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"e3ecc8ab-d5eb-4cba-a99e-67040fbb452e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 20:35:52.723083 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:35:52.722969 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/e3ecc8ab-d5eb-4cba-a99e-67040fbb452e-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"e3ecc8ab-d5eb-4cba-a99e-67040fbb452e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 20:35:52.723083 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:35:52.722995 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/e3ecc8ab-d5eb-4cba-a99e-67040fbb452e-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"e3ecc8ab-d5eb-4cba-a99e-67040fbb452e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 20:35:52.723083 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:35:52.723020 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e3ecc8ab-d5eb-4cba-a99e-67040fbb452e-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"e3ecc8ab-d5eb-4cba-a99e-67040fbb452e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 20:35:52.723293 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:35:52.723088 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e3ecc8ab-d5eb-4cba-a99e-67040fbb452e-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"e3ecc8ab-d5eb-4cba-a99e-67040fbb452e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 20:35:52.723293 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:35:52.723127 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/e3ecc8ab-d5eb-4cba-a99e-67040fbb452e-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"e3ecc8ab-d5eb-4cba-a99e-67040fbb452e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 20:35:52.723293 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:35:52.723157 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e3ecc8ab-d5eb-4cba-a99e-67040fbb452e-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"e3ecc8ab-d5eb-4cba-a99e-67040fbb452e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 20:35:52.723293 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:35:52.723189 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/e3ecc8ab-d5eb-4cba-a99e-67040fbb452e-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"e3ecc8ab-d5eb-4cba-a99e-67040fbb452e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 20:35:52.723293 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:35:52.723216 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e3ecc8ab-d5eb-4cba-a99e-67040fbb452e-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"e3ecc8ab-d5eb-4cba-a99e-67040fbb452e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 20:35:52.723293 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:35:52.723248 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/e3ecc8ab-d5eb-4cba-a99e-67040fbb452e-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"e3ecc8ab-d5eb-4cba-a99e-67040fbb452e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 20:35:52.723293 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:35:52.723270 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/e3ecc8ab-d5eb-4cba-a99e-67040fbb452e-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"e3ecc8ab-d5eb-4cba-a99e-67040fbb452e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 20:35:52.723583 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:35:52.723300 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/e3ecc8ab-d5eb-4cba-a99e-67040fbb452e-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"e3ecc8ab-d5eb-4cba-a99e-67040fbb452e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 20:35:52.723583 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:35:52.723341 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/e3ecc8ab-d5eb-4cba-a99e-67040fbb452e-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"e3ecc8ab-d5eb-4cba-a99e-67040fbb452e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 20:35:52.723583 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:35:52.723368 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/e3ecc8ab-d5eb-4cba-a99e-67040fbb452e-web-config\") pod \"prometheus-k8s-0\" (UID: \"e3ecc8ab-d5eb-4cba-a99e-67040fbb452e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 20:35:52.823837 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:35:52.823806 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/e3ecc8ab-d5eb-4cba-a99e-67040fbb452e-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"e3ecc8ab-d5eb-4cba-a99e-67040fbb452e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 20:35:52.824003 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:35:52.823847 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/e3ecc8ab-d5eb-4cba-a99e-67040fbb452e-web-config\") pod \"prometheus-k8s-0\" (UID: \"e3ecc8ab-d5eb-4cba-a99e-67040fbb452e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 20:35:52.824003 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:35:52.823887 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/e3ecc8ab-d5eb-4cba-a99e-67040fbb452e-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"e3ecc8ab-d5eb-4cba-a99e-67040fbb452e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 20:35:52.824003 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:35:52.823907 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/e3ecc8ab-d5eb-4cba-a99e-67040fbb452e-config-out\") pod \"prometheus-k8s-0\" (UID: \"e3ecc8ab-d5eb-4cba-a99e-67040fbb452e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 20:35:52.824003 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:35:52.823933 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/e3ecc8ab-d5eb-4cba-a99e-67040fbb452e-config\") pod \"prometheus-k8s-0\" (UID: \"e3ecc8ab-d5eb-4cba-a99e-67040fbb452e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 20:35:52.824003 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:35:52.823950 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/e3ecc8ab-d5eb-4cba-a99e-67040fbb452e-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"e3ecc8ab-d5eb-4cba-a99e-67040fbb452e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 20:35:52.824003 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:35:52.823972 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/e3ecc8ab-d5eb-4cba-a99e-67040fbb452e-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"e3ecc8ab-d5eb-4cba-a99e-67040fbb452e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 20:35:52.824290 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:35:52.824041 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d6zjq\" (UniqueName: \"kubernetes.io/projected/e3ecc8ab-d5eb-4cba-a99e-67040fbb452e-kube-api-access-d6zjq\") pod \"prometheus-k8s-0\" (UID: \"e3ecc8ab-d5eb-4cba-a99e-67040fbb452e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 20:35:52.824290 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:35:52.824087 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/e3ecc8ab-d5eb-4cba-a99e-67040fbb452e-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"e3ecc8ab-d5eb-4cba-a99e-67040fbb452e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 20:35:52.824290 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:35:52.824127 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/e3ecc8ab-d5eb-4cba-a99e-67040fbb452e-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"e3ecc8ab-d5eb-4cba-a99e-67040fbb452e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 20:35:52.824290 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:35:52.824156 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/e3ecc8ab-d5eb-4cba-a99e-67040fbb452e-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"e3ecc8ab-d5eb-4cba-a99e-67040fbb452e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 20:35:52.824290 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:35:52.824182 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e3ecc8ab-d5eb-4cba-a99e-67040fbb452e-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"e3ecc8ab-d5eb-4cba-a99e-67040fbb452e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 20:35:52.824290 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:35:52.824224 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e3ecc8ab-d5eb-4cba-a99e-67040fbb452e-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"e3ecc8ab-d5eb-4cba-a99e-67040fbb452e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 20:35:52.824290 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:35:52.824262 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/e3ecc8ab-d5eb-4cba-a99e-67040fbb452e-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"e3ecc8ab-d5eb-4cba-a99e-67040fbb452e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 20:35:52.824693 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:35:52.824294 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e3ecc8ab-d5eb-4cba-a99e-67040fbb452e-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"e3ecc8ab-d5eb-4cba-a99e-67040fbb452e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 20:35:52.824693 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:35:52.824359 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/e3ecc8ab-d5eb-4cba-a99e-67040fbb452e-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"e3ecc8ab-d5eb-4cba-a99e-67040fbb452e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 20:35:52.824693 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:35:52.824387 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e3ecc8ab-d5eb-4cba-a99e-67040fbb452e-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"e3ecc8ab-d5eb-4cba-a99e-67040fbb452e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 20:35:52.824693 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:35:52.824424 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/e3ecc8ab-d5eb-4cba-a99e-67040fbb452e-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"e3ecc8ab-d5eb-4cba-a99e-67040fbb452e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 20:35:52.824693 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:35:52.824447 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/e3ecc8ab-d5eb-4cba-a99e-67040fbb452e-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"e3ecc8ab-d5eb-4cba-a99e-67040fbb452e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 20:35:52.824693 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:35:52.824477 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/e3ecc8ab-d5eb-4cba-a99e-67040fbb452e-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"e3ecc8ab-d5eb-4cba-a99e-67040fbb452e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 20:35:52.824693 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:35:52.824648 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/e3ecc8ab-d5eb-4cba-a99e-67040fbb452e-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"e3ecc8ab-d5eb-4cba-a99e-67040fbb452e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 20:35:52.825748 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:35:52.825436 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e3ecc8ab-d5eb-4cba-a99e-67040fbb452e-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"e3ecc8ab-d5eb-4cba-a99e-67040fbb452e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 20:35:52.828082 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:35:52.827560 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/e3ecc8ab-d5eb-4cba-a99e-67040fbb452e-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"e3ecc8ab-d5eb-4cba-a99e-67040fbb452e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 20:35:52.828082 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:35:52.828002 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e3ecc8ab-d5eb-4cba-a99e-67040fbb452e-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"e3ecc8ab-d5eb-4cba-a99e-67040fbb452e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 20:35:52.828082 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:35:52.828006 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/e3ecc8ab-d5eb-4cba-a99e-67040fbb452e-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"e3ecc8ab-d5eb-4cba-a99e-67040fbb452e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 20:35:52.829083 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:35:52.828299 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/e3ecc8ab-d5eb-4cba-a99e-67040fbb452e-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"e3ecc8ab-d5eb-4cba-a99e-67040fbb452e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 20:35:52.829083 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:35:52.828839 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/e3ecc8ab-d5eb-4cba-a99e-67040fbb452e-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"e3ecc8ab-d5eb-4cba-a99e-67040fbb452e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 20:35:52.829083 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:35:52.828930 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e3ecc8ab-d5eb-4cba-a99e-67040fbb452e-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"e3ecc8ab-d5eb-4cba-a99e-67040fbb452e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 20:35:52.829083 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:35:52.828307 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/e3ecc8ab-d5eb-4cba-a99e-67040fbb452e-config-out\") pod \"prometheus-k8s-0\" (UID: \"e3ecc8ab-d5eb-4cba-a99e-67040fbb452e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 20:35:52.829369 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:35:52.829217 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/e3ecc8ab-d5eb-4cba-a99e-67040fbb452e-config\") pod \"prometheus-k8s-0\" (UID: \"e3ecc8ab-d5eb-4cba-a99e-67040fbb452e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 20:35:52.829369 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:35:52.829279 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e3ecc8ab-d5eb-4cba-a99e-67040fbb452e-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"e3ecc8ab-d5eb-4cba-a99e-67040fbb452e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 20:35:52.829628 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:35:52.829566 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/e3ecc8ab-d5eb-4cba-a99e-67040fbb452e-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"e3ecc8ab-d5eb-4cba-a99e-67040fbb452e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 20:35:52.830084 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:35:52.830060 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/e3ecc8ab-d5eb-4cba-a99e-67040fbb452e-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"e3ecc8ab-d5eb-4cba-a99e-67040fbb452e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 20:35:52.830827 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:35:52.830787 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/e3ecc8ab-d5eb-4cba-a99e-67040fbb452e-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"e3ecc8ab-d5eb-4cba-a99e-67040fbb452e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 20:35:52.830923 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:35:52.830846 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/e3ecc8ab-d5eb-4cba-a99e-67040fbb452e-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"e3ecc8ab-d5eb-4cba-a99e-67040fbb452e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 20:35:52.831062 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:35:52.831040 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/e3ecc8ab-d5eb-4cba-a99e-67040fbb452e-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"e3ecc8ab-d5eb-4cba-a99e-67040fbb452e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 20:35:52.831391 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:35:52.831368 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/e3ecc8ab-d5eb-4cba-a99e-67040fbb452e-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"e3ecc8ab-d5eb-4cba-a99e-67040fbb452e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 20:35:52.831490 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:35:52.831456 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/e3ecc8ab-d5eb-4cba-a99e-67040fbb452e-web-config\") pod \"prometheus-k8s-0\" (UID: \"e3ecc8ab-d5eb-4cba-a99e-67040fbb452e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 20:35:52.831647 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:35:52.831627 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/e3ecc8ab-d5eb-4cba-a99e-67040fbb452e-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"e3ecc8ab-d5eb-4cba-a99e-67040fbb452e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 20:35:52.836923 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:35:52.836892 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d6zjq\" (UniqueName: \"kubernetes.io/projected/e3ecc8ab-d5eb-4cba-a99e-67040fbb452e-kube-api-access-d6zjq\") pod \"prometheus-k8s-0\" (UID: \"e3ecc8ab-d5eb-4cba-a99e-67040fbb452e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 20:35:52.990038 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:35:52.989957 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 27 20:35:53.243297 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:35:53.243232 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 27 20:35:53.246258 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:35:53.246235 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode3ecc8ab_d5eb_4cba_a99e_67040fbb452e.slice/crio-4187470497b91da239faf7a0a8c50950800b58a9ce2723a300c2a39cc9427e85 WatchSource:0}: Error finding container 4187470497b91da239faf7a0a8c50950800b58a9ce2723a300c2a39cc9427e85: Status 404 returned error can't find the container with id 4187470497b91da239faf7a0a8c50950800b58a9ce2723a300c2a39cc9427e85 Jul 27 20:35:53.538872 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:35:53.538840 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"e3ecc8ab-d5eb-4cba-a99e-67040fbb452e","Type":"ContainerStarted","Data":"4187470497b91da239faf7a0a8c50950800b58a9ce2723a300c2a39cc9427e85"} Jul 27 20:35:53.540201 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:35:53.540178 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-59bwv" event={"ID":"59206a62-e80f-4339-9698-16334b19fdba","Type":"ContainerStarted","Data":"35f681d7d2993709147d60c9d02056f53e6747f8334e562ef079c577c023ac07"} Jul 27 20:35:54.545313 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:35:54.545279 2572 generic.go:356] "Generic (PLEG): container finished" podID="e3ecc8ab-d5eb-4cba-a99e-67040fbb452e" containerID="5059f39f3a2ba3ef0e820c9e6c69b8532b197be46e02e9bb9ae330f386dc5a05" exitCode=0 Jul 27 20:35:54.545313 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:35:54.545313 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"e3ecc8ab-d5eb-4cba-a99e-67040fbb452e","Type":"ContainerDied","Data":"5059f39f3a2ba3ef0e820c9e6c69b8532b197be46e02e9bb9ae330f386dc5a05"} Jul 27 20:35:55.895049 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:35:55.895011 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbpp5_e2759622-0ab6-46b7-b434-f0a0f8942dfe/konnectivity-agent/0.log" limit=1024 Jul 27 20:35:55.949065 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:35:55.949037 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbpp5_e2759622-0ab6-46b7-b434-f0a0f8942dfe/konnectivity-agent/0.log" limit=1024 Jul 27 20:35:56.296583 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:35:56.296544 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbpp5_e2759622-0ab6-46b7-b434-f0a0f8942dfe/konnectivity-agent/0.log" limit=1024 Jul 27 20:35:56.349353 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:35:56.349307 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbpp5_e2759622-0ab6-46b7-b434-f0a0f8942dfe/konnectivity-agent/0.log" limit=1024 Jul 27 20:35:57.562583 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:35:57.562536 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-59bwv" event={"ID":"59206a62-e80f-4339-9698-16334b19fdba","Type":"ContainerStarted","Data":"ecf1c9227c371d938cbd76bc06dd4d9aa1039efd54c3feaf0d09cac12d24eddb"} Jul 27 20:35:58.557314 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:35:58.557270 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbpp5_e2759622-0ab6-46b7-b434-f0a0f8942dfe/konnectivity-agent/0.log" limit=1024 Jul 27 20:35:58.609556 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:35:58.609521 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbpp5_e2759622-0ab6-46b7-b434-f0a0f8942dfe/konnectivity-agent/0.log" limit=1024 Jul 27 20:35:59.001461 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:35:59.001380 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbpp5_e2759622-0ab6-46b7-b434-f0a0f8942dfe/konnectivity-agent/0.log" limit=1024 Jul 27 20:35:59.102582 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:35:59.102544 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbpp5_e2759622-0ab6-46b7-b434-f0a0f8942dfe/konnectivity-agent/0.log" limit=1024 Jul 27 20:35:59.963446 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:35:59.963411 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbpp5_e2759622-0ab6-46b7-b434-f0a0f8942dfe/konnectivity-agent/0.log" limit=1024 Jul 27 20:36:00.578078 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:36:00.578039 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"e3ecc8ab-d5eb-4cba-a99e-67040fbb452e","Type":"ContainerStarted","Data":"dd505182d35865b4a3b79f10dffc85c7321dc2414ac0dc1992b8737e818b8e5c"} Jul 27 20:36:00.578252 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:36:00.578131 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"e3ecc8ab-d5eb-4cba-a99e-67040fbb452e","Type":"ContainerStarted","Data":"9f38e95800cf35f5af27de6dc1d621ab0df48ac947cdd232faab993ebdeca3f9"} Jul 27 20:36:00.580742 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:36:00.580710 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-59bwv" event={"ID":"59206a62-e80f-4339-9698-16334b19fdba","Type":"ContainerStarted","Data":"ad18c46446200c9830497aaeb3ba3120dd3a1d9a16e2aef86cceaabc562f4475"} Jul 27 20:36:00.601928 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:36:00.601864 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-59bwv" podStartSLOduration=16.560040848 podStartE2EDuration="28.601849492s" totalImagesPullingTime="12.041808644s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 20:35:32 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:36:00.600043282 +0000 UTC m=+94.069586292" watchObservedRunningTime="2026-07-27 20:36:00.601849492 +0000 UTC m=+94.071392503" Jul 27 20:36:01.133104 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:36:01.133070 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbpp5_e2759622-0ab6-46b7-b434-f0a0f8942dfe/konnectivity-agent/0.log" limit=1024 Jul 27 20:36:01.227201 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:36:01.227154 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbpp5_e2759622-0ab6-46b7-b434-f0a0f8942dfe/konnectivity-agent/0.log" limit=1024 Jul 27 20:36:02.591574 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:36:02.591497 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"e3ecc8ab-d5eb-4cba-a99e-67040fbb452e","Type":"ContainerStarted","Data":"71b1f821d444486b40c309d027af70ddcd8935824ade7e028e732fb649c1e2d3"} Jul 27 20:36:02.591997 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:36:02.591599 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"e3ecc8ab-d5eb-4cba-a99e-67040fbb452e","Type":"ContainerStarted","Data":"92a6101fa50a8b71f61659f53161182421202a73d5f2bbe67c642cd548d2332d"} Jul 27 20:36:02.591997 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:36:02.591653 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"e3ecc8ab-d5eb-4cba-a99e-67040fbb452e","Type":"ContainerStarted","Data":"f7b0b2be3c6de330971f225b21fbad58813e7f45046963196d7445148c8cefb7"} Jul 27 20:36:02.591997 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:36:02.591695 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"e3ecc8ab-d5eb-4cba-a99e-67040fbb452e","Type":"ContainerStarted","Data":"9bf74e339990d0cf2777915beedc3f0a4c611ac919afa5b7787212f1fee24b67"} Jul 27 20:36:02.622646 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:36:02.622600 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=1.9620358 podStartE2EDuration="10.622584471s" totalImagesPullingTime="8.636253865s" totalInitContainerRuntime="24.294806ms" isStatefulPod=false podCreationTimestamp="2026-07-27 20:35:52 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:36:02.621770173 +0000 UTC m=+96.091313182" watchObservedRunningTime="2026-07-27 20:36:02.622584471 +0000 UTC m=+96.092127478" Jul 27 20:36:02.990103 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:36:02.990020 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 27 20:36:04.984960 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:36:04.984928 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbpp5_e2759622-0ab6-46b7-b434-f0a0f8942dfe/konnectivity-agent/0.log" limit=1024 Jul 27 20:36:05.076866 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:36:05.076837 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbpp5_e2759622-0ab6-46b7-b434-f0a0f8942dfe/konnectivity-agent/0.log" limit=1024 Jul 27 20:36:12.563148 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:36:12.563112 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbpp5_e2759622-0ab6-46b7-b434-f0a0f8942dfe/konnectivity-agent/0.log" limit=1024 Jul 27 20:36:12.614955 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:36:12.614925 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbpp5_e2759622-0ab6-46b7-b434-f0a0f8942dfe/konnectivity-agent/0.log" limit=1024 Jul 27 20:36:12.675494 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:36:12.675466 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbpp5_e2759622-0ab6-46b7-b434-f0a0f8942dfe/konnectivity-agent/0.log" limit=1024 Jul 27 20:36:14.002529 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:36:14.002499 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbpp5_e2759622-0ab6-46b7-b434-f0a0f8942dfe/konnectivity-agent/0.log" limit=1024 Jul 27 20:36:14.102705 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:36:14.102671 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbpp5_e2759622-0ab6-46b7-b434-f0a0f8942dfe/konnectivity-agent/0.log" limit=1024 Jul 27 20:36:21.084451 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:36:21.084411 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbpp5_e2759622-0ab6-46b7-b434-f0a0f8942dfe/konnectivity-agent/0.log" limit=1024 Jul 27 20:36:21.183165 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:36:21.183134 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbpp5_e2759622-0ab6-46b7-b434-f0a0f8942dfe/konnectivity-agent/0.log" limit=1024 Jul 27 20:36:21.283966 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:36:21.283933 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbpp5_e2759622-0ab6-46b7-b434-f0a0f8942dfe/konnectivity-agent/0.log" limit=1024 Jul 27 20:36:26.858264 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:36:26.858232 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbpp5_e2759622-0ab6-46b7-b434-f0a0f8942dfe/konnectivity-agent/0.log" limit=1024 Jul 27 20:36:29.003375 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:36:29.003340 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbpp5_e2759622-0ab6-46b7-b434-f0a0f8942dfe/konnectivity-agent/0.log" limit=1024 Jul 27 20:36:29.062865 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:36:29.062841 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbpp5_e2759622-0ab6-46b7-b434-f0a0f8942dfe/konnectivity-agent/0.log" limit=1024 Jul 27 20:36:52.990930 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:36:52.990888 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jul 27 20:36:53.010089 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:36:53.010064 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jul 27 20:36:53.771874 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:36:53.771850 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 27 20:37:02.278873 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:37:02.278839 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbpp5_e2759622-0ab6-46b7-b434-f0a0f8942dfe/konnectivity-agent/0.log" limit=1024 Jul 27 20:37:02.375310 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:37:02.375281 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbpp5_e2759622-0ab6-46b7-b434-f0a0f8942dfe/konnectivity-agent/0.log" limit=1024 Jul 27 20:37:05.665482 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:37:05.665437 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbpp5_e2759622-0ab6-46b7-b434-f0a0f8942dfe/konnectivity-agent/0.log" limit=1024 Jul 27 20:37:06.010240 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:37:06.010207 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbpp5_e2759622-0ab6-46b7-b434-f0a0f8942dfe/konnectivity-agent/0.log" limit=1024 Jul 27 20:37:11.083244 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:37:11.083203 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 27 20:37:11.083774 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:37:11.083575 2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="e3ecc8ab-d5eb-4cba-a99e-67040fbb452e" containerName="prometheus" containerID="cri-o://9f38e95800cf35f5af27de6dc1d621ab0df48ac947cdd232faab993ebdeca3f9" gracePeriod=600 Jul 27 20:37:11.083774 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:37:11.083602 2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="e3ecc8ab-d5eb-4cba-a99e-67040fbb452e" containerName="kube-rbac-proxy" containerID="cri-o://92a6101fa50a8b71f61659f53161182421202a73d5f2bbe67c642cd548d2332d" gracePeriod=600 Jul 27 20:37:11.083774 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:37:11.083618 2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="e3ecc8ab-d5eb-4cba-a99e-67040fbb452e" containerName="thanos-sidecar" containerID="cri-o://9bf74e339990d0cf2777915beedc3f0a4c611ac919afa5b7787212f1fee24b67" gracePeriod=600 Jul 27 20:37:11.083774 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:37:11.083633 2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="e3ecc8ab-d5eb-4cba-a99e-67040fbb452e" containerName="kube-rbac-proxy-web" containerID="cri-o://f7b0b2be3c6de330971f225b21fbad58813e7f45046963196d7445148c8cefb7" gracePeriod=600 Jul 27 20:37:11.083774 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:37:11.083659 2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="e3ecc8ab-d5eb-4cba-a99e-67040fbb452e" containerName="kube-rbac-proxy-thanos" containerID="cri-o://71b1f821d444486b40c309d027af70ddcd8935824ade7e028e732fb649c1e2d3" gracePeriod=600 Jul 27 20:37:11.083774 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:37:11.083668 2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="e3ecc8ab-d5eb-4cba-a99e-67040fbb452e" containerName="config-reloader" containerID="cri-o://dd505182d35865b4a3b79f10dffc85c7321dc2414ac0dc1992b8737e818b8e5c" gracePeriod=600 Jul 27 20:37:11.316797 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:37:11.316774 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 27 20:37:11.419458 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:37:11.419372 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/e3ecc8ab-d5eb-4cba-a99e-67040fbb452e-prometheus-k8s-rulefiles-1\") pod \"e3ecc8ab-d5eb-4cba-a99e-67040fbb452e\" (UID: \"e3ecc8ab-d5eb-4cba-a99e-67040fbb452e\") " Jul 27 20:37:11.419458 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:37:11.419413 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-d6zjq\" (UniqueName: \"kubernetes.io/projected/e3ecc8ab-d5eb-4cba-a99e-67040fbb452e-kube-api-access-d6zjq\") pod \"e3ecc8ab-d5eb-4cba-a99e-67040fbb452e\" (UID: \"e3ecc8ab-d5eb-4cba-a99e-67040fbb452e\") " Jul 27 20:37:11.419458 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:37:11.419435 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/e3ecc8ab-d5eb-4cba-a99e-67040fbb452e-secret-kube-rbac-proxy\") pod \"e3ecc8ab-d5eb-4cba-a99e-67040fbb452e\" (UID: \"e3ecc8ab-d5eb-4cba-a99e-67040fbb452e\") " Jul 27 20:37:11.419458 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:37:11.419457 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/e3ecc8ab-d5eb-4cba-a99e-67040fbb452e-config-out\") pod \"e3ecc8ab-d5eb-4cba-a99e-67040fbb452e\" (UID: \"e3ecc8ab-d5eb-4cba-a99e-67040fbb452e\") " Jul 27 20:37:11.419742 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:37:11.419490 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e3ecc8ab-d5eb-4cba-a99e-67040fbb452e-configmap-kubelet-serving-ca-bundle\") pod \"e3ecc8ab-d5eb-4cba-a99e-67040fbb452e\" (UID: \"e3ecc8ab-d5eb-4cba-a99e-67040fbb452e\") " Jul 27 20:37:11.419742 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:37:11.419532 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e3ecc8ab-d5eb-4cba-a99e-67040fbb452e-prometheus-trusted-ca-bundle\") pod \"e3ecc8ab-d5eb-4cba-a99e-67040fbb452e\" (UID: \"e3ecc8ab-d5eb-4cba-a99e-67040fbb452e\") " Jul 27 20:37:11.419742 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:37:11.419558 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/e3ecc8ab-d5eb-4cba-a99e-67040fbb452e-tls-assets\") pod \"e3ecc8ab-d5eb-4cba-a99e-67040fbb452e\" (UID: \"e3ecc8ab-d5eb-4cba-a99e-67040fbb452e\") " Jul 27 20:37:11.419742 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:37:11.419687 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/e3ecc8ab-d5eb-4cba-a99e-67040fbb452e-secret-prometheus-k8s-tls\") pod \"e3ecc8ab-d5eb-4cba-a99e-67040fbb452e\" (UID: \"e3ecc8ab-d5eb-4cba-a99e-67040fbb452e\") " Jul 27 20:37:11.419742 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:37:11.419719 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/e3ecc8ab-d5eb-4cba-a99e-67040fbb452e-secret-grpc-tls\") pod \"e3ecc8ab-d5eb-4cba-a99e-67040fbb452e\" (UID: \"e3ecc8ab-d5eb-4cba-a99e-67040fbb452e\") " Jul 27 20:37:11.419946 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:37:11.419751 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/e3ecc8ab-d5eb-4cba-a99e-67040fbb452e-prometheus-k8s-rulefiles-2\") pod \"e3ecc8ab-d5eb-4cba-a99e-67040fbb452e\" (UID: \"e3ecc8ab-d5eb-4cba-a99e-67040fbb452e\") " Jul 27 20:37:11.419946 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:37:11.419781 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e3ecc8ab-d5eb-4cba-a99e-67040fbb452e-configmap-metrics-client-ca\") pod \"e3ecc8ab-d5eb-4cba-a99e-67040fbb452e\" (UID: \"e3ecc8ab-d5eb-4cba-a99e-67040fbb452e\") " Jul 27 20:37:11.419946 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:37:11.419811 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/e3ecc8ab-d5eb-4cba-a99e-67040fbb452e-prometheus-k8s-rulefiles-0\") pod \"e3ecc8ab-d5eb-4cba-a99e-67040fbb452e\" (UID: \"e3ecc8ab-d5eb-4cba-a99e-67040fbb452e\") " Jul 27 20:37:11.419946 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:37:11.419837 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/e3ecc8ab-d5eb-4cba-a99e-67040fbb452e-web-config\") pod \"e3ecc8ab-d5eb-4cba-a99e-67040fbb452e\" (UID: \"e3ecc8ab-d5eb-4cba-a99e-67040fbb452e\") " Jul 27 20:37:11.419946 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:37:11.419871 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/e3ecc8ab-d5eb-4cba-a99e-67040fbb452e-secret-metrics-client-certs\") pod \"e3ecc8ab-d5eb-4cba-a99e-67040fbb452e\" (UID: \"e3ecc8ab-d5eb-4cba-a99e-67040fbb452e\") " Jul 27 20:37:11.419946 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:37:11.419895 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/e3ecc8ab-d5eb-4cba-a99e-67040fbb452e-config\") pod \"e3ecc8ab-d5eb-4cba-a99e-67040fbb452e\" (UID: \"e3ecc8ab-d5eb-4cba-a99e-67040fbb452e\") " Jul 27 20:37:11.419946 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:37:11.419921 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/e3ecc8ab-d5eb-4cba-a99e-67040fbb452e-thanos-prometheus-http-client-file\") pod \"e3ecc8ab-d5eb-4cba-a99e-67040fbb452e\" (UID: \"e3ecc8ab-d5eb-4cba-a99e-67040fbb452e\") " Jul 27 20:37:11.420276 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:37:11.419951 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e3ecc8ab-d5eb-4cba-a99e-67040fbb452e-configmap-serving-certs-ca-bundle\") pod \"e3ecc8ab-d5eb-4cba-a99e-67040fbb452e\" (UID: \"e3ecc8ab-d5eb-4cba-a99e-67040fbb452e\") " Jul 27 20:37:11.420276 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:37:11.419986 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/e3ecc8ab-d5eb-4cba-a99e-67040fbb452e-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"e3ecc8ab-d5eb-4cba-a99e-67040fbb452e\" (UID: \"e3ecc8ab-d5eb-4cba-a99e-67040fbb452e\") " Jul 27 20:37:11.420276 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:37:11.420017 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/e3ecc8ab-d5eb-4cba-a99e-67040fbb452e-prometheus-k8s-db\") pod \"e3ecc8ab-d5eb-4cba-a99e-67040fbb452e\" (UID: \"e3ecc8ab-d5eb-4cba-a99e-67040fbb452e\") " Jul 27 20:37:11.420276 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:37:11.420043 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/e3ecc8ab-d5eb-4cba-a99e-67040fbb452e-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"e3ecc8ab-d5eb-4cba-a99e-67040fbb452e\" (UID: \"e3ecc8ab-d5eb-4cba-a99e-67040fbb452e\") " Jul 27 20:37:11.420276 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:37:11.420113 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e3ecc8ab-d5eb-4cba-a99e-67040fbb452e-prometheus-k8s-rulefiles-1" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-1") pod "e3ecc8ab-d5eb-4cba-a99e-67040fbb452e" (UID: "e3ecc8ab-d5eb-4cba-a99e-67040fbb452e"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 27 20:37:11.420276 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:37:11.420245 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e3ecc8ab-d5eb-4cba-a99e-67040fbb452e-prometheus-k8s-rulefiles-2" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-2") pod "e3ecc8ab-d5eb-4cba-a99e-67040fbb452e" (UID: "e3ecc8ab-d5eb-4cba-a99e-67040fbb452e"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 27 20:37:11.420619 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:37:11.420296 2572 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/e3ecc8ab-d5eb-4cba-a99e-67040fbb452e-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-139-2.ec2.internal\" DevicePath \"\"" Jul 27 20:37:11.420619 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:37:11.420338 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e3ecc8ab-d5eb-4cba-a99e-67040fbb452e-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "e3ecc8ab-d5eb-4cba-a99e-67040fbb452e" (UID: "e3ecc8ab-d5eb-4cba-a99e-67040fbb452e"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 27 20:37:11.420949 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:37:11.420878 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e3ecc8ab-d5eb-4cba-a99e-67040fbb452e-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "e3ecc8ab-d5eb-4cba-a99e-67040fbb452e" (UID: "e3ecc8ab-d5eb-4cba-a99e-67040fbb452e"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 27 20:37:11.421075 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:37:11.421043 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e3ecc8ab-d5eb-4cba-a99e-67040fbb452e-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "e3ecc8ab-d5eb-4cba-a99e-67040fbb452e" (UID: "e3ecc8ab-d5eb-4cba-a99e-67040fbb452e"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 27 20:37:11.421727 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:37:11.421647 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e3ecc8ab-d5eb-4cba-a99e-67040fbb452e-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "e3ecc8ab-d5eb-4cba-a99e-67040fbb452e" (UID: "e3ecc8ab-d5eb-4cba-a99e-67040fbb452e"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 27 20:37:11.422181 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:37:11.422155 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e3ecc8ab-d5eb-4cba-a99e-67040fbb452e-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "e3ecc8ab-d5eb-4cba-a99e-67040fbb452e" (UID: "e3ecc8ab-d5eb-4cba-a99e-67040fbb452e"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 27 20:37:11.422296 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:37:11.422275 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e3ecc8ab-d5eb-4cba-a99e-67040fbb452e-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "e3ecc8ab-d5eb-4cba-a99e-67040fbb452e" (UID: "e3ecc8ab-d5eb-4cba-a99e-67040fbb452e"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 27 20:37:11.423202 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:37:11.423174 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e3ecc8ab-d5eb-4cba-a99e-67040fbb452e-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "e3ecc8ab-d5eb-4cba-a99e-67040fbb452e" (UID: "e3ecc8ab-d5eb-4cba-a99e-67040fbb452e"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 27 20:37:11.423288 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:37:11.423222 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e3ecc8ab-d5eb-4cba-a99e-67040fbb452e-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "e3ecc8ab-d5eb-4cba-a99e-67040fbb452e" (UID: "e3ecc8ab-d5eb-4cba-a99e-67040fbb452e"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 27 20:37:11.423356 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:37:11.423297 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e3ecc8ab-d5eb-4cba-a99e-67040fbb452e-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "e3ecc8ab-d5eb-4cba-a99e-67040fbb452e" (UID: "e3ecc8ab-d5eb-4cba-a99e-67040fbb452e"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 27 20:37:11.423822 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:37:11.423725 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e3ecc8ab-d5eb-4cba-a99e-67040fbb452e-config" (OuterVolumeSpecName: "config") pod "e3ecc8ab-d5eb-4cba-a99e-67040fbb452e" (UID: "e3ecc8ab-d5eb-4cba-a99e-67040fbb452e"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 27 20:37:11.423822 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:37:11.423777 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e3ecc8ab-d5eb-4cba-a99e-67040fbb452e-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "e3ecc8ab-d5eb-4cba-a99e-67040fbb452e" (UID: "e3ecc8ab-d5eb-4cba-a99e-67040fbb452e"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 27 20:37:11.423822 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:37:11.423798 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e3ecc8ab-d5eb-4cba-a99e-67040fbb452e-kube-api-access-d6zjq" (OuterVolumeSpecName: "kube-api-access-d6zjq") pod "e3ecc8ab-d5eb-4cba-a99e-67040fbb452e" (UID: "e3ecc8ab-d5eb-4cba-a99e-67040fbb452e"). InnerVolumeSpecName "kube-api-access-d6zjq". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 27 20:37:11.424008 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:37:11.423873 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e3ecc8ab-d5eb-4cba-a99e-67040fbb452e-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "e3ecc8ab-d5eb-4cba-a99e-67040fbb452e" (UID: "e3ecc8ab-d5eb-4cba-a99e-67040fbb452e"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 27 20:37:11.424008 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:37:11.423946 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e3ecc8ab-d5eb-4cba-a99e-67040fbb452e-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "e3ecc8ab-d5eb-4cba-a99e-67040fbb452e" (UID: "e3ecc8ab-d5eb-4cba-a99e-67040fbb452e"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 27 20:37:11.424247 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:37:11.424228 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e3ecc8ab-d5eb-4cba-a99e-67040fbb452e-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "e3ecc8ab-d5eb-4cba-a99e-67040fbb452e" (UID: "e3ecc8ab-d5eb-4cba-a99e-67040fbb452e"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 27 20:37:11.424741 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:37:11.424722 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e3ecc8ab-d5eb-4cba-a99e-67040fbb452e-config-out" (OuterVolumeSpecName: "config-out") pod "e3ecc8ab-d5eb-4cba-a99e-67040fbb452e" (UID: "e3ecc8ab-d5eb-4cba-a99e-67040fbb452e"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 27 20:37:11.425009 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:37:11.424994 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e3ecc8ab-d5eb-4cba-a99e-67040fbb452e-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "e3ecc8ab-d5eb-4cba-a99e-67040fbb452e" (UID: "e3ecc8ab-d5eb-4cba-a99e-67040fbb452e"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 27 20:37:11.433907 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:37:11.433888 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e3ecc8ab-d5eb-4cba-a99e-67040fbb452e-web-config" (OuterVolumeSpecName: "web-config") pod "e3ecc8ab-d5eb-4cba-a99e-67040fbb452e" (UID: "e3ecc8ab-d5eb-4cba-a99e-67040fbb452e"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 27 20:37:11.521148 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:37:11.521118 2572 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e3ecc8ab-d5eb-4cba-a99e-67040fbb452e-prometheus-trusted-ca-bundle\") on node \"ip-10-0-139-2.ec2.internal\" DevicePath \"\"" Jul 27 20:37:11.521148 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:37:11.521147 2572 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/e3ecc8ab-d5eb-4cba-a99e-67040fbb452e-tls-assets\") on node \"ip-10-0-139-2.ec2.internal\" DevicePath \"\"" Jul 27 20:37:11.521396 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:37:11.521161 2572 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/e3ecc8ab-d5eb-4cba-a99e-67040fbb452e-secret-prometheus-k8s-tls\") on node \"ip-10-0-139-2.ec2.internal\" DevicePath \"\"" Jul 27 20:37:11.521396 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:37:11.521173 2572 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/e3ecc8ab-d5eb-4cba-a99e-67040fbb452e-secret-grpc-tls\") on node \"ip-10-0-139-2.ec2.internal\" DevicePath \"\"" Jul 27 20:37:11.521396 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:37:11.521188 2572 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/e3ecc8ab-d5eb-4cba-a99e-67040fbb452e-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-139-2.ec2.internal\" DevicePath \"\"" Jul 27 20:37:11.521396 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:37:11.521199 2572 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e3ecc8ab-d5eb-4cba-a99e-67040fbb452e-configmap-metrics-client-ca\") on node \"ip-10-0-139-2.ec2.internal\" DevicePath \"\"" Jul 27 20:37:11.521396 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:37:11.521211 2572 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/e3ecc8ab-d5eb-4cba-a99e-67040fbb452e-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-139-2.ec2.internal\" DevicePath \"\"" Jul 27 20:37:11.521396 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:37:11.521222 2572 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/e3ecc8ab-d5eb-4cba-a99e-67040fbb452e-web-config\") on node \"ip-10-0-139-2.ec2.internal\" DevicePath \"\"" Jul 27 20:37:11.521396 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:37:11.521233 2572 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/e3ecc8ab-d5eb-4cba-a99e-67040fbb452e-secret-metrics-client-certs\") on node \"ip-10-0-139-2.ec2.internal\" DevicePath \"\"" Jul 27 20:37:11.521396 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:37:11.521243 2572 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/e3ecc8ab-d5eb-4cba-a99e-67040fbb452e-config\") on node \"ip-10-0-139-2.ec2.internal\" DevicePath \"\"" Jul 27 20:37:11.521396 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:37:11.521257 2572 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/e3ecc8ab-d5eb-4cba-a99e-67040fbb452e-thanos-prometheus-http-client-file\") on node \"ip-10-0-139-2.ec2.internal\" DevicePath \"\"" Jul 27 20:37:11.521396 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:37:11.521271 2572 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e3ecc8ab-d5eb-4cba-a99e-67040fbb452e-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-139-2.ec2.internal\" DevicePath \"\"" Jul 27 20:37:11.521396 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:37:11.521284 2572 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/e3ecc8ab-d5eb-4cba-a99e-67040fbb452e-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-139-2.ec2.internal\" DevicePath \"\"" Jul 27 20:37:11.521396 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:37:11.521298 2572 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/e3ecc8ab-d5eb-4cba-a99e-67040fbb452e-prometheus-k8s-db\") on node \"ip-10-0-139-2.ec2.internal\" DevicePath \"\"" Jul 27 20:37:11.521396 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:37:11.521310 2572 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/e3ecc8ab-d5eb-4cba-a99e-67040fbb452e-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-139-2.ec2.internal\" DevicePath \"\"" Jul 27 20:37:11.521396 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:37:11.521348 2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-d6zjq\" (UniqueName: \"kubernetes.io/projected/e3ecc8ab-d5eb-4cba-a99e-67040fbb452e-kube-api-access-d6zjq\") on node \"ip-10-0-139-2.ec2.internal\" DevicePath \"\"" Jul 27 20:37:11.521396 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:37:11.521362 2572 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/e3ecc8ab-d5eb-4cba-a99e-67040fbb452e-secret-kube-rbac-proxy\") on node \"ip-10-0-139-2.ec2.internal\" DevicePath \"\"" Jul 27 20:37:11.521396 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:37:11.521374 2572 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/e3ecc8ab-d5eb-4cba-a99e-67040fbb452e-config-out\") on node \"ip-10-0-139-2.ec2.internal\" DevicePath \"\"" Jul 27 20:37:11.521396 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:37:11.521388 2572 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e3ecc8ab-d5eb-4cba-a99e-67040fbb452e-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-139-2.ec2.internal\" DevicePath \"\"" Jul 27 20:37:11.817486 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:37:11.817456 2572 generic.go:356] "Generic (PLEG): container finished" podID="e3ecc8ab-d5eb-4cba-a99e-67040fbb452e" containerID="71b1f821d444486b40c309d027af70ddcd8935824ade7e028e732fb649c1e2d3" exitCode=0 Jul 27 20:37:11.817486 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:37:11.817482 2572 generic.go:356] "Generic (PLEG): container finished" podID="e3ecc8ab-d5eb-4cba-a99e-67040fbb452e" containerID="92a6101fa50a8b71f61659f53161182421202a73d5f2bbe67c642cd548d2332d" exitCode=0 Jul 27 20:37:11.817486 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:37:11.817489 2572 generic.go:356] "Generic (PLEG): container finished" podID="e3ecc8ab-d5eb-4cba-a99e-67040fbb452e" containerID="f7b0b2be3c6de330971f225b21fbad58813e7f45046963196d7445148c8cefb7" exitCode=0 Jul 27 20:37:11.817750 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:37:11.817497 2572 generic.go:356] "Generic (PLEG): container finished" podID="e3ecc8ab-d5eb-4cba-a99e-67040fbb452e" containerID="9bf74e339990d0cf2777915beedc3f0a4c611ac919afa5b7787212f1fee24b67" exitCode=0 Jul 27 20:37:11.817750 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:37:11.817505 2572 generic.go:356] "Generic (PLEG): container finished" podID="e3ecc8ab-d5eb-4cba-a99e-67040fbb452e" containerID="dd505182d35865b4a3b79f10dffc85c7321dc2414ac0dc1992b8737e818b8e5c" exitCode=0 Jul 27 20:37:11.817750 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:37:11.817513 2572 generic.go:356] "Generic (PLEG): container finished" podID="e3ecc8ab-d5eb-4cba-a99e-67040fbb452e" containerID="9f38e95800cf35f5af27de6dc1d621ab0df48ac947cdd232faab993ebdeca3f9" exitCode=0 Jul 27 20:37:11.817750 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:37:11.817532 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 27 20:37:11.817750 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:37:11.817541 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"e3ecc8ab-d5eb-4cba-a99e-67040fbb452e","Type":"ContainerDied","Data":"71b1f821d444486b40c309d027af70ddcd8935824ade7e028e732fb649c1e2d3"} Jul 27 20:37:11.817750 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:37:11.817608 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"e3ecc8ab-d5eb-4cba-a99e-67040fbb452e","Type":"ContainerDied","Data":"92a6101fa50a8b71f61659f53161182421202a73d5f2bbe67c642cd548d2332d"} Jul 27 20:37:11.817750 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:37:11.817635 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"e3ecc8ab-d5eb-4cba-a99e-67040fbb452e","Type":"ContainerDied","Data":"f7b0b2be3c6de330971f225b21fbad58813e7f45046963196d7445148c8cefb7"} Jul 27 20:37:11.817750 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:37:11.817660 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"e3ecc8ab-d5eb-4cba-a99e-67040fbb452e","Type":"ContainerDied","Data":"9bf74e339990d0cf2777915beedc3f0a4c611ac919afa5b7787212f1fee24b67"} Jul 27 20:37:11.817750 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:37:11.817691 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"e3ecc8ab-d5eb-4cba-a99e-67040fbb452e","Type":"ContainerDied","Data":"dd505182d35865b4a3b79f10dffc85c7321dc2414ac0dc1992b8737e818b8e5c"} Jul 27 20:37:11.817750 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:37:11.817717 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"e3ecc8ab-d5eb-4cba-a99e-67040fbb452e","Type":"ContainerDied","Data":"9f38e95800cf35f5af27de6dc1d621ab0df48ac947cdd232faab993ebdeca3f9"} Jul 27 20:37:11.817750 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:37:11.817743 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"e3ecc8ab-d5eb-4cba-a99e-67040fbb452e","Type":"ContainerDied","Data":"4187470497b91da239faf7a0a8c50950800b58a9ce2723a300c2a39cc9427e85"} Jul 27 20:37:11.818184 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:37:11.817693 2572 scope.go:117] "RemoveContainer" containerID="71b1f821d444486b40c309d027af70ddcd8935824ade7e028e732fb649c1e2d3" Jul 27 20:37:11.826067 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:37:11.826051 2572 scope.go:117] "RemoveContainer" containerID="92a6101fa50a8b71f61659f53161182421202a73d5f2bbe67c642cd548d2332d" Jul 27 20:37:11.832751 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:37:11.832735 2572 scope.go:117] "RemoveContainer" containerID="f7b0b2be3c6de330971f225b21fbad58813e7f45046963196d7445148c8cefb7" Jul 27 20:37:11.838813 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:37:11.838798 2572 scope.go:117] "RemoveContainer" containerID="9bf74e339990d0cf2777915beedc3f0a4c611ac919afa5b7787212f1fee24b67" Jul 27 20:37:11.841747 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:37:11.841725 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 27 20:37:11.845560 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:37:11.845543 2572 scope.go:117] "RemoveContainer" containerID="dd505182d35865b4a3b79f10dffc85c7321dc2414ac0dc1992b8737e818b8e5c" Jul 27 20:37:11.846541 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:37:11.846507 2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 27 20:37:11.851882 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:37:11.851868 2572 scope.go:117] "RemoveContainer" containerID="9f38e95800cf35f5af27de6dc1d621ab0df48ac947cdd232faab993ebdeca3f9" Jul 27 20:37:11.858606 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:37:11.858592 2572 scope.go:117] "RemoveContainer" containerID="5059f39f3a2ba3ef0e820c9e6c69b8532b197be46e02e9bb9ae330f386dc5a05" Jul 27 20:37:11.865058 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:37:11.865042 2572 scope.go:117] "RemoveContainer" containerID="71b1f821d444486b40c309d027af70ddcd8935824ade7e028e732fb649c1e2d3" Jul 27 20:37:11.865333 ip-10-0-139-2 kubenswrapper[2572]: E0727 20:37:11.865302 2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"71b1f821d444486b40c309d027af70ddcd8935824ade7e028e732fb649c1e2d3\": container with ID starting with 71b1f821d444486b40c309d027af70ddcd8935824ade7e028e732fb649c1e2d3 not found: ID does not exist" containerID="71b1f821d444486b40c309d027af70ddcd8935824ade7e028e732fb649c1e2d3" Jul 27 20:37:11.865382 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:37:11.865342 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"71b1f821d444486b40c309d027af70ddcd8935824ade7e028e732fb649c1e2d3"} err="failed to get container status \"71b1f821d444486b40c309d027af70ddcd8935824ade7e028e732fb649c1e2d3\": rpc error: code = NotFound desc = could not find container \"71b1f821d444486b40c309d027af70ddcd8935824ade7e028e732fb649c1e2d3\": container with ID starting with 71b1f821d444486b40c309d027af70ddcd8935824ade7e028e732fb649c1e2d3 not found: ID does not exist" Jul 27 20:37:11.865382 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:37:11.865375 2572 scope.go:117] "RemoveContainer" containerID="92a6101fa50a8b71f61659f53161182421202a73d5f2bbe67c642cd548d2332d" Jul 27 20:37:11.865615 ip-10-0-139-2 kubenswrapper[2572]: E0727 20:37:11.865599 2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"92a6101fa50a8b71f61659f53161182421202a73d5f2bbe67c642cd548d2332d\": container with ID starting with 92a6101fa50a8b71f61659f53161182421202a73d5f2bbe67c642cd548d2332d not found: ID does not exist" containerID="92a6101fa50a8b71f61659f53161182421202a73d5f2bbe67c642cd548d2332d" Jul 27 20:37:11.865652 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:37:11.865621 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"92a6101fa50a8b71f61659f53161182421202a73d5f2bbe67c642cd548d2332d"} err="failed to get container status \"92a6101fa50a8b71f61659f53161182421202a73d5f2bbe67c642cd548d2332d\": rpc error: code = NotFound desc = could not find container \"92a6101fa50a8b71f61659f53161182421202a73d5f2bbe67c642cd548d2332d\": container with ID starting with 92a6101fa50a8b71f61659f53161182421202a73d5f2bbe67c642cd548d2332d not found: ID does not exist" Jul 27 20:37:11.865652 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:37:11.865638 2572 scope.go:117] "RemoveContainer" containerID="f7b0b2be3c6de330971f225b21fbad58813e7f45046963196d7445148c8cefb7" Jul 27 20:37:11.865903 ip-10-0-139-2 kubenswrapper[2572]: E0727 20:37:11.865886 2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f7b0b2be3c6de330971f225b21fbad58813e7f45046963196d7445148c8cefb7\": container with ID starting with f7b0b2be3c6de330971f225b21fbad58813e7f45046963196d7445148c8cefb7 not found: ID does not exist" containerID="f7b0b2be3c6de330971f225b21fbad58813e7f45046963196d7445148c8cefb7" Jul 27 20:37:11.865950 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:37:11.865906 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f7b0b2be3c6de330971f225b21fbad58813e7f45046963196d7445148c8cefb7"} err="failed to get container status \"f7b0b2be3c6de330971f225b21fbad58813e7f45046963196d7445148c8cefb7\": rpc error: code = NotFound desc = could not find container \"f7b0b2be3c6de330971f225b21fbad58813e7f45046963196d7445148c8cefb7\": container with ID starting with f7b0b2be3c6de330971f225b21fbad58813e7f45046963196d7445148c8cefb7 not found: ID does not exist" Jul 27 20:37:11.865950 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:37:11.865927 2572 scope.go:117] "RemoveContainer" containerID="9bf74e339990d0cf2777915beedc3f0a4c611ac919afa5b7787212f1fee24b67" Jul 27 20:37:11.866156 ip-10-0-139-2 kubenswrapper[2572]: E0727 20:37:11.866137 2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9bf74e339990d0cf2777915beedc3f0a4c611ac919afa5b7787212f1fee24b67\": container with ID starting with 9bf74e339990d0cf2777915beedc3f0a4c611ac919afa5b7787212f1fee24b67 not found: ID does not exist" containerID="9bf74e339990d0cf2777915beedc3f0a4c611ac919afa5b7787212f1fee24b67" Jul 27 20:37:11.866201 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:37:11.866162 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9bf74e339990d0cf2777915beedc3f0a4c611ac919afa5b7787212f1fee24b67"} err="failed to get container status \"9bf74e339990d0cf2777915beedc3f0a4c611ac919afa5b7787212f1fee24b67\": rpc error: code = NotFound desc = could not find container \"9bf74e339990d0cf2777915beedc3f0a4c611ac919afa5b7787212f1fee24b67\": container with ID starting with 9bf74e339990d0cf2777915beedc3f0a4c611ac919afa5b7787212f1fee24b67 not found: ID does not exist" Jul 27 20:37:11.866201 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:37:11.866177 2572 scope.go:117] "RemoveContainer" containerID="dd505182d35865b4a3b79f10dffc85c7321dc2414ac0dc1992b8737e818b8e5c" Jul 27 20:37:11.866425 ip-10-0-139-2 kubenswrapper[2572]: E0727 20:37:11.866409 2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"dd505182d35865b4a3b79f10dffc85c7321dc2414ac0dc1992b8737e818b8e5c\": container with ID starting with dd505182d35865b4a3b79f10dffc85c7321dc2414ac0dc1992b8737e818b8e5c not found: ID does not exist" containerID="dd505182d35865b4a3b79f10dffc85c7321dc2414ac0dc1992b8737e818b8e5c" Jul 27 20:37:11.866484 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:37:11.866429 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dd505182d35865b4a3b79f10dffc85c7321dc2414ac0dc1992b8737e818b8e5c"} err="failed to get container status \"dd505182d35865b4a3b79f10dffc85c7321dc2414ac0dc1992b8737e818b8e5c\": rpc error: code = NotFound desc = could not find container \"dd505182d35865b4a3b79f10dffc85c7321dc2414ac0dc1992b8737e818b8e5c\": container with ID starting with dd505182d35865b4a3b79f10dffc85c7321dc2414ac0dc1992b8737e818b8e5c not found: ID does not exist" Jul 27 20:37:11.866484 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:37:11.866445 2572 scope.go:117] "RemoveContainer" containerID="9f38e95800cf35f5af27de6dc1d621ab0df48ac947cdd232faab993ebdeca3f9" Jul 27 20:37:11.866672 ip-10-0-139-2 kubenswrapper[2572]: E0727 20:37:11.866656 2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9f38e95800cf35f5af27de6dc1d621ab0df48ac947cdd232faab993ebdeca3f9\": container with ID starting with 9f38e95800cf35f5af27de6dc1d621ab0df48ac947cdd232faab993ebdeca3f9 not found: ID does not exist" containerID="9f38e95800cf35f5af27de6dc1d621ab0df48ac947cdd232faab993ebdeca3f9" Jul 27 20:37:11.866718 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:37:11.866674 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9f38e95800cf35f5af27de6dc1d621ab0df48ac947cdd232faab993ebdeca3f9"} err="failed to get container status \"9f38e95800cf35f5af27de6dc1d621ab0df48ac947cdd232faab993ebdeca3f9\": rpc error: code = NotFound desc = could not find container \"9f38e95800cf35f5af27de6dc1d621ab0df48ac947cdd232faab993ebdeca3f9\": container with ID starting with 9f38e95800cf35f5af27de6dc1d621ab0df48ac947cdd232faab993ebdeca3f9 not found: ID does not exist" Jul 27 20:37:11.866718 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:37:11.866686 2572 scope.go:117] "RemoveContainer" containerID="5059f39f3a2ba3ef0e820c9e6c69b8532b197be46e02e9bb9ae330f386dc5a05" Jul 27 20:37:11.866901 ip-10-0-139-2 kubenswrapper[2572]: E0727 20:37:11.866883 2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5059f39f3a2ba3ef0e820c9e6c69b8532b197be46e02e9bb9ae330f386dc5a05\": container with ID starting with 5059f39f3a2ba3ef0e820c9e6c69b8532b197be46e02e9bb9ae330f386dc5a05 not found: ID does not exist" containerID="5059f39f3a2ba3ef0e820c9e6c69b8532b197be46e02e9bb9ae330f386dc5a05" Jul 27 20:37:11.866940 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:37:11.866904 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5059f39f3a2ba3ef0e820c9e6c69b8532b197be46e02e9bb9ae330f386dc5a05"} err="failed to get container status \"5059f39f3a2ba3ef0e820c9e6c69b8532b197be46e02e9bb9ae330f386dc5a05\": rpc error: code = NotFound desc = could not find container \"5059f39f3a2ba3ef0e820c9e6c69b8532b197be46e02e9bb9ae330f386dc5a05\": container with ID starting with 5059f39f3a2ba3ef0e820c9e6c69b8532b197be46e02e9bb9ae330f386dc5a05 not found: ID does not exist" Jul 27 20:37:11.866940 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:37:11.866918 2572 scope.go:117] "RemoveContainer" containerID="71b1f821d444486b40c309d027af70ddcd8935824ade7e028e732fb649c1e2d3" Jul 27 20:37:11.867139 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:37:11.867125 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"71b1f821d444486b40c309d027af70ddcd8935824ade7e028e732fb649c1e2d3"} err="failed to get container status \"71b1f821d444486b40c309d027af70ddcd8935824ade7e028e732fb649c1e2d3\": rpc error: code = NotFound desc = could not find container \"71b1f821d444486b40c309d027af70ddcd8935824ade7e028e732fb649c1e2d3\": container with ID starting with 71b1f821d444486b40c309d027af70ddcd8935824ade7e028e732fb649c1e2d3 not found: ID does not exist" Jul 27 20:37:11.867194 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:37:11.867140 2572 scope.go:117] "RemoveContainer" containerID="92a6101fa50a8b71f61659f53161182421202a73d5f2bbe67c642cd548d2332d" Jul 27 20:37:11.867404 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:37:11.867370 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"92a6101fa50a8b71f61659f53161182421202a73d5f2bbe67c642cd548d2332d"} err="failed to get container status \"92a6101fa50a8b71f61659f53161182421202a73d5f2bbe67c642cd548d2332d\": rpc error: code = NotFound desc = could not find container \"92a6101fa50a8b71f61659f53161182421202a73d5f2bbe67c642cd548d2332d\": container with ID starting with 92a6101fa50a8b71f61659f53161182421202a73d5f2bbe67c642cd548d2332d not found: ID does not exist" Jul 27 20:37:11.867404 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:37:11.867391 2572 scope.go:117] "RemoveContainer" containerID="f7b0b2be3c6de330971f225b21fbad58813e7f45046963196d7445148c8cefb7" Jul 27 20:37:11.867611 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:37:11.867594 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f7b0b2be3c6de330971f225b21fbad58813e7f45046963196d7445148c8cefb7"} err="failed to get container status \"f7b0b2be3c6de330971f225b21fbad58813e7f45046963196d7445148c8cefb7\": rpc error: code = NotFound desc = could not find container \"f7b0b2be3c6de330971f225b21fbad58813e7f45046963196d7445148c8cefb7\": container with ID starting with f7b0b2be3c6de330971f225b21fbad58813e7f45046963196d7445148c8cefb7 not found: ID does not exist" Jul 27 20:37:11.867611 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:37:11.867610 2572 scope.go:117] "RemoveContainer" containerID="9bf74e339990d0cf2777915beedc3f0a4c611ac919afa5b7787212f1fee24b67" Jul 27 20:37:11.867817 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:37:11.867799 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9bf74e339990d0cf2777915beedc3f0a4c611ac919afa5b7787212f1fee24b67"} err="failed to get container status \"9bf74e339990d0cf2777915beedc3f0a4c611ac919afa5b7787212f1fee24b67\": rpc error: code = NotFound desc = could not find container \"9bf74e339990d0cf2777915beedc3f0a4c611ac919afa5b7787212f1fee24b67\": container with ID starting with 9bf74e339990d0cf2777915beedc3f0a4c611ac919afa5b7787212f1fee24b67 not found: ID does not exist" Jul 27 20:37:11.867853 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:37:11.867819 2572 scope.go:117] "RemoveContainer" containerID="dd505182d35865b4a3b79f10dffc85c7321dc2414ac0dc1992b8737e818b8e5c" Jul 27 20:37:11.868179 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:37:11.868157 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dd505182d35865b4a3b79f10dffc85c7321dc2414ac0dc1992b8737e818b8e5c"} err="failed to get container status \"dd505182d35865b4a3b79f10dffc85c7321dc2414ac0dc1992b8737e818b8e5c\": rpc error: code = NotFound desc = could not find container \"dd505182d35865b4a3b79f10dffc85c7321dc2414ac0dc1992b8737e818b8e5c\": container with ID starting with dd505182d35865b4a3b79f10dffc85c7321dc2414ac0dc1992b8737e818b8e5c not found: ID does not exist" Jul 27 20:37:11.868274 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:37:11.868179 2572 scope.go:117] "RemoveContainer" containerID="9f38e95800cf35f5af27de6dc1d621ab0df48ac947cdd232faab993ebdeca3f9" Jul 27 20:37:11.868452 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:37:11.868420 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9f38e95800cf35f5af27de6dc1d621ab0df48ac947cdd232faab993ebdeca3f9"} err="failed to get container status \"9f38e95800cf35f5af27de6dc1d621ab0df48ac947cdd232faab993ebdeca3f9\": rpc error: code = NotFound desc = could not find container \"9f38e95800cf35f5af27de6dc1d621ab0df48ac947cdd232faab993ebdeca3f9\": container with ID starting with 9f38e95800cf35f5af27de6dc1d621ab0df48ac947cdd232faab993ebdeca3f9 not found: ID does not exist" Jul 27 20:37:11.868452 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:37:11.868451 2572 scope.go:117] "RemoveContainer" containerID="5059f39f3a2ba3ef0e820c9e6c69b8532b197be46e02e9bb9ae330f386dc5a05" Jul 27 20:37:11.868800 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:37:11.868733 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5059f39f3a2ba3ef0e820c9e6c69b8532b197be46e02e9bb9ae330f386dc5a05"} err="failed to get container status \"5059f39f3a2ba3ef0e820c9e6c69b8532b197be46e02e9bb9ae330f386dc5a05\": rpc error: code = NotFound desc = could not find container \"5059f39f3a2ba3ef0e820c9e6c69b8532b197be46e02e9bb9ae330f386dc5a05\": container with ID starting with 5059f39f3a2ba3ef0e820c9e6c69b8532b197be46e02e9bb9ae330f386dc5a05 not found: ID does not exist" Jul 27 20:37:11.868800 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:37:11.868757 2572 scope.go:117] "RemoveContainer" containerID="71b1f821d444486b40c309d027af70ddcd8935824ade7e028e732fb649c1e2d3" Jul 27 20:37:11.869067 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:37:11.869045 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"71b1f821d444486b40c309d027af70ddcd8935824ade7e028e732fb649c1e2d3"} err="failed to get container status \"71b1f821d444486b40c309d027af70ddcd8935824ade7e028e732fb649c1e2d3\": rpc error: code = NotFound desc = could not find container \"71b1f821d444486b40c309d027af70ddcd8935824ade7e028e732fb649c1e2d3\": container with ID starting with 71b1f821d444486b40c309d027af70ddcd8935824ade7e028e732fb649c1e2d3 not found: ID does not exist" Jul 27 20:37:11.869067 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:37:11.869066 2572 scope.go:117] "RemoveContainer" containerID="92a6101fa50a8b71f61659f53161182421202a73d5f2bbe67c642cd548d2332d" Jul 27 20:37:11.869348 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:37:11.869310 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"92a6101fa50a8b71f61659f53161182421202a73d5f2bbe67c642cd548d2332d"} err="failed to get container status \"92a6101fa50a8b71f61659f53161182421202a73d5f2bbe67c642cd548d2332d\": rpc error: code = NotFound desc = could not find container \"92a6101fa50a8b71f61659f53161182421202a73d5f2bbe67c642cd548d2332d\": container with ID starting with 92a6101fa50a8b71f61659f53161182421202a73d5f2bbe67c642cd548d2332d not found: ID does not exist" Jul 27 20:37:11.869419 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:37:11.869350 2572 scope.go:117] "RemoveContainer" containerID="f7b0b2be3c6de330971f225b21fbad58813e7f45046963196d7445148c8cefb7" Jul 27 20:37:11.869583 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:37:11.869566 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f7b0b2be3c6de330971f225b21fbad58813e7f45046963196d7445148c8cefb7"} err="failed to get container status \"f7b0b2be3c6de330971f225b21fbad58813e7f45046963196d7445148c8cefb7\": rpc error: code = NotFound desc = could not find container \"f7b0b2be3c6de330971f225b21fbad58813e7f45046963196d7445148c8cefb7\": container with ID starting with f7b0b2be3c6de330971f225b21fbad58813e7f45046963196d7445148c8cefb7 not found: ID does not exist" Jul 27 20:37:11.869629 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:37:11.869583 2572 scope.go:117] "RemoveContainer" containerID="9bf74e339990d0cf2777915beedc3f0a4c611ac919afa5b7787212f1fee24b67" Jul 27 20:37:11.869816 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:37:11.869798 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9bf74e339990d0cf2777915beedc3f0a4c611ac919afa5b7787212f1fee24b67"} err="failed to get container status \"9bf74e339990d0cf2777915beedc3f0a4c611ac919afa5b7787212f1fee24b67\": rpc error: code = NotFound desc = could not find container \"9bf74e339990d0cf2777915beedc3f0a4c611ac919afa5b7787212f1fee24b67\": container with ID starting with 9bf74e339990d0cf2777915beedc3f0a4c611ac919afa5b7787212f1fee24b67 not found: ID does not exist" Jul 27 20:37:11.869884 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:37:11.869818 2572 scope.go:117] "RemoveContainer" containerID="dd505182d35865b4a3b79f10dffc85c7321dc2414ac0dc1992b8737e818b8e5c" Jul 27 20:37:11.870075 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:37:11.870057 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dd505182d35865b4a3b79f10dffc85c7321dc2414ac0dc1992b8737e818b8e5c"} err="failed to get container status \"dd505182d35865b4a3b79f10dffc85c7321dc2414ac0dc1992b8737e818b8e5c\": rpc error: code = NotFound desc = could not find container \"dd505182d35865b4a3b79f10dffc85c7321dc2414ac0dc1992b8737e818b8e5c\": container with ID starting with dd505182d35865b4a3b79f10dffc85c7321dc2414ac0dc1992b8737e818b8e5c not found: ID does not exist" Jul 27 20:37:11.870123 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:37:11.870079 2572 scope.go:117] "RemoveContainer" containerID="9f38e95800cf35f5af27de6dc1d621ab0df48ac947cdd232faab993ebdeca3f9" Jul 27 20:37:11.870123 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:37:11.870064 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 27 20:37:11.870303 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:37:11.870281 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9f38e95800cf35f5af27de6dc1d621ab0df48ac947cdd232faab993ebdeca3f9"} err="failed to get container status \"9f38e95800cf35f5af27de6dc1d621ab0df48ac947cdd232faab993ebdeca3f9\": rpc error: code = NotFound desc = could not find container \"9f38e95800cf35f5af27de6dc1d621ab0df48ac947cdd232faab993ebdeca3f9\": container with ID starting with 9f38e95800cf35f5af27de6dc1d621ab0df48ac947cdd232faab993ebdeca3f9 not found: ID does not exist" Jul 27 20:37:11.870374 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:37:11.870306 2572 scope.go:117] "RemoveContainer" containerID="5059f39f3a2ba3ef0e820c9e6c69b8532b197be46e02e9bb9ae330f386dc5a05" Jul 27 20:37:11.870433 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:37:11.870373 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e3ecc8ab-d5eb-4cba-a99e-67040fbb452e" containerName="kube-rbac-proxy" Jul 27 20:37:11.870433 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:37:11.870385 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="e3ecc8ab-d5eb-4cba-a99e-67040fbb452e" containerName="kube-rbac-proxy" Jul 27 20:37:11.870433 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:37:11.870394 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e3ecc8ab-d5eb-4cba-a99e-67040fbb452e" containerName="init-config-reloader" Jul 27 20:37:11.870433 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:37:11.870400 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="e3ecc8ab-d5eb-4cba-a99e-67040fbb452e" containerName="init-config-reloader" Jul 27 20:37:11.870433 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:37:11.870406 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e3ecc8ab-d5eb-4cba-a99e-67040fbb452e" containerName="config-reloader" Jul 27 20:37:11.870433 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:37:11.870411 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="e3ecc8ab-d5eb-4cba-a99e-67040fbb452e" containerName="config-reloader" Jul 27 20:37:11.870433 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:37:11.870417 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e3ecc8ab-d5eb-4cba-a99e-67040fbb452e" containerName="kube-rbac-proxy-thanos" Jul 27 20:37:11.870433 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:37:11.870423 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="e3ecc8ab-d5eb-4cba-a99e-67040fbb452e" containerName="kube-rbac-proxy-thanos" Jul 27 20:37:11.870433 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:37:11.870433 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e3ecc8ab-d5eb-4cba-a99e-67040fbb452e" containerName="prometheus" Jul 27 20:37:11.870729 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:37:11.870440 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="e3ecc8ab-d5eb-4cba-a99e-67040fbb452e" containerName="prometheus" Jul 27 20:37:11.870729 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:37:11.870445 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e3ecc8ab-d5eb-4cba-a99e-67040fbb452e" containerName="thanos-sidecar" Jul 27 20:37:11.870729 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:37:11.870452 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="e3ecc8ab-d5eb-4cba-a99e-67040fbb452e" containerName="thanos-sidecar" Jul 27 20:37:11.870729 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:37:11.870474 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e3ecc8ab-d5eb-4cba-a99e-67040fbb452e" containerName="kube-rbac-proxy-web" Jul 27 20:37:11.870729 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:37:11.870483 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="e3ecc8ab-d5eb-4cba-a99e-67040fbb452e" containerName="kube-rbac-proxy-web" Jul 27 20:37:11.870729 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:37:11.870527 2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="e3ecc8ab-d5eb-4cba-a99e-67040fbb452e" containerName="thanos-sidecar" Jul 27 20:37:11.870729 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:37:11.870535 2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="e3ecc8ab-d5eb-4cba-a99e-67040fbb452e" containerName="kube-rbac-proxy-web" Jul 27 20:37:11.870729 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:37:11.870542 2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="e3ecc8ab-d5eb-4cba-a99e-67040fbb452e" containerName="kube-rbac-proxy" Jul 27 20:37:11.870729 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:37:11.870547 2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="e3ecc8ab-d5eb-4cba-a99e-67040fbb452e" containerName="kube-rbac-proxy-thanos" Jul 27 20:37:11.870729 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:37:11.870555 2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="e3ecc8ab-d5eb-4cba-a99e-67040fbb452e" containerName="prometheus" Jul 27 20:37:11.870729 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:37:11.870564 2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="e3ecc8ab-d5eb-4cba-a99e-67040fbb452e" containerName="config-reloader" Jul 27 20:37:11.870729 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:37:11.870571 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5059f39f3a2ba3ef0e820c9e6c69b8532b197be46e02e9bb9ae330f386dc5a05"} err="failed to get container status \"5059f39f3a2ba3ef0e820c9e6c69b8532b197be46e02e9bb9ae330f386dc5a05\": rpc error: code = NotFound desc = could not find container \"5059f39f3a2ba3ef0e820c9e6c69b8532b197be46e02e9bb9ae330f386dc5a05\": container with ID starting with 5059f39f3a2ba3ef0e820c9e6c69b8532b197be46e02e9bb9ae330f386dc5a05 not found: ID does not exist" Jul 27 20:37:11.870729 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:37:11.870588 2572 scope.go:117] "RemoveContainer" containerID="71b1f821d444486b40c309d027af70ddcd8935824ade7e028e732fb649c1e2d3" Jul 27 20:37:11.871155 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:37:11.870785 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"71b1f821d444486b40c309d027af70ddcd8935824ade7e028e732fb649c1e2d3"} err="failed to get container status \"71b1f821d444486b40c309d027af70ddcd8935824ade7e028e732fb649c1e2d3\": rpc error: code = NotFound desc = could not find container \"71b1f821d444486b40c309d027af70ddcd8935824ade7e028e732fb649c1e2d3\": container with ID starting with 71b1f821d444486b40c309d027af70ddcd8935824ade7e028e732fb649c1e2d3 not found: ID does not exist" Jul 27 20:37:11.871155 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:37:11.870801 2572 scope.go:117] "RemoveContainer" containerID="92a6101fa50a8b71f61659f53161182421202a73d5f2bbe67c642cd548d2332d" Jul 27 20:37:11.871155 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:37:11.871003 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"92a6101fa50a8b71f61659f53161182421202a73d5f2bbe67c642cd548d2332d"} err="failed to get container status \"92a6101fa50a8b71f61659f53161182421202a73d5f2bbe67c642cd548d2332d\": rpc error: code = NotFound desc = could not find container \"92a6101fa50a8b71f61659f53161182421202a73d5f2bbe67c642cd548d2332d\": container with ID starting with 92a6101fa50a8b71f61659f53161182421202a73d5f2bbe67c642cd548d2332d not found: ID does not exist" Jul 27 20:37:11.871155 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:37:11.871021 2572 scope.go:117] "RemoveContainer" containerID="f7b0b2be3c6de330971f225b21fbad58813e7f45046963196d7445148c8cefb7" Jul 27 20:37:11.871291 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:37:11.871213 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f7b0b2be3c6de330971f225b21fbad58813e7f45046963196d7445148c8cefb7"} err="failed to get container status \"f7b0b2be3c6de330971f225b21fbad58813e7f45046963196d7445148c8cefb7\": rpc error: code = NotFound desc = could not find container \"f7b0b2be3c6de330971f225b21fbad58813e7f45046963196d7445148c8cefb7\": container with ID starting with f7b0b2be3c6de330971f225b21fbad58813e7f45046963196d7445148c8cefb7 not found: ID does not exist" Jul 27 20:37:11.871291 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:37:11.871232 2572 scope.go:117] "RemoveContainer" containerID="9bf74e339990d0cf2777915beedc3f0a4c611ac919afa5b7787212f1fee24b67" Jul 27 20:37:11.871450 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:37:11.871431 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9bf74e339990d0cf2777915beedc3f0a4c611ac919afa5b7787212f1fee24b67"} err="failed to get container status \"9bf74e339990d0cf2777915beedc3f0a4c611ac919afa5b7787212f1fee24b67\": rpc error: code = NotFound desc = could not find container \"9bf74e339990d0cf2777915beedc3f0a4c611ac919afa5b7787212f1fee24b67\": container with ID starting with 9bf74e339990d0cf2777915beedc3f0a4c611ac919afa5b7787212f1fee24b67 not found: ID does not exist" Jul 27 20:37:11.871515 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:37:11.871452 2572 scope.go:117] "RemoveContainer" containerID="dd505182d35865b4a3b79f10dffc85c7321dc2414ac0dc1992b8737e818b8e5c" Jul 27 20:37:11.871707 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:37:11.871688 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dd505182d35865b4a3b79f10dffc85c7321dc2414ac0dc1992b8737e818b8e5c"} err="failed to get container status \"dd505182d35865b4a3b79f10dffc85c7321dc2414ac0dc1992b8737e818b8e5c\": rpc error: code = NotFound desc = could not find container \"dd505182d35865b4a3b79f10dffc85c7321dc2414ac0dc1992b8737e818b8e5c\": container with ID starting with dd505182d35865b4a3b79f10dffc85c7321dc2414ac0dc1992b8737e818b8e5c not found: ID does not exist" Jul 27 20:37:11.871752 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:37:11.871708 2572 scope.go:117] "RemoveContainer" containerID="9f38e95800cf35f5af27de6dc1d621ab0df48ac947cdd232faab993ebdeca3f9" Jul 27 20:37:11.871936 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:37:11.871917 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9f38e95800cf35f5af27de6dc1d621ab0df48ac947cdd232faab993ebdeca3f9"} err="failed to get container status \"9f38e95800cf35f5af27de6dc1d621ab0df48ac947cdd232faab993ebdeca3f9\": rpc error: code = NotFound desc = could not find container \"9f38e95800cf35f5af27de6dc1d621ab0df48ac947cdd232faab993ebdeca3f9\": container with ID starting with 9f38e95800cf35f5af27de6dc1d621ab0df48ac947cdd232faab993ebdeca3f9 not found: ID does not exist" Jul 27 20:37:11.871978 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:37:11.871937 2572 scope.go:117] "RemoveContainer" containerID="5059f39f3a2ba3ef0e820c9e6c69b8532b197be46e02e9bb9ae330f386dc5a05" Jul 27 20:37:11.872134 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:37:11.872117 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5059f39f3a2ba3ef0e820c9e6c69b8532b197be46e02e9bb9ae330f386dc5a05"} err="failed to get container status \"5059f39f3a2ba3ef0e820c9e6c69b8532b197be46e02e9bb9ae330f386dc5a05\": rpc error: code = NotFound desc = could not find container \"5059f39f3a2ba3ef0e820c9e6c69b8532b197be46e02e9bb9ae330f386dc5a05\": container with ID starting with 5059f39f3a2ba3ef0e820c9e6c69b8532b197be46e02e9bb9ae330f386dc5a05 not found: ID does not exist" Jul 27 20:37:11.872178 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:37:11.872134 2572 scope.go:117] "RemoveContainer" containerID="71b1f821d444486b40c309d027af70ddcd8935824ade7e028e732fb649c1e2d3" Jul 27 20:37:11.872366 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:37:11.872347 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"71b1f821d444486b40c309d027af70ddcd8935824ade7e028e732fb649c1e2d3"} err="failed to get container status \"71b1f821d444486b40c309d027af70ddcd8935824ade7e028e732fb649c1e2d3\": rpc error: code = NotFound desc = could not find container \"71b1f821d444486b40c309d027af70ddcd8935824ade7e028e732fb649c1e2d3\": container with ID starting with 71b1f821d444486b40c309d027af70ddcd8935824ade7e028e732fb649c1e2d3 not found: ID does not exist" Jul 27 20:37:11.872366 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:37:11.872366 2572 scope.go:117] "RemoveContainer" containerID="92a6101fa50a8b71f61659f53161182421202a73d5f2bbe67c642cd548d2332d" Jul 27 20:37:11.872588 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:37:11.872571 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"92a6101fa50a8b71f61659f53161182421202a73d5f2bbe67c642cd548d2332d"} err="failed to get container status \"92a6101fa50a8b71f61659f53161182421202a73d5f2bbe67c642cd548d2332d\": rpc error: code = NotFound desc = could not find container \"92a6101fa50a8b71f61659f53161182421202a73d5f2bbe67c642cd548d2332d\": container with ID starting with 92a6101fa50a8b71f61659f53161182421202a73d5f2bbe67c642cd548d2332d not found: ID does not exist" Jul 27 20:37:11.872658 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:37:11.872589 2572 scope.go:117] "RemoveContainer" containerID="f7b0b2be3c6de330971f225b21fbad58813e7f45046963196d7445148c8cefb7" Jul 27 20:37:11.872786 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:37:11.872770 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f7b0b2be3c6de330971f225b21fbad58813e7f45046963196d7445148c8cefb7"} err="failed to get container status \"f7b0b2be3c6de330971f225b21fbad58813e7f45046963196d7445148c8cefb7\": rpc error: code = NotFound desc = could not find container \"f7b0b2be3c6de330971f225b21fbad58813e7f45046963196d7445148c8cefb7\": container with ID starting with f7b0b2be3c6de330971f225b21fbad58813e7f45046963196d7445148c8cefb7 not found: ID does not exist" Jul 27 20:37:11.872851 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:37:11.872787 2572 scope.go:117] "RemoveContainer" containerID="9bf74e339990d0cf2777915beedc3f0a4c611ac919afa5b7787212f1fee24b67" Jul 27 20:37:11.872979 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:37:11.872962 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9bf74e339990d0cf2777915beedc3f0a4c611ac919afa5b7787212f1fee24b67"} err="failed to get container status \"9bf74e339990d0cf2777915beedc3f0a4c611ac919afa5b7787212f1fee24b67\": rpc error: code = NotFound desc = could not find container \"9bf74e339990d0cf2777915beedc3f0a4c611ac919afa5b7787212f1fee24b67\": container with ID starting with 9bf74e339990d0cf2777915beedc3f0a4c611ac919afa5b7787212f1fee24b67 not found: ID does not exist" Jul 27 20:37:11.873040 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:37:11.872980 2572 scope.go:117] "RemoveContainer" containerID="dd505182d35865b4a3b79f10dffc85c7321dc2414ac0dc1992b8737e818b8e5c" Jul 27 20:37:11.873184 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:37:11.873168 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dd505182d35865b4a3b79f10dffc85c7321dc2414ac0dc1992b8737e818b8e5c"} err="failed to get container status \"dd505182d35865b4a3b79f10dffc85c7321dc2414ac0dc1992b8737e818b8e5c\": rpc error: code = NotFound desc = could not find container \"dd505182d35865b4a3b79f10dffc85c7321dc2414ac0dc1992b8737e818b8e5c\": container with ID starting with dd505182d35865b4a3b79f10dffc85c7321dc2414ac0dc1992b8737e818b8e5c not found: ID does not exist" Jul 27 20:37:11.873248 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:37:11.873184 2572 scope.go:117] "RemoveContainer" containerID="9f38e95800cf35f5af27de6dc1d621ab0df48ac947cdd232faab993ebdeca3f9" Jul 27 20:37:11.873449 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:37:11.873431 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9f38e95800cf35f5af27de6dc1d621ab0df48ac947cdd232faab993ebdeca3f9"} err="failed to get container status \"9f38e95800cf35f5af27de6dc1d621ab0df48ac947cdd232faab993ebdeca3f9\": rpc error: code = NotFound desc = could not find container \"9f38e95800cf35f5af27de6dc1d621ab0df48ac947cdd232faab993ebdeca3f9\": container with ID starting with 9f38e95800cf35f5af27de6dc1d621ab0df48ac947cdd232faab993ebdeca3f9 not found: ID does not exist" Jul 27 20:37:11.873515 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:37:11.873450 2572 scope.go:117] "RemoveContainer" containerID="5059f39f3a2ba3ef0e820c9e6c69b8532b197be46e02e9bb9ae330f386dc5a05" Jul 27 20:37:11.873655 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:37:11.873636 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5059f39f3a2ba3ef0e820c9e6c69b8532b197be46e02e9bb9ae330f386dc5a05"} err="failed to get container status \"5059f39f3a2ba3ef0e820c9e6c69b8532b197be46e02e9bb9ae330f386dc5a05\": rpc error: code = NotFound desc = could not find container \"5059f39f3a2ba3ef0e820c9e6c69b8532b197be46e02e9bb9ae330f386dc5a05\": container with ID starting with 5059f39f3a2ba3ef0e820c9e6c69b8532b197be46e02e9bb9ae330f386dc5a05 not found: ID does not exist" Jul 27 20:37:11.873716 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:37:11.873657 2572 scope.go:117] "RemoveContainer" containerID="71b1f821d444486b40c309d027af70ddcd8935824ade7e028e732fb649c1e2d3" Jul 27 20:37:11.874306 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:37:11.874288 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"71b1f821d444486b40c309d027af70ddcd8935824ade7e028e732fb649c1e2d3"} err="failed to get container status \"71b1f821d444486b40c309d027af70ddcd8935824ade7e028e732fb649c1e2d3\": rpc error: code = NotFound desc = could not find container \"71b1f821d444486b40c309d027af70ddcd8935824ade7e028e732fb649c1e2d3\": container with ID starting with 71b1f821d444486b40c309d027af70ddcd8935824ade7e028e732fb649c1e2d3 not found: ID does not exist" Jul 27 20:37:11.874306 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:37:11.874306 2572 scope.go:117] "RemoveContainer" containerID="92a6101fa50a8b71f61659f53161182421202a73d5f2bbe67c642cd548d2332d" Jul 27 20:37:11.874478 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:37:11.874463 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 27 20:37:11.874544 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:37:11.874528 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"92a6101fa50a8b71f61659f53161182421202a73d5f2bbe67c642cd548d2332d"} err="failed to get container status \"92a6101fa50a8b71f61659f53161182421202a73d5f2bbe67c642cd548d2332d\": rpc error: code = NotFound desc = could not find container \"92a6101fa50a8b71f61659f53161182421202a73d5f2bbe67c642cd548d2332d\": container with ID starting with 92a6101fa50a8b71f61659f53161182421202a73d5f2bbe67c642cd548d2332d not found: ID does not exist" Jul 27 20:37:11.874596 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:37:11.874547 2572 scope.go:117] "RemoveContainer" containerID="f7b0b2be3c6de330971f225b21fbad58813e7f45046963196d7445148c8cefb7" Jul 27 20:37:11.874949 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:37:11.874760 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f7b0b2be3c6de330971f225b21fbad58813e7f45046963196d7445148c8cefb7"} err="failed to get container status \"f7b0b2be3c6de330971f225b21fbad58813e7f45046963196d7445148c8cefb7\": rpc error: code = NotFound desc = could not find container \"f7b0b2be3c6de330971f225b21fbad58813e7f45046963196d7445148c8cefb7\": container with ID starting with f7b0b2be3c6de330971f225b21fbad58813e7f45046963196d7445148c8cefb7 not found: ID does not exist" Jul 27 20:37:11.874949 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:37:11.874787 2572 scope.go:117] "RemoveContainer" containerID="9bf74e339990d0cf2777915beedc3f0a4c611ac919afa5b7787212f1fee24b67" Jul 27 20:37:11.875103 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:37:11.875058 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9bf74e339990d0cf2777915beedc3f0a4c611ac919afa5b7787212f1fee24b67"} err="failed to get container status \"9bf74e339990d0cf2777915beedc3f0a4c611ac919afa5b7787212f1fee24b67\": rpc error: code = NotFound desc = could not find container \"9bf74e339990d0cf2777915beedc3f0a4c611ac919afa5b7787212f1fee24b67\": container with ID starting with 9bf74e339990d0cf2777915beedc3f0a4c611ac919afa5b7787212f1fee24b67 not found: ID does not exist" Jul 27 20:37:11.875103 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:37:11.875080 2572 scope.go:117] "RemoveContainer" containerID="dd505182d35865b4a3b79f10dffc85c7321dc2414ac0dc1992b8737e818b8e5c" Jul 27 20:37:11.875313 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:37:11.875287 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dd505182d35865b4a3b79f10dffc85c7321dc2414ac0dc1992b8737e818b8e5c"} err="failed to get container status \"dd505182d35865b4a3b79f10dffc85c7321dc2414ac0dc1992b8737e818b8e5c\": rpc error: code = NotFound desc = could not find container \"dd505182d35865b4a3b79f10dffc85c7321dc2414ac0dc1992b8737e818b8e5c\": container with ID starting with dd505182d35865b4a3b79f10dffc85c7321dc2414ac0dc1992b8737e818b8e5c not found: ID does not exist" Jul 27 20:37:11.875313 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:37:11.875306 2572 scope.go:117] "RemoveContainer" containerID="9f38e95800cf35f5af27de6dc1d621ab0df48ac947cdd232faab993ebdeca3f9" Jul 27 20:37:11.875541 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:37:11.875524 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9f38e95800cf35f5af27de6dc1d621ab0df48ac947cdd232faab993ebdeca3f9"} err="failed to get container status \"9f38e95800cf35f5af27de6dc1d621ab0df48ac947cdd232faab993ebdeca3f9\": rpc error: code = NotFound desc = could not find container \"9f38e95800cf35f5af27de6dc1d621ab0df48ac947cdd232faab993ebdeca3f9\": container with ID starting with 9f38e95800cf35f5af27de6dc1d621ab0df48ac947cdd232faab993ebdeca3f9 not found: ID does not exist" Jul 27 20:37:11.875582 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:37:11.875541 2572 scope.go:117] "RemoveContainer" containerID="5059f39f3a2ba3ef0e820c9e6c69b8532b197be46e02e9bb9ae330f386dc5a05" Jul 27 20:37:11.875756 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:37:11.875742 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5059f39f3a2ba3ef0e820c9e6c69b8532b197be46e02e9bb9ae330f386dc5a05"} err="failed to get container status \"5059f39f3a2ba3ef0e820c9e6c69b8532b197be46e02e9bb9ae330f386dc5a05\": rpc error: code = NotFound desc = could not find container \"5059f39f3a2ba3ef0e820c9e6c69b8532b197be46e02e9bb9ae330f386dc5a05\": container with ID starting with 5059f39f3a2ba3ef0e820c9e6c69b8532b197be46e02e9bb9ae330f386dc5a05 not found: ID does not exist" Jul 27 20:37:11.876438 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:37:11.876406 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jul 27 20:37:11.876438 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:37:11.876418 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jul 27 20:37:11.876599 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:37:11.876512 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jul 27 20:37:11.876787 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:37:11.876770 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jul 27 20:37:11.877034 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:37:11.877017 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jul 27 20:37:11.877359 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:37:11.877094 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-etp9shnfa56qe\"" Jul 27 20:37:11.877359 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:37:11.877087 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jul 27 20:37:11.877359 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:37:11.877102 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jul 27 20:37:11.877359 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:37:11.877145 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-whjxs\"" Jul 27 20:37:11.877359 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:37:11.877155 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jul 27 20:37:11.877623 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:37:11.877471 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jul 27 20:37:11.877623 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:37:11.877593 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jul 27 20:37:11.877726 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:37:11.877704 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jul 27 20:37:11.877798 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:37:11.877784 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jul 27 20:37:11.878018 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:37:11.877990 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jul 27 20:37:11.879784 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:37:11.879765 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jul 27 20:37:11.882828 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:37:11.882811 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jul 27 20:37:11.893693 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:37:11.893674 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 27 20:37:11.924097 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:37:11.924053 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/2a47764b-610b-48b9-8e23-2b1eef779ea9-config\") pod \"prometheus-k8s-0\" (UID: \"2a47764b-610b-48b9-8e23-2b1eef779ea9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 20:37:11.924271 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:37:11.924109 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2a47764b-610b-48b9-8e23-2b1eef779ea9-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"2a47764b-610b-48b9-8e23-2b1eef779ea9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 20:37:11.924271 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:37:11.924172 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gbqv8\" (UniqueName: \"kubernetes.io/projected/2a47764b-610b-48b9-8e23-2b1eef779ea9-kube-api-access-gbqv8\") pod \"prometheus-k8s-0\" (UID: \"2a47764b-610b-48b9-8e23-2b1eef779ea9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 20:37:11.924271 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:37:11.924208 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/2a47764b-610b-48b9-8e23-2b1eef779ea9-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"2a47764b-610b-48b9-8e23-2b1eef779ea9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 20:37:11.924271 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:37:11.924239 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2a47764b-610b-48b9-8e23-2b1eef779ea9-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"2a47764b-610b-48b9-8e23-2b1eef779ea9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 20:37:11.924490 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:37:11.924279 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/2a47764b-610b-48b9-8e23-2b1eef779ea9-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"2a47764b-610b-48b9-8e23-2b1eef779ea9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 20:37:11.924490 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:37:11.924311 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/2a47764b-610b-48b9-8e23-2b1eef779ea9-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"2a47764b-610b-48b9-8e23-2b1eef779ea9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 20:37:11.924490 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:37:11.924373 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/2a47764b-610b-48b9-8e23-2b1eef779ea9-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"2a47764b-610b-48b9-8e23-2b1eef779ea9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 20:37:11.924490 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:37:11.924407 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/2a47764b-610b-48b9-8e23-2b1eef779ea9-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"2a47764b-610b-48b9-8e23-2b1eef779ea9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 20:37:11.924490 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:37:11.924443 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/2a47764b-610b-48b9-8e23-2b1eef779ea9-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"2a47764b-610b-48b9-8e23-2b1eef779ea9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 20:37:11.924691 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:37:11.924553 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2a47764b-610b-48b9-8e23-2b1eef779ea9-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"2a47764b-610b-48b9-8e23-2b1eef779ea9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 20:37:11.924742 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:37:11.924707 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/2a47764b-610b-48b9-8e23-2b1eef779ea9-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"2a47764b-610b-48b9-8e23-2b1eef779ea9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 20:37:11.924785 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:37:11.924755 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2a47764b-610b-48b9-8e23-2b1eef779ea9-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"2a47764b-610b-48b9-8e23-2b1eef779ea9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 20:37:11.924785 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:37:11.924775 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/2a47764b-610b-48b9-8e23-2b1eef779ea9-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"2a47764b-610b-48b9-8e23-2b1eef779ea9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 20:37:11.924858 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:37:11.924832 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/2a47764b-610b-48b9-8e23-2b1eef779ea9-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"2a47764b-610b-48b9-8e23-2b1eef779ea9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 20:37:11.924895 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:37:11.924857 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/2a47764b-610b-48b9-8e23-2b1eef779ea9-web-config\") pod \"prometheus-k8s-0\" (UID: \"2a47764b-610b-48b9-8e23-2b1eef779ea9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 20:37:11.924895 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:37:11.924880 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/2a47764b-610b-48b9-8e23-2b1eef779ea9-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"2a47764b-610b-48b9-8e23-2b1eef779ea9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 20:37:11.924969 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:37:11.924896 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/2a47764b-610b-48b9-8e23-2b1eef779ea9-config-out\") pod \"prometheus-k8s-0\" (UID: \"2a47764b-610b-48b9-8e23-2b1eef779ea9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 20:37:11.924969 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:37:11.924923 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/2a47764b-610b-48b9-8e23-2b1eef779ea9-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"2a47764b-610b-48b9-8e23-2b1eef779ea9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 20:37:11.924969 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:37:11.924958 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/2a47764b-610b-48b9-8e23-2b1eef779ea9-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"2a47764b-610b-48b9-8e23-2b1eef779ea9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 20:37:12.025991 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:37:12.025962 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2a47764b-610b-48b9-8e23-2b1eef779ea9-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"2a47764b-610b-48b9-8e23-2b1eef779ea9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 20:37:12.025991 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:37:12.025997 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/2a47764b-610b-48b9-8e23-2b1eef779ea9-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"2a47764b-610b-48b9-8e23-2b1eef779ea9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 20:37:12.026228 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:37:12.026016 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2a47764b-610b-48b9-8e23-2b1eef779ea9-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"2a47764b-610b-48b9-8e23-2b1eef779ea9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 20:37:12.026228 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:37:12.026035 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/2a47764b-610b-48b9-8e23-2b1eef779ea9-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"2a47764b-610b-48b9-8e23-2b1eef779ea9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 20:37:12.026228 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:37:12.026219 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/2a47764b-610b-48b9-8e23-2b1eef779ea9-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"2a47764b-610b-48b9-8e23-2b1eef779ea9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 20:37:12.026394 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:37:12.026250 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/2a47764b-610b-48b9-8e23-2b1eef779ea9-web-config\") pod \"prometheus-k8s-0\" (UID: \"2a47764b-610b-48b9-8e23-2b1eef779ea9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 20:37:12.026394 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:37:12.026274 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/2a47764b-610b-48b9-8e23-2b1eef779ea9-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"2a47764b-610b-48b9-8e23-2b1eef779ea9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 20:37:12.026394 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:37:12.026293 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/2a47764b-610b-48b9-8e23-2b1eef779ea9-config-out\") pod \"prometheus-k8s-0\" (UID: \"2a47764b-610b-48b9-8e23-2b1eef779ea9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 20:37:12.026394 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:37:12.026336 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/2a47764b-610b-48b9-8e23-2b1eef779ea9-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"2a47764b-610b-48b9-8e23-2b1eef779ea9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 20:37:12.026394 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:37:12.026365 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/2a47764b-610b-48b9-8e23-2b1eef779ea9-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"2a47764b-610b-48b9-8e23-2b1eef779ea9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 20:37:12.026394 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:37:12.026391 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/2a47764b-610b-48b9-8e23-2b1eef779ea9-config\") pod \"prometheus-k8s-0\" (UID: \"2a47764b-610b-48b9-8e23-2b1eef779ea9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 20:37:12.026681 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:37:12.026417 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2a47764b-610b-48b9-8e23-2b1eef779ea9-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"2a47764b-610b-48b9-8e23-2b1eef779ea9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 20:37:12.026681 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:37:12.026445 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gbqv8\" (UniqueName: \"kubernetes.io/projected/2a47764b-610b-48b9-8e23-2b1eef779ea9-kube-api-access-gbqv8\") pod \"prometheus-k8s-0\" (UID: \"2a47764b-610b-48b9-8e23-2b1eef779ea9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 20:37:12.026681 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:37:12.026474 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/2a47764b-610b-48b9-8e23-2b1eef779ea9-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"2a47764b-610b-48b9-8e23-2b1eef779ea9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 20:37:12.026681 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:37:12.026497 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2a47764b-610b-48b9-8e23-2b1eef779ea9-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"2a47764b-610b-48b9-8e23-2b1eef779ea9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 20:37:12.026681 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:37:12.026539 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/2a47764b-610b-48b9-8e23-2b1eef779ea9-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"2a47764b-610b-48b9-8e23-2b1eef779ea9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 20:37:12.026681 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:37:12.026563 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/2a47764b-610b-48b9-8e23-2b1eef779ea9-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"2a47764b-610b-48b9-8e23-2b1eef779ea9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 20:37:12.026681 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:37:12.026597 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/2a47764b-610b-48b9-8e23-2b1eef779ea9-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"2a47764b-610b-48b9-8e23-2b1eef779ea9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 20:37:12.026681 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:37:12.026623 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/2a47764b-610b-48b9-8e23-2b1eef779ea9-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"2a47764b-610b-48b9-8e23-2b1eef779ea9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 20:37:12.026681 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:37:12.026655 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/2a47764b-610b-48b9-8e23-2b1eef779ea9-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"2a47764b-610b-48b9-8e23-2b1eef779ea9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 20:37:12.027109 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:37:12.026738 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/2a47764b-610b-48b9-8e23-2b1eef779ea9-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"2a47764b-610b-48b9-8e23-2b1eef779ea9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 20:37:12.027109 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:37:12.027099 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2a47764b-610b-48b9-8e23-2b1eef779ea9-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"2a47764b-610b-48b9-8e23-2b1eef779ea9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 20:37:12.027208 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:37:12.027135 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2a47764b-610b-48b9-8e23-2b1eef779ea9-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"2a47764b-610b-48b9-8e23-2b1eef779ea9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 20:37:12.027752 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:37:12.027729 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/2a47764b-610b-48b9-8e23-2b1eef779ea9-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"2a47764b-610b-48b9-8e23-2b1eef779ea9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 20:37:12.029338 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:37:12.029195 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/2a47764b-610b-48b9-8e23-2b1eef779ea9-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"2a47764b-610b-48b9-8e23-2b1eef779ea9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 20:37:12.029338 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:37:12.029236 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/2a47764b-610b-48b9-8e23-2b1eef779ea9-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"2a47764b-610b-48b9-8e23-2b1eef779ea9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 20:37:12.029338 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:37:12.029261 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/2a47764b-610b-48b9-8e23-2b1eef779ea9-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"2a47764b-610b-48b9-8e23-2b1eef779ea9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 20:37:12.029554 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:37:12.029410 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/2a47764b-610b-48b9-8e23-2b1eef779ea9-config-out\") pod \"prometheus-k8s-0\" (UID: \"2a47764b-610b-48b9-8e23-2b1eef779ea9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 20:37:12.029554 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:37:12.029536 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/2a47764b-610b-48b9-8e23-2b1eef779ea9-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"2a47764b-610b-48b9-8e23-2b1eef779ea9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 20:37:12.030661 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:37:12.030280 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/2a47764b-610b-48b9-8e23-2b1eef779ea9-web-config\") pod \"prometheus-k8s-0\" (UID: \"2a47764b-610b-48b9-8e23-2b1eef779ea9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 20:37:12.030661 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:37:12.030346 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2a47764b-610b-48b9-8e23-2b1eef779ea9-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"2a47764b-610b-48b9-8e23-2b1eef779ea9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 20:37:12.030661 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:37:12.030494 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/2a47764b-610b-48b9-8e23-2b1eef779ea9-config\") pod \"prometheus-k8s-0\" (UID: \"2a47764b-610b-48b9-8e23-2b1eef779ea9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 20:37:12.030661 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:37:12.030604 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/2a47764b-610b-48b9-8e23-2b1eef779ea9-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"2a47764b-610b-48b9-8e23-2b1eef779ea9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 20:37:12.030900 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:37:12.030676 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/2a47764b-610b-48b9-8e23-2b1eef779ea9-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"2a47764b-610b-48b9-8e23-2b1eef779ea9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 20:37:12.031055 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:37:12.031032 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2a47764b-610b-48b9-8e23-2b1eef779ea9-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"2a47764b-610b-48b9-8e23-2b1eef779ea9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 20:37:12.031639 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:37:12.031621 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/2a47764b-610b-48b9-8e23-2b1eef779ea9-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"2a47764b-610b-48b9-8e23-2b1eef779ea9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 20:37:12.031729 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:37:12.031705 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/2a47764b-610b-48b9-8e23-2b1eef779ea9-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"2a47764b-610b-48b9-8e23-2b1eef779ea9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 20:37:12.031792 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:37:12.031743 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/2a47764b-610b-48b9-8e23-2b1eef779ea9-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"2a47764b-610b-48b9-8e23-2b1eef779ea9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 20:37:12.031979 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:37:12.031959 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/2a47764b-610b-48b9-8e23-2b1eef779ea9-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"2a47764b-610b-48b9-8e23-2b1eef779ea9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 20:37:12.038299 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:37:12.038279 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gbqv8\" (UniqueName: \"kubernetes.io/projected/2a47764b-610b-48b9-8e23-2b1eef779ea9-kube-api-access-gbqv8\") pod \"prometheus-k8s-0\" (UID: \"2a47764b-610b-48b9-8e23-2b1eef779ea9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 20:37:12.184236 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:37:12.184186 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 27 20:37:12.315715 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:37:12.315689 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 27 20:37:12.317640 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:37:12.317616 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2a47764b_610b_48b9_8e23_2b1eef779ea9.slice/crio-2793a0841df3a31bde72348d5fdea4f750ef872adae4f7d47818e225ae413c86 WatchSource:0}: Error finding container 2793a0841df3a31bde72348d5fdea4f750ef872adae4f7d47818e225ae413c86: Status 404 returned error can't find the container with id 2793a0841df3a31bde72348d5fdea4f750ef872adae4f7d47818e225ae413c86 Jul 27 20:37:12.823581 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:37:12.823551 2572 generic.go:356] "Generic (PLEG): container finished" podID="2a47764b-610b-48b9-8e23-2b1eef779ea9" containerID="1717ac254cf34e85dd4203212041790c1ab8221e2cb28544a7badebb7a210780" exitCode=0 Jul 27 20:37:12.823748 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:37:12.823587 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"2a47764b-610b-48b9-8e23-2b1eef779ea9","Type":"ContainerDied","Data":"1717ac254cf34e85dd4203212041790c1ab8221e2cb28544a7badebb7a210780"} Jul 27 20:37:12.823748 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:37:12.823637 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"2a47764b-610b-48b9-8e23-2b1eef779ea9","Type":"ContainerStarted","Data":"2793a0841df3a31bde72348d5fdea4f750ef872adae4f7d47818e225ae413c86"} Jul 27 20:37:13.078153 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:37:13.078093 2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e3ecc8ab-d5eb-4cba-a99e-67040fbb452e" path="/var/lib/kubelet/pods/e3ecc8ab-d5eb-4cba-a99e-67040fbb452e/volumes" Jul 27 20:37:13.830238 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:37:13.830198 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"2a47764b-610b-48b9-8e23-2b1eef779ea9","Type":"ContainerStarted","Data":"83b429544a0e5f966da450c31b94a8a0e4e7c46b1eadac9c461668fa55938c3e"} Jul 27 20:37:13.830658 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:37:13.830277 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"2a47764b-610b-48b9-8e23-2b1eef779ea9","Type":"ContainerStarted","Data":"d7d37db9369d17c575fceeabf0e676338bc029f5f84557cf25f27d231fa31896"} Jul 27 20:37:13.830658 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:37:13.830340 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"2a47764b-610b-48b9-8e23-2b1eef779ea9","Type":"ContainerStarted","Data":"a8084a8525c1bee5ff446f00cc5d05c4da756c574a81341f97afbbb1c0bffa12"} Jul 27 20:37:13.830658 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:37:13.830386 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"2a47764b-610b-48b9-8e23-2b1eef779ea9","Type":"ContainerStarted","Data":"d8e5cc4e5a25f26fd72a53e8d203c7fe82bb5e4d25aa2b82b20eef9bbe86c23f"} Jul 27 20:37:13.830658 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:37:13.830423 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"2a47764b-610b-48b9-8e23-2b1eef779ea9","Type":"ContainerStarted","Data":"8cf203b6663e588fc45fe34af30ec8d08aa62ab64d5b49f65a33de3e7e131928"} Jul 27 20:37:13.830658 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:37:13.830458 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"2a47764b-610b-48b9-8e23-2b1eef779ea9","Type":"ContainerStarted","Data":"4da9d27b7a3ce920474015c08d1a4255e5b5de71116701ca13ab299ad2b2af62"} Jul 27 20:37:13.862340 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:37:13.860651 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.840991506 podStartE2EDuration="2.860625104s" totalImagesPullingTime="0s" totalInitContainerRuntime="19.633598ms" isStatefulPod=false podCreationTimestamp="2026-07-27 20:37:11 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:37:13.859651379 +0000 UTC m=+167.329194390" watchObservedRunningTime="2026-07-27 20:37:13.860625104 +0000 UTC m=+167.330168116" Jul 27 20:37:14.601843 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:37:14.601808 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbpp5_e2759622-0ab6-46b7-b434-f0a0f8942dfe/konnectivity-agent/0.log" limit=1024 Jul 27 20:37:14.656105 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:37:14.656075 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbpp5_e2759622-0ab6-46b7-b434-f0a0f8942dfe/konnectivity-agent/0.log" limit=1024 Jul 27 20:37:17.184428 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:37:17.184385 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 27 20:37:25.833047 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:37:25.832964 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbpp5_e2759622-0ab6-46b7-b434-f0a0f8942dfe/konnectivity-agent/0.log" limit=1024 Jul 27 20:37:25.887353 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:37:25.887293 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbpp5_e2759622-0ab6-46b7-b434-f0a0f8942dfe/konnectivity-agent/0.log" limit=1024 Jul 27 20:37:25.948014 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:37:25.947987 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbpp5_e2759622-0ab6-46b7-b434-f0a0f8942dfe/konnectivity-agent/0.log" limit=1024 Jul 27 20:37:55.431861 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:37:55.431825 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbpp5_e2759622-0ab6-46b7-b434-f0a0f8942dfe/konnectivity-agent/0.log" limit=1024 Jul 27 20:38:12.184777 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:38:12.184745 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jul 27 20:38:12.199747 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:38:12.199725 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jul 27 20:38:13.054128 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:38:13.054102 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 27 20:38:20.928737 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:38:20.928704 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbpp5_e2759622-0ab6-46b7-b434-f0a0f8942dfe/konnectivity-agent/0.log" limit=1024 Jul 27 20:38:20.983101 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:38:20.983073 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbpp5_e2759622-0ab6-46b7-b434-f0a0f8942dfe/konnectivity-agent/0.log" limit=1024 Jul 27 20:38:31.413855 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:38:31.413815 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbpp5_e2759622-0ab6-46b7-b434-f0a0f8942dfe/konnectivity-agent/0.log" limit=1024 Jul 27 20:38:31.480761 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:38:31.480730 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbpp5_e2759622-0ab6-46b7-b434-f0a0f8942dfe/konnectivity-agent/0.log" limit=1024 Jul 27 20:38:32.848926 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:38:32.848895 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbpp5_e2759622-0ab6-46b7-b434-f0a0f8942dfe/konnectivity-agent/0.log" limit=1024 Jul 27 20:38:32.945531 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:38:32.945502 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbpp5_e2759622-0ab6-46b7-b434-f0a0f8942dfe/konnectivity-agent/0.log" limit=1024 Jul 27 20:38:42.128926 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:38:42.128895 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbpp5_e2759622-0ab6-46b7-b434-f0a0f8942dfe/konnectivity-agent/0.log" limit=1024 Jul 27 20:38:42.230655 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:38:42.230628 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbpp5_e2759622-0ab6-46b7-b434-f0a0f8942dfe/konnectivity-agent/0.log" limit=1024 Jul 27 20:38:42.291654 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:38:42.291627 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbpp5_e2759622-0ab6-46b7-b434-f0a0f8942dfe/konnectivity-agent/0.log" limit=1024 Jul 27 20:38:44.017573 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:38:44.017539 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbpp5_e2759622-0ab6-46b7-b434-f0a0f8942dfe/konnectivity-agent/0.log" limit=1024 Jul 27 20:38:44.118869 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:38:44.118842 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbpp5_e2759622-0ab6-46b7-b434-f0a0f8942dfe/konnectivity-agent/0.log" limit=1024 Jul 27 20:39:05.683491 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:39:05.683422 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbpp5_e2759622-0ab6-46b7-b434-f0a0f8942dfe/konnectivity-agent/0.log" limit=1024 Jul 27 20:39:05.762247 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:39:05.762216 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbpp5_e2759622-0ab6-46b7-b434-f0a0f8942dfe/konnectivity-agent/0.log" limit=1024 Jul 27 20:39:26.897647 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:39:26.897622 2572 kubelet.go:1648] "Image garbage collection succeeded" Jul 27 20:39:27.757707 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:39:27.757662 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbpp5_e2759622-0ab6-46b7-b434-f0a0f8942dfe/konnectivity-agent/0.log" limit=1024 Jul 27 20:39:28.748619 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:39:28.748591 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbpp5_e2759622-0ab6-46b7-b434-f0a0f8942dfe/konnectivity-agent/0.log" limit=1024 Jul 27 20:39:54.489809 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:39:54.489772 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbpp5_e2759622-0ab6-46b7-b434-f0a0f8942dfe/konnectivity-agent/0.log" limit=1024 Jul 27 20:39:55.298713 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:39:55.298681 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbpp5_e2759622-0ab6-46b7-b434-f0a0f8942dfe/konnectivity-agent/0.log" limit=1024 Jul 27 20:39:58.105994 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:39:58.105963 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbpp5_e2759622-0ab6-46b7-b434-f0a0f8942dfe/konnectivity-agent/0.log" limit=1024 Jul 27 20:39:58.211892 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:39:58.211865 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbpp5_e2759622-0ab6-46b7-b434-f0a0f8942dfe/konnectivity-agent/0.log" limit=1024 Jul 27 20:39:59.180872 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:39:59.180838 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbpp5_e2759622-0ab6-46b7-b434-f0a0f8942dfe/konnectivity-agent/0.log" limit=1024 Jul 27 20:39:59.277749 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:39:59.277720 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbpp5_e2759622-0ab6-46b7-b434-f0a0f8942dfe/konnectivity-agent/0.log" limit=1024 Jul 27 20:39:59.685089 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:39:59.685053 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbpp5_e2759622-0ab6-46b7-b434-f0a0f8942dfe/konnectivity-agent/0.log" limit=1024 Jul 27 20:39:59.791687 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:39:59.791656 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbpp5_e2759622-0ab6-46b7-b434-f0a0f8942dfe/konnectivity-agent/0.log" limit=1024 Jul 27 20:40:01.189455 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:40:01.189422 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbpp5_e2759622-0ab6-46b7-b434-f0a0f8942dfe/konnectivity-agent/0.log" limit=1024 Jul 27 20:40:01.577246 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:40:01.577214 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbpp5_e2759622-0ab6-46b7-b434-f0a0f8942dfe/konnectivity-agent/0.log" limit=1024 Jul 27 20:40:04.919532 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:40:04.919497 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbpp5_e2759622-0ab6-46b7-b434-f0a0f8942dfe/konnectivity-agent/0.log" limit=1024 Jul 27 20:40:05.017746 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:40:05.017722 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbpp5_e2759622-0ab6-46b7-b434-f0a0f8942dfe/konnectivity-agent/0.log" limit=1024 Jul 27 20:40:07.564294 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:40:07.564253 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbpp5_e2759622-0ab6-46b7-b434-f0a0f8942dfe/konnectivity-agent/0.log" limit=1024 Jul 27 20:40:09.652694 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:40:09.652658 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbpp5_e2759622-0ab6-46b7-b434-f0a0f8942dfe/konnectivity-agent/0.log" limit=1024 Jul 27 20:40:09.753692 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:40:09.753661 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbpp5_e2759622-0ab6-46b7-b434-f0a0f8942dfe/konnectivity-agent/0.log" limit=1024 Jul 27 20:40:09.978253 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:40:09.978183 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbpp5_e2759622-0ab6-46b7-b434-f0a0f8942dfe/konnectivity-agent/0.log" limit=1024 Jul 27 20:40:33.944888 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:40:33.944806 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbpp5_e2759622-0ab6-46b7-b434-f0a0f8942dfe/konnectivity-agent/0.log" limit=1024 Jul 27 20:40:34.040885 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:40:34.040854 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbpp5_e2759622-0ab6-46b7-b434-f0a0f8942dfe/konnectivity-agent/0.log" limit=1024 Jul 27 20:40:41.226027 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:40:41.225997 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbpp5_e2759622-0ab6-46b7-b434-f0a0f8942dfe/konnectivity-agent/0.log" limit=1024 Jul 27 20:40:41.321997 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:40:41.321966 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbpp5_e2759622-0ab6-46b7-b434-f0a0f8942dfe/konnectivity-agent/0.log" limit=1024 Jul 27 20:40:43.335744 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:40:43.335693 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbpp5_e2759622-0ab6-46b7-b434-f0a0f8942dfe/konnectivity-agent/0.log" limit=1024 Jul 27 20:40:47.573414 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:40:47.573382 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbpp5_e2759622-0ab6-46b7-b434-f0a0f8942dfe/konnectivity-agent/0.log" limit=1024 Jul 27 20:40:47.633344 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:40:47.633305 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-77cbdf6c7d-wfq2l"] Jul 27 20:40:47.636401 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:40:47.636387 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-77cbdf6c7d-wfq2l" Jul 27 20:40:47.639026 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:40:47.639010 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jul 27 20:40:47.639155 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:40:47.639007 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jul 27 20:40:47.639155 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:40:47.639011 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-nz6c6\"" Jul 27 20:40:47.639155 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:40:47.639138 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Jul 27 20:40:47.639334 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:40:47.639138 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Jul 27 20:40:47.639401 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:40:47.639386 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Jul 27 20:40:47.645445 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:40:47.645427 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-77cbdf6c7d-wfq2l"] Jul 27 20:40:47.658207 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:40:47.658190 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbpp5_e2759622-0ab6-46b7-b434-f0a0f8942dfe/konnectivity-agent/0.log" limit=1024 Jul 27 20:40:47.751074 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:40:47.751049 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2lxsl\" (UniqueName: \"kubernetes.io/projected/a187ed56-7f3d-4916-89cb-b703b75374fa-kube-api-access-2lxsl\") pod \"lws-controller-manager-77cbdf6c7d-wfq2l\" (UID: \"a187ed56-7f3d-4916-89cb-b703b75374fa\") " pod="openshift-lws-operator/lws-controller-manager-77cbdf6c7d-wfq2l" Jul 27 20:40:47.751184 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:40:47.751079 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/a187ed56-7f3d-4916-89cb-b703b75374fa-metrics-cert\") pod \"lws-controller-manager-77cbdf6c7d-wfq2l\" (UID: \"a187ed56-7f3d-4916-89cb-b703b75374fa\") " pod="openshift-lws-operator/lws-controller-manager-77cbdf6c7d-wfq2l" Jul 27 20:40:47.751184 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:40:47.751114 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/a187ed56-7f3d-4916-89cb-b703b75374fa-manager-config\") pod \"lws-controller-manager-77cbdf6c7d-wfq2l\" (UID: \"a187ed56-7f3d-4916-89cb-b703b75374fa\") " pod="openshift-lws-operator/lws-controller-manager-77cbdf6c7d-wfq2l" Jul 27 20:40:47.751184 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:40:47.751168 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a187ed56-7f3d-4916-89cb-b703b75374fa-cert\") pod \"lws-controller-manager-77cbdf6c7d-wfq2l\" (UID: \"a187ed56-7f3d-4916-89cb-b703b75374fa\") " pod="openshift-lws-operator/lws-controller-manager-77cbdf6c7d-wfq2l" Jul 27 20:40:47.851501 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:40:47.851440 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/a187ed56-7f3d-4916-89cb-b703b75374fa-manager-config\") pod \"lws-controller-manager-77cbdf6c7d-wfq2l\" (UID: \"a187ed56-7f3d-4916-89cb-b703b75374fa\") " pod="openshift-lws-operator/lws-controller-manager-77cbdf6c7d-wfq2l" Jul 27 20:40:47.851501 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:40:47.851491 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a187ed56-7f3d-4916-89cb-b703b75374fa-cert\") pod \"lws-controller-manager-77cbdf6c7d-wfq2l\" (UID: \"a187ed56-7f3d-4916-89cb-b703b75374fa\") " pod="openshift-lws-operator/lws-controller-manager-77cbdf6c7d-wfq2l" Jul 27 20:40:47.851659 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:40:47.851548 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2lxsl\" (UniqueName: \"kubernetes.io/projected/a187ed56-7f3d-4916-89cb-b703b75374fa-kube-api-access-2lxsl\") pod \"lws-controller-manager-77cbdf6c7d-wfq2l\" (UID: \"a187ed56-7f3d-4916-89cb-b703b75374fa\") " pod="openshift-lws-operator/lws-controller-manager-77cbdf6c7d-wfq2l" Jul 27 20:40:47.851659 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:40:47.851573 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/a187ed56-7f3d-4916-89cb-b703b75374fa-metrics-cert\") pod \"lws-controller-manager-77cbdf6c7d-wfq2l\" (UID: \"a187ed56-7f3d-4916-89cb-b703b75374fa\") " pod="openshift-lws-operator/lws-controller-manager-77cbdf6c7d-wfq2l" Jul 27 20:40:47.852050 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:40:47.852032 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/a187ed56-7f3d-4916-89cb-b703b75374fa-manager-config\") pod \"lws-controller-manager-77cbdf6c7d-wfq2l\" (UID: \"a187ed56-7f3d-4916-89cb-b703b75374fa\") " pod="openshift-lws-operator/lws-controller-manager-77cbdf6c7d-wfq2l" Jul 27 20:40:47.853982 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:40:47.853962 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/a187ed56-7f3d-4916-89cb-b703b75374fa-metrics-cert\") pod \"lws-controller-manager-77cbdf6c7d-wfq2l\" (UID: \"a187ed56-7f3d-4916-89cb-b703b75374fa\") " pod="openshift-lws-operator/lws-controller-manager-77cbdf6c7d-wfq2l" Jul 27 20:40:47.854069 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:40:47.853989 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a187ed56-7f3d-4916-89cb-b703b75374fa-cert\") pod \"lws-controller-manager-77cbdf6c7d-wfq2l\" (UID: \"a187ed56-7f3d-4916-89cb-b703b75374fa\") " pod="openshift-lws-operator/lws-controller-manager-77cbdf6c7d-wfq2l" Jul 27 20:40:47.860102 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:40:47.860083 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2lxsl\" (UniqueName: \"kubernetes.io/projected/a187ed56-7f3d-4916-89cb-b703b75374fa-kube-api-access-2lxsl\") pod \"lws-controller-manager-77cbdf6c7d-wfq2l\" (UID: \"a187ed56-7f3d-4916-89cb-b703b75374fa\") " pod="openshift-lws-operator/lws-controller-manager-77cbdf6c7d-wfq2l" Jul 27 20:40:47.945635 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:40:47.945611 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-77cbdf6c7d-wfq2l" Jul 27 20:40:48.068785 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:40:48.068666 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-77cbdf6c7d-wfq2l"] Jul 27 20:40:48.071602 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:40:48.071578 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda187ed56_7f3d_4916_89cb_b703b75374fa.slice/crio-3acbc80611c186ea19e332a04c13e547a4f1bf76d646e2924be1fd57408d3583 WatchSource:0}: Error finding container 3acbc80611c186ea19e332a04c13e547a4f1bf76d646e2924be1fd57408d3583: Status 404 returned error can't find the container with id 3acbc80611c186ea19e332a04c13e547a4f1bf76d646e2924be1fd57408d3583 Jul 27 20:40:48.074066 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:40:48.074045 2572 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 27 20:40:48.552389 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:40:48.552359 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-77cbdf6c7d-wfq2l" event={"ID":"a187ed56-7f3d-4916-89cb-b703b75374fa","Type":"ContainerStarted","Data":"3acbc80611c186ea19e332a04c13e547a4f1bf76d646e2924be1fd57408d3583"} Jul 27 20:40:52.568443 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:40:52.568410 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-77cbdf6c7d-wfq2l" event={"ID":"a187ed56-7f3d-4916-89cb-b703b75374fa","Type":"ContainerStarted","Data":"d0542ddc0f4aa55c44810aa7c12d261b1403c357b75ae2682cecb33348050d29"} Jul 27 20:40:52.568902 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:40:52.568544 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-77cbdf6c7d-wfq2l" Jul 27 20:40:52.585114 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:40:52.585070 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-77cbdf6c7d-wfq2l" podStartSLOduration=1.187698829 podStartE2EDuration="5.585056619s" totalImagesPullingTime="4.39735779s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 20:40:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:40:52.584123773 +0000 UTC m=+386.053666785" watchObservedRunningTime="2026-07-27 20:40:52.585056619 +0000 UTC m=+386.054599629" Jul 27 20:40:55.323907 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:40:55.323878 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbpp5_e2759622-0ab6-46b7-b434-f0a0f8942dfe/konnectivity-agent/0.log" limit=1024 Jul 27 20:40:55.423934 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:40:55.423900 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbpp5_e2759622-0ab6-46b7-b434-f0a0f8942dfe/konnectivity-agent/0.log" limit=1024 Jul 27 20:40:55.919864 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:40:55.919835 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbpp5_e2759622-0ab6-46b7-b434-f0a0f8942dfe/konnectivity-agent/0.log" limit=1024 Jul 27 20:40:56.219927 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:40:56.219851 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbpp5_e2759622-0ab6-46b7-b434-f0a0f8942dfe/konnectivity-agent/0.log" limit=1024 Jul 27 20:40:56.325712 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:40:56.325667 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbpp5_e2759622-0ab6-46b7-b434-f0a0f8942dfe/konnectivity-agent/0.log" limit=1024 Jul 27 20:40:56.378562 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:40:56.378535 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5767d7b464-tggsg"] Jul 27 20:40:56.381724 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:40:56.381709 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-5767d7b464-tggsg" Jul 27 20:40:56.385193 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:40:56.385164 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jul 27 20:40:56.385496 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:40:56.385197 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jul 27 20:40:56.385496 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:40:56.385294 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jul 27 20:40:56.385496 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:40:56.385355 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-8slmf\"" Jul 27 20:40:56.388019 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:40:56.385749 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jul 27 20:40:56.401001 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:40:56.400981 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5767d7b464-tggsg"] Jul 27 20:40:56.412736 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:40:56.412715 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tlwc2\" (UniqueName: \"kubernetes.io/projected/c177ef8d-6173-405a-a19e-5fcb03b66600-kube-api-access-tlwc2\") pod \"opendatahub-operator-controller-manager-5767d7b464-tggsg\" (UID: \"c177ef8d-6173-405a-a19e-5fcb03b66600\") " pod="opendatahub/opendatahub-operator-controller-manager-5767d7b464-tggsg" Jul 27 20:40:56.412840 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:40:56.412746 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/c177ef8d-6173-405a-a19e-5fcb03b66600-manifests\") pod \"opendatahub-operator-controller-manager-5767d7b464-tggsg\" (UID: \"c177ef8d-6173-405a-a19e-5fcb03b66600\") " pod="opendatahub/opendatahub-operator-controller-manager-5767d7b464-tggsg" Jul 27 20:40:56.412840 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:40:56.412779 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/c177ef8d-6173-405a-a19e-5fcb03b66600-webhook-cert\") pod \"opendatahub-operator-controller-manager-5767d7b464-tggsg\" (UID: \"c177ef8d-6173-405a-a19e-5fcb03b66600\") " pod="opendatahub/opendatahub-operator-controller-manager-5767d7b464-tggsg" Jul 27 20:40:56.412950 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:40:56.412874 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/c177ef8d-6173-405a-a19e-5fcb03b66600-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5767d7b464-tggsg\" (UID: \"c177ef8d-6173-405a-a19e-5fcb03b66600\") " pod="opendatahub/opendatahub-operator-controller-manager-5767d7b464-tggsg" Jul 27 20:40:56.412950 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:40:56.412921 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c177ef8d-6173-405a-a19e-5fcb03b66600-tmp\") pod \"opendatahub-operator-controller-manager-5767d7b464-tggsg\" (UID: \"c177ef8d-6173-405a-a19e-5fcb03b66600\") " pod="opendatahub/opendatahub-operator-controller-manager-5767d7b464-tggsg" Jul 27 20:40:56.482875 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:40:56.482824 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbpp5_e2759622-0ab6-46b7-b434-f0a0f8942dfe/konnectivity-agent/0.log" limit=1024 Jul 27 20:40:56.513936 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:40:56.513910 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/c177ef8d-6173-405a-a19e-5fcb03b66600-webhook-cert\") pod \"opendatahub-operator-controller-manager-5767d7b464-tggsg\" (UID: \"c177ef8d-6173-405a-a19e-5fcb03b66600\") " pod="opendatahub/opendatahub-operator-controller-manager-5767d7b464-tggsg" Jul 27 20:40:56.514030 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:40:56.513959 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/c177ef8d-6173-405a-a19e-5fcb03b66600-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5767d7b464-tggsg\" (UID: \"c177ef8d-6173-405a-a19e-5fcb03b66600\") " pod="opendatahub/opendatahub-operator-controller-manager-5767d7b464-tggsg" Jul 27 20:40:56.514030 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:40:56.514006 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c177ef8d-6173-405a-a19e-5fcb03b66600-tmp\") pod \"opendatahub-operator-controller-manager-5767d7b464-tggsg\" (UID: \"c177ef8d-6173-405a-a19e-5fcb03b66600\") " pod="opendatahub/opendatahub-operator-controller-manager-5767d7b464-tggsg" Jul 27 20:40:56.514137 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:40:56.514037 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tlwc2\" (UniqueName: \"kubernetes.io/projected/c177ef8d-6173-405a-a19e-5fcb03b66600-kube-api-access-tlwc2\") pod \"opendatahub-operator-controller-manager-5767d7b464-tggsg\" (UID: \"c177ef8d-6173-405a-a19e-5fcb03b66600\") " pod="opendatahub/opendatahub-operator-controller-manager-5767d7b464-tggsg" Jul 27 20:40:56.514137 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:40:56.514067 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/c177ef8d-6173-405a-a19e-5fcb03b66600-manifests\") pod \"opendatahub-operator-controller-manager-5767d7b464-tggsg\" (UID: \"c177ef8d-6173-405a-a19e-5fcb03b66600\") " pod="opendatahub/opendatahub-operator-controller-manager-5767d7b464-tggsg" Jul 27 20:40:56.514482 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:40:56.514458 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/c177ef8d-6173-405a-a19e-5fcb03b66600-manifests\") pod \"opendatahub-operator-controller-manager-5767d7b464-tggsg\" (UID: \"c177ef8d-6173-405a-a19e-5fcb03b66600\") " pod="opendatahub/opendatahub-operator-controller-manager-5767d7b464-tggsg" Jul 27 20:40:56.516328 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:40:56.516288 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c177ef8d-6173-405a-a19e-5fcb03b66600-tmp\") pod \"opendatahub-operator-controller-manager-5767d7b464-tggsg\" (UID: \"c177ef8d-6173-405a-a19e-5fcb03b66600\") " pod="opendatahub/opendatahub-operator-controller-manager-5767d7b464-tggsg" Jul 27 20:40:56.516402 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:40:56.516355 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/c177ef8d-6173-405a-a19e-5fcb03b66600-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5767d7b464-tggsg\" (UID: \"c177ef8d-6173-405a-a19e-5fcb03b66600\") " pod="opendatahub/opendatahub-operator-controller-manager-5767d7b464-tggsg" Jul 27 20:40:56.516440 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:40:56.516403 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/c177ef8d-6173-405a-a19e-5fcb03b66600-webhook-cert\") pod \"opendatahub-operator-controller-manager-5767d7b464-tggsg\" (UID: \"c177ef8d-6173-405a-a19e-5fcb03b66600\") " pod="opendatahub/opendatahub-operator-controller-manager-5767d7b464-tggsg" Jul 27 20:40:56.522833 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:40:56.522813 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tlwc2\" (UniqueName: \"kubernetes.io/projected/c177ef8d-6173-405a-a19e-5fcb03b66600-kube-api-access-tlwc2\") pod \"opendatahub-operator-controller-manager-5767d7b464-tggsg\" (UID: \"c177ef8d-6173-405a-a19e-5fcb03b66600\") " pod="opendatahub/opendatahub-operator-controller-manager-5767d7b464-tggsg" Jul 27 20:40:56.582595 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:40:56.582570 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbpp5_e2759622-0ab6-46b7-b434-f0a0f8942dfe/konnectivity-agent/0.log" limit=1024 Jul 27 20:40:56.693779 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:40:56.693754 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-5767d7b464-tggsg" Jul 27 20:40:56.699485 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:40:56.699433 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbpp5_e2759622-0ab6-46b7-b434-f0a0f8942dfe/konnectivity-agent/0.log" limit=1024 Jul 27 20:40:56.800997 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:40:56.800972 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbpp5_e2759622-0ab6-46b7-b434-f0a0f8942dfe/konnectivity-agent/0.log" limit=1024 Jul 27 20:40:56.825979 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:40:56.825961 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5767d7b464-tggsg"] Jul 27 20:40:56.828535 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:40:56.828493 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc177ef8d_6173_405a_a19e_5fcb03b66600.slice/crio-bfe17348eb78c68ccb5efc5e91a00b16d230c2b51944e294c6c5e8b3a160d5fd WatchSource:0}: Error finding container bfe17348eb78c68ccb5efc5e91a00b16d230c2b51944e294c6c5e8b3a160d5fd: Status 404 returned error can't find the container with id bfe17348eb78c68ccb5efc5e91a00b16d230c2b51944e294c6c5e8b3a160d5fd Jul 27 20:40:56.872760 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:40:56.872730 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbpp5_e2759622-0ab6-46b7-b434-f0a0f8942dfe/konnectivity-agent/0.log" limit=1024 Jul 27 20:40:56.946709 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:40:56.946681 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbpp5_e2759622-0ab6-46b7-b434-f0a0f8942dfe/konnectivity-agent/0.log" limit=1024 Jul 27 20:40:57.044698 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:40:57.044652 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbpp5_e2759622-0ab6-46b7-b434-f0a0f8942dfe/konnectivity-agent/0.log" limit=1024 Jul 27 20:40:57.586936 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:40:57.586893 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5767d7b464-tggsg" event={"ID":"c177ef8d-6173-405a-a19e-5fcb03b66600","Type":"ContainerStarted","Data":"bfe17348eb78c68ccb5efc5e91a00b16d230c2b51944e294c6c5e8b3a160d5fd"} Jul 27 20:41:00.602716 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:41:00.602683 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5767d7b464-tggsg" event={"ID":"c177ef8d-6173-405a-a19e-5fcb03b66600","Type":"ContainerStarted","Data":"e999782b05032957cbe5832326f3c1a7ade73fba5900cffb34eb02b18842ad00"} Jul 27 20:41:01.607395 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:41:01.607362 2572 generic.go:356] "Generic (PLEG): container finished" podID="c177ef8d-6173-405a-a19e-5fcb03b66600" containerID="e999782b05032957cbe5832326f3c1a7ade73fba5900cffb34eb02b18842ad00" exitCode=0 Jul 27 20:41:01.607739 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:41:01.607450 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5767d7b464-tggsg" event={"ID":"c177ef8d-6173-405a-a19e-5fcb03b66600","Type":"ContainerDied","Data":"e999782b05032957cbe5832326f3c1a7ade73fba5900cffb34eb02b18842ad00"} Jul 27 20:41:02.613266 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:41:02.613230 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5767d7b464-tggsg" event={"ID":"c177ef8d-6173-405a-a19e-5fcb03b66600","Type":"ContainerStarted","Data":"d23831d904c884c158724050f7cb61fc19ee2c60c0cd0b6990555995e15ed72a"} Jul 27 20:41:02.613668 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:41:02.613366 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-5767d7b464-tggsg" Jul 27 20:41:02.679055 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:41:02.679003 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-5767d7b464-tggsg" podStartSLOduration=2.436277952 podStartE2EDuration="6.678985702s" totalImagesPullingTime="3.264529633s" totalInitContainerRuntime="978.178117ms" isStatefulPod=false podCreationTimestamp="2026-07-27 20:40:56 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:41:02.648786177 +0000 UTC m=+396.118329187" watchObservedRunningTime="2026-07-27 20:41:02.678985702 +0000 UTC m=+396.148528711" Jul 27 20:41:03.574434 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:41:03.574400 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-77cbdf6c7d-wfq2l" Jul 27 20:41:13.619044 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:41:13.619012 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-5767d7b464-tggsg" Jul 27 20:41:15.378029 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:41:15.377984 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbpp5_e2759622-0ab6-46b7-b434-f0a0f8942dfe/konnectivity-agent/0.log" limit=1024 Jul 27 20:41:15.576863 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:41:15.576831 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbpp5_e2759622-0ab6-46b7-b434-f0a0f8942dfe/konnectivity-agent/0.log" limit=1024 Jul 27 20:41:15.881877 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:41:15.881845 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbpp5_e2759622-0ab6-46b7-b434-f0a0f8942dfe/konnectivity-agent/0.log" limit=1024 Jul 27 20:41:16.000240 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:41:16.000213 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbpp5_e2759622-0ab6-46b7-b434-f0a0f8942dfe/konnectivity-agent/0.log" limit=1024 Jul 27 20:41:16.364295 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:41:16.364270 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbpp5_e2759622-0ab6-46b7-b434-f0a0f8942dfe/konnectivity-agent/0.log" limit=1024 Jul 27 20:41:16.434582 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:41:16.434535 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbpp5_e2759622-0ab6-46b7-b434-f0a0f8942dfe/konnectivity-agent/0.log" limit=1024 Jul 27 20:41:16.535615 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:41:16.535588 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbpp5_e2759622-0ab6-46b7-b434-f0a0f8942dfe/konnectivity-agent/0.log" limit=1024 Jul 27 20:41:16.620791 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:41:16.620693 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbpp5_e2759622-0ab6-46b7-b434-f0a0f8942dfe/konnectivity-agent/0.log" limit=1024 Jul 27 20:41:17.376591 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:41:17.376542 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbpp5_e2759622-0ab6-46b7-b434-f0a0f8942dfe/konnectivity-agent/0.log" limit=1024 Jul 27 20:41:17.450749 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:41:17.450713 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbpp5_e2759622-0ab6-46b7-b434-f0a0f8942dfe/konnectivity-agent/0.log" limit=1024 Jul 27 20:41:17.834010 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:41:17.833972 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbpp5_e2759622-0ab6-46b7-b434-f0a0f8942dfe/konnectivity-agent/0.log" limit=1024 Jul 27 20:41:18.545054 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:41:18.545022 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbpp5_e2759622-0ab6-46b7-b434-f0a0f8942dfe/konnectivity-agent/0.log" limit=1024 Jul 27 20:41:23.292645 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:41:23.292595 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbpp5_e2759622-0ab6-46b7-b434-f0a0f8942dfe/konnectivity-agent/0.log" limit=1024 Jul 27 20:41:23.395627 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:41:23.395602 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbpp5_e2759622-0ab6-46b7-b434-f0a0f8942dfe/konnectivity-agent/0.log" limit=1024 Jul 27 20:41:23.936883 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:41:23.936854 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799czz2ql"] Jul 27 20:41:23.939885 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:41:23.939870 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799czz2ql" Jul 27 20:41:23.942149 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:41:23.942129 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jul 27 20:41:23.942389 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:41:23.942374 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jul 27 20:41:23.942605 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:41:23.942590 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jul 27 20:41:23.942738 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:41:23.942724 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-k7xkn\"" Jul 27 20:41:23.957824 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:41:23.957802 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799czz2ql"] Jul 27 20:41:23.981445 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:41:23.981420 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbpp5_e2759622-0ab6-46b7-b434-f0a0f8942dfe/konnectivity-agent/0.log" limit=1024 Jul 27 20:41:24.010516 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:41:24.010494 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/44540294-2a54-4ae9-812f-e21ac4887037-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799czz2ql\" (UID: \"44540294-2a54-4ae9-812f-e21ac4887037\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799czz2ql" Jul 27 20:41:24.010585 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:41:24.010524 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j9kmd\" (UniqueName: \"kubernetes.io/projected/44540294-2a54-4ae9-812f-e21ac4887037-kube-api-access-j9kmd\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799czz2ql\" (UID: \"44540294-2a54-4ae9-812f-e21ac4887037\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799czz2ql" Jul 27 20:41:24.010585 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:41:24.010555 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/44540294-2a54-4ae9-812f-e21ac4887037-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799czz2ql\" (UID: \"44540294-2a54-4ae9-812f-e21ac4887037\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799czz2ql" Jul 27 20:41:24.010657 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:41:24.010627 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/44540294-2a54-4ae9-812f-e21ac4887037-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799czz2ql\" (UID: \"44540294-2a54-4ae9-812f-e21ac4887037\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799czz2ql" Jul 27 20:41:24.010689 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:41:24.010658 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/44540294-2a54-4ae9-812f-e21ac4887037-istio-token\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799czz2ql\" (UID: \"44540294-2a54-4ae9-812f-e21ac4887037\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799czz2ql" Jul 27 20:41:24.010720 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:41:24.010698 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/44540294-2a54-4ae9-812f-e21ac4887037-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799czz2ql\" (UID: \"44540294-2a54-4ae9-812f-e21ac4887037\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799czz2ql" Jul 27 20:41:24.010720 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:41:24.010714 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/44540294-2a54-4ae9-812f-e21ac4887037-istio-data\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799czz2ql\" (UID: \"44540294-2a54-4ae9-812f-e21ac4887037\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799czz2ql" Jul 27 20:41:24.010790 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:41:24.010774 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/44540294-2a54-4ae9-812f-e21ac4887037-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799czz2ql\" (UID: \"44540294-2a54-4ae9-812f-e21ac4887037\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799czz2ql" Jul 27 20:41:24.010823 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:41:24.010800 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/44540294-2a54-4ae9-812f-e21ac4887037-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799czz2ql\" (UID: \"44540294-2a54-4ae9-812f-e21ac4887037\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799czz2ql" Jul 27 20:41:24.111942 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:41:24.111918 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/44540294-2a54-4ae9-812f-e21ac4887037-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799czz2ql\" (UID: \"44540294-2a54-4ae9-812f-e21ac4887037\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799czz2ql" Jul 27 20:41:24.112050 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:41:24.111950 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/44540294-2a54-4ae9-812f-e21ac4887037-istio-token\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799czz2ql\" (UID: \"44540294-2a54-4ae9-812f-e21ac4887037\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799czz2ql" Jul 27 20:41:24.112050 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:41:24.111997 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/44540294-2a54-4ae9-812f-e21ac4887037-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799czz2ql\" (UID: \"44540294-2a54-4ae9-812f-e21ac4887037\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799czz2ql" Jul 27 20:41:24.112050 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:41:24.112021 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/44540294-2a54-4ae9-812f-e21ac4887037-istio-data\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799czz2ql\" (UID: \"44540294-2a54-4ae9-812f-e21ac4887037\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799czz2ql" Jul 27 20:41:24.112205 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:41:24.112052 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/44540294-2a54-4ae9-812f-e21ac4887037-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799czz2ql\" (UID: \"44540294-2a54-4ae9-812f-e21ac4887037\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799czz2ql" Jul 27 20:41:24.112205 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:41:24.112075 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/44540294-2a54-4ae9-812f-e21ac4887037-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799czz2ql\" (UID: \"44540294-2a54-4ae9-812f-e21ac4887037\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799czz2ql" Jul 27 20:41:24.112205 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:41:24.112110 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/44540294-2a54-4ae9-812f-e21ac4887037-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799czz2ql\" (UID: \"44540294-2a54-4ae9-812f-e21ac4887037\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799czz2ql" Jul 27 20:41:24.112205 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:41:24.112141 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j9kmd\" (UniqueName: \"kubernetes.io/projected/44540294-2a54-4ae9-812f-e21ac4887037-kube-api-access-j9kmd\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799czz2ql\" (UID: \"44540294-2a54-4ae9-812f-e21ac4887037\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799czz2ql" Jul 27 20:41:24.112205 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:41:24.112192 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/44540294-2a54-4ae9-812f-e21ac4887037-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799czz2ql\" (UID: \"44540294-2a54-4ae9-812f-e21ac4887037\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799czz2ql" Jul 27 20:41:24.112478 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:41:24.112454 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/44540294-2a54-4ae9-812f-e21ac4887037-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799czz2ql\" (UID: \"44540294-2a54-4ae9-812f-e21ac4887037\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799czz2ql" Jul 27 20:41:24.112654 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:41:24.112526 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/44540294-2a54-4ae9-812f-e21ac4887037-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799czz2ql\" (UID: \"44540294-2a54-4ae9-812f-e21ac4887037\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799czz2ql" Jul 27 20:41:24.112762 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:41:24.112682 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/44540294-2a54-4ae9-812f-e21ac4887037-istio-data\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799czz2ql\" (UID: \"44540294-2a54-4ae9-812f-e21ac4887037\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799czz2ql" Jul 27 20:41:24.112762 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:41:24.112715 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/44540294-2a54-4ae9-812f-e21ac4887037-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799czz2ql\" (UID: \"44540294-2a54-4ae9-812f-e21ac4887037\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799czz2ql" Jul 27 20:41:24.112762 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:41:24.112738 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/44540294-2a54-4ae9-812f-e21ac4887037-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799czz2ql\" (UID: \"44540294-2a54-4ae9-812f-e21ac4887037\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799czz2ql" Jul 27 20:41:24.114821 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:41:24.114807 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/44540294-2a54-4ae9-812f-e21ac4887037-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799czz2ql\" (UID: \"44540294-2a54-4ae9-812f-e21ac4887037\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799czz2ql" Jul 27 20:41:24.115133 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:41:24.115113 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/44540294-2a54-4ae9-812f-e21ac4887037-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799czz2ql\" (UID: \"44540294-2a54-4ae9-812f-e21ac4887037\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799czz2ql" Jul 27 20:41:24.118823 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:41:24.118803 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/44540294-2a54-4ae9-812f-e21ac4887037-istio-token\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799czz2ql\" (UID: \"44540294-2a54-4ae9-812f-e21ac4887037\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799czz2ql" Jul 27 20:41:24.119574 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:41:24.119552 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j9kmd\" (UniqueName: \"kubernetes.io/projected/44540294-2a54-4ae9-812f-e21ac4887037-kube-api-access-j9kmd\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799czz2ql\" (UID: \"44540294-2a54-4ae9-812f-e21ac4887037\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799czz2ql" Jul 27 20:41:24.249569 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:41:24.249506 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799czz2ql" Jul 27 20:41:24.260929 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:41:24.260907 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbpp5_e2759622-0ab6-46b7-b434-f0a0f8942dfe/konnectivity-agent/0.log" limit=1024 Jul 27 20:41:24.379449 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:41:24.379427 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799czz2ql"] Jul 27 20:41:24.382090 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:41:24.382061 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod44540294_2a54_4ae9_812f_e21ac4887037.slice/crio-1ca2ff3866eb6894aa60c2dcbef75fe4c1a0b500880bd430bbc29fcbe192c8f0 WatchSource:0}: Error finding container 1ca2ff3866eb6894aa60c2dcbef75fe4c1a0b500880bd430bbc29fcbe192c8f0: Status 404 returned error can't find the container with id 1ca2ff3866eb6894aa60c2dcbef75fe4c1a0b500880bd430bbc29fcbe192c8f0 Jul 27 20:41:24.691207 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:41:24.691171 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799czz2ql" event={"ID":"44540294-2a54-4ae9-812f-e21ac4887037","Type":"ContainerStarted","Data":"1ca2ff3866eb6894aa60c2dcbef75fe4c1a0b500880bd430bbc29fcbe192c8f0"} Jul 27 20:41:24.790357 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:41:24.790306 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbpp5_e2759622-0ab6-46b7-b434-f0a0f8942dfe/konnectivity-agent/0.log" limit=1024 Jul 27 20:41:26.184364 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:41:26.184312 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-dt5js"] Jul 27 20:41:26.187437 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:41:26.187422 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-dt5js" Jul 27 20:41:26.190357 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:41:26.190335 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\"" Jul 27 20:41:26.190704 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:41:26.190688 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\"" Jul 27 20:41:26.190830 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:41:26.190711 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-nhxhv\"" Jul 27 20:41:26.190924 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:41:26.190906 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\"" Jul 27 20:41:26.205117 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:41:26.205093 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-dt5js"] Jul 27 20:41:26.231400 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:41:26.231374 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/2837bbdb-20ee-4aee-9977-c78c5c50fa4b-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-dt5js\" (UID: \"2837bbdb-20ee-4aee-9977-c78c5c50fa4b\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-dt5js" Jul 27 20:41:26.231528 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:41:26.231413 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/2837bbdb-20ee-4aee-9977-c78c5c50fa4b-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-dt5js\" (UID: \"2837bbdb-20ee-4aee-9977-c78c5c50fa4b\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-dt5js" Jul 27 20:41:26.231528 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:41:26.231434 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2bz7r\" (UniqueName: \"kubernetes.io/projected/2837bbdb-20ee-4aee-9977-c78c5c50fa4b-kube-api-access-2bz7r\") pod \"istiod-openshift-gateway-5677ccb49b-dt5js\" (UID: \"2837bbdb-20ee-4aee-9977-c78c5c50fa4b\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-dt5js" Jul 27 20:41:26.231528 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:41:26.231511 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/2837bbdb-20ee-4aee-9977-c78c5c50fa4b-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-dt5js\" (UID: \"2837bbdb-20ee-4aee-9977-c78c5c50fa4b\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-dt5js" Jul 27 20:41:26.231646 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:41:26.231568 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2837bbdb-20ee-4aee-9977-c78c5c50fa4b-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-dt5js\" (UID: \"2837bbdb-20ee-4aee-9977-c78c5c50fa4b\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-dt5js" Jul 27 20:41:26.231646 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:41:26.231609 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/2837bbdb-20ee-4aee-9977-c78c5c50fa4b-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-dt5js\" (UID: \"2837bbdb-20ee-4aee-9977-c78c5c50fa4b\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-dt5js" Jul 27 20:41:26.231726 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:41:26.231657 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/2837bbdb-20ee-4aee-9977-c78c5c50fa4b-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-dt5js\" (UID: \"2837bbdb-20ee-4aee-9977-c78c5c50fa4b\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-dt5js" Jul 27 20:41:26.333101 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:41:26.333061 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/2837bbdb-20ee-4aee-9977-c78c5c50fa4b-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-dt5js\" (UID: \"2837bbdb-20ee-4aee-9977-c78c5c50fa4b\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-dt5js" Jul 27 20:41:26.333257 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:41:26.333119 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2837bbdb-20ee-4aee-9977-c78c5c50fa4b-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-dt5js\" (UID: \"2837bbdb-20ee-4aee-9977-c78c5c50fa4b\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-dt5js" Jul 27 20:41:26.333257 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:41:26.333169 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/2837bbdb-20ee-4aee-9977-c78c5c50fa4b-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-dt5js\" (UID: \"2837bbdb-20ee-4aee-9977-c78c5c50fa4b\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-dt5js" Jul 27 20:41:26.333257 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:41:26.333209 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/2837bbdb-20ee-4aee-9977-c78c5c50fa4b-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-dt5js\" (UID: \"2837bbdb-20ee-4aee-9977-c78c5c50fa4b\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-dt5js" Jul 27 20:41:26.333441 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:41:26.333261 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/2837bbdb-20ee-4aee-9977-c78c5c50fa4b-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-dt5js\" (UID: \"2837bbdb-20ee-4aee-9977-c78c5c50fa4b\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-dt5js" Jul 27 20:41:26.333441 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:41:26.333287 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/2837bbdb-20ee-4aee-9977-c78c5c50fa4b-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-dt5js\" (UID: \"2837bbdb-20ee-4aee-9977-c78c5c50fa4b\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-dt5js" Jul 27 20:41:26.333441 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:41:26.333329 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2bz7r\" (UniqueName: \"kubernetes.io/projected/2837bbdb-20ee-4aee-9977-c78c5c50fa4b-kube-api-access-2bz7r\") pod \"istiod-openshift-gateway-5677ccb49b-dt5js\" (UID: \"2837bbdb-20ee-4aee-9977-c78c5c50fa4b\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-dt5js" Jul 27 20:41:26.334197 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:41:26.334168 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/2837bbdb-20ee-4aee-9977-c78c5c50fa4b-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-dt5js\" (UID: \"2837bbdb-20ee-4aee-9977-c78c5c50fa4b\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-dt5js" Jul 27 20:41:26.335665 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:41:26.335642 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/2837bbdb-20ee-4aee-9977-c78c5c50fa4b-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-dt5js\" (UID: \"2837bbdb-20ee-4aee-9977-c78c5c50fa4b\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-dt5js" Jul 27 20:41:26.335927 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:41:26.335906 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/2837bbdb-20ee-4aee-9977-c78c5c50fa4b-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-dt5js\" (UID: \"2837bbdb-20ee-4aee-9977-c78c5c50fa4b\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-dt5js" Jul 27 20:41:26.336333 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:41:26.336303 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/2837bbdb-20ee-4aee-9977-c78c5c50fa4b-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-dt5js\" (UID: \"2837bbdb-20ee-4aee-9977-c78c5c50fa4b\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-dt5js" Jul 27 20:41:26.336480 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:41:26.336463 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/2837bbdb-20ee-4aee-9977-c78c5c50fa4b-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-dt5js\" (UID: \"2837bbdb-20ee-4aee-9977-c78c5c50fa4b\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-dt5js" Jul 27 20:41:26.342269 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:41:26.342251 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2837bbdb-20ee-4aee-9977-c78c5c50fa4b-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-dt5js\" (UID: \"2837bbdb-20ee-4aee-9977-c78c5c50fa4b\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-dt5js" Jul 27 20:41:26.342377 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:41:26.342271 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2bz7r\" (UniqueName: \"kubernetes.io/projected/2837bbdb-20ee-4aee-9977-c78c5c50fa4b-kube-api-access-2bz7r\") pod \"istiod-openshift-gateway-5677ccb49b-dt5js\" (UID: \"2837bbdb-20ee-4aee-9977-c78c5c50fa4b\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-dt5js" Jul 27 20:41:26.497512 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:41:26.497435 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-dt5js" Jul 27 20:41:27.201722 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:41:27.201672 2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 27 20:41:27.202028 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:41:27.201791 2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 27 20:41:27.202028 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:41:27.201839 2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 27 20:41:27.286481 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:41:27.286458 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-dt5js"] Jul 27 20:41:27.288435 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:41:27.288411 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2837bbdb_20ee_4aee_9977_c78c5c50fa4b.slice/crio-1e961e57914959b66f0fcdd434bfc36b13456d552850cfe623ce401cbf29a1fb WatchSource:0}: Error finding container 1e961e57914959b66f0fcdd434bfc36b13456d552850cfe623ce401cbf29a1fb: Status 404 returned error can't find the container with id 1e961e57914959b66f0fcdd434bfc36b13456d552850cfe623ce401cbf29a1fb Jul 27 20:41:27.704593 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:41:27.704555 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-dt5js" event={"ID":"2837bbdb-20ee-4aee-9977-c78c5c50fa4b","Type":"ContainerStarted","Data":"1e961e57914959b66f0fcdd434bfc36b13456d552850cfe623ce401cbf29a1fb"} Jul 27 20:41:27.706043 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:41:27.706022 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799czz2ql" event={"ID":"44540294-2a54-4ae9-812f-e21ac4887037","Type":"ContainerStarted","Data":"0930ea538f9fc4ca6d18419b3d3a46c9ff8619599a2bac7e3d968bb0045d0570"} Jul 27 20:41:27.735963 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:41:27.735913 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799czz2ql" podStartSLOduration=1.918793067 podStartE2EDuration="4.735898431s" totalImagesPullingTime="2.817105364s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 20:41:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:41:27.73417616 +0000 UTC m=+421.203719182" watchObservedRunningTime="2026-07-27 20:41:27.735898431 +0000 UTC m=+421.205441440" Jul 27 20:41:27.891258 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:41:27.891226 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbpp5_e2759622-0ab6-46b7-b434-f0a0f8942dfe/konnectivity-agent/0.log" limit=1024 Jul 27 20:41:28.032766 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:41:28.032739 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbpp5_e2759622-0ab6-46b7-b434-f0a0f8942dfe/konnectivity-agent/0.log" limit=1024 Jul 27 20:41:28.230150 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:41:28.230111 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbpp5_e2759622-0ab6-46b7-b434-f0a0f8942dfe/konnectivity-agent/0.log" limit=1024 Jul 27 20:41:28.250066 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:41:28.250039 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799czz2ql" Jul 27 20:41:28.255608 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:41:28.255582 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799czz2ql" Jul 27 20:41:28.332419 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:41:28.332340 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbpp5_e2759622-0ab6-46b7-b434-f0a0f8942dfe/konnectivity-agent/0.log" limit=1024 Jul 27 20:41:28.711469 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:41:28.711392 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799czz2ql" Jul 27 20:41:28.712668 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:41:28.712644 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799czz2ql" Jul 27 20:41:29.605765 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:41:29.605736 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbpp5_e2759622-0ab6-46b7-b434-f0a0f8942dfe/konnectivity-agent/0.log" limit=1024 Jul 27 20:41:29.698809 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:41:29.698773 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbpp5_e2759622-0ab6-46b7-b434-f0a0f8942dfe/konnectivity-agent/0.log" limit=1024 Jul 27 20:41:29.802083 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:41:29.802047 2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 27 20:41:29.802201 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:41:29.802113 2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 27 20:41:30.721511 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:41:30.721472 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-dt5js" event={"ID":"2837bbdb-20ee-4aee-9977-c78c5c50fa4b","Type":"ContainerStarted","Data":"d00119465587731b367908be5dfd12da9e0272787b1d136fafc1962b0e600ddf"} Jul 27 20:41:30.765682 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:41:30.765620 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-dt5js" podStartSLOduration=2.25477756 podStartE2EDuration="4.765598899s" totalImagesPullingTime="2.510821339s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 20:41:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:41:30.763985687 +0000 UTC m=+424.233528707" watchObservedRunningTime="2026-07-27 20:41:30.765598899 +0000 UTC m=+424.235141911" Jul 27 20:41:31.724842 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:41:31.724807 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-dt5js" Jul 27 20:41:31.726299 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:41:31.726282 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-dt5js" Jul 27 20:41:36.284205 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:41:36.284170 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbpp5_e2759622-0ab6-46b7-b434-f0a0f8942dfe/konnectivity-agent/0.log" limit=1024 Jul 27 20:42:03.699263 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:42:03.699188 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbpp5_e2759622-0ab6-46b7-b434-f0a0f8942dfe/konnectivity-agent/0.log" limit=1024 Jul 27 20:42:17.008149 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:42:17.008108 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbpp5_e2759622-0ab6-46b7-b434-f0a0f8942dfe/konnectivity-agent/0.log" limit=1024 Jul 27 20:42:17.074176 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:42:17.074144 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbpp5_e2759622-0ab6-46b7-b434-f0a0f8942dfe/konnectivity-agent/0.log" limit=1024 Jul 27 20:42:17.215365 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:42:17.215335 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbpp5_e2759622-0ab6-46b7-b434-f0a0f8942dfe/konnectivity-agent/0.log" limit=1024 Jul 27 20:42:34.326225 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:42:34.326188 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbpp5_e2759622-0ab6-46b7-b434-f0a0f8942dfe/konnectivity-agent/0.log" limit=1024 Jul 27 20:42:34.466720 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:42:34.466686 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbpp5_e2759622-0ab6-46b7-b434-f0a0f8942dfe/konnectivity-agent/0.log" limit=1024 Jul 27 20:42:34.532238 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:42:34.532207 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbpp5_e2759622-0ab6-46b7-b434-f0a0f8942dfe/konnectivity-agent/0.log" limit=1024 Jul 27 20:42:35.061841 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:42:35.061812 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbpp5_e2759622-0ab6-46b7-b434-f0a0f8942dfe/konnectivity-agent/0.log" limit=1024 Jul 27 20:42:35.119792 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:42:35.119765 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbpp5_e2759622-0ab6-46b7-b434-f0a0f8942dfe/konnectivity-agent/0.log" limit=1024 Jul 27 20:42:41.435311 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:42:41.435275 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbpp5_e2759622-0ab6-46b7-b434-f0a0f8942dfe/konnectivity-agent/0.log" limit=1024 Jul 27 20:42:41.486700 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:42:41.486665 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbpp5_e2759622-0ab6-46b7-b434-f0a0f8942dfe/konnectivity-agent/0.log" limit=1024 Jul 27 20:42:44.343028 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:42:44.342995 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbpp5_e2759622-0ab6-46b7-b434-f0a0f8942dfe/konnectivity-agent/0.log" limit=1024 Jul 27 20:42:44.947121 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:42:44.947093 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbpp5_e2759622-0ab6-46b7-b434-f0a0f8942dfe/konnectivity-agent/0.log" limit=1024 Jul 27 20:42:45.366502 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:42:45.366467 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbpp5_e2759622-0ab6-46b7-b434-f0a0f8942dfe/konnectivity-agent/0.log" limit=1024 Jul 27 20:42:45.467226 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:42:45.467193 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbpp5_e2759622-0ab6-46b7-b434-f0a0f8942dfe/konnectivity-agent/0.log" limit=1024 Jul 27 20:42:45.567522 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:42:45.567494 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbpp5_e2759622-0ab6-46b7-b434-f0a0f8942dfe/konnectivity-agent/0.log" limit=1024 Jul 27 20:42:49.758365 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:42:49.758334 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbpp5_e2759622-0ab6-46b7-b434-f0a0f8942dfe/konnectivity-agent/0.log" limit=1024 Jul 27 20:42:51.804081 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:42:51.804053 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbpp5_e2759622-0ab6-46b7-b434-f0a0f8942dfe/konnectivity-agent/0.log" limit=1024 Jul 27 20:42:52.759562 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:42:52.759509 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbpp5_e2759622-0ab6-46b7-b434-f0a0f8942dfe/konnectivity-agent/0.log" limit=1024 Jul 27 20:42:53.590041 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:42:53.590010 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbpp5_e2759622-0ab6-46b7-b434-f0a0f8942dfe/konnectivity-agent/0.log" limit=1024 Jul 27 20:42:55.761867 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:42:55.761839 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbpp5_e2759622-0ab6-46b7-b434-f0a0f8942dfe/konnectivity-agent/0.log" limit=1024 Jul 27 20:42:56.229020 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:42:56.228992 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbpp5_e2759622-0ab6-46b7-b434-f0a0f8942dfe/konnectivity-agent/0.log" limit=1024 Jul 27 20:42:59.395456 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:42:59.395422 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbpp5_e2759622-0ab6-46b7-b434-f0a0f8942dfe/konnectivity-agent/0.log" limit=1024 Jul 27 20:43:03.013000 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:43:03.012969 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbpp5_e2759622-0ab6-46b7-b434-f0a0f8942dfe/konnectivity-agent/0.log" limit=1024 Jul 27 20:43:03.112692 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:43:03.112653 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbpp5_e2759622-0ab6-46b7-b434-f0a0f8942dfe/konnectivity-agent/0.log" limit=1024 Jul 27 20:43:03.578785 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:43:03.578746 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbpp5_e2759622-0ab6-46b7-b434-f0a0f8942dfe/konnectivity-agent/0.log" limit=1024 Jul 27 20:43:03.700096 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:43:03.700062 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbpp5_e2759622-0ab6-46b7-b434-f0a0f8942dfe/konnectivity-agent/0.log" limit=1024 Jul 27 20:43:04.385610 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:43:04.385577 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbpp5_e2759622-0ab6-46b7-b434-f0a0f8942dfe/konnectivity-agent/0.log" limit=1024 Jul 27 20:43:07.361357 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:43:07.361306 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbpp5_e2759622-0ab6-46b7-b434-f0a0f8942dfe/konnectivity-agent/0.log" limit=1024 Jul 27 20:43:07.463427 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:43:07.463399 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbpp5_e2759622-0ab6-46b7-b434-f0a0f8942dfe/konnectivity-agent/0.log" limit=1024 Jul 27 20:43:10.371460 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:43:10.371423 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbpp5_e2759622-0ab6-46b7-b434-f0a0f8942dfe/konnectivity-agent/0.log" limit=1024 Jul 27 20:43:10.460567 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:43:10.460532 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbpp5_e2759622-0ab6-46b7-b434-f0a0f8942dfe/konnectivity-agent/0.log" limit=1024 Jul 27 20:43:10.583921 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:43:10.583891 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbpp5_e2759622-0ab6-46b7-b434-f0a0f8942dfe/konnectivity-agent/0.log" limit=1024 Jul 27 20:43:14.310046 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:43:14.310012 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbpp5_e2759622-0ab6-46b7-b434-f0a0f8942dfe/konnectivity-agent/0.log" limit=1024 Jul 27 20:43:14.411407 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:43:14.411373 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbpp5_e2759622-0ab6-46b7-b434-f0a0f8942dfe/konnectivity-agent/0.log" limit=1024 Jul 27 20:43:22.161923 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:43:22.161848 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbpp5_e2759622-0ab6-46b7-b434-f0a0f8942dfe/konnectivity-agent/0.log" limit=1024 Jul 27 20:43:22.284502 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:43:22.284472 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbpp5_e2759622-0ab6-46b7-b434-f0a0f8942dfe/konnectivity-agent/0.log" limit=1024 Jul 27 20:43:22.563832 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:43:22.563804 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbpp5_e2759622-0ab6-46b7-b434-f0a0f8942dfe/konnectivity-agent/0.log" limit=1024 Jul 27 20:43:22.660913 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:43:22.660875 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbpp5_e2759622-0ab6-46b7-b434-f0a0f8942dfe/konnectivity-agent/0.log" limit=1024 Jul 27 20:43:26.185442 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:43:26.185416 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbpp5_e2759622-0ab6-46b7-b434-f0a0f8942dfe/konnectivity-agent/0.log" limit=1024 Jul 27 20:43:26.293727 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:43:26.293696 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbpp5_e2759622-0ab6-46b7-b434-f0a0f8942dfe/konnectivity-agent/0.log" limit=1024 Jul 27 20:43:28.746238 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:43:28.746203 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbpp5_e2759622-0ab6-46b7-b434-f0a0f8942dfe/konnectivity-agent/0.log" limit=1024 Jul 27 20:43:28.795677 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:43:28.795647 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbpp5_e2759622-0ab6-46b7-b434-f0a0f8942dfe/konnectivity-agent/0.log" limit=1024 Jul 27 20:43:33.456704 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:43:33.456665 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbpp5_e2759622-0ab6-46b7-b434-f0a0f8942dfe/konnectivity-agent/0.log" limit=1024 Jul 27 20:43:33.561424 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:43:33.561390 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbpp5_e2759622-0ab6-46b7-b434-f0a0f8942dfe/konnectivity-agent/0.log" limit=1024 Jul 27 20:43:34.258904 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:43:34.258870 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbpp5_e2759622-0ab6-46b7-b434-f0a0f8942dfe/konnectivity-agent/0.log" limit=1024 Jul 27 20:43:34.373276 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:43:34.373245 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbpp5_e2759622-0ab6-46b7-b434-f0a0f8942dfe/konnectivity-agent/0.log" limit=1024 Jul 27 20:43:45.896116 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:43:45.896071 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbpp5_e2759622-0ab6-46b7-b434-f0a0f8942dfe/konnectivity-agent/0.log" limit=1024 Jul 27 20:43:45.996137 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:43:45.996112 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbpp5_e2759622-0ab6-46b7-b434-f0a0f8942dfe/konnectivity-agent/0.log" limit=1024 Jul 27 20:43:49.896006 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:43:49.895970 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbpp5_e2759622-0ab6-46b7-b434-f0a0f8942dfe/konnectivity-agent/0.log" limit=1024 Jul 27 20:43:50.178431 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:43:50.178358 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbpp5_e2759622-0ab6-46b7-b434-f0a0f8942dfe/konnectivity-agent/0.log" limit=1024 Jul 27 20:43:51.196828 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:43:51.196785 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbpp5_e2759622-0ab6-46b7-b434-f0a0f8942dfe/konnectivity-agent/0.log" limit=1024 Jul 27 20:44:05.829534 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:44:05.829488 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbpp5_e2759622-0ab6-46b7-b434-f0a0f8942dfe/konnectivity-agent/0.log" limit=1024 Jul 27 20:44:05.924559 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:44:05.924523 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbpp5_e2759622-0ab6-46b7-b434-f0a0f8942dfe/konnectivity-agent/0.log" limit=1024 Jul 27 20:44:05.978449 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:44:05.978419 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbpp5_e2759622-0ab6-46b7-b434-f0a0f8942dfe/konnectivity-agent/0.log" limit=1024 Jul 27 20:44:06.658771 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:44:06.658732 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbpp5_e2759622-0ab6-46b7-b434-f0a0f8942dfe/konnectivity-agent/0.log" limit=1024 Jul 27 20:44:06.716940 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:44:06.716913 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbpp5_e2759622-0ab6-46b7-b434-f0a0f8942dfe/konnectivity-agent/0.log" limit=1024 Jul 27 20:44:26.137872 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:44:26.137804 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbpp5_e2759622-0ab6-46b7-b434-f0a0f8942dfe/konnectivity-agent/0.log" limit=1024 Jul 27 20:44:26.237266 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:44:26.237236 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbpp5_e2759622-0ab6-46b7-b434-f0a0f8942dfe/konnectivity-agent/0.log" limit=1024 Jul 27 20:44:26.635242 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:44:26.635213 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbpp5_e2759622-0ab6-46b7-b434-f0a0f8942dfe/konnectivity-agent/0.log" limit=1024 Jul 27 20:44:39.231105 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:44:39.231073 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbpp5_e2759622-0ab6-46b7-b434-f0a0f8942dfe/konnectivity-agent/0.log" limit=1024 Jul 27 20:44:40.459371 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:44:40.459341 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbpp5_e2759622-0ab6-46b7-b434-f0a0f8942dfe/konnectivity-agent/0.log" limit=1024 Jul 27 20:44:46.427755 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:44:46.427720 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbpp5_e2759622-0ab6-46b7-b434-f0a0f8942dfe/konnectivity-agent/0.log" limit=1024 Jul 27 20:44:46.582115 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:44:46.582082 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbpp5_e2759622-0ab6-46b7-b434-f0a0f8942dfe/konnectivity-agent/0.log" limit=1024 Jul 27 20:44:46.669835 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:44:46.669804 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbpp5_e2759622-0ab6-46b7-b434-f0a0f8942dfe/konnectivity-agent/0.log" limit=1024 Jul 27 20:44:49.784709 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:44:49.784606 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbpp5_e2759622-0ab6-46b7-b434-f0a0f8942dfe/konnectivity-agent/0.log" limit=1024 Jul 27 20:44:49.887107 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:44:49.887072 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbpp5_e2759622-0ab6-46b7-b434-f0a0f8942dfe/konnectivity-agent/0.log" limit=1024 Jul 27 20:45:21.394627 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:45:21.394594 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbpp5_e2759622-0ab6-46b7-b434-f0a0f8942dfe/konnectivity-agent/0.log" limit=1024 Jul 27 20:45:21.478851 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:45:21.478825 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbpp5_e2759622-0ab6-46b7-b434-f0a0f8942dfe/konnectivity-agent/0.log" limit=1024 Jul 27 20:45:21.984120 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:45:21.984090 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbpp5_e2759622-0ab6-46b7-b434-f0a0f8942dfe/konnectivity-agent/0.log" limit=1024 Jul 27 20:45:22.140810 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:45:22.140778 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbpp5_e2759622-0ab6-46b7-b434-f0a0f8942dfe/konnectivity-agent/0.log" limit=1024 Jul 27 20:45:22.487231 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:45:22.487202 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbpp5_e2759622-0ab6-46b7-b434-f0a0f8942dfe/konnectivity-agent/0.log" limit=1024 Jul 27 20:45:22.578240 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:45:22.578211 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbpp5_e2759622-0ab6-46b7-b434-f0a0f8942dfe/konnectivity-agent/0.log" limit=1024 Jul 27 20:45:22.596223 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:45:22.596188 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-687dbb6cf6-5bwxq"] Jul 27 20:45:22.599461 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:45:22.599441 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-687dbb6cf6-5bwxq" Jul 27 20:45:22.601393 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:45:22.601374 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\"" Jul 27 20:45:22.609854 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:45:22.609835 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-687dbb6cf6-5bwxq"] Jul 27 20:45:22.773452 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:45:22.773424 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ac462ac8-4588-4df4-b385-b913c760f392-plugins-config-volume\") pod \"payload-pre-processing-687dbb6cf6-5bwxq\" (UID: \"ac462ac8-4588-4df4-b385-b913c760f392\") " pod="openshift-ingress/payload-pre-processing-687dbb6cf6-5bwxq" Jul 27 20:45:22.773588 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:45:22.773474 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l6dpc\" (UniqueName: \"kubernetes.io/projected/ac462ac8-4588-4df4-b385-b913c760f392-kube-api-access-l6dpc\") pod \"payload-pre-processing-687dbb6cf6-5bwxq\" (UID: \"ac462ac8-4588-4df4-b385-b913c760f392\") " pod="openshift-ingress/payload-pre-processing-687dbb6cf6-5bwxq" Jul 27 20:45:22.874751 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:45:22.874725 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l6dpc\" (UniqueName: \"kubernetes.io/projected/ac462ac8-4588-4df4-b385-b913c760f392-kube-api-access-l6dpc\") pod \"payload-pre-processing-687dbb6cf6-5bwxq\" (UID: \"ac462ac8-4588-4df4-b385-b913c760f392\") " pod="openshift-ingress/payload-pre-processing-687dbb6cf6-5bwxq" Jul 27 20:45:22.874848 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:45:22.874786 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ac462ac8-4588-4df4-b385-b913c760f392-plugins-config-volume\") pod \"payload-pre-processing-687dbb6cf6-5bwxq\" (UID: \"ac462ac8-4588-4df4-b385-b913c760f392\") " pod="openshift-ingress/payload-pre-processing-687dbb6cf6-5bwxq" Jul 27 20:45:22.875543 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:45:22.875526 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ac462ac8-4588-4df4-b385-b913c760f392-plugins-config-volume\") pod \"payload-pre-processing-687dbb6cf6-5bwxq\" (UID: \"ac462ac8-4588-4df4-b385-b913c760f392\") " pod="openshift-ingress/payload-pre-processing-687dbb6cf6-5bwxq" Jul 27 20:45:22.882006 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:45:22.881984 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l6dpc\" (UniqueName: \"kubernetes.io/projected/ac462ac8-4588-4df4-b385-b913c760f392-kube-api-access-l6dpc\") pod \"payload-pre-processing-687dbb6cf6-5bwxq\" (UID: \"ac462ac8-4588-4df4-b385-b913c760f392\") " pod="openshift-ingress/payload-pre-processing-687dbb6cf6-5bwxq" Jul 27 20:45:22.909938 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:45:22.909916 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-687dbb6cf6-5bwxq" Jul 27 20:45:23.034597 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:45:23.034521 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-687dbb6cf6-5bwxq"] Jul 27 20:45:23.038469 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:45:23.038443 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podac462ac8_4588_4df4_b385_b913c760f392.slice/crio-565426d49a74467b0d16fb70ecafff7314c17a24d69c1a1426fe1a587ef87133 WatchSource:0}: Error finding container 565426d49a74467b0d16fb70ecafff7314c17a24d69c1a1426fe1a587ef87133: Status 404 returned error can't find the container with id 565426d49a74467b0d16fb70ecafff7314c17a24d69c1a1426fe1a587ef87133 Jul 27 20:45:23.561703 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:45:23.561670 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-687dbb6cf6-5bwxq" event={"ID":"ac462ac8-4588-4df4-b385-b913c760f392","Type":"ContainerStarted","Data":"565426d49a74467b0d16fb70ecafff7314c17a24d69c1a1426fe1a587ef87133"} Jul 27 20:45:25.570698 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:45:25.570668 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-687dbb6cf6-5bwxq" event={"ID":"ac462ac8-4588-4df4-b385-b913c760f392","Type":"ContainerStarted","Data":"64344468f2b1380d51df552afc0f37352ccdbcb16f99944b8ab800542b549bb7"} Jul 27 20:45:25.571049 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:45:25.570794 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-687dbb6cf6-5bwxq" Jul 27 20:45:25.585540 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:45:25.585497 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-687dbb6cf6-5bwxq" podStartSLOduration=1.417986019 podStartE2EDuration="3.585483736s" totalImagesPullingTime="2.167497717s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 20:45:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:45:25.584262567 +0000 UTC m=+659.053805578" watchObservedRunningTime="2026-07-27 20:45:25.585483736 +0000 UTC m=+659.055026745" Jul 27 20:45:32.849017 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:45:32.848982 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbpp5_e2759622-0ab6-46b7-b434-f0a0f8942dfe/konnectivity-agent/0.log" limit=1024 Jul 27 20:45:32.988830 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:45:32.988795 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbpp5_e2759622-0ab6-46b7-b434-f0a0f8942dfe/konnectivity-agent/0.log" limit=1024 Jul 27 20:45:36.576514 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:45:36.576485 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-687dbb6cf6-5bwxq" Jul 27 20:45:42.835101 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:45:42.835069 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbpp5_e2759622-0ab6-46b7-b434-f0a0f8942dfe/konnectivity-agent/0.log" limit=1024 Jul 27 20:45:51.749014 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:45:51.748982 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbpp5_e2759622-0ab6-46b7-b434-f0a0f8942dfe/konnectivity-agent/0.log" limit=1024 Jul 27 20:45:59.142424 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:45:59.142393 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-zl2qb"] Jul 27 20:45:59.145481 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:45:59.145465 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-zl2qb" Jul 27 20:45:59.148035 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:45:59.148008 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\"" Jul 27 20:45:59.148474 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:45:59.148456 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jul 27 20:45:59.149761 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:45:59.149745 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jul 27 20:45:59.151129 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:45:59.151111 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-vxgfz\"" Jul 27 20:45:59.164623 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:45:59.164602 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-zl2qb"] Jul 27 20:45:59.195693 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:45:59.195666 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbpp5_e2759622-0ab6-46b7-b434-f0a0f8942dfe/konnectivity-agent/0.log" limit=1024 Jul 27 20:45:59.265423 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:45:59.265402 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d3b22090-76f1-4387-a89f-0909d15c7649-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-zl2qb\" (UID: \"d3b22090-76f1-4387-a89f-0909d15c7649\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-zl2qb" Jul 27 20:45:59.265533 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:45:59.265437 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d3b22090-76f1-4387-a89f-0909d15c7649-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-zl2qb\" (UID: \"d3b22090-76f1-4387-a89f-0909d15c7649\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-zl2qb" Jul 27 20:45:59.265533 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:45:59.265472 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d3b22090-76f1-4387-a89f-0909d15c7649-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-zl2qb\" (UID: \"d3b22090-76f1-4387-a89f-0909d15c7649\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-zl2qb" Jul 27 20:45:59.265533 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:45:59.265511 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d3b22090-76f1-4387-a89f-0909d15c7649-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-zl2qb\" (UID: \"d3b22090-76f1-4387-a89f-0909d15c7649\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-zl2qb" Jul 27 20:45:59.265721 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:45:59.265548 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sns9r\" (UniqueName: \"kubernetes.io/projected/d3b22090-76f1-4387-a89f-0909d15c7649-kube-api-access-sns9r\") pod \"e2e-trlp-test-simulated-kserve-598466548d-zl2qb\" (UID: \"d3b22090-76f1-4387-a89f-0909d15c7649\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-zl2qb" Jul 27 20:45:59.265721 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:45:59.265573 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d3b22090-76f1-4387-a89f-0909d15c7649-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-zl2qb\" (UID: \"d3b22090-76f1-4387-a89f-0909d15c7649\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-zl2qb" Jul 27 20:45:59.366303 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:45:59.366266 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d3b22090-76f1-4387-a89f-0909d15c7649-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-zl2qb\" (UID: \"d3b22090-76f1-4387-a89f-0909d15c7649\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-zl2qb" Jul 27 20:45:59.366492 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:45:59.366312 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d3b22090-76f1-4387-a89f-0909d15c7649-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-zl2qb\" (UID: \"d3b22090-76f1-4387-a89f-0909d15c7649\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-zl2qb" Jul 27 20:45:59.366492 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:45:59.366375 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d3b22090-76f1-4387-a89f-0909d15c7649-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-zl2qb\" (UID: \"d3b22090-76f1-4387-a89f-0909d15c7649\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-zl2qb" Jul 27 20:45:59.366492 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:45:59.366402 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d3b22090-76f1-4387-a89f-0909d15c7649-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-zl2qb\" (UID: \"d3b22090-76f1-4387-a89f-0909d15c7649\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-zl2qb" Jul 27 20:45:59.366492 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:45:59.366452 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sns9r\" (UniqueName: \"kubernetes.io/projected/d3b22090-76f1-4387-a89f-0909d15c7649-kube-api-access-sns9r\") pod \"e2e-trlp-test-simulated-kserve-598466548d-zl2qb\" (UID: \"d3b22090-76f1-4387-a89f-0909d15c7649\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-zl2qb" Jul 27 20:45:59.366492 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:45:59.366482 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d3b22090-76f1-4387-a89f-0909d15c7649-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-zl2qb\" (UID: \"d3b22090-76f1-4387-a89f-0909d15c7649\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-zl2qb" Jul 27 20:45:59.366763 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:45:59.366725 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d3b22090-76f1-4387-a89f-0909d15c7649-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-zl2qb\" (UID: \"d3b22090-76f1-4387-a89f-0909d15c7649\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-zl2qb" Jul 27 20:45:59.366763 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:45:59.366746 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d3b22090-76f1-4387-a89f-0909d15c7649-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-zl2qb\" (UID: \"d3b22090-76f1-4387-a89f-0909d15c7649\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-zl2qb" Jul 27 20:45:59.366870 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:45:59.366775 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d3b22090-76f1-4387-a89f-0909d15c7649-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-zl2qb\" (UID: \"d3b22090-76f1-4387-a89f-0909d15c7649\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-zl2qb" Jul 27 20:45:59.368697 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:45:59.368673 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d3b22090-76f1-4387-a89f-0909d15c7649-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-zl2qb\" (UID: \"d3b22090-76f1-4387-a89f-0909d15c7649\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-zl2qb" Jul 27 20:45:59.368984 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:45:59.368963 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d3b22090-76f1-4387-a89f-0909d15c7649-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-zl2qb\" (UID: \"d3b22090-76f1-4387-a89f-0909d15c7649\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-zl2qb" Jul 27 20:45:59.374684 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:45:59.374658 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sns9r\" (UniqueName: \"kubernetes.io/projected/d3b22090-76f1-4387-a89f-0909d15c7649-kube-api-access-sns9r\") pod \"e2e-trlp-test-simulated-kserve-598466548d-zl2qb\" (UID: \"d3b22090-76f1-4387-a89f-0909d15c7649\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-zl2qb" Jul 27 20:45:59.455686 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:45:59.455578 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-zl2qb" Jul 27 20:45:59.583180 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:45:59.583141 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-zl2qb"] Jul 27 20:45:59.586136 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:45:59.586103 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd3b22090_76f1_4387_a89f_0909d15c7649.slice/crio-2104d649b5c2bdc2db44b91bbf64b979573cd6a0cb4ac4a7f66461aa3670786f WatchSource:0}: Error finding container 2104d649b5c2bdc2db44b91bbf64b979573cd6a0cb4ac4a7f66461aa3670786f: Status 404 returned error can't find the container with id 2104d649b5c2bdc2db44b91bbf64b979573cd6a0cb4ac4a7f66461aa3670786f Jul 27 20:45:59.587626 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:45:59.587605 2572 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 27 20:45:59.697049 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:45:59.697015 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-zl2qb" event={"ID":"d3b22090-76f1-4387-a89f-0909d15c7649","Type":"ContainerStarted","Data":"2104d649b5c2bdc2db44b91bbf64b979573cd6a0cb4ac4a7f66461aa3670786f"} Jul 27 20:46:00.702716 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:46:00.702677 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-zl2qb" event={"ID":"d3b22090-76f1-4387-a89f-0909d15c7649","Type":"ContainerStarted","Data":"a6186c3a5275cba1a1c70ce77be2e41a7c267727deaf865935b0401d56949e09"} Jul 27 20:46:00.721056 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:46:00.721001 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-zl2qb" podStartSLOduration=0.772092076 podStartE2EDuration="1.720984737s" totalImagesPullingTime="948.892661ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 20:45:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:46:00.718925881 +0000 UTC m=+694.188468893" watchObservedRunningTime="2026-07-27 20:46:00.720984737 +0000 UTC m=+694.190527747" Jul 27 20:46:07.031745 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:46:07.031710 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fj2qzv"] Jul 27 20:46:07.035167 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:46:07.035145 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fj2qzv" Jul 27 20:46:07.037038 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:46:07.037019 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\"" Jul 27 20:46:07.043821 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:46:07.043796 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fj2qzv"] Jul 27 20:46:07.060740 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:46:07.060712 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbpp5_e2759622-0ab6-46b7-b434-f0a0f8942dfe/konnectivity-agent/0.log" limit=1024 Jul 27 20:46:07.132716 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:46:07.132676 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-924pl\" (UniqueName: \"kubernetes.io/projected/3f9de9c6-4066-4681-ae7e-c4551469ead0-kube-api-access-924pl\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fj2qzv\" (UID: \"3f9de9c6-4066-4681-ae7e-c4551469ead0\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fj2qzv" Jul 27 20:46:07.132890 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:46:07.132780 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3f9de9c6-4066-4681-ae7e-c4551469ead0-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fj2qzv\" (UID: \"3f9de9c6-4066-4681-ae7e-c4551469ead0\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fj2qzv" Jul 27 20:46:07.132890 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:46:07.132820 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3f9de9c6-4066-4681-ae7e-c4551469ead0-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fj2qzv\" (UID: \"3f9de9c6-4066-4681-ae7e-c4551469ead0\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fj2qzv" Jul 27 20:46:07.132890 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:46:07.132843 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3f9de9c6-4066-4681-ae7e-c4551469ead0-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fj2qzv\" (UID: \"3f9de9c6-4066-4681-ae7e-c4551469ead0\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fj2qzv" Jul 27 20:46:07.132890 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:46:07.132867 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3f9de9c6-4066-4681-ae7e-c4551469ead0-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fj2qzv\" (UID: \"3f9de9c6-4066-4681-ae7e-c4551469ead0\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fj2qzv" Jul 27 20:46:07.133061 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:46:07.132906 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3f9de9c6-4066-4681-ae7e-c4551469ead0-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fj2qzv\" (UID: \"3f9de9c6-4066-4681-ae7e-c4551469ead0\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fj2qzv" Jul 27 20:46:07.234201 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:46:07.234154 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-924pl\" (UniqueName: \"kubernetes.io/projected/3f9de9c6-4066-4681-ae7e-c4551469ead0-kube-api-access-924pl\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fj2qzv\" (UID: \"3f9de9c6-4066-4681-ae7e-c4551469ead0\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fj2qzv" Jul 27 20:46:07.234201 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:46:07.234209 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3f9de9c6-4066-4681-ae7e-c4551469ead0-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fj2qzv\" (UID: \"3f9de9c6-4066-4681-ae7e-c4551469ead0\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fj2qzv" Jul 27 20:46:07.234484 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:46:07.234352 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3f9de9c6-4066-4681-ae7e-c4551469ead0-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fj2qzv\" (UID: \"3f9de9c6-4066-4681-ae7e-c4551469ead0\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fj2qzv" Jul 27 20:46:07.234484 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:46:07.234398 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3f9de9c6-4066-4681-ae7e-c4551469ead0-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fj2qzv\" (UID: \"3f9de9c6-4066-4681-ae7e-c4551469ead0\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fj2qzv" Jul 27 20:46:07.234484 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:46:07.234426 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3f9de9c6-4066-4681-ae7e-c4551469ead0-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fj2qzv\" (UID: \"3f9de9c6-4066-4681-ae7e-c4551469ead0\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fj2qzv" Jul 27 20:46:07.234484 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:46:07.234460 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3f9de9c6-4066-4681-ae7e-c4551469ead0-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fj2qzv\" (UID: \"3f9de9c6-4066-4681-ae7e-c4551469ead0\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fj2qzv" Jul 27 20:46:07.234739 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:46:07.234594 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3f9de9c6-4066-4681-ae7e-c4551469ead0-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fj2qzv\" (UID: \"3f9de9c6-4066-4681-ae7e-c4551469ead0\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fj2qzv" Jul 27 20:46:07.234739 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:46:07.234651 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3f9de9c6-4066-4681-ae7e-c4551469ead0-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fj2qzv\" (UID: \"3f9de9c6-4066-4681-ae7e-c4551469ead0\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fj2qzv" Jul 27 20:46:07.234860 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:46:07.234810 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3f9de9c6-4066-4681-ae7e-c4551469ead0-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fj2qzv\" (UID: \"3f9de9c6-4066-4681-ae7e-c4551469ead0\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fj2qzv" Jul 27 20:46:07.236450 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:46:07.236430 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3f9de9c6-4066-4681-ae7e-c4551469ead0-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fj2qzv\" (UID: \"3f9de9c6-4066-4681-ae7e-c4551469ead0\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fj2qzv" Jul 27 20:46:07.236759 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:46:07.236742 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3f9de9c6-4066-4681-ae7e-c4551469ead0-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fj2qzv\" (UID: \"3f9de9c6-4066-4681-ae7e-c4551469ead0\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fj2qzv" Jul 27 20:46:07.241910 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:46:07.241881 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-924pl\" (UniqueName: \"kubernetes.io/projected/3f9de9c6-4066-4681-ae7e-c4551469ead0-kube-api-access-924pl\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fj2qzv\" (UID: \"3f9de9c6-4066-4681-ae7e-c4551469ead0\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fj2qzv" Jul 27 20:46:07.347455 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:46:07.347352 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fj2qzv" Jul 27 20:46:07.474964 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:46:07.474936 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fj2qzv"] Jul 27 20:46:07.477695 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:46:07.477665 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3f9de9c6_4066_4681_ae7e_c4551469ead0.slice/crio-846795735b8c7867bcb0e6f0156b102bb53f8018ba267f6e9878d11f419bf2a7 WatchSource:0}: Error finding container 846795735b8c7867bcb0e6f0156b102bb53f8018ba267f6e9878d11f419bf2a7: Status 404 returned error can't find the container with id 846795735b8c7867bcb0e6f0156b102bb53f8018ba267f6e9878d11f419bf2a7 Jul 27 20:46:07.731968 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:46:07.731937 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fj2qzv" event={"ID":"3f9de9c6-4066-4681-ae7e-c4551469ead0","Type":"ContainerStarted","Data":"262dbf3fc3be61dbc0658c82339b272fc3907a0f5823e2bc956b38c870ac2656"} Jul 27 20:46:07.732126 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:46:07.731992 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fj2qzv" event={"ID":"3f9de9c6-4066-4681-ae7e-c4551469ead0","Type":"ContainerStarted","Data":"846795735b8c7867bcb0e6f0156b102bb53f8018ba267f6e9878d11f419bf2a7"} Jul 27 20:46:07.749528 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:46:07.749473 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fj2qzv" podStartSLOduration=0.579874044 podStartE2EDuration="749.457261ms" totalImagesPullingTime="169.583217ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 20:46:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:46:07.748013184 +0000 UTC m=+701.217556195" watchObservedRunningTime="2026-07-27 20:46:07.749457261 +0000 UTC m=+701.219000271" Jul 27 20:46:09.456400 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:46:09.456364 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-zl2qb" Jul 27 20:46:09.456800 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:46:09.456447 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-zl2qb" Jul 27 20:46:09.473564 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:46:09.473535 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-zl2qb" Jul 27 20:46:09.750765 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:46:09.750688 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-zl2qb" Jul 27 20:46:17.347498 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:46:17.347454 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fj2qzv" Jul 27 20:46:17.347994 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:46:17.347529 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fj2qzv" Jul 27 20:46:17.359948 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:46:17.359918 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fj2qzv" Jul 27 20:46:17.781219 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:46:17.781197 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fj2qzv" Jul 27 20:46:27.229028 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:46:27.228954 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-dlglp"] Jul 27 20:46:27.233261 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:46:27.233246 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-dlglp" Jul 27 20:46:27.235253 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:46:27.235232 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\"" Jul 27 20:46:27.241546 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:46:27.241526 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-dlglp"] Jul 27 20:46:27.254126 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:46:27.254096 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbpp5_e2759622-0ab6-46b7-b434-f0a0f8942dfe/konnectivity-agent/0.log" limit=1024 Jul 27 20:46:27.304908 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:46:27.304877 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/eb8f2c49-10b7-44c9-8f7c-eb79c6cb55aa-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-dlglp\" (UID: \"eb8f2c49-10b7-44c9-8f7c-eb79c6cb55aa\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-dlglp" Jul 27 20:46:27.304908 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:46:27.304907 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/eb8f2c49-10b7-44c9-8f7c-eb79c6cb55aa-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-dlglp\" (UID: \"eb8f2c49-10b7-44c9-8f7c-eb79c6cb55aa\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-dlglp" Jul 27 20:46:27.305107 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:46:27.304929 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sn9fj\" (UniqueName: \"kubernetes.io/projected/eb8f2c49-10b7-44c9-8f7c-eb79c6cb55aa-kube-api-access-sn9fj\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-dlglp\" (UID: \"eb8f2c49-10b7-44c9-8f7c-eb79c6cb55aa\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-dlglp" Jul 27 20:46:27.305107 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:46:27.305038 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/eb8f2c49-10b7-44c9-8f7c-eb79c6cb55aa-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-dlglp\" (UID: \"eb8f2c49-10b7-44c9-8f7c-eb79c6cb55aa\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-dlglp" Jul 27 20:46:27.305107 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:46:27.305072 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/eb8f2c49-10b7-44c9-8f7c-eb79c6cb55aa-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-dlglp\" (UID: \"eb8f2c49-10b7-44c9-8f7c-eb79c6cb55aa\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-dlglp" Jul 27 20:46:27.305215 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:46:27.305139 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/eb8f2c49-10b7-44c9-8f7c-eb79c6cb55aa-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-dlglp\" (UID: \"eb8f2c49-10b7-44c9-8f7c-eb79c6cb55aa\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-dlglp" Jul 27 20:46:27.405714 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:46:27.405679 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/eb8f2c49-10b7-44c9-8f7c-eb79c6cb55aa-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-dlglp\" (UID: \"eb8f2c49-10b7-44c9-8f7c-eb79c6cb55aa\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-dlglp" Jul 27 20:46:27.405714 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:46:27.405715 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/eb8f2c49-10b7-44c9-8f7c-eb79c6cb55aa-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-dlglp\" (UID: \"eb8f2c49-10b7-44c9-8f7c-eb79c6cb55aa\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-dlglp" Jul 27 20:46:27.405967 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:46:27.405743 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sn9fj\" (UniqueName: \"kubernetes.io/projected/eb8f2c49-10b7-44c9-8f7c-eb79c6cb55aa-kube-api-access-sn9fj\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-dlglp\" (UID: \"eb8f2c49-10b7-44c9-8f7c-eb79c6cb55aa\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-dlglp" Jul 27 20:46:27.405967 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:46:27.405794 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/eb8f2c49-10b7-44c9-8f7c-eb79c6cb55aa-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-dlglp\" (UID: \"eb8f2c49-10b7-44c9-8f7c-eb79c6cb55aa\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-dlglp" Jul 27 20:46:27.405967 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:46:27.405816 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/eb8f2c49-10b7-44c9-8f7c-eb79c6cb55aa-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-dlglp\" (UID: \"eb8f2c49-10b7-44c9-8f7c-eb79c6cb55aa\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-dlglp" Jul 27 20:46:27.405967 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:46:27.405868 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/eb8f2c49-10b7-44c9-8f7c-eb79c6cb55aa-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-dlglp\" (UID: \"eb8f2c49-10b7-44c9-8f7c-eb79c6cb55aa\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-dlglp" Jul 27 20:46:27.406168 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:46:27.406113 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/eb8f2c49-10b7-44c9-8f7c-eb79c6cb55aa-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-dlglp\" (UID: \"eb8f2c49-10b7-44c9-8f7c-eb79c6cb55aa\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-dlglp" Jul 27 20:46:27.406168 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:46:27.406146 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/eb8f2c49-10b7-44c9-8f7c-eb79c6cb55aa-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-dlglp\" (UID: \"eb8f2c49-10b7-44c9-8f7c-eb79c6cb55aa\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-dlglp" Jul 27 20:46:27.406276 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:46:27.406182 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/eb8f2c49-10b7-44c9-8f7c-eb79c6cb55aa-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-dlglp\" (UID: \"eb8f2c49-10b7-44c9-8f7c-eb79c6cb55aa\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-dlglp" Jul 27 20:46:27.408236 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:46:27.408214 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/eb8f2c49-10b7-44c9-8f7c-eb79c6cb55aa-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-dlglp\" (UID: \"eb8f2c49-10b7-44c9-8f7c-eb79c6cb55aa\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-dlglp" Jul 27 20:46:27.409411 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:46:27.409390 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/eb8f2c49-10b7-44c9-8f7c-eb79c6cb55aa-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-dlglp\" (UID: \"eb8f2c49-10b7-44c9-8f7c-eb79c6cb55aa\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-dlglp" Jul 27 20:46:27.413205 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:46:27.413182 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sn9fj\" (UniqueName: \"kubernetes.io/projected/eb8f2c49-10b7-44c9-8f7c-eb79c6cb55aa-kube-api-access-sn9fj\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-dlglp\" (UID: \"eb8f2c49-10b7-44c9-8f7c-eb79c6cb55aa\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-dlglp" Jul 27 20:46:27.543107 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:46:27.543071 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-dlglp" Jul 27 20:46:27.667848 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:46:27.667821 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-dlglp"] Jul 27 20:46:27.669693 ip-10-0-139-2 kubenswrapper[2572]: W0727 20:46:27.669666 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeb8f2c49_10b7_44c9_8f7c_eb79c6cb55aa.slice/crio-a33d72dba6c9ea173de254afcc0fe78118d148972eeda938d7392c9fd5bc0d90 WatchSource:0}: Error finding container a33d72dba6c9ea173de254afcc0fe78118d148972eeda938d7392c9fd5bc0d90: Status 404 returned error can't find the container with id a33d72dba6c9ea173de254afcc0fe78118d148972eeda938d7392c9fd5bc0d90 Jul 27 20:46:27.808412 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:46:27.808307 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-dlglp" event={"ID":"eb8f2c49-10b7-44c9-8f7c-eb79c6cb55aa","Type":"ContainerStarted","Data":"a33d72dba6c9ea173de254afcc0fe78118d148972eeda938d7392c9fd5bc0d90"} Jul 27 20:46:28.813878 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:46:28.813845 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-dlglp" event={"ID":"eb8f2c49-10b7-44c9-8f7c-eb79c6cb55aa","Type":"ContainerStarted","Data":"7525cd4c9c7208dc354b4b8f5ff67703863bba1febcbc45ea66d4d96556bf69b"} Jul 27 20:46:28.831739 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:46:28.831689 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-dlglp" podStartSLOduration=1.62627528 podStartE2EDuration="1.831642927s" totalImagesPullingTime="205.367647ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 20:46:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:46:28.829528209 +0000 UTC m=+722.299071219" watchObservedRunningTime="2026-07-27 20:46:28.831642927 +0000 UTC m=+722.301185936" Jul 27 20:46:33.722203 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:46:33.722169 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbpp5_e2759622-0ab6-46b7-b434-f0a0f8942dfe/konnectivity-agent/0.log" limit=1024 Jul 27 20:46:37.543581 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:46:37.543543 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-dlglp" Jul 27 20:46:37.544049 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:46:37.543602 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-dlglp" Jul 27 20:46:37.555962 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:46:37.555933 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-dlglp" Jul 27 20:46:37.861222 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:46:37.861150 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-dlglp" Jul 27 20:47:17.875265 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:47:17.875225 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbpp5_e2759622-0ab6-46b7-b434-f0a0f8942dfe/konnectivity-agent/0.log" limit=1024 Jul 27 20:47:20.832009 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:47:20.831975 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbpp5_e2759622-0ab6-46b7-b434-f0a0f8942dfe/konnectivity-agent/0.log" limit=1024 Jul 27 20:47:20.933005 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:47:20.932978 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbpp5_e2759622-0ab6-46b7-b434-f0a0f8942dfe/konnectivity-agent/0.log" limit=1024 Jul 27 20:47:34.613779 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:47:34.613747 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbpp5_e2759622-0ab6-46b7-b434-f0a0f8942dfe/konnectivity-agent/0.log" limit=1024 Jul 27 20:47:37.834574 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:47:37.834542 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbpp5_e2759622-0ab6-46b7-b434-f0a0f8942dfe/konnectivity-agent/0.log" limit=1024 Jul 27 20:47:37.926700 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:47:37.926668 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbpp5_e2759622-0ab6-46b7-b434-f0a0f8942dfe/konnectivity-agent/0.log" limit=1024 Jul 27 20:47:38.983850 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:47:38.983816 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbpp5_e2759622-0ab6-46b7-b434-f0a0f8942dfe/konnectivity-agent/0.log" limit=1024 Jul 27 20:47:39.088137 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:47:39.088105 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbpp5_e2759622-0ab6-46b7-b434-f0a0f8942dfe/konnectivity-agent/0.log" limit=1024 Jul 27 20:48:39.254405 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:48:39.254364 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbpp5_e2759622-0ab6-46b7-b434-f0a0f8942dfe/konnectivity-agent/0.log" limit=1024 Jul 27 20:48:39.355595 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:48:39.355560 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbpp5_e2759622-0ab6-46b7-b434-f0a0f8942dfe/konnectivity-agent/0.log" limit=1024 Jul 27 20:49:10.262298 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:49:10.262268 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbpp5_e2759622-0ab6-46b7-b434-f0a0f8942dfe/konnectivity-agent/0.log" limit=1024 Jul 27 20:49:47.237298 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:49:47.237265 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbpp5_e2759622-0ab6-46b7-b434-f0a0f8942dfe/konnectivity-agent/0.log" limit=1024 Jul 27 20:49:48.904890 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:49:48.904854 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbpp5_e2759622-0ab6-46b7-b434-f0a0f8942dfe/konnectivity-agent/0.log" limit=1024 Jul 27 20:50:18.975368 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:50:18.975312 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbpp5_e2759622-0ab6-46b7-b434-f0a0f8942dfe/konnectivity-agent/0.log" limit=1024 Jul 27 20:50:19.074699 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:50:19.074666 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbpp5_e2759622-0ab6-46b7-b434-f0a0f8942dfe/konnectivity-agent/0.log" limit=1024 Jul 27 20:50:19.229658 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:50:19.229585 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbpp5_e2759622-0ab6-46b7-b434-f0a0f8942dfe/konnectivity-agent/0.log" limit=1024 Jul 27 20:50:20.486264 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:50:20.486234 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbpp5_e2759622-0ab6-46b7-b434-f0a0f8942dfe/konnectivity-agent/0.log" limit=1024 Jul 27 20:50:20.588756 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:50:20.588727 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbpp5_e2759622-0ab6-46b7-b434-f0a0f8942dfe/konnectivity-agent/0.log" limit=1024 Jul 27 20:50:25.021015 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:50:25.020983 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbpp5_e2759622-0ab6-46b7-b434-f0a0f8942dfe/konnectivity-agent/0.log" limit=1024 Jul 27 20:50:25.213657 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:50:25.213627 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbpp5_e2759622-0ab6-46b7-b434-f0a0f8942dfe/konnectivity-agent/0.log" limit=1024 Jul 27 20:50:25.312618 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:50:25.312542 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbpp5_e2759622-0ab6-46b7-b434-f0a0f8942dfe/konnectivity-agent/0.log" limit=1024 Jul 27 20:50:25.412919 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:50:25.412895 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbpp5_e2759622-0ab6-46b7-b434-f0a0f8942dfe/konnectivity-agent/0.log" limit=1024 Jul 27 20:50:30.925710 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:50:30.925673 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbpp5_e2759622-0ab6-46b7-b434-f0a0f8942dfe/konnectivity-agent/0.log" limit=1024 Jul 27 20:50:30.989067 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:50:30.989041 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbpp5_e2759622-0ab6-46b7-b434-f0a0f8942dfe/konnectivity-agent/0.log" limit=1024 Jul 27 20:52:23.069867 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:52:23.069788 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbpp5_e2759622-0ab6-46b7-b434-f0a0f8942dfe/konnectivity-agent/0.log" limit=1024 Jul 27 20:58:02.500518 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:58:02.500485 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbpp5_e2759622-0ab6-46b7-b434-f0a0f8942dfe/konnectivity-agent/0.log" limit=1024 Jul 27 20:58:24.182111 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:58:24.182042 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbpp5_e2759622-0ab6-46b7-b434-f0a0f8942dfe/konnectivity-agent/0.log" limit=1024 Jul 27 20:58:32.743539 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:58:32.743486 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbpp5_e2759622-0ab6-46b7-b434-f0a0f8942dfe/konnectivity-agent/0.log" limit=1024 Jul 27 20:58:44.339561 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:58:44.339528 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbpp5_e2759622-0ab6-46b7-b434-f0a0f8942dfe/konnectivity-agent/0.log" limit=1024 Jul 27 20:59:09.762206 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:59:09.762175 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbpp5_e2759622-0ab6-46b7-b434-f0a0f8942dfe/konnectivity-agent/0.log" limit=1024 Jul 27 20:59:10.755611 ip-10-0-139-2 kubenswrapper[2572]: I0727 20:59:10.755585 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbpp5_e2759622-0ab6-46b7-b434-f0a0f8942dfe/konnectivity-agent/0.log" limit=1024 Jul 27 21:01:23.171257 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:01:23.171156 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbpp5_e2759622-0ab6-46b7-b434-f0a0f8942dfe/konnectivity-agent/0.log" limit=1024 Jul 27 21:02:13.544018 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:02:13.543979 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbpp5_e2759622-0ab6-46b7-b434-f0a0f8942dfe/konnectivity-agent/0.log" limit=1024 Jul 27 21:02:13.643872 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:02:13.643835 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbpp5_e2759622-0ab6-46b7-b434-f0a0f8942dfe/konnectivity-agent/0.log" limit=1024 Jul 27 21:02:20.331712 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:02:20.331677 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbpp5_e2759622-0ab6-46b7-b434-f0a0f8942dfe/konnectivity-agent/0.log" limit=1024 Jul 27 21:02:43.904154 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:02:43.904121 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbpp5_e2759622-0ab6-46b7-b434-f0a0f8942dfe/konnectivity-agent/0.log" limit=1024 Jul 27 21:02:47.146282 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:02:47.146247 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbpp5_e2759622-0ab6-46b7-b434-f0a0f8942dfe/konnectivity-agent/0.log" limit=1024 Jul 27 21:02:47.255862 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:02:47.255801 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbpp5_e2759622-0ab6-46b7-b434-f0a0f8942dfe/konnectivity-agent/0.log" limit=1024 Jul 27 21:02:47.611094 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:02:47.611062 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbpp5_e2759622-0ab6-46b7-b434-f0a0f8942dfe/konnectivity-agent/0.log" limit=1024 Jul 27 21:02:53.770601 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:02:53.770531 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbpp5_e2759622-0ab6-46b7-b434-f0a0f8942dfe/konnectivity-agent/0.log" limit=1024 Jul 27 21:02:53.873542 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:02:53.873513 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbpp5_e2759622-0ab6-46b7-b434-f0a0f8942dfe/konnectivity-agent/0.log" limit=1024 Jul 27 21:02:54.022150 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:02:54.022077 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbpp5_e2759622-0ab6-46b7-b434-f0a0f8942dfe/konnectivity-agent/0.log" limit=1024 Jul 27 21:02:54.335407 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:02:54.335339 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-f9e4b23a-openshift-default-75f94f8688-zxhhx"] Jul 27 21:02:54.338575 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:02:54.338558 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-f9e4b23a-openshift-default-75f94f8688-zxhhx" Jul 27 21:02:54.341103 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:02:54.341078 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-f9e4b23a-openshift-default-dockercfg-hfppj\"" Jul 27 21:02:54.359417 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:02:54.359395 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-scx52\" (UniqueName: \"kubernetes.io/projected/82283efa-b666-4a08-b830-da577271b0e6-kube-api-access-scx52\") pod \"e2e-ait-f9e4b23a-openshift-default-75f94f8688-zxhhx\" (UID: \"82283efa-b666-4a08-b830-da577271b0e6\") " pod="openshift-ingress/e2e-ait-f9e4b23a-openshift-default-75f94f8688-zxhhx" Jul 27 21:02:54.359508 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:02:54.359436 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/82283efa-b666-4a08-b830-da577271b0e6-istio-data\") pod \"e2e-ait-f9e4b23a-openshift-default-75f94f8688-zxhhx\" (UID: \"82283efa-b666-4a08-b830-da577271b0e6\") " pod="openshift-ingress/e2e-ait-f9e4b23a-openshift-default-75f94f8688-zxhhx" Jul 27 21:02:54.359562 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:02:54.359512 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/82283efa-b666-4a08-b830-da577271b0e6-istio-envoy\") pod \"e2e-ait-f9e4b23a-openshift-default-75f94f8688-zxhhx\" (UID: \"82283efa-b666-4a08-b830-da577271b0e6\") " pod="openshift-ingress/e2e-ait-f9e4b23a-openshift-default-75f94f8688-zxhhx" Jul 27 21:02:54.359562 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:02:54.359546 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/82283efa-b666-4a08-b830-da577271b0e6-istio-podinfo\") pod \"e2e-ait-f9e4b23a-openshift-default-75f94f8688-zxhhx\" (UID: \"82283efa-b666-4a08-b830-da577271b0e6\") " pod="openshift-ingress/e2e-ait-f9e4b23a-openshift-default-75f94f8688-zxhhx" Jul 27 21:02:54.359641 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:02:54.359586 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/82283efa-b666-4a08-b830-da577271b0e6-workload-socket\") pod \"e2e-ait-f9e4b23a-openshift-default-75f94f8688-zxhhx\" (UID: \"82283efa-b666-4a08-b830-da577271b0e6\") " pod="openshift-ingress/e2e-ait-f9e4b23a-openshift-default-75f94f8688-zxhhx" Jul 27 21:02:54.359675 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:02:54.359633 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/82283efa-b666-4a08-b830-da577271b0e6-workload-certs\") pod \"e2e-ait-f9e4b23a-openshift-default-75f94f8688-zxhhx\" (UID: \"82283efa-b666-4a08-b830-da577271b0e6\") " pod="openshift-ingress/e2e-ait-f9e4b23a-openshift-default-75f94f8688-zxhhx" Jul 27 21:02:54.359675 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:02:54.359663 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/82283efa-b666-4a08-b830-da577271b0e6-istio-token\") pod \"e2e-ait-f9e4b23a-openshift-default-75f94f8688-zxhhx\" (UID: \"82283efa-b666-4a08-b830-da577271b0e6\") " pod="openshift-ingress/e2e-ait-f9e4b23a-openshift-default-75f94f8688-zxhhx" Jul 27 21:02:54.359739 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:02:54.359689 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/82283efa-b666-4a08-b830-da577271b0e6-istiod-ca-cert\") pod \"e2e-ait-f9e4b23a-openshift-default-75f94f8688-zxhhx\" (UID: \"82283efa-b666-4a08-b830-da577271b0e6\") " pod="openshift-ingress/e2e-ait-f9e4b23a-openshift-default-75f94f8688-zxhhx" Jul 27 21:02:54.359739 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:02:54.359722 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/82283efa-b666-4a08-b830-da577271b0e6-credential-socket\") pod \"e2e-ait-f9e4b23a-openshift-default-75f94f8688-zxhhx\" (UID: \"82283efa-b666-4a08-b830-da577271b0e6\") " pod="openshift-ingress/e2e-ait-f9e4b23a-openshift-default-75f94f8688-zxhhx" Jul 27 21:02:54.383568 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:02:54.383542 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbpp5_e2759622-0ab6-46b7-b434-f0a0f8942dfe/konnectivity-agent/0.log" limit=1024 Jul 27 21:02:54.410601 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:02:54.410575 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-f9e4b23a-openshift-default-75f94f8688-zxhhx"] Jul 27 21:02:54.460906 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:02:54.460872 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/82283efa-b666-4a08-b830-da577271b0e6-istio-envoy\") pod \"e2e-ait-f9e4b23a-openshift-default-75f94f8688-zxhhx\" (UID: \"82283efa-b666-4a08-b830-da577271b0e6\") " pod="openshift-ingress/e2e-ait-f9e4b23a-openshift-default-75f94f8688-zxhhx" Jul 27 21:02:54.461071 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:02:54.460914 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/82283efa-b666-4a08-b830-da577271b0e6-istio-podinfo\") pod \"e2e-ait-f9e4b23a-openshift-default-75f94f8688-zxhhx\" (UID: \"82283efa-b666-4a08-b830-da577271b0e6\") " pod="openshift-ingress/e2e-ait-f9e4b23a-openshift-default-75f94f8688-zxhhx" Jul 27 21:02:54.461071 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:02:54.460941 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/82283efa-b666-4a08-b830-da577271b0e6-workload-socket\") pod \"e2e-ait-f9e4b23a-openshift-default-75f94f8688-zxhhx\" (UID: \"82283efa-b666-4a08-b830-da577271b0e6\") " pod="openshift-ingress/e2e-ait-f9e4b23a-openshift-default-75f94f8688-zxhhx" Jul 27 21:02:54.461071 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:02:54.460958 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/82283efa-b666-4a08-b830-da577271b0e6-workload-certs\") pod \"e2e-ait-f9e4b23a-openshift-default-75f94f8688-zxhhx\" (UID: \"82283efa-b666-4a08-b830-da577271b0e6\") " pod="openshift-ingress/e2e-ait-f9e4b23a-openshift-default-75f94f8688-zxhhx" Jul 27 21:02:54.461071 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:02:54.461008 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/82283efa-b666-4a08-b830-da577271b0e6-istio-token\") pod \"e2e-ait-f9e4b23a-openshift-default-75f94f8688-zxhhx\" (UID: \"82283efa-b666-4a08-b830-da577271b0e6\") " pod="openshift-ingress/e2e-ait-f9e4b23a-openshift-default-75f94f8688-zxhhx" Jul 27 21:02:54.461071 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:02:54.461046 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/82283efa-b666-4a08-b830-da577271b0e6-istiod-ca-cert\") pod \"e2e-ait-f9e4b23a-openshift-default-75f94f8688-zxhhx\" (UID: \"82283efa-b666-4a08-b830-da577271b0e6\") " pod="openshift-ingress/e2e-ait-f9e4b23a-openshift-default-75f94f8688-zxhhx" Jul 27 21:02:54.461346 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:02:54.461113 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/82283efa-b666-4a08-b830-da577271b0e6-credential-socket\") pod \"e2e-ait-f9e4b23a-openshift-default-75f94f8688-zxhhx\" (UID: \"82283efa-b666-4a08-b830-da577271b0e6\") " pod="openshift-ingress/e2e-ait-f9e4b23a-openshift-default-75f94f8688-zxhhx" Jul 27 21:02:54.461346 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:02:54.461165 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-scx52\" (UniqueName: \"kubernetes.io/projected/82283efa-b666-4a08-b830-da577271b0e6-kube-api-access-scx52\") pod \"e2e-ait-f9e4b23a-openshift-default-75f94f8688-zxhhx\" (UID: \"82283efa-b666-4a08-b830-da577271b0e6\") " pod="openshift-ingress/e2e-ait-f9e4b23a-openshift-default-75f94f8688-zxhhx" Jul 27 21:02:54.461346 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:02:54.461199 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/82283efa-b666-4a08-b830-da577271b0e6-istio-data\") pod \"e2e-ait-f9e4b23a-openshift-default-75f94f8688-zxhhx\" (UID: \"82283efa-b666-4a08-b830-da577271b0e6\") " pod="openshift-ingress/e2e-ait-f9e4b23a-openshift-default-75f94f8688-zxhhx" Jul 27 21:02:54.461516 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:02:54.461472 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/82283efa-b666-4a08-b830-da577271b0e6-workload-certs\") pod \"e2e-ait-f9e4b23a-openshift-default-75f94f8688-zxhhx\" (UID: \"82283efa-b666-4a08-b830-da577271b0e6\") " pod="openshift-ingress/e2e-ait-f9e4b23a-openshift-default-75f94f8688-zxhhx" Jul 27 21:02:54.461569 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:02:54.461544 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/82283efa-b666-4a08-b830-da577271b0e6-workload-socket\") pod \"e2e-ait-f9e4b23a-openshift-default-75f94f8688-zxhhx\" (UID: \"82283efa-b666-4a08-b830-da577271b0e6\") " pod="openshift-ingress/e2e-ait-f9e4b23a-openshift-default-75f94f8688-zxhhx" Jul 27 21:02:54.461751 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:02:54.461719 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/82283efa-b666-4a08-b830-da577271b0e6-credential-socket\") pod \"e2e-ait-f9e4b23a-openshift-default-75f94f8688-zxhhx\" (UID: \"82283efa-b666-4a08-b830-da577271b0e6\") " pod="openshift-ingress/e2e-ait-f9e4b23a-openshift-default-75f94f8688-zxhhx" Jul 27 21:02:54.461751 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:02:54.461741 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/82283efa-b666-4a08-b830-da577271b0e6-istio-data\") pod \"e2e-ait-f9e4b23a-openshift-default-75f94f8688-zxhhx\" (UID: \"82283efa-b666-4a08-b830-da577271b0e6\") " pod="openshift-ingress/e2e-ait-f9e4b23a-openshift-default-75f94f8688-zxhhx" Jul 27 21:02:54.462002 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:02:54.461977 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/82283efa-b666-4a08-b830-da577271b0e6-istiod-ca-cert\") pod \"e2e-ait-f9e4b23a-openshift-default-75f94f8688-zxhhx\" (UID: \"82283efa-b666-4a08-b830-da577271b0e6\") " pod="openshift-ingress/e2e-ait-f9e4b23a-openshift-default-75f94f8688-zxhhx" Jul 27 21:02:54.463218 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:02:54.463198 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/82283efa-b666-4a08-b830-da577271b0e6-istio-envoy\") pod \"e2e-ait-f9e4b23a-openshift-default-75f94f8688-zxhhx\" (UID: \"82283efa-b666-4a08-b830-da577271b0e6\") " pod="openshift-ingress/e2e-ait-f9e4b23a-openshift-default-75f94f8688-zxhhx" Jul 27 21:02:54.463553 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:02:54.463537 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/82283efa-b666-4a08-b830-da577271b0e6-istio-podinfo\") pod \"e2e-ait-f9e4b23a-openshift-default-75f94f8688-zxhhx\" (UID: \"82283efa-b666-4a08-b830-da577271b0e6\") " pod="openshift-ingress/e2e-ait-f9e4b23a-openshift-default-75f94f8688-zxhhx" Jul 27 21:02:54.476815 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:02:54.476797 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/82283efa-b666-4a08-b830-da577271b0e6-istio-token\") pod \"e2e-ait-f9e4b23a-openshift-default-75f94f8688-zxhhx\" (UID: \"82283efa-b666-4a08-b830-da577271b0e6\") " pod="openshift-ingress/e2e-ait-f9e4b23a-openshift-default-75f94f8688-zxhhx" Jul 27 21:02:54.476999 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:02:54.476982 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-scx52\" (UniqueName: \"kubernetes.io/projected/82283efa-b666-4a08-b830-da577271b0e6-kube-api-access-scx52\") pod \"e2e-ait-f9e4b23a-openshift-default-75f94f8688-zxhhx\" (UID: \"82283efa-b666-4a08-b830-da577271b0e6\") " pod="openshift-ingress/e2e-ait-f9e4b23a-openshift-default-75f94f8688-zxhhx" Jul 27 21:02:54.541803 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:02:54.541774 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbpp5_e2759622-0ab6-46b7-b434-f0a0f8942dfe/konnectivity-agent/0.log" limit=1024 Jul 27 21:02:54.648951 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:02:54.648878 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-f9e4b23a-openshift-default-75f94f8688-zxhhx" Jul 27 21:02:54.785445 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:02:54.785419 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-f9e4b23a-openshift-default-75f94f8688-zxhhx"] Jul 27 21:02:54.788013 ip-10-0-139-2 kubenswrapper[2572]: W0727 21:02:54.787978 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod82283efa_b666_4a08_b830_da577271b0e6.slice/crio-131ed51e82209f86e70f3a7f14370c1d91894051147a5b9a34fe058b5a9d3f9c WatchSource:0}: Error finding container 131ed51e82209f86e70f3a7f14370c1d91894051147a5b9a34fe058b5a9d3f9c: Status 404 returned error can't find the container with id 131ed51e82209f86e70f3a7f14370c1d91894051147a5b9a34fe058b5a9d3f9c Jul 27 21:02:54.789952 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:02:54.789923 2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 27 21:02:54.790006 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:02:54.789988 2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 27 21:02:54.790041 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:02:54.790017 2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 27 21:02:55.758986 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:02:55.758949 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-f9e4b23a-openshift-default-75f94f8688-zxhhx" event={"ID":"82283efa-b666-4a08-b830-da577271b0e6","Type":"ContainerStarted","Data":"d19549479fd89bdf02df01718706f45dca5fdabf7ebc6445c52e543550facf48"} Jul 27 21:02:55.759191 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:02:55.759004 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-f9e4b23a-openshift-default-75f94f8688-zxhhx" event={"ID":"82283efa-b666-4a08-b830-da577271b0e6","Type":"ContainerStarted","Data":"131ed51e82209f86e70f3a7f14370c1d91894051147a5b9a34fe058b5a9d3f9c"} Jul 27 21:02:55.785681 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:02:55.785636 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-f9e4b23a-openshift-default-75f94f8688-zxhhx" podStartSLOduration=1.7856218369999999 podStartE2EDuration="1.785621837s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 21:02:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 21:02:55.783425406 +0000 UTC m=+1709.252968432" watchObservedRunningTime="2026-07-27 21:02:55.785621837 +0000 UTC m=+1709.255164846" Jul 27 21:02:56.649413 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:02:56.649375 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-f9e4b23a-openshift-default-75f94f8688-zxhhx" Jul 27 21:02:56.654622 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:02:56.654594 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-f9e4b23a-openshift-default-75f94f8688-zxhhx" Jul 27 21:02:56.763152 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:02:56.763117 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-f9e4b23a-openshift-default-75f94f8688-zxhhx" Jul 27 21:02:56.763944 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:02:56.763929 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-f9e4b23a-openshift-default-75f94f8688-zxhhx" Jul 27 21:02:57.210514 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:02:57.210479 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbpp5_e2759622-0ab6-46b7-b434-f0a0f8942dfe/konnectivity-agent/0.log" limit=1024 Jul 27 21:02:57.357070 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:02:57.357032 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbpp5_e2759622-0ab6-46b7-b434-f0a0f8942dfe/konnectivity-agent/0.log" limit=1024 Jul 27 21:02:57.478647 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:02:57.478566 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbpp5_e2759622-0ab6-46b7-b434-f0a0f8942dfe/konnectivity-agent/0.log" limit=1024 Jul 27 21:02:57.705506 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:02:57.705471 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbpp5_e2759622-0ab6-46b7-b434-f0a0f8942dfe/konnectivity-agent/0.log" limit=1024 Jul 27 21:02:57.917933 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:02:57.917894 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbpp5_e2759622-0ab6-46b7-b434-f0a0f8942dfe/konnectivity-agent/0.log" limit=1024 Jul 27 21:02:58.019473 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:02:58.019445 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbpp5_e2759622-0ab6-46b7-b434-f0a0f8942dfe/konnectivity-agent/0.log" limit=1024 Jul 27 21:02:58.031715 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:02:58.031688 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-f9e4b23a-75fc47cb8-gkzcw"] Jul 27 21:02:58.034743 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:02:58.034729 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-f9e4b23a-75fc47cb8-gkzcw" Jul 27 21:02:58.036911 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:02:58.036890 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ait-f9e4b23a\"" Jul 27 21:02:58.037012 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:02:58.036961 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ait-f9e4b23a-dockercfg-jh6pv\"" Jul 27 21:02:58.050500 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:02:58.050470 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-f9e4b23a-75fc47cb8-gkzcw"] Jul 27 21:02:58.060111 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:02:58.060083 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-f9e4b23a-bdcb685dd-pg2qf"] Jul 27 21:02:58.063265 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:02:58.063248 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-f9e4b23a-bdcb685dd-pg2qf" Jul 27 21:02:58.079385 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:02:58.079353 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-f9e4b23a-bdcb685dd-pg2qf"] Jul 27 21:02:58.091757 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:02:58.091733 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/07cf2cfe-e57f-470e-94c5-b1c1ad87c060-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-f9e4b23a-75fc47cb8-gkzcw\" (UID: \"07cf2cfe-e57f-470e-94c5-b1c1ad87c060\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-f9e4b23a-75fc47cb8-gkzcw" Jul 27 21:02:58.091897 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:02:58.091799 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c6swx\" (UniqueName: \"kubernetes.io/projected/9a712d3d-467c-44e2-8d56-d1c533c713d1-kube-api-access-c6swx\") pod \"payload-processing-e2e-ait-f9e4b23a-bdcb685dd-pg2qf\" (UID: \"9a712d3d-467c-44e2-8d56-d1c533c713d1\") " pod="openshift-ingress/payload-processing-e2e-ait-f9e4b23a-bdcb685dd-pg2qf" Jul 27 21:02:58.091897 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:02:58.091855 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9a712d3d-467c-44e2-8d56-d1c533c713d1-plugins-config-volume\") pod \"payload-processing-e2e-ait-f9e4b23a-bdcb685dd-pg2qf\" (UID: \"9a712d3d-467c-44e2-8d56-d1c533c713d1\") " pod="openshift-ingress/payload-processing-e2e-ait-f9e4b23a-bdcb685dd-pg2qf" Jul 27 21:02:58.091999 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:02:58.091916 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hv956\" (UniqueName: \"kubernetes.io/projected/07cf2cfe-e57f-470e-94c5-b1c1ad87c060-kube-api-access-hv956\") pod \"payload-pre-processing-e2e-ait-f9e4b23a-75fc47cb8-gkzcw\" (UID: \"07cf2cfe-e57f-470e-94c5-b1c1ad87c060\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-f9e4b23a-75fc47cb8-gkzcw" Jul 27 21:02:58.192536 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:02:58.192453 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c6swx\" (UniqueName: \"kubernetes.io/projected/9a712d3d-467c-44e2-8d56-d1c533c713d1-kube-api-access-c6swx\") pod \"payload-processing-e2e-ait-f9e4b23a-bdcb685dd-pg2qf\" (UID: \"9a712d3d-467c-44e2-8d56-d1c533c713d1\") " pod="openshift-ingress/payload-processing-e2e-ait-f9e4b23a-bdcb685dd-pg2qf" Jul 27 21:02:58.192536 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:02:58.192502 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9a712d3d-467c-44e2-8d56-d1c533c713d1-plugins-config-volume\") pod \"payload-processing-e2e-ait-f9e4b23a-bdcb685dd-pg2qf\" (UID: \"9a712d3d-467c-44e2-8d56-d1c533c713d1\") " pod="openshift-ingress/payload-processing-e2e-ait-f9e4b23a-bdcb685dd-pg2qf" Jul 27 21:02:58.192708 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:02:58.192560 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hv956\" (UniqueName: \"kubernetes.io/projected/07cf2cfe-e57f-470e-94c5-b1c1ad87c060-kube-api-access-hv956\") pod \"payload-pre-processing-e2e-ait-f9e4b23a-75fc47cb8-gkzcw\" (UID: \"07cf2cfe-e57f-470e-94c5-b1c1ad87c060\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-f9e4b23a-75fc47cb8-gkzcw" Jul 27 21:02:58.192708 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:02:58.192608 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/07cf2cfe-e57f-470e-94c5-b1c1ad87c060-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-f9e4b23a-75fc47cb8-gkzcw\" (UID: \"07cf2cfe-e57f-470e-94c5-b1c1ad87c060\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-f9e4b23a-75fc47cb8-gkzcw" Jul 27 21:02:58.193289 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:02:58.193270 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9a712d3d-467c-44e2-8d56-d1c533c713d1-plugins-config-volume\") pod \"payload-processing-e2e-ait-f9e4b23a-bdcb685dd-pg2qf\" (UID: \"9a712d3d-467c-44e2-8d56-d1c533c713d1\") " pod="openshift-ingress/payload-processing-e2e-ait-f9e4b23a-bdcb685dd-pg2qf" Jul 27 21:02:58.193351 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:02:58.193298 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/07cf2cfe-e57f-470e-94c5-b1c1ad87c060-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-f9e4b23a-75fc47cb8-gkzcw\" (UID: \"07cf2cfe-e57f-470e-94c5-b1c1ad87c060\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-f9e4b23a-75fc47cb8-gkzcw" Jul 27 21:02:58.202096 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:02:58.202075 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hv956\" (UniqueName: \"kubernetes.io/projected/07cf2cfe-e57f-470e-94c5-b1c1ad87c060-kube-api-access-hv956\") pod \"payload-pre-processing-e2e-ait-f9e4b23a-75fc47cb8-gkzcw\" (UID: \"07cf2cfe-e57f-470e-94c5-b1c1ad87c060\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-f9e4b23a-75fc47cb8-gkzcw" Jul 27 21:02:58.202229 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:02:58.202110 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c6swx\" (UniqueName: \"kubernetes.io/projected/9a712d3d-467c-44e2-8d56-d1c533c713d1-kube-api-access-c6swx\") pod \"payload-processing-e2e-ait-f9e4b23a-bdcb685dd-pg2qf\" (UID: \"9a712d3d-467c-44e2-8d56-d1c533c713d1\") " pod="openshift-ingress/payload-processing-e2e-ait-f9e4b23a-bdcb685dd-pg2qf" Jul 27 21:02:58.346052 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:02:58.346028 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-f9e4b23a-75fc47cb8-gkzcw" Jul 27 21:02:58.374049 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:02:58.374026 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-f9e4b23a-bdcb685dd-pg2qf" Jul 27 21:02:58.490599 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:02:58.490570 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-f9e4b23a-75fc47cb8-gkzcw"] Jul 27 21:02:58.493620 ip-10-0-139-2 kubenswrapper[2572]: W0727 21:02:58.493595 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod07cf2cfe_e57f_470e_94c5_b1c1ad87c060.slice/crio-6235c6cfd6acdd9aac0ab08cbc93680f95e0d499b16b3ced5e6cbc54d8a5c065 WatchSource:0}: Error finding container 6235c6cfd6acdd9aac0ab08cbc93680f95e0d499b16b3ced5e6cbc54d8a5c065: Status 404 returned error can't find the container with id 6235c6cfd6acdd9aac0ab08cbc93680f95e0d499b16b3ced5e6cbc54d8a5c065 Jul 27 21:02:58.723828 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:02:58.723782 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-f9e4b23a-bdcb685dd-pg2qf"] Jul 27 21:02:58.726475 ip-10-0-139-2 kubenswrapper[2572]: W0727 21:02:58.726444 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9a712d3d_467c_44e2_8d56_d1c533c713d1.slice/crio-15d7172818e93bb8fb622cbd44ed6de60f23c900126addb18a64ccaa2a6d0bbd WatchSource:0}: Error finding container 15d7172818e93bb8fb622cbd44ed6de60f23c900126addb18a64ccaa2a6d0bbd: Status 404 returned error can't find the container with id 15d7172818e93bb8fb622cbd44ed6de60f23c900126addb18a64ccaa2a6d0bbd Jul 27 21:02:58.772514 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:02:58.772484 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-f9e4b23a-75fc47cb8-gkzcw" event={"ID":"07cf2cfe-e57f-470e-94c5-b1c1ad87c060","Type":"ContainerStarted","Data":"ed96e7c12a74c3d8003995dcd81ebd90a68aa25793fdc725292ce88d53e65dd2"} Jul 27 21:02:58.772659 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:02:58.772553 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-f9e4b23a-75fc47cb8-gkzcw" event={"ID":"07cf2cfe-e57f-470e-94c5-b1c1ad87c060","Type":"ContainerStarted","Data":"6235c6cfd6acdd9aac0ab08cbc93680f95e0d499b16b3ced5e6cbc54d8a5c065"} Jul 27 21:02:58.772659 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:02:58.772584 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ait-f9e4b23a-75fc47cb8-gkzcw" Jul 27 21:02:58.774247 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:02:58.774222 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-f9e4b23a-bdcb685dd-pg2qf" event={"ID":"9a712d3d-467c-44e2-8d56-d1c533c713d1","Type":"ContainerStarted","Data":"15d7172818e93bb8fb622cbd44ed6de60f23c900126addb18a64ccaa2a6d0bbd"} Jul 27 21:02:58.790254 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:02:58.790212 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ait-f9e4b23a-75fc47cb8-gkzcw" podStartSLOduration=0.790193976 podStartE2EDuration="790.193976ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 21:02:58 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 21:02:58.788999441 +0000 UTC m=+1712.258542450" watchObservedRunningTime="2026-07-27 21:02:58.790193976 +0000 UTC m=+1712.259736988" Jul 27 21:02:59.780187 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:02:59.780153 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-f9e4b23a-bdcb685dd-pg2qf" event={"ID":"9a712d3d-467c-44e2-8d56-d1c533c713d1","Type":"ContainerStarted","Data":"44fb4e509cd7e5a8c60758a37fdf0901bd5abae52dea5994d781ff64520c949f"} Jul 27 21:02:59.799410 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:02:59.799363 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ait-f9e4b23a-bdcb685dd-pg2qf" podStartSLOduration=1.799348261 podStartE2EDuration="1.799348261s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 21:02:58 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 21:02:59.797914025 +0000 UTC m=+1713.267457049" watchObservedRunningTime="2026-07-27 21:02:59.799348261 +0000 UTC m=+1713.268891271" Jul 27 21:03:00.784678 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:03:00.784645 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ait-f9e4b23a-bdcb685dd-pg2qf" Jul 27 21:03:09.783200 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:03:09.783170 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ait-f9e4b23a-75fc47cb8-gkzcw" Jul 27 21:03:11.791393 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:03:11.791298 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ait-f9e4b23a-bdcb685dd-pg2qf" Jul 27 21:03:12.434068 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:03:12.434027 2572 patch_prober.go:28] interesting pod/e2e-ait-f9e4b23a-openshift-default-75f94f8688-zxhhx container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.23:15021/healthz/ready\": read tcp 10.133.0.2:34550->10.133.0.23:15021: read: connection reset by peer" start-of-body= Jul 27 21:03:12.434248 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:03:12.434117 2572 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ait-f9e4b23a-openshift-default-75f94f8688-zxhhx" podUID="82283efa-b666-4a08-b830-da577271b0e6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.23:15021/healthz/ready\": read tcp 10.133.0.2:34550->10.133.0.23:15021: read: connection reset by peer" Jul 27 21:03:12.836356 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:03:12.836305 2572 generic.go:356] "Generic (PLEG): container finished" podID="82283efa-b666-4a08-b830-da577271b0e6" containerID="d19549479fd89bdf02df01718706f45dca5fdabf7ebc6445c52e543550facf48" exitCode=0 Jul 27 21:03:12.836731 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:03:12.836377 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-f9e4b23a-openshift-default-75f94f8688-zxhhx" event={"ID":"82283efa-b666-4a08-b830-da577271b0e6","Type":"ContainerDied","Data":"d19549479fd89bdf02df01718706f45dca5fdabf7ebc6445c52e543550facf48"} Jul 27 21:03:12.836870 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:03:12.836853 2572 scope.go:117] "RemoveContainer" containerID="d19549479fd89bdf02df01718706f45dca5fdabf7ebc6445c52e543550facf48" Jul 27 21:03:12.837846 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:03:12.837818 2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 27 21:03:12.837906 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:03:12.837886 2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 27 21:03:12.837940 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:03:12.837925 2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 27 21:03:13.858086 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:03:13.858045 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-f9e4b23a-openshift-default-75f94f8688-zxhhx" event={"ID":"82283efa-b666-4a08-b830-da577271b0e6","Type":"ContainerStarted","Data":"0c4392bb1e680bcb84c92ff2fc4bbe31f43cdc0f979377fb3b5a9246645bb9dd"} Jul 27 21:03:14.649547 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:03:14.649449 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-f9e4b23a-openshift-default-75f94f8688-zxhhx" Jul 27 21:03:14.649547 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:03:14.649507 2572 patch_prober.go:28] interesting pod/e2e-ait-f9e4b23a-openshift-default-75f94f8688-zxhhx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.23:15021/healthz/ready\": dial tcp 10.133.0.23:15021: connect: connection refused" start-of-body= Jul 27 21:03:14.649858 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:03:14.649558 2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-f9e4b23a-openshift-default-75f94f8688-zxhhx" podUID="82283efa-b666-4a08-b830-da577271b0e6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.23:15021/healthz/ready\": dial tcp 10.133.0.23:15021: connect: connection refused" Jul 27 21:03:15.650110 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:03:15.650073 2572 patch_prober.go:28] interesting pod/e2e-ait-f9e4b23a-openshift-default-75f94f8688-zxhhx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.23:15021/healthz/ready\": dial tcp 10.133.0.23:15021: connect: connection refused" start-of-body= Jul 27 21:03:15.651078 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:03:15.650676 2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-f9e4b23a-openshift-default-75f94f8688-zxhhx" podUID="82283efa-b666-4a08-b830-da577271b0e6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.23:15021/healthz/ready\": dial tcp 10.133.0.23:15021: connect: connection refused" Jul 27 21:03:16.649915 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:03:16.649869 2572 patch_prober.go:28] interesting pod/e2e-ait-f9e4b23a-openshift-default-75f94f8688-zxhhx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.23:15021/healthz/ready\": dial tcp 10.133.0.23:15021: connect: connection refused" start-of-body= Jul 27 21:03:16.650108 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:03:16.649937 2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-f9e4b23a-openshift-default-75f94f8688-zxhhx" podUID="82283efa-b666-4a08-b830-da577271b0e6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.23:15021/healthz/ready\": dial tcp 10.133.0.23:15021: connect: connection refused" Jul 27 21:03:17.649440 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:03:17.649396 2572 patch_prober.go:28] interesting pod/e2e-ait-f9e4b23a-openshift-default-75f94f8688-zxhhx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.23:15021/healthz/ready\": dial tcp 10.133.0.23:15021: connect: connection refused" start-of-body= Jul 27 21:03:17.649835 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:03:17.649467 2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-f9e4b23a-openshift-default-75f94f8688-zxhhx" podUID="82283efa-b666-4a08-b830-da577271b0e6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.23:15021/healthz/ready\": dial tcp 10.133.0.23:15021: connect: connection refused" Jul 27 21:03:18.652818 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:03:18.652786 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-f9e4b23a-openshift-default-75f94f8688-zxhhx" Jul 27 21:03:18.653273 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:03:18.653033 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-f9e4b23a-openshift-default-75f94f8688-zxhhx" Jul 27 21:03:18.653720 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:03:18.653700 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-f9e4b23a-openshift-default-75f94f8688-zxhhx" Jul 27 21:03:33.259061 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:03:33.259022 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbpp5_e2759622-0ab6-46b7-b434-f0a0f8942dfe/konnectivity-agent/0.log" limit=1024 Jul 27 21:03:33.290288 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:03:33.290255 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-f9e4b23a-bdcb685dd-pg2qf"] Jul 27 21:03:33.290553 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:03:33.290513 2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ait-f9e4b23a-bdcb685dd-pg2qf" podUID="9a712d3d-467c-44e2-8d56-d1c533c713d1" containerName="payload-processing" containerID="cri-o://44fb4e509cd7e5a8c60758a37fdf0901bd5abae52dea5994d781ff64520c949f" gracePeriod=30 Jul 27 21:03:33.295532 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:03:33.295506 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-f9e4b23a-75fc47cb8-gkzcw"] Jul 27 21:03:33.295804 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:03:33.295715 2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ait-f9e4b23a-75fc47cb8-gkzcw" podUID="07cf2cfe-e57f-470e-94c5-b1c1ad87c060" containerName="payload-pre-processing" containerID="cri-o://ed96e7c12a74c3d8003995dcd81ebd90a68aa25793fdc725292ce88d53e65dd2" gracePeriod=30 Jul 27 21:03:33.540329 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:03:33.540281 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-f9e4b23a-bdcb685dd-pg2qf" Jul 27 21:03:33.584635 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:03:33.584612 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-f9e4b23a-75fc47cb8-gkzcw" Jul 27 21:03:33.717922 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:03:33.717883 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-c6swx\" (UniqueName: \"kubernetes.io/projected/9a712d3d-467c-44e2-8d56-d1c533c713d1-kube-api-access-c6swx\") pod \"9a712d3d-467c-44e2-8d56-d1c533c713d1\" (UID: \"9a712d3d-467c-44e2-8d56-d1c533c713d1\") " Jul 27 21:03:33.718095 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:03:33.717938 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hv956\" (UniqueName: \"kubernetes.io/projected/07cf2cfe-e57f-470e-94c5-b1c1ad87c060-kube-api-access-hv956\") pod \"07cf2cfe-e57f-470e-94c5-b1c1ad87c060\" (UID: \"07cf2cfe-e57f-470e-94c5-b1c1ad87c060\") " Jul 27 21:03:33.718095 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:03:33.717969 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/07cf2cfe-e57f-470e-94c5-b1c1ad87c060-plugins-config-volume\") pod \"07cf2cfe-e57f-470e-94c5-b1c1ad87c060\" (UID: \"07cf2cfe-e57f-470e-94c5-b1c1ad87c060\") " Jul 27 21:03:33.718095 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:03:33.717991 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9a712d3d-467c-44e2-8d56-d1c533c713d1-plugins-config-volume\") pod \"9a712d3d-467c-44e2-8d56-d1c533c713d1\" (UID: \"9a712d3d-467c-44e2-8d56-d1c533c713d1\") " Jul 27 21:03:33.718435 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:03:33.718409 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/07cf2cfe-e57f-470e-94c5-b1c1ad87c060-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "07cf2cfe-e57f-470e-94c5-b1c1ad87c060" (UID: "07cf2cfe-e57f-470e-94c5-b1c1ad87c060"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 27 21:03:33.718509 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:03:33.718414 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9a712d3d-467c-44e2-8d56-d1c533c713d1-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "9a712d3d-467c-44e2-8d56-d1c533c713d1" (UID: "9a712d3d-467c-44e2-8d56-d1c533c713d1"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 27 21:03:33.720216 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:03:33.720197 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/07cf2cfe-e57f-470e-94c5-b1c1ad87c060-kube-api-access-hv956" (OuterVolumeSpecName: "kube-api-access-hv956") pod "07cf2cfe-e57f-470e-94c5-b1c1ad87c060" (UID: "07cf2cfe-e57f-470e-94c5-b1c1ad87c060"). InnerVolumeSpecName "kube-api-access-hv956". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 27 21:03:33.720263 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:03:33.720219 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9a712d3d-467c-44e2-8d56-d1c533c713d1-kube-api-access-c6swx" (OuterVolumeSpecName: "kube-api-access-c6swx") pod "9a712d3d-467c-44e2-8d56-d1c533c713d1" (UID: "9a712d3d-467c-44e2-8d56-d1c533c713d1"). InnerVolumeSpecName "kube-api-access-c6swx". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 27 21:03:33.819260 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:03:33.819191 2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-c6swx\" (UniqueName: \"kubernetes.io/projected/9a712d3d-467c-44e2-8d56-d1c533c713d1-kube-api-access-c6swx\") on node \"ip-10-0-139-2.ec2.internal\" DevicePath \"\"" Jul 27 21:03:33.819260 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:03:33.819214 2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hv956\" (UniqueName: \"kubernetes.io/projected/07cf2cfe-e57f-470e-94c5-b1c1ad87c060-kube-api-access-hv956\") on node \"ip-10-0-139-2.ec2.internal\" DevicePath \"\"" Jul 27 21:03:33.819260 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:03:33.819225 2572 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/07cf2cfe-e57f-470e-94c5-b1c1ad87c060-plugins-config-volume\") on node \"ip-10-0-139-2.ec2.internal\" DevicePath \"\"" Jul 27 21:03:33.819260 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:03:33.819233 2572 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9a712d3d-467c-44e2-8d56-d1c533c713d1-plugins-config-volume\") on node \"ip-10-0-139-2.ec2.internal\" DevicePath \"\"" Jul 27 21:03:33.948256 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:03:33.948219 2572 generic.go:356] "Generic (PLEG): container finished" podID="07cf2cfe-e57f-470e-94c5-b1c1ad87c060" containerID="ed96e7c12a74c3d8003995dcd81ebd90a68aa25793fdc725292ce88d53e65dd2" exitCode=0 Jul 27 21:03:33.948434 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:03:33.948269 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-f9e4b23a-75fc47cb8-gkzcw" Jul 27 21:03:33.948434 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:03:33.948301 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-f9e4b23a-75fc47cb8-gkzcw" event={"ID":"07cf2cfe-e57f-470e-94c5-b1c1ad87c060","Type":"ContainerDied","Data":"ed96e7c12a74c3d8003995dcd81ebd90a68aa25793fdc725292ce88d53e65dd2"} Jul 27 21:03:33.948434 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:03:33.948361 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-f9e4b23a-75fc47cb8-gkzcw" event={"ID":"07cf2cfe-e57f-470e-94c5-b1c1ad87c060","Type":"ContainerDied","Data":"6235c6cfd6acdd9aac0ab08cbc93680f95e0d499b16b3ced5e6cbc54d8a5c065"} Jul 27 21:03:33.948434 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:03:33.948384 2572 scope.go:117] "RemoveContainer" containerID="ed96e7c12a74c3d8003995dcd81ebd90a68aa25793fdc725292ce88d53e65dd2" Jul 27 21:03:33.952422 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:03:33.952299 2572 generic.go:356] "Generic (PLEG): container finished" podID="9a712d3d-467c-44e2-8d56-d1c533c713d1" containerID="44fb4e509cd7e5a8c60758a37fdf0901bd5abae52dea5994d781ff64520c949f" exitCode=0 Jul 27 21:03:33.952422 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:03:33.952358 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-f9e4b23a-bdcb685dd-pg2qf" Jul 27 21:03:33.952422 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:03:33.952366 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-f9e4b23a-bdcb685dd-pg2qf" event={"ID":"9a712d3d-467c-44e2-8d56-d1c533c713d1","Type":"ContainerDied","Data":"44fb4e509cd7e5a8c60758a37fdf0901bd5abae52dea5994d781ff64520c949f"} Jul 27 21:03:33.952422 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:03:33.952417 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-f9e4b23a-bdcb685dd-pg2qf" event={"ID":"9a712d3d-467c-44e2-8d56-d1c533c713d1","Type":"ContainerDied","Data":"15d7172818e93bb8fb622cbd44ed6de60f23c900126addb18a64ccaa2a6d0bbd"} Jul 27 21:03:33.960721 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:03:33.960703 2572 scope.go:117] "RemoveContainer" containerID="ed96e7c12a74c3d8003995dcd81ebd90a68aa25793fdc725292ce88d53e65dd2" Jul 27 21:03:33.960988 ip-10-0-139-2 kubenswrapper[2572]: E0727 21:03:33.960960 2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ed96e7c12a74c3d8003995dcd81ebd90a68aa25793fdc725292ce88d53e65dd2\": container with ID starting with ed96e7c12a74c3d8003995dcd81ebd90a68aa25793fdc725292ce88d53e65dd2 not found: ID does not exist" containerID="ed96e7c12a74c3d8003995dcd81ebd90a68aa25793fdc725292ce88d53e65dd2" Jul 27 21:03:33.961090 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:03:33.960997 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ed96e7c12a74c3d8003995dcd81ebd90a68aa25793fdc725292ce88d53e65dd2"} err="failed to get container status \"ed96e7c12a74c3d8003995dcd81ebd90a68aa25793fdc725292ce88d53e65dd2\": rpc error: code = NotFound desc = could not find container \"ed96e7c12a74c3d8003995dcd81ebd90a68aa25793fdc725292ce88d53e65dd2\": container with ID starting with ed96e7c12a74c3d8003995dcd81ebd90a68aa25793fdc725292ce88d53e65dd2 not found: ID does not exist" Jul 27 21:03:33.961090 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:03:33.961031 2572 scope.go:117] "RemoveContainer" containerID="44fb4e509cd7e5a8c60758a37fdf0901bd5abae52dea5994d781ff64520c949f" Jul 27 21:03:33.968071 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:03:33.968056 2572 scope.go:117] "RemoveContainer" containerID="44fb4e509cd7e5a8c60758a37fdf0901bd5abae52dea5994d781ff64520c949f" Jul 27 21:03:33.968284 ip-10-0-139-2 kubenswrapper[2572]: E0727 21:03:33.968266 2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"44fb4e509cd7e5a8c60758a37fdf0901bd5abae52dea5994d781ff64520c949f\": container with ID starting with 44fb4e509cd7e5a8c60758a37fdf0901bd5abae52dea5994d781ff64520c949f not found: ID does not exist" containerID="44fb4e509cd7e5a8c60758a37fdf0901bd5abae52dea5994d781ff64520c949f" Jul 27 21:03:33.968352 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:03:33.968293 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"44fb4e509cd7e5a8c60758a37fdf0901bd5abae52dea5994d781ff64520c949f"} err="failed to get container status \"44fb4e509cd7e5a8c60758a37fdf0901bd5abae52dea5994d781ff64520c949f\": rpc error: code = NotFound desc = could not find container \"44fb4e509cd7e5a8c60758a37fdf0901bd5abae52dea5994d781ff64520c949f\": container with ID starting with 44fb4e509cd7e5a8c60758a37fdf0901bd5abae52dea5994d781ff64520c949f not found: ID does not exist" Jul 27 21:03:33.973262 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:03:33.973245 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-f9e4b23a-75fc47cb8-gkzcw"] Jul 27 21:03:33.981861 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:03:33.981841 2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-f9e4b23a-75fc47cb8-gkzcw"] Jul 27 21:03:33.992230 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:03:33.992209 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-f9e4b23a-bdcb685dd-pg2qf"] Jul 27 21:03:33.998554 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:03:33.998533 2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-f9e4b23a-bdcb685dd-pg2qf"] Jul 27 21:03:34.510195 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:03:34.510161 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbpp5_e2759622-0ab6-46b7-b434-f0a0f8942dfe/konnectivity-agent/0.log" limit=1024 Jul 27 21:03:35.077560 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:03:35.077529 2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="07cf2cfe-e57f-470e-94c5-b1c1ad87c060" path="/var/lib/kubelet/pods/07cf2cfe-e57f-470e-94c5-b1c1ad87c060/volumes" Jul 27 21:03:35.077896 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:03:35.077884 2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9a712d3d-467c-44e2-8d56-d1c533c713d1" path="/var/lib/kubelet/pods/9a712d3d-467c-44e2-8d56-d1c533c713d1/volumes" Jul 27 21:03:37.868970 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:03:37.868935 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbpp5_e2759622-0ab6-46b7-b434-f0a0f8942dfe/konnectivity-agent/0.log" limit=1024 Jul 27 21:03:37.999378 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:03:37.999344 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-f9e4b23a-openshift-default-75f94f8688-zxhhx"] Jul 27 21:03:37.999616 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:03:37.999591 2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-f9e4b23a-openshift-default-75f94f8688-zxhhx" podUID="82283efa-b666-4a08-b830-da577271b0e6" containerName="istio-proxy" containerID="cri-o://0c4392bb1e680bcb84c92ff2fc4bbe31f43cdc0f979377fb3b5a9246645bb9dd" gracePeriod=30 Jul 27 21:03:38.019746 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:03:38.019689 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbpp5_e2759622-0ab6-46b7-b434-f0a0f8942dfe/konnectivity-agent/0.log" limit=1024 Jul 27 21:03:38.264349 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:03:38.264262 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbpp5_e2759622-0ab6-46b7-b434-f0a0f8942dfe/konnectivity-agent/0.log" limit=1024 Jul 27 21:03:38.538676 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:03:38.538645 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbpp5_e2759622-0ab6-46b7-b434-f0a0f8942dfe/konnectivity-agent/0.log" limit=1024 Jul 27 21:03:38.637842 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:03:38.637811 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbpp5_e2759622-0ab6-46b7-b434-f0a0f8942dfe/konnectivity-agent/0.log" limit=1024 Jul 27 21:03:38.754520 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:03:38.754491 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbpp5_e2759622-0ab6-46b7-b434-f0a0f8942dfe/konnectivity-agent/0.log" limit=1024 Jul 27 21:03:39.038695 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:03:39.038661 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-migrate-4d7f566d-gw-openshift-default-65f6c88dd-fgz69"] Jul 27 21:03:39.039038 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:03:39.038977 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="07cf2cfe-e57f-470e-94c5-b1c1ad87c060" containerName="payload-pre-processing" Jul 27 21:03:39.039038 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:03:39.038989 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="07cf2cfe-e57f-470e-94c5-b1c1ad87c060" containerName="payload-pre-processing" Jul 27 21:03:39.039038 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:03:39.039009 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9a712d3d-467c-44e2-8d56-d1c533c713d1" containerName="payload-processing" Jul 27 21:03:39.039038 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:03:39.039015 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="9a712d3d-467c-44e2-8d56-d1c533c713d1" containerName="payload-processing" Jul 27 21:03:39.039158 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:03:39.039063 2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="9a712d3d-467c-44e2-8d56-d1c533c713d1" containerName="payload-processing" Jul 27 21:03:39.039158 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:03:39.039074 2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="07cf2cfe-e57f-470e-94c5-b1c1ad87c060" containerName="payload-pre-processing" Jul 27 21:03:39.043731 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:03:39.043710 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-4d7f566d-gw-openshift-default-65f6c88dd-fgz69" Jul 27 21:03:39.045858 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:03:39.045839 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-migrate-4d7f566d-gw-openshift-default-dockercfg-mc2x5\"" Jul 27 21:03:39.056761 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:03:39.056738 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-migrate-4d7f566d-gw-openshift-default-65f6c88dd-fgz69"] Jul 27 21:03:39.063017 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:03:39.062992 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/261c79d1-3c9d-466b-b981-2d3c4127c115-credential-socket\") pod \"e2e-migrate-4d7f566d-gw-openshift-default-65f6c88dd-fgz69\" (UID: \"261c79d1-3c9d-466b-b981-2d3c4127c115\") " pod="openshift-ingress/e2e-migrate-4d7f566d-gw-openshift-default-65f6c88dd-fgz69" Jul 27 21:03:39.063111 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:03:39.063031 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/261c79d1-3c9d-466b-b981-2d3c4127c115-istio-envoy\") pod \"e2e-migrate-4d7f566d-gw-openshift-default-65f6c88dd-fgz69\" (UID: \"261c79d1-3c9d-466b-b981-2d3c4127c115\") " pod="openshift-ingress/e2e-migrate-4d7f566d-gw-openshift-default-65f6c88dd-fgz69" Jul 27 21:03:39.063111 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:03:39.063058 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/261c79d1-3c9d-466b-b981-2d3c4127c115-istio-data\") pod \"e2e-migrate-4d7f566d-gw-openshift-default-65f6c88dd-fgz69\" (UID: \"261c79d1-3c9d-466b-b981-2d3c4127c115\") " pod="openshift-ingress/e2e-migrate-4d7f566d-gw-openshift-default-65f6c88dd-fgz69" Jul 27 21:03:39.063111 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:03:39.063100 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zkkrv\" (UniqueName: \"kubernetes.io/projected/261c79d1-3c9d-466b-b981-2d3c4127c115-kube-api-access-zkkrv\") pod \"e2e-migrate-4d7f566d-gw-openshift-default-65f6c88dd-fgz69\" (UID: \"261c79d1-3c9d-466b-b981-2d3c4127c115\") " pod="openshift-ingress/e2e-migrate-4d7f566d-gw-openshift-default-65f6c88dd-fgz69" Jul 27 21:03:39.063208 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:03:39.063167 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/261c79d1-3c9d-466b-b981-2d3c4127c115-istio-podinfo\") pod \"e2e-migrate-4d7f566d-gw-openshift-default-65f6c88dd-fgz69\" (UID: \"261c79d1-3c9d-466b-b981-2d3c4127c115\") " pod="openshift-ingress/e2e-migrate-4d7f566d-gw-openshift-default-65f6c88dd-fgz69" Jul 27 21:03:39.063251 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:03:39.063209 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/261c79d1-3c9d-466b-b981-2d3c4127c115-workload-socket\") pod \"e2e-migrate-4d7f566d-gw-openshift-default-65f6c88dd-fgz69\" (UID: \"261c79d1-3c9d-466b-b981-2d3c4127c115\") " pod="openshift-ingress/e2e-migrate-4d7f566d-gw-openshift-default-65f6c88dd-fgz69" Jul 27 21:03:39.063251 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:03:39.063233 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/261c79d1-3c9d-466b-b981-2d3c4127c115-istiod-ca-cert\") pod \"e2e-migrate-4d7f566d-gw-openshift-default-65f6c88dd-fgz69\" (UID: \"261c79d1-3c9d-466b-b981-2d3c4127c115\") " pod="openshift-ingress/e2e-migrate-4d7f566d-gw-openshift-default-65f6c88dd-fgz69" Jul 27 21:03:39.063311 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:03:39.063259 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/261c79d1-3c9d-466b-b981-2d3c4127c115-istio-token\") pod \"e2e-migrate-4d7f566d-gw-openshift-default-65f6c88dd-fgz69\" (UID: \"261c79d1-3c9d-466b-b981-2d3c4127c115\") " pod="openshift-ingress/e2e-migrate-4d7f566d-gw-openshift-default-65f6c88dd-fgz69" Jul 27 21:03:39.063311 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:03:39.063300 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/261c79d1-3c9d-466b-b981-2d3c4127c115-workload-certs\") pod \"e2e-migrate-4d7f566d-gw-openshift-default-65f6c88dd-fgz69\" (UID: \"261c79d1-3c9d-466b-b981-2d3c4127c115\") " pod="openshift-ingress/e2e-migrate-4d7f566d-gw-openshift-default-65f6c88dd-fgz69" Jul 27 21:03:39.064295 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:03:39.064267 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbpp5_e2759622-0ab6-46b7-b434-f0a0f8942dfe/konnectivity-agent/0.log" limit=1024 Jul 27 21:03:39.163980 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:03:39.163948 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zkkrv\" (UniqueName: \"kubernetes.io/projected/261c79d1-3c9d-466b-b981-2d3c4127c115-kube-api-access-zkkrv\") pod \"e2e-migrate-4d7f566d-gw-openshift-default-65f6c88dd-fgz69\" (UID: \"261c79d1-3c9d-466b-b981-2d3c4127c115\") " pod="openshift-ingress/e2e-migrate-4d7f566d-gw-openshift-default-65f6c88dd-fgz69" Jul 27 21:03:39.164163 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:03:39.163986 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/261c79d1-3c9d-466b-b981-2d3c4127c115-istio-podinfo\") pod \"e2e-migrate-4d7f566d-gw-openshift-default-65f6c88dd-fgz69\" (UID: \"261c79d1-3c9d-466b-b981-2d3c4127c115\") " pod="openshift-ingress/e2e-migrate-4d7f566d-gw-openshift-default-65f6c88dd-fgz69" Jul 27 21:03:39.164163 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:03:39.164043 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/261c79d1-3c9d-466b-b981-2d3c4127c115-workload-socket\") pod \"e2e-migrate-4d7f566d-gw-openshift-default-65f6c88dd-fgz69\" (UID: \"261c79d1-3c9d-466b-b981-2d3c4127c115\") " pod="openshift-ingress/e2e-migrate-4d7f566d-gw-openshift-default-65f6c88dd-fgz69" Jul 27 21:03:39.164163 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:03:39.164070 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/261c79d1-3c9d-466b-b981-2d3c4127c115-istiod-ca-cert\") pod \"e2e-migrate-4d7f566d-gw-openshift-default-65f6c88dd-fgz69\" (UID: \"261c79d1-3c9d-466b-b981-2d3c4127c115\") " pod="openshift-ingress/e2e-migrate-4d7f566d-gw-openshift-default-65f6c88dd-fgz69" Jul 27 21:03:39.164163 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:03:39.164103 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/261c79d1-3c9d-466b-b981-2d3c4127c115-istio-token\") pod \"e2e-migrate-4d7f566d-gw-openshift-default-65f6c88dd-fgz69\" (UID: \"261c79d1-3c9d-466b-b981-2d3c4127c115\") " pod="openshift-ingress/e2e-migrate-4d7f566d-gw-openshift-default-65f6c88dd-fgz69" Jul 27 21:03:39.164163 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:03:39.164154 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/261c79d1-3c9d-466b-b981-2d3c4127c115-workload-certs\") pod \"e2e-migrate-4d7f566d-gw-openshift-default-65f6c88dd-fgz69\" (UID: \"261c79d1-3c9d-466b-b981-2d3c4127c115\") " pod="openshift-ingress/e2e-migrate-4d7f566d-gw-openshift-default-65f6c88dd-fgz69" Jul 27 21:03:39.164448 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:03:39.164202 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/261c79d1-3c9d-466b-b981-2d3c4127c115-credential-socket\") pod \"e2e-migrate-4d7f566d-gw-openshift-default-65f6c88dd-fgz69\" (UID: \"261c79d1-3c9d-466b-b981-2d3c4127c115\") " pod="openshift-ingress/e2e-migrate-4d7f566d-gw-openshift-default-65f6c88dd-fgz69" Jul 27 21:03:39.164448 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:03:39.164224 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/261c79d1-3c9d-466b-b981-2d3c4127c115-istio-envoy\") pod \"e2e-migrate-4d7f566d-gw-openshift-default-65f6c88dd-fgz69\" (UID: \"261c79d1-3c9d-466b-b981-2d3c4127c115\") " pod="openshift-ingress/e2e-migrate-4d7f566d-gw-openshift-default-65f6c88dd-fgz69" Jul 27 21:03:39.164448 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:03:39.164245 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/261c79d1-3c9d-466b-b981-2d3c4127c115-istio-data\") pod \"e2e-migrate-4d7f566d-gw-openshift-default-65f6c88dd-fgz69\" (UID: \"261c79d1-3c9d-466b-b981-2d3c4127c115\") " pod="openshift-ingress/e2e-migrate-4d7f566d-gw-openshift-default-65f6c88dd-fgz69" Jul 27 21:03:39.164850 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:03:39.164817 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/261c79d1-3c9d-466b-b981-2d3c4127c115-workload-socket\") pod \"e2e-migrate-4d7f566d-gw-openshift-default-65f6c88dd-fgz69\" (UID: \"261c79d1-3c9d-466b-b981-2d3c4127c115\") " pod="openshift-ingress/e2e-migrate-4d7f566d-gw-openshift-default-65f6c88dd-fgz69" Jul 27 21:03:39.164951 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:03:39.164930 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/261c79d1-3c9d-466b-b981-2d3c4127c115-istio-data\") pod \"e2e-migrate-4d7f566d-gw-openshift-default-65f6c88dd-fgz69\" (UID: \"261c79d1-3c9d-466b-b981-2d3c4127c115\") " pod="openshift-ingress/e2e-migrate-4d7f566d-gw-openshift-default-65f6c88dd-fgz69" Jul 27 21:03:39.165016 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:03:39.164953 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/261c79d1-3c9d-466b-b981-2d3c4127c115-workload-certs\") pod \"e2e-migrate-4d7f566d-gw-openshift-default-65f6c88dd-fgz69\" (UID: \"261c79d1-3c9d-466b-b981-2d3c4127c115\") " pod="openshift-ingress/e2e-migrate-4d7f566d-gw-openshift-default-65f6c88dd-fgz69" Jul 27 21:03:39.165076 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:03:39.165053 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/261c79d1-3c9d-466b-b981-2d3c4127c115-istiod-ca-cert\") pod \"e2e-migrate-4d7f566d-gw-openshift-default-65f6c88dd-fgz69\" (UID: \"261c79d1-3c9d-466b-b981-2d3c4127c115\") " pod="openshift-ingress/e2e-migrate-4d7f566d-gw-openshift-default-65f6c88dd-fgz69" Jul 27 21:03:39.165154 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:03:39.165089 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/261c79d1-3c9d-466b-b981-2d3c4127c115-credential-socket\") pod \"e2e-migrate-4d7f566d-gw-openshift-default-65f6c88dd-fgz69\" (UID: \"261c79d1-3c9d-466b-b981-2d3c4127c115\") " pod="openshift-ingress/e2e-migrate-4d7f566d-gw-openshift-default-65f6c88dd-fgz69" Jul 27 21:03:39.166477 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:03:39.166459 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/261c79d1-3c9d-466b-b981-2d3c4127c115-istio-podinfo\") pod \"e2e-migrate-4d7f566d-gw-openshift-default-65f6c88dd-fgz69\" (UID: \"261c79d1-3c9d-466b-b981-2d3c4127c115\") " pod="openshift-ingress/e2e-migrate-4d7f566d-gw-openshift-default-65f6c88dd-fgz69" Jul 27 21:03:39.166626 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:03:39.166610 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/261c79d1-3c9d-466b-b981-2d3c4127c115-istio-envoy\") pod \"e2e-migrate-4d7f566d-gw-openshift-default-65f6c88dd-fgz69\" (UID: \"261c79d1-3c9d-466b-b981-2d3c4127c115\") " pod="openshift-ingress/e2e-migrate-4d7f566d-gw-openshift-default-65f6c88dd-fgz69" Jul 27 21:03:39.172365 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:03:39.172345 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/261c79d1-3c9d-466b-b981-2d3c4127c115-istio-token\") pod \"e2e-migrate-4d7f566d-gw-openshift-default-65f6c88dd-fgz69\" (UID: \"261c79d1-3c9d-466b-b981-2d3c4127c115\") " pod="openshift-ingress/e2e-migrate-4d7f566d-gw-openshift-default-65f6c88dd-fgz69" Jul 27 21:03:39.172458 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:03:39.172393 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zkkrv\" (UniqueName: \"kubernetes.io/projected/261c79d1-3c9d-466b-b981-2d3c4127c115-kube-api-access-zkkrv\") pod \"e2e-migrate-4d7f566d-gw-openshift-default-65f6c88dd-fgz69\" (UID: \"261c79d1-3c9d-466b-b981-2d3c4127c115\") " pod="openshift-ingress/e2e-migrate-4d7f566d-gw-openshift-default-65f6c88dd-fgz69" Jul 27 21:03:39.354020 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:03:39.353926 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-4d7f566d-gw-openshift-default-65f6c88dd-fgz69" Jul 27 21:03:39.487183 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:03:39.487152 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-migrate-4d7f566d-gw-openshift-default-65f6c88dd-fgz69"] Jul 27 21:03:39.490369 ip-10-0-139-2 kubenswrapper[2572]: W0727 21:03:39.490344 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod261c79d1_3c9d_466b_b981_2d3c4127c115.slice/crio-9c2798a3324a2c9361f74c8dd125a8b629f387d100b5a46c44179dac864249d9 WatchSource:0}: Error finding container 9c2798a3324a2c9361f74c8dd125a8b629f387d100b5a46c44179dac864249d9: Status 404 returned error can't find the container with id 9c2798a3324a2c9361f74c8dd125a8b629f387d100b5a46c44179dac864249d9 Jul 27 21:03:39.492620 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:03:39.492588 2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 27 21:03:39.492714 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:03:39.492653 2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 27 21:03:39.492714 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:03:39.492684 2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 27 21:03:39.517633 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:03:39.517610 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbpp5_e2759622-0ab6-46b7-b434-f0a0f8942dfe/konnectivity-agent/0.log" limit=1024 Jul 27 21:03:39.982233 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:03:39.982191 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-4d7f566d-gw-openshift-default-65f6c88dd-fgz69" event={"ID":"261c79d1-3c9d-466b-b981-2d3c4127c115","Type":"ContainerStarted","Data":"1d8408b81b317991a5817c35968dc329401f93c50cac43ea6d459686d5747f05"} Jul 27 21:03:39.982431 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:03:39.982254 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-4d7f566d-gw-openshift-default-65f6c88dd-fgz69" event={"ID":"261c79d1-3c9d-466b-b981-2d3c4127c115","Type":"ContainerStarted","Data":"9c2798a3324a2c9361f74c8dd125a8b629f387d100b5a46c44179dac864249d9"} Jul 27 21:03:40.004842 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:03:40.004793 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-migrate-4d7f566d-gw-openshift-default-65f6c88dd-fgz69" podStartSLOduration=1.004777225 podStartE2EDuration="1.004777225s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 21:03:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 21:03:40.003623883 +0000 UTC m=+1753.473166892" watchObservedRunningTime="2026-07-27 21:03:40.004777225 +0000 UTC m=+1753.474320236" Jul 27 21:03:40.354989 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:03:40.354957 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-migrate-4d7f566d-gw-openshift-default-65f6c88dd-fgz69" Jul 27 21:03:40.360255 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:03:40.360232 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-migrate-4d7f566d-gw-openshift-default-65f6c88dd-fgz69" Jul 27 21:03:40.986765 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:03:40.986732 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-migrate-4d7f566d-gw-openshift-default-65f6c88dd-fgz69" Jul 27 21:03:40.987661 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:03:40.987641 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-migrate-4d7f566d-gw-openshift-default-65f6c88dd-fgz69" Jul 27 21:03:41.464264 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:03:41.464227 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbpp5_e2759622-0ab6-46b7-b434-f0a0f8942dfe/konnectivity-agent/0.log" limit=1024 Jul 27 21:03:41.578822 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:03:41.578789 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbpp5_e2759622-0ab6-46b7-b434-f0a0f8942dfe/konnectivity-agent/0.log" limit=1024 Jul 27 21:03:41.908113 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:03:41.908081 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbpp5_e2759622-0ab6-46b7-b434-f0a0f8942dfe/konnectivity-agent/0.log" limit=1024 Jul 27 21:03:42.165828 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:03:42.165748 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbpp5_e2759622-0ab6-46b7-b434-f0a0f8942dfe/konnectivity-agent/0.log" limit=1024 Jul 27 21:03:42.256703 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:03:42.256669 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbpp5_e2759622-0ab6-46b7-b434-f0a0f8942dfe/konnectivity-agent/0.log" limit=1024 Jul 27 21:03:42.291713 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:03:42.291684 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-4d7f566d-7c5d7bbf6-6j72r"] Jul 27 21:03:42.295078 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:03:42.295060 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-migrate-4d7f566d-7c5d7bbf6-6j72r" Jul 27 21:03:42.297336 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:03:42.297303 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-migrate-4d7f566d\"" Jul 27 21:03:42.307440 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:03:42.307413 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-4d7f566d-7c5d7bbf6-6j72r"] Jul 27 21:03:42.388078 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:03:42.388043 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ad912a15-543f-494a-a489-81a0ad8caead-plugins-config-volume\") pod \"payload-pre-processing-e2e-migrate-4d7f566d-7c5d7bbf6-6j72r\" (UID: \"ad912a15-543f-494a-a489-81a0ad8caead\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-4d7f566d-7c5d7bbf6-6j72r" Jul 27 21:03:42.388078 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:03:42.388082 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9zxhj\" (UniqueName: \"kubernetes.io/projected/ad912a15-543f-494a-a489-81a0ad8caead-kube-api-access-9zxhj\") pod \"payload-pre-processing-e2e-migrate-4d7f566d-7c5d7bbf6-6j72r\" (UID: \"ad912a15-543f-494a-a489-81a0ad8caead\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-4d7f566d-7c5d7bbf6-6j72r" Jul 27 21:03:42.488809 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:03:42.488723 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ad912a15-543f-494a-a489-81a0ad8caead-plugins-config-volume\") pod \"payload-pre-processing-e2e-migrate-4d7f566d-7c5d7bbf6-6j72r\" (UID: \"ad912a15-543f-494a-a489-81a0ad8caead\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-4d7f566d-7c5d7bbf6-6j72r" Jul 27 21:03:42.488809 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:03:42.488760 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9zxhj\" (UniqueName: \"kubernetes.io/projected/ad912a15-543f-494a-a489-81a0ad8caead-kube-api-access-9zxhj\") pod \"payload-pre-processing-e2e-migrate-4d7f566d-7c5d7bbf6-6j72r\" (UID: \"ad912a15-543f-494a-a489-81a0ad8caead\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-4d7f566d-7c5d7bbf6-6j72r" Jul 27 21:03:42.489411 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:03:42.489391 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ad912a15-543f-494a-a489-81a0ad8caead-plugins-config-volume\") pod \"payload-pre-processing-e2e-migrate-4d7f566d-7c5d7bbf6-6j72r\" (UID: \"ad912a15-543f-494a-a489-81a0ad8caead\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-4d7f566d-7c5d7bbf6-6j72r" Jul 27 21:03:42.500085 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:03:42.500063 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9zxhj\" (UniqueName: \"kubernetes.io/projected/ad912a15-543f-494a-a489-81a0ad8caead-kube-api-access-9zxhj\") pod \"payload-pre-processing-e2e-migrate-4d7f566d-7c5d7bbf6-6j72r\" (UID: \"ad912a15-543f-494a-a489-81a0ad8caead\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-4d7f566d-7c5d7bbf6-6j72r" Jul 27 21:03:42.605651 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:03:42.605625 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-migrate-4d7f566d-7c5d7bbf6-6j72r" Jul 27 21:03:42.732572 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:03:42.732509 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-4d7f566d-7c5d7bbf6-6j72r"] Jul 27 21:03:42.734588 ip-10-0-139-2 kubenswrapper[2572]: W0727 21:03:42.734563 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podad912a15_543f_494a_a489_81a0ad8caead.slice/crio-8c79cbac93b89fbff3aec6806abaa87644ee2970f2fd50defda0ca79b04965f2 WatchSource:0}: Error finding container 8c79cbac93b89fbff3aec6806abaa87644ee2970f2fd50defda0ca79b04965f2: Status 404 returned error can't find the container with id 8c79cbac93b89fbff3aec6806abaa87644ee2970f2fd50defda0ca79b04965f2 Jul 27 21:03:42.997191 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:03:42.997105 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-migrate-4d7f566d-7c5d7bbf6-6j72r" event={"ID":"ad912a15-543f-494a-a489-81a0ad8caead","Type":"ContainerStarted","Data":"e53199a3443e46806b015106ce28c85285c2a44b141e39e7eb944e83f2cca02d"} Jul 27 21:03:42.997191 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:03:42.997155 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-migrate-4d7f566d-7c5d7bbf6-6j72r" event={"ID":"ad912a15-543f-494a-a489-81a0ad8caead","Type":"ContainerStarted","Data":"8c79cbac93b89fbff3aec6806abaa87644ee2970f2fd50defda0ca79b04965f2"} Jul 27 21:03:43.015786 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:03:43.015726 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-migrate-4d7f566d-7c5d7bbf6-6j72r" podStartSLOduration=1.015692398 podStartE2EDuration="1.015692398s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 21:03:42 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 21:03:43.013771946 +0000 UTC m=+1756.483314952" watchObservedRunningTime="2026-07-27 21:03:43.015692398 +0000 UTC m=+1756.485235406" Jul 27 21:03:43.236523 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:03:43.236493 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-f9e4b23a-openshift-default-75f94f8688-zxhhx" Jul 27 21:03:43.295170 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:03:43.295151 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/82283efa-b666-4a08-b830-da577271b0e6-istio-envoy\") pod \"82283efa-b666-4a08-b830-da577271b0e6\" (UID: \"82283efa-b666-4a08-b830-da577271b0e6\") " Jul 27 21:03:43.295353 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:03:43.295180 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/82283efa-b666-4a08-b830-da577271b0e6-workload-certs\") pod \"82283efa-b666-4a08-b830-da577271b0e6\" (UID: \"82283efa-b666-4a08-b830-da577271b0e6\") " Jul 27 21:03:43.295353 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:03:43.295203 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/82283efa-b666-4a08-b830-da577271b0e6-istio-data\") pod \"82283efa-b666-4a08-b830-da577271b0e6\" (UID: \"82283efa-b666-4a08-b830-da577271b0e6\") " Jul 27 21:03:43.295353 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:03:43.295222 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/82283efa-b666-4a08-b830-da577271b0e6-istio-token\") pod \"82283efa-b666-4a08-b830-da577271b0e6\" (UID: \"82283efa-b666-4a08-b830-da577271b0e6\") " Jul 27 21:03:43.295353 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:03:43.295248 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/82283efa-b666-4a08-b830-da577271b0e6-credential-socket\") pod \"82283efa-b666-4a08-b830-da577271b0e6\" (UID: \"82283efa-b666-4a08-b830-da577271b0e6\") " Jul 27 21:03:43.295353 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:03:43.295297 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-scx52\" (UniqueName: \"kubernetes.io/projected/82283efa-b666-4a08-b830-da577271b0e6-kube-api-access-scx52\") pod \"82283efa-b666-4a08-b830-da577271b0e6\" (UID: \"82283efa-b666-4a08-b830-da577271b0e6\") " Jul 27 21:03:43.295353 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:03:43.295337 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/82283efa-b666-4a08-b830-da577271b0e6-workload-socket\") pod \"82283efa-b666-4a08-b830-da577271b0e6\" (UID: \"82283efa-b666-4a08-b830-da577271b0e6\") " Jul 27 21:03:43.295670 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:03:43.295415 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/82283efa-b666-4a08-b830-da577271b0e6-istiod-ca-cert\") pod \"82283efa-b666-4a08-b830-da577271b0e6\" (UID: \"82283efa-b666-4a08-b830-da577271b0e6\") " Jul 27 21:03:43.295670 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:03:43.295487 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/82283efa-b666-4a08-b830-da577271b0e6-istio-podinfo\") pod \"82283efa-b666-4a08-b830-da577271b0e6\" (UID: \"82283efa-b666-4a08-b830-da577271b0e6\") " Jul 27 21:03:43.295670 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:03:43.295470 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/82283efa-b666-4a08-b830-da577271b0e6-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "82283efa-b666-4a08-b830-da577271b0e6" (UID: "82283efa-b666-4a08-b830-da577271b0e6"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 27 21:03:43.295670 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:03:43.295634 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/82283efa-b666-4a08-b830-da577271b0e6-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "82283efa-b666-4a08-b830-da577271b0e6" (UID: "82283efa-b666-4a08-b830-da577271b0e6"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 27 21:03:43.295854 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:03:43.295668 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/82283efa-b666-4a08-b830-da577271b0e6-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "82283efa-b666-4a08-b830-da577271b0e6" (UID: "82283efa-b666-4a08-b830-da577271b0e6"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 27 21:03:43.295854 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:03:43.295795 2572 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/82283efa-b666-4a08-b830-da577271b0e6-credential-socket\") on node \"ip-10-0-139-2.ec2.internal\" DevicePath \"\"" Jul 27 21:03:43.295854 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:03:43.295813 2572 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/82283efa-b666-4a08-b830-da577271b0e6-workload-socket\") on node \"ip-10-0-139-2.ec2.internal\" DevicePath \"\"" Jul 27 21:03:43.295854 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:03:43.295827 2572 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/82283efa-b666-4a08-b830-da577271b0e6-workload-certs\") on node \"ip-10-0-139-2.ec2.internal\" DevicePath \"\"" Jul 27 21:03:43.296025 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:03:43.295982 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/82283efa-b666-4a08-b830-da577271b0e6-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "82283efa-b666-4a08-b830-da577271b0e6" (UID: "82283efa-b666-4a08-b830-da577271b0e6"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 27 21:03:43.296172 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:03:43.296145 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/82283efa-b666-4a08-b830-da577271b0e6-istio-data" (OuterVolumeSpecName: "istio-data") pod "82283efa-b666-4a08-b830-da577271b0e6" (UID: "82283efa-b666-4a08-b830-da577271b0e6"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 27 21:03:43.297355 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:03:43.297332 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/82283efa-b666-4a08-b830-da577271b0e6-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "82283efa-b666-4a08-b830-da577271b0e6" (UID: "82283efa-b666-4a08-b830-da577271b0e6"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 27 21:03:43.297496 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:03:43.297479 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/82283efa-b666-4a08-b830-da577271b0e6-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "82283efa-b666-4a08-b830-da577271b0e6" (UID: "82283efa-b666-4a08-b830-da577271b0e6"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 27 21:03:43.297699 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:03:43.297683 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/82283efa-b666-4a08-b830-da577271b0e6-istio-token" (OuterVolumeSpecName: "istio-token") pod "82283efa-b666-4a08-b830-da577271b0e6" (UID: "82283efa-b666-4a08-b830-da577271b0e6"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 27 21:03:43.297836 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:03:43.297815 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/82283efa-b666-4a08-b830-da577271b0e6-kube-api-access-scx52" (OuterVolumeSpecName: "kube-api-access-scx52") pod "82283efa-b666-4a08-b830-da577271b0e6" (UID: "82283efa-b666-4a08-b830-da577271b0e6"). InnerVolumeSpecName "kube-api-access-scx52". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 27 21:03:43.396852 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:03:43.396812 2572 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/82283efa-b666-4a08-b830-da577271b0e6-istio-podinfo\") on node \"ip-10-0-139-2.ec2.internal\" DevicePath \"\"" Jul 27 21:03:43.396852 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:03:43.396847 2572 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/82283efa-b666-4a08-b830-da577271b0e6-istio-envoy\") on node \"ip-10-0-139-2.ec2.internal\" DevicePath \"\"" Jul 27 21:03:43.396852 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:03:43.396856 2572 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/82283efa-b666-4a08-b830-da577271b0e6-istio-data\") on node \"ip-10-0-139-2.ec2.internal\" DevicePath \"\"" Jul 27 21:03:43.397033 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:03:43.396863 2572 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/82283efa-b666-4a08-b830-da577271b0e6-istio-token\") on node \"ip-10-0-139-2.ec2.internal\" DevicePath \"\"" Jul 27 21:03:43.397033 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:03:43.396871 2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-scx52\" (UniqueName: \"kubernetes.io/projected/82283efa-b666-4a08-b830-da577271b0e6-kube-api-access-scx52\") on node \"ip-10-0-139-2.ec2.internal\" DevicePath \"\"" Jul 27 21:03:43.397033 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:03:43.396881 2572 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/82283efa-b666-4a08-b830-da577271b0e6-istiod-ca-cert\") on node \"ip-10-0-139-2.ec2.internal\" DevicePath \"\"" Jul 27 21:03:44.003532 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:03:44.003497 2572 generic.go:356] "Generic (PLEG): container finished" podID="82283efa-b666-4a08-b830-da577271b0e6" containerID="0c4392bb1e680bcb84c92ff2fc4bbe31f43cdc0f979377fb3b5a9246645bb9dd" exitCode=0 Jul 27 21:03:44.003971 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:03:44.003549 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-f9e4b23a-openshift-default-75f94f8688-zxhhx" Jul 27 21:03:44.003971 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:03:44.003580 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-f9e4b23a-openshift-default-75f94f8688-zxhhx" event={"ID":"82283efa-b666-4a08-b830-da577271b0e6","Type":"ContainerDied","Data":"0c4392bb1e680bcb84c92ff2fc4bbe31f43cdc0f979377fb3b5a9246645bb9dd"} Jul 27 21:03:44.003971 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:03:44.003641 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-f9e4b23a-openshift-default-75f94f8688-zxhhx" event={"ID":"82283efa-b666-4a08-b830-da577271b0e6","Type":"ContainerDied","Data":"131ed51e82209f86e70f3a7f14370c1d91894051147a5b9a34fe058b5a9d3f9c"} Jul 27 21:03:44.003971 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:03:44.003665 2572 scope.go:117] "RemoveContainer" containerID="0c4392bb1e680bcb84c92ff2fc4bbe31f43cdc0f979377fb3b5a9246645bb9dd" Jul 27 21:03:44.003971 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:03:44.003887 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-migrate-4d7f566d-7c5d7bbf6-6j72r" Jul 27 21:03:44.013535 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:03:44.013516 2572 scope.go:117] "RemoveContainer" containerID="d19549479fd89bdf02df01718706f45dca5fdabf7ebc6445c52e543550facf48" Jul 27 21:03:44.022376 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:03:44.022356 2572 scope.go:117] "RemoveContainer" containerID="0c4392bb1e680bcb84c92ff2fc4bbe31f43cdc0f979377fb3b5a9246645bb9dd" Jul 27 21:03:44.022625 ip-10-0-139-2 kubenswrapper[2572]: E0727 21:03:44.022605 2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0c4392bb1e680bcb84c92ff2fc4bbe31f43cdc0f979377fb3b5a9246645bb9dd\": container with ID starting with 0c4392bb1e680bcb84c92ff2fc4bbe31f43cdc0f979377fb3b5a9246645bb9dd not found: ID does not exist" containerID="0c4392bb1e680bcb84c92ff2fc4bbe31f43cdc0f979377fb3b5a9246645bb9dd" Jul 27 21:03:44.022686 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:03:44.022634 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0c4392bb1e680bcb84c92ff2fc4bbe31f43cdc0f979377fb3b5a9246645bb9dd"} err="failed to get container status \"0c4392bb1e680bcb84c92ff2fc4bbe31f43cdc0f979377fb3b5a9246645bb9dd\": rpc error: code = NotFound desc = could not find container \"0c4392bb1e680bcb84c92ff2fc4bbe31f43cdc0f979377fb3b5a9246645bb9dd\": container with ID starting with 0c4392bb1e680bcb84c92ff2fc4bbe31f43cdc0f979377fb3b5a9246645bb9dd not found: ID does not exist" Jul 27 21:03:44.022686 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:03:44.022651 2572 scope.go:117] "RemoveContainer" containerID="d19549479fd89bdf02df01718706f45dca5fdabf7ebc6445c52e543550facf48" Jul 27 21:03:44.022888 ip-10-0-139-2 kubenswrapper[2572]: E0727 21:03:44.022869 2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d19549479fd89bdf02df01718706f45dca5fdabf7ebc6445c52e543550facf48\": container with ID starting with d19549479fd89bdf02df01718706f45dca5fdabf7ebc6445c52e543550facf48 not found: ID does not exist" containerID="d19549479fd89bdf02df01718706f45dca5fdabf7ebc6445c52e543550facf48" Jul 27 21:03:44.022935 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:03:44.022894 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d19549479fd89bdf02df01718706f45dca5fdabf7ebc6445c52e543550facf48"} err="failed to get container status \"d19549479fd89bdf02df01718706f45dca5fdabf7ebc6445c52e543550facf48\": rpc error: code = NotFound desc = could not find container \"d19549479fd89bdf02df01718706f45dca5fdabf7ebc6445c52e543550facf48\": container with ID starting with d19549479fd89bdf02df01718706f45dca5fdabf7ebc6445c52e543550facf48 not found: ID does not exist" Jul 27 21:03:44.028036 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:03:44.028013 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-f9e4b23a-openshift-default-75f94f8688-zxhhx"] Jul 27 21:03:44.033978 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:03:44.033956 2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-f9e4b23a-openshift-default-75f94f8688-zxhhx"] Jul 27 21:03:45.078823 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:03:45.078790 2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="82283efa-b666-4a08-b830-da577271b0e6" path="/var/lib/kubelet/pods/82283efa-b666-4a08-b830-da577271b0e6/volumes" Jul 27 21:03:55.012246 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:03:55.012216 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-migrate-4d7f566d-7c5d7bbf6-6j72r" Jul 27 21:03:55.987801 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:03:55.987770 2572 patch_prober.go:28] interesting pod/e2e-migrate-4d7f566d-gw-openshift-default-65f6c88dd-fgz69 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.26:15021/healthz/ready\": dial tcp 10.133.0.26:15021: connect: connection refused" start-of-body= Jul 27 21:03:55.987996 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:03:55.987831 2572 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-migrate-4d7f566d-gw-openshift-default-65f6c88dd-fgz69" podUID="261c79d1-3c9d-466b-b981-2d3c4127c115" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.26:15021/healthz/ready\": dial tcp 10.133.0.26:15021: connect: connection refused" Jul 27 21:03:56.062545 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:03:56.062512 2572 generic.go:356] "Generic (PLEG): container finished" podID="261c79d1-3c9d-466b-b981-2d3c4127c115" containerID="1d8408b81b317991a5817c35968dc329401f93c50cac43ea6d459686d5747f05" exitCode=0 Jul 27 21:03:56.062885 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:03:56.062584 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-4d7f566d-gw-openshift-default-65f6c88dd-fgz69" event={"ID":"261c79d1-3c9d-466b-b981-2d3c4127c115","Type":"ContainerDied","Data":"1d8408b81b317991a5817c35968dc329401f93c50cac43ea6d459686d5747f05"} Jul 27 21:03:56.062944 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:03:56.062929 2572 scope.go:117] "RemoveContainer" containerID="1d8408b81b317991a5817c35968dc329401f93c50cac43ea6d459686d5747f05" Jul 27 21:03:56.063884 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:03:56.063852 2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 27 21:03:56.063973 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:03:56.063919 2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 27 21:03:56.063973 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:03:56.063953 2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 27 21:03:57.069597 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:03:57.069557 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-4d7f566d-gw-openshift-default-65f6c88dd-fgz69" event={"ID":"261c79d1-3c9d-466b-b981-2d3c4127c115","Type":"ContainerStarted","Data":"c4e205ff3a5d07ac0dc5a60a32f615d34c1b12f5a7113a4df06cdb0e52ac2f72"} Jul 27 21:03:57.354398 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:03:57.354283 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-migrate-4d7f566d-gw-openshift-default-65f6c88dd-fgz69" Jul 27 21:03:57.354398 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:03:57.354368 2572 patch_prober.go:28] interesting pod/e2e-migrate-4d7f566d-gw-openshift-default-65f6c88dd-fgz69 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.26:15021/healthz/ready\": dial tcp 10.133.0.26:15021: connect: connection refused" start-of-body= Jul 27 21:03:57.354623 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:03:57.354419 2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-4d7f566d-gw-openshift-default-65f6c88dd-fgz69" podUID="261c79d1-3c9d-466b-b981-2d3c4127c115" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.26:15021/healthz/ready\": dial tcp 10.133.0.26:15021: connect: connection refused" Jul 27 21:03:58.354980 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:03:58.354544 2572 patch_prober.go:28] interesting pod/e2e-migrate-4d7f566d-gw-openshift-default-65f6c88dd-fgz69 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.26:15021/healthz/ready\": dial tcp 10.133.0.26:15021: connect: connection refused" start-of-body= Jul 27 21:03:58.354980 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:03:58.354606 2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-4d7f566d-gw-openshift-default-65f6c88dd-fgz69" podUID="261c79d1-3c9d-466b-b981-2d3c4127c115" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.26:15021/healthz/ready\": dial tcp 10.133.0.26:15021: connect: connection refused" Jul 27 21:03:59.354911 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:03:59.354874 2572 patch_prober.go:28] interesting pod/e2e-migrate-4d7f566d-gw-openshift-default-65f6c88dd-fgz69 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.26:15021/healthz/ready\": dial tcp 10.133.0.26:15021: connect: connection refused" start-of-body= Jul 27 21:03:59.355207 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:03:59.355175 2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-4d7f566d-gw-openshift-default-65f6c88dd-fgz69" podUID="261c79d1-3c9d-466b-b981-2d3c4127c115" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.26:15021/healthz/ready\": dial tcp 10.133.0.26:15021: connect: connection refused" Jul 27 21:04:00.354482 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:04:00.354443 2572 patch_prober.go:28] interesting pod/e2e-migrate-4d7f566d-gw-openshift-default-65f6c88dd-fgz69 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.26:15021/healthz/ready\": dial tcp 10.133.0.26:15021: connect: connection refused" start-of-body= Jul 27 21:04:00.354681 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:04:00.354510 2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-4d7f566d-gw-openshift-default-65f6c88dd-fgz69" podUID="261c79d1-3c9d-466b-b981-2d3c4127c115" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.26:15021/healthz/ready\": dial tcp 10.133.0.26:15021: connect: connection refused" Jul 27 21:04:01.358936 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:04:01.358904 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-migrate-4d7f566d-gw-openshift-default-65f6c88dd-fgz69" Jul 27 21:04:01.359414 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:04:01.359280 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-migrate-4d7f566d-gw-openshift-default-65f6c88dd-fgz69" Jul 27 21:04:01.359874 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:04:01.359859 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-migrate-4d7f566d-gw-openshift-default-65f6c88dd-fgz69" Jul 27 21:04:16.937982 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:04:16.937946 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbpp5_e2759622-0ab6-46b7-b434-f0a0f8942dfe/konnectivity-agent/0.log" limit=1024 Jul 27 21:04:16.973293 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:04:16.973254 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-4d7f566d-7c5d7bbf6-6j72r"] Jul 27 21:04:16.973566 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:04:16.973531 2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-migrate-4d7f566d-7c5d7bbf6-6j72r" podUID="ad912a15-543f-494a-a489-81a0ad8caead" containerName="payload-pre-processing" containerID="cri-o://e53199a3443e46806b015106ce28c85285c2a44b141e39e7eb944e83f2cca02d" gracePeriod=30 Jul 27 21:04:17.038948 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:04:17.038920 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbpp5_e2759622-0ab6-46b7-b434-f0a0f8942dfe/konnectivity-agent/0.log" limit=1024 Jul 27 21:04:17.138500 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:04:17.138452 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbpp5_e2759622-0ab6-46b7-b434-f0a0f8942dfe/konnectivity-agent/0.log" limit=1024 Jul 27 21:04:17.160208 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:04:17.160178 2572 generic.go:356] "Generic (PLEG): container finished" podID="ad912a15-543f-494a-a489-81a0ad8caead" containerID="e53199a3443e46806b015106ce28c85285c2a44b141e39e7eb944e83f2cca02d" exitCode=0 Jul 27 21:04:17.160368 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:04:17.160244 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-migrate-4d7f566d-7c5d7bbf6-6j72r" event={"ID":"ad912a15-543f-494a-a489-81a0ad8caead","Type":"ContainerDied","Data":"e53199a3443e46806b015106ce28c85285c2a44b141e39e7eb944e83f2cca02d"} Jul 27 21:04:17.218114 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:04:17.218093 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-migrate-4d7f566d-7c5d7bbf6-6j72r" Jul 27 21:04:17.299993 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:04:17.299963 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ad912a15-543f-494a-a489-81a0ad8caead-plugins-config-volume\") pod \"ad912a15-543f-494a-a489-81a0ad8caead\" (UID: \"ad912a15-543f-494a-a489-81a0ad8caead\") " Jul 27 21:04:17.300167 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:04:17.300018 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9zxhj\" (UniqueName: \"kubernetes.io/projected/ad912a15-543f-494a-a489-81a0ad8caead-kube-api-access-9zxhj\") pod \"ad912a15-543f-494a-a489-81a0ad8caead\" (UID: \"ad912a15-543f-494a-a489-81a0ad8caead\") " Jul 27 21:04:17.300372 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:04:17.300346 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ad912a15-543f-494a-a489-81a0ad8caead-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "ad912a15-543f-494a-a489-81a0ad8caead" (UID: "ad912a15-543f-494a-a489-81a0ad8caead"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 27 21:04:17.302188 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:04:17.302164 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ad912a15-543f-494a-a489-81a0ad8caead-kube-api-access-9zxhj" (OuterVolumeSpecName: "kube-api-access-9zxhj") pod "ad912a15-543f-494a-a489-81a0ad8caead" (UID: "ad912a15-543f-494a-a489-81a0ad8caead"). InnerVolumeSpecName "kube-api-access-9zxhj". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 27 21:04:17.401389 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:04:17.401357 2572 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ad912a15-543f-494a-a489-81a0ad8caead-plugins-config-volume\") on node \"ip-10-0-139-2.ec2.internal\" DevicePath \"\"" Jul 27 21:04:17.401389 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:04:17.401384 2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9zxhj\" (UniqueName: \"kubernetes.io/projected/ad912a15-543f-494a-a489-81a0ad8caead-kube-api-access-9zxhj\") on node \"ip-10-0-139-2.ec2.internal\" DevicePath \"\"" Jul 27 21:04:18.166213 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:04:18.166177 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-migrate-4d7f566d-7c5d7bbf6-6j72r" event={"ID":"ad912a15-543f-494a-a489-81a0ad8caead","Type":"ContainerDied","Data":"8c79cbac93b89fbff3aec6806abaa87644ee2970f2fd50defda0ca79b04965f2"} Jul 27 21:04:18.166213 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:04:18.166205 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-migrate-4d7f566d-7c5d7bbf6-6j72r" Jul 27 21:04:18.166696 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:04:18.166248 2572 scope.go:117] "RemoveContainer" containerID="e53199a3443e46806b015106ce28c85285c2a44b141e39e7eb944e83f2cca02d" Jul 27 21:04:18.186871 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:04:18.186838 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-4d7f566d-7c5d7bbf6-6j72r"] Jul 27 21:04:18.191567 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:04:18.191548 2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-4d7f566d-7c5d7bbf6-6j72r"] Jul 27 21:04:19.077969 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:04:19.077934 2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ad912a15-543f-494a-a489-81a0ad8caead" path="/var/lib/kubelet/pods/ad912a15-543f-494a-a489-81a0ad8caead/volumes" Jul 27 21:04:21.570874 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:04:21.570842 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbpp5_e2759622-0ab6-46b7-b434-f0a0f8942dfe/konnectivity-agent/0.log" limit=1024 Jul 27 21:04:21.710177 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:04:21.710147 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-migrate-4d7f566d-gw-openshift-default-65f6c88dd-fgz69"] Jul 27 21:04:21.710424 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:04:21.710375 2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-migrate-4d7f566d-gw-openshift-default-65f6c88dd-fgz69" podUID="261c79d1-3c9d-466b-b981-2d3c4127c115" containerName="istio-proxy" containerID="cri-o://c4e205ff3a5d07ac0dc5a60a32f615d34c1b12f5a7113a4df06cdb0e52ac2f72" gracePeriod=30 Jul 27 21:04:21.733635 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:04:21.733605 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbpp5_e2759622-0ab6-46b7-b434-f0a0f8942dfe/konnectivity-agent/0.log" limit=1024 Jul 27 21:04:21.976385 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:04:21.976286 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbpp5_e2759622-0ab6-46b7-b434-f0a0f8942dfe/konnectivity-agent/0.log" limit=1024 Jul 27 21:04:22.206524 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:04:22.206493 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbpp5_e2759622-0ab6-46b7-b434-f0a0f8942dfe/konnectivity-agent/0.log" limit=1024 Jul 27 21:04:22.505797 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:04:22.505758 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-560b69a4-openshift-default-5bb65467d6-tt87m"] Jul 27 21:04:22.506096 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:04:22.506084 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ad912a15-543f-494a-a489-81a0ad8caead" containerName="payload-pre-processing" Jul 27 21:04:22.506139 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:04:22.506097 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="ad912a15-543f-494a-a489-81a0ad8caead" containerName="payload-pre-processing" Jul 27 21:04:22.506139 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:04:22.506115 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="82283efa-b666-4a08-b830-da577271b0e6" containerName="istio-proxy" Jul 27 21:04:22.506139 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:04:22.506121 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="82283efa-b666-4a08-b830-da577271b0e6" containerName="istio-proxy" Jul 27 21:04:22.506139 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:04:22.506131 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="82283efa-b666-4a08-b830-da577271b0e6" containerName="istio-proxy" Jul 27 21:04:22.506139 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:04:22.506136 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="82283efa-b666-4a08-b830-da577271b0e6" containerName="istio-proxy" Jul 27 21:04:22.506285 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:04:22.506185 2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="82283efa-b666-4a08-b830-da577271b0e6" containerName="istio-proxy" Jul 27 21:04:22.506285 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:04:22.506193 2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="ad912a15-543f-494a-a489-81a0ad8caead" containerName="payload-pre-processing" Jul 27 21:04:22.510374 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:04:22.510357 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-560b69a4-openshift-default-5bb65467d6-tt87m" Jul 27 21:04:22.512357 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:04:22.512335 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-560b69a4-openshift-default-dockercfg-mqw8m\"" Jul 27 21:04:22.518262 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:04:22.518241 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-560b69a4-openshift-default-5bb65467d6-tt87m"] Jul 27 21:04:22.537244 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:04:22.537206 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbpp5_e2759622-0ab6-46b7-b434-f0a0f8942dfe/konnectivity-agent/0.log" limit=1024 Jul 27 21:04:22.645667 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:04:22.645631 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ed5fcbea-4993-4d15-bf09-834a79ab7e21-workload-certs\") pod \"e2e-ait-560b69a4-openshift-default-5bb65467d6-tt87m\" (UID: \"ed5fcbea-4993-4d15-bf09-834a79ab7e21\") " pod="openshift-ingress/e2e-ait-560b69a4-openshift-default-5bb65467d6-tt87m" Jul 27 21:04:22.645667 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:04:22.645668 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ed5fcbea-4993-4d15-bf09-834a79ab7e21-istio-envoy\") pod \"e2e-ait-560b69a4-openshift-default-5bb65467d6-tt87m\" (UID: \"ed5fcbea-4993-4d15-bf09-834a79ab7e21\") " pod="openshift-ingress/e2e-ait-560b69a4-openshift-default-5bb65467d6-tt87m" Jul 27 21:04:22.646139 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:04:22.645700 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ed5fcbea-4993-4d15-bf09-834a79ab7e21-istiod-ca-cert\") pod \"e2e-ait-560b69a4-openshift-default-5bb65467d6-tt87m\" (UID: \"ed5fcbea-4993-4d15-bf09-834a79ab7e21\") " pod="openshift-ingress/e2e-ait-560b69a4-openshift-default-5bb65467d6-tt87m" Jul 27 21:04:22.646139 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:04:22.645750 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ed5fcbea-4993-4d15-bf09-834a79ab7e21-credential-socket\") pod \"e2e-ait-560b69a4-openshift-default-5bb65467d6-tt87m\" (UID: \"ed5fcbea-4993-4d15-bf09-834a79ab7e21\") " pod="openshift-ingress/e2e-ait-560b69a4-openshift-default-5bb65467d6-tt87m" Jul 27 21:04:22.646139 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:04:22.645779 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ed5fcbea-4993-4d15-bf09-834a79ab7e21-istio-podinfo\") pod \"e2e-ait-560b69a4-openshift-default-5bb65467d6-tt87m\" (UID: \"ed5fcbea-4993-4d15-bf09-834a79ab7e21\") " pod="openshift-ingress/e2e-ait-560b69a4-openshift-default-5bb65467d6-tt87m" Jul 27 21:04:22.646139 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:04:22.645796 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ed5fcbea-4993-4d15-bf09-834a79ab7e21-workload-socket\") pod \"e2e-ait-560b69a4-openshift-default-5bb65467d6-tt87m\" (UID: \"ed5fcbea-4993-4d15-bf09-834a79ab7e21\") " pod="openshift-ingress/e2e-ait-560b69a4-openshift-default-5bb65467d6-tt87m" Jul 27 21:04:22.646139 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:04:22.645817 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ed5fcbea-4993-4d15-bf09-834a79ab7e21-istio-data\") pod \"e2e-ait-560b69a4-openshift-default-5bb65467d6-tt87m\" (UID: \"ed5fcbea-4993-4d15-bf09-834a79ab7e21\") " pod="openshift-ingress/e2e-ait-560b69a4-openshift-default-5bb65467d6-tt87m" Jul 27 21:04:22.646139 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:04:22.645832 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ed5fcbea-4993-4d15-bf09-834a79ab7e21-istio-token\") pod \"e2e-ait-560b69a4-openshift-default-5bb65467d6-tt87m\" (UID: \"ed5fcbea-4993-4d15-bf09-834a79ab7e21\") " pod="openshift-ingress/e2e-ait-560b69a4-openshift-default-5bb65467d6-tt87m" Jul 27 21:04:22.646139 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:04:22.645926 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jtggq\" (UniqueName: \"kubernetes.io/projected/ed5fcbea-4993-4d15-bf09-834a79ab7e21-kube-api-access-jtggq\") pod \"e2e-ait-560b69a4-openshift-default-5bb65467d6-tt87m\" (UID: \"ed5fcbea-4993-4d15-bf09-834a79ab7e21\") " pod="openshift-ingress/e2e-ait-560b69a4-openshift-default-5bb65467d6-tt87m" Jul 27 21:04:22.747191 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:04:22.747167 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ed5fcbea-4993-4d15-bf09-834a79ab7e21-workload-certs\") pod \"e2e-ait-560b69a4-openshift-default-5bb65467d6-tt87m\" (UID: \"ed5fcbea-4993-4d15-bf09-834a79ab7e21\") " pod="openshift-ingress/e2e-ait-560b69a4-openshift-default-5bb65467d6-tt87m" Jul 27 21:04:22.747191 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:04:22.747195 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ed5fcbea-4993-4d15-bf09-834a79ab7e21-istio-envoy\") pod \"e2e-ait-560b69a4-openshift-default-5bb65467d6-tt87m\" (UID: \"ed5fcbea-4993-4d15-bf09-834a79ab7e21\") " pod="openshift-ingress/e2e-ait-560b69a4-openshift-default-5bb65467d6-tt87m" Jul 27 21:04:22.747410 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:04:22.747224 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ed5fcbea-4993-4d15-bf09-834a79ab7e21-istiod-ca-cert\") pod \"e2e-ait-560b69a4-openshift-default-5bb65467d6-tt87m\" (UID: \"ed5fcbea-4993-4d15-bf09-834a79ab7e21\") " pod="openshift-ingress/e2e-ait-560b69a4-openshift-default-5bb65467d6-tt87m" Jul 27 21:04:22.747410 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:04:22.747350 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ed5fcbea-4993-4d15-bf09-834a79ab7e21-credential-socket\") pod \"e2e-ait-560b69a4-openshift-default-5bb65467d6-tt87m\" (UID: \"ed5fcbea-4993-4d15-bf09-834a79ab7e21\") " pod="openshift-ingress/e2e-ait-560b69a4-openshift-default-5bb65467d6-tt87m" Jul 27 21:04:22.747410 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:04:22.747392 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ed5fcbea-4993-4d15-bf09-834a79ab7e21-istio-podinfo\") pod \"e2e-ait-560b69a4-openshift-default-5bb65467d6-tt87m\" (UID: \"ed5fcbea-4993-4d15-bf09-834a79ab7e21\") " pod="openshift-ingress/e2e-ait-560b69a4-openshift-default-5bb65467d6-tt87m" Jul 27 21:04:22.747558 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:04:22.747422 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ed5fcbea-4993-4d15-bf09-834a79ab7e21-workload-socket\") pod \"e2e-ait-560b69a4-openshift-default-5bb65467d6-tt87m\" (UID: \"ed5fcbea-4993-4d15-bf09-834a79ab7e21\") " pod="openshift-ingress/e2e-ait-560b69a4-openshift-default-5bb65467d6-tt87m" Jul 27 21:04:22.747558 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:04:22.747459 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ed5fcbea-4993-4d15-bf09-834a79ab7e21-istio-data\") pod \"e2e-ait-560b69a4-openshift-default-5bb65467d6-tt87m\" (UID: \"ed5fcbea-4993-4d15-bf09-834a79ab7e21\") " pod="openshift-ingress/e2e-ait-560b69a4-openshift-default-5bb65467d6-tt87m" Jul 27 21:04:22.747558 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:04:22.747483 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ed5fcbea-4993-4d15-bf09-834a79ab7e21-istio-token\") pod \"e2e-ait-560b69a4-openshift-default-5bb65467d6-tt87m\" (UID: \"ed5fcbea-4993-4d15-bf09-834a79ab7e21\") " pod="openshift-ingress/e2e-ait-560b69a4-openshift-default-5bb65467d6-tt87m" Jul 27 21:04:22.747701 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:04:22.747572 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jtggq\" (UniqueName: \"kubernetes.io/projected/ed5fcbea-4993-4d15-bf09-834a79ab7e21-kube-api-access-jtggq\") pod \"e2e-ait-560b69a4-openshift-default-5bb65467d6-tt87m\" (UID: \"ed5fcbea-4993-4d15-bf09-834a79ab7e21\") " pod="openshift-ingress/e2e-ait-560b69a4-openshift-default-5bb65467d6-tt87m" Jul 27 21:04:22.747701 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:04:22.747646 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ed5fcbea-4993-4d15-bf09-834a79ab7e21-workload-certs\") pod \"e2e-ait-560b69a4-openshift-default-5bb65467d6-tt87m\" (UID: \"ed5fcbea-4993-4d15-bf09-834a79ab7e21\") " pod="openshift-ingress/e2e-ait-560b69a4-openshift-default-5bb65467d6-tt87m" Jul 27 21:04:22.747793 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:04:22.747724 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ed5fcbea-4993-4d15-bf09-834a79ab7e21-credential-socket\") pod \"e2e-ait-560b69a4-openshift-default-5bb65467d6-tt87m\" (UID: \"ed5fcbea-4993-4d15-bf09-834a79ab7e21\") " pod="openshift-ingress/e2e-ait-560b69a4-openshift-default-5bb65467d6-tt87m" Jul 27 21:04:22.747864 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:04:22.747842 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ed5fcbea-4993-4d15-bf09-834a79ab7e21-workload-socket\") pod \"e2e-ait-560b69a4-openshift-default-5bb65467d6-tt87m\" (UID: \"ed5fcbea-4993-4d15-bf09-834a79ab7e21\") " pod="openshift-ingress/e2e-ait-560b69a4-openshift-default-5bb65467d6-tt87m" Jul 27 21:04:22.748050 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:04:22.748029 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ed5fcbea-4993-4d15-bf09-834a79ab7e21-istio-data\") pod \"e2e-ait-560b69a4-openshift-default-5bb65467d6-tt87m\" (UID: \"ed5fcbea-4993-4d15-bf09-834a79ab7e21\") " pod="openshift-ingress/e2e-ait-560b69a4-openshift-default-5bb65467d6-tt87m" Jul 27 21:04:22.748246 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:04:22.748227 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ed5fcbea-4993-4d15-bf09-834a79ab7e21-istiod-ca-cert\") pod \"e2e-ait-560b69a4-openshift-default-5bb65467d6-tt87m\" (UID: \"ed5fcbea-4993-4d15-bf09-834a79ab7e21\") " pod="openshift-ingress/e2e-ait-560b69a4-openshift-default-5bb65467d6-tt87m" Jul 27 21:04:22.749442 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:04:22.749422 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ed5fcbea-4993-4d15-bf09-834a79ab7e21-istio-envoy\") pod \"e2e-ait-560b69a4-openshift-default-5bb65467d6-tt87m\" (UID: \"ed5fcbea-4993-4d15-bf09-834a79ab7e21\") " pod="openshift-ingress/e2e-ait-560b69a4-openshift-default-5bb65467d6-tt87m" Jul 27 21:04:22.749698 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:04:22.749677 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ed5fcbea-4993-4d15-bf09-834a79ab7e21-istio-podinfo\") pod \"e2e-ait-560b69a4-openshift-default-5bb65467d6-tt87m\" (UID: \"ed5fcbea-4993-4d15-bf09-834a79ab7e21\") " pod="openshift-ingress/e2e-ait-560b69a4-openshift-default-5bb65467d6-tt87m" Jul 27 21:04:22.755141 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:04:22.755120 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ed5fcbea-4993-4d15-bf09-834a79ab7e21-istio-token\") pod \"e2e-ait-560b69a4-openshift-default-5bb65467d6-tt87m\" (UID: \"ed5fcbea-4993-4d15-bf09-834a79ab7e21\") " pod="openshift-ingress/e2e-ait-560b69a4-openshift-default-5bb65467d6-tt87m" Jul 27 21:04:22.755233 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:04:22.755159 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jtggq\" (UniqueName: \"kubernetes.io/projected/ed5fcbea-4993-4d15-bf09-834a79ab7e21-kube-api-access-jtggq\") pod \"e2e-ait-560b69a4-openshift-default-5bb65467d6-tt87m\" (UID: \"ed5fcbea-4993-4d15-bf09-834a79ab7e21\") " pod="openshift-ingress/e2e-ait-560b69a4-openshift-default-5bb65467d6-tt87m" Jul 27 21:04:22.821480 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:04:22.821452 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-560b69a4-openshift-default-5bb65467d6-tt87m" Jul 27 21:04:22.950945 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:04:22.950920 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-560b69a4-openshift-default-5bb65467d6-tt87m"] Jul 27 21:04:22.953269 ip-10-0-139-2 kubenswrapper[2572]: W0727 21:04:22.953242 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poded5fcbea_4993_4d15_bf09_834a79ab7e21.slice/crio-49b5d1bf9d494663fc053872664fa864d92cbba335d70b91605756277f15f792 WatchSource:0}: Error finding container 49b5d1bf9d494663fc053872664fa864d92cbba335d70b91605756277f15f792: Status 404 returned error can't find the container with id 49b5d1bf9d494663fc053872664fa864d92cbba335d70b91605756277f15f792 Jul 27 21:04:22.955280 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:04:22.955249 2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 27 21:04:22.955375 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:04:22.955308 2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 27 21:04:22.955375 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:04:22.955364 2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 27 21:04:23.089341 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:04:23.089239 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbpp5_e2759622-0ab6-46b7-b434-f0a0f8942dfe/konnectivity-agent/0.log" limit=1024 Jul 27 21:04:23.195421 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:04:23.195384 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-560b69a4-openshift-default-5bb65467d6-tt87m" event={"ID":"ed5fcbea-4993-4d15-bf09-834a79ab7e21","Type":"ContainerStarted","Data":"bc4c855811fb182339c17aca0802de103bcda93e7b52e523e82150ec3e8dc041"} Jul 27 21:04:23.195583 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:04:23.195438 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-560b69a4-openshift-default-5bb65467d6-tt87m" event={"ID":"ed5fcbea-4993-4d15-bf09-834a79ab7e21","Type":"ContainerStarted","Data":"49b5d1bf9d494663fc053872664fa864d92cbba335d70b91605756277f15f792"} Jul 27 21:04:23.215681 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:04:23.215628 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-560b69a4-openshift-default-5bb65467d6-tt87m" podStartSLOduration=1.2156118949999999 podStartE2EDuration="1.215611895s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 21:04:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 21:04:23.214735196 +0000 UTC m=+1796.684278243" watchObservedRunningTime="2026-07-27 21:04:23.215611895 +0000 UTC m=+1796.685154903" Jul 27 21:04:23.822490 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:04:23.822456 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-560b69a4-openshift-default-5bb65467d6-tt87m" Jul 27 21:04:24.655351 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:04:24.655307 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbpp5_e2759622-0ab6-46b7-b434-f0a0f8942dfe/konnectivity-agent/0.log" limit=1024 Jul 27 21:04:24.751819 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:04:24.751786 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbpp5_e2759622-0ab6-46b7-b434-f0a0f8942dfe/konnectivity-agent/0.log" limit=1024 Jul 27 21:04:24.826277 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:04:24.826250 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-560b69a4-openshift-default-5bb65467d6-tt87m" Jul 27 21:04:24.833567 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:04:24.833498 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbpp5_e2759622-0ab6-46b7-b434-f0a0f8942dfe/konnectivity-agent/0.log" limit=1024 Jul 27 21:04:25.204236 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:04:25.204163 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-560b69a4-openshift-default-5bb65467d6-tt87m" Jul 27 21:04:25.205191 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:04:25.205172 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-560b69a4-openshift-default-5bb65467d6-tt87m" Jul 27 21:04:25.416339 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:04:25.416286 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbpp5_e2759622-0ab6-46b7-b434-f0a0f8942dfe/konnectivity-agent/0.log" limit=1024 Jul 27 21:04:25.516314 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:04:25.516288 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbpp5_e2759622-0ab6-46b7-b434-f0a0f8942dfe/konnectivity-agent/0.log" limit=1024 Jul 27 21:04:25.553379 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:04:25.553351 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-560b69a4-56554c9768-nz999"] Jul 27 21:04:25.553741 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:04:25.553722 2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="82283efa-b666-4a08-b830-da577271b0e6" containerName="istio-proxy" Jul 27 21:04:25.556704 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:04:25.556687 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-560b69a4-56554c9768-nz999" Jul 27 21:04:25.558834 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:04:25.558811 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ait-560b69a4-dockercfg-654bq\"" Jul 27 21:04:25.558910 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:04:25.558813 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ait-560b69a4\"" Jul 27 21:04:25.567198 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:04:25.567178 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-560b69a4-56554c9768-nz999"] Jul 27 21:04:25.586029 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:04:25.586009 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-560b69a4-79b4456494-cgt2c"] Jul 27 21:04:25.589301 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:04:25.589283 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-560b69a4-79b4456494-cgt2c" Jul 27 21:04:25.598783 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:04:25.598765 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-560b69a4-79b4456494-cgt2c"] Jul 27 21:04:25.601729 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:04:25.601708 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbpp5_e2759622-0ab6-46b7-b434-f0a0f8942dfe/konnectivity-agent/0.log" limit=1024 Jul 27 21:04:25.678353 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:04:25.678289 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e04bdce7-96c6-4145-8963-87e40b1048e4-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-560b69a4-56554c9768-nz999\" (UID: \"e04bdce7-96c6-4145-8963-87e40b1048e4\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-560b69a4-56554c9768-nz999" Jul 27 21:04:25.678532 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:04:25.678451 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4d643f68-5ab8-4159-acb0-cb615972b420-plugins-config-volume\") pod \"payload-processing-e2e-ait-560b69a4-79b4456494-cgt2c\" (UID: \"4d643f68-5ab8-4159-acb0-cb615972b420\") " pod="openshift-ingress/payload-processing-e2e-ait-560b69a4-79b4456494-cgt2c" Jul 27 21:04:25.678607 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:04:25.678540 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fw8tl\" (UniqueName: \"kubernetes.io/projected/4d643f68-5ab8-4159-acb0-cb615972b420-kube-api-access-fw8tl\") pod \"payload-processing-e2e-ait-560b69a4-79b4456494-cgt2c\" (UID: \"4d643f68-5ab8-4159-acb0-cb615972b420\") " pod="openshift-ingress/payload-processing-e2e-ait-560b69a4-79b4456494-cgt2c" Jul 27 21:04:25.678655 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:04:25.678619 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p9wf8\" (UniqueName: \"kubernetes.io/projected/e04bdce7-96c6-4145-8963-87e40b1048e4-kube-api-access-p9wf8\") pod \"payload-pre-processing-e2e-ait-560b69a4-56554c9768-nz999\" (UID: \"e04bdce7-96c6-4145-8963-87e40b1048e4\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-560b69a4-56554c9768-nz999" Jul 27 21:04:25.779338 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:04:25.779245 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e04bdce7-96c6-4145-8963-87e40b1048e4-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-560b69a4-56554c9768-nz999\" (UID: \"e04bdce7-96c6-4145-8963-87e40b1048e4\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-560b69a4-56554c9768-nz999" Jul 27 21:04:25.779338 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:04:25.779290 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4d643f68-5ab8-4159-acb0-cb615972b420-plugins-config-volume\") pod \"payload-processing-e2e-ait-560b69a4-79b4456494-cgt2c\" (UID: \"4d643f68-5ab8-4159-acb0-cb615972b420\") " pod="openshift-ingress/payload-processing-e2e-ait-560b69a4-79b4456494-cgt2c" Jul 27 21:04:25.779513 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:04:25.779369 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fw8tl\" (UniqueName: \"kubernetes.io/projected/4d643f68-5ab8-4159-acb0-cb615972b420-kube-api-access-fw8tl\") pod \"payload-processing-e2e-ait-560b69a4-79b4456494-cgt2c\" (UID: \"4d643f68-5ab8-4159-acb0-cb615972b420\") " pod="openshift-ingress/payload-processing-e2e-ait-560b69a4-79b4456494-cgt2c" Jul 27 21:04:25.779513 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:04:25.779418 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p9wf8\" (UniqueName: \"kubernetes.io/projected/e04bdce7-96c6-4145-8963-87e40b1048e4-kube-api-access-p9wf8\") pod \"payload-pre-processing-e2e-ait-560b69a4-56554c9768-nz999\" (UID: \"e04bdce7-96c6-4145-8963-87e40b1048e4\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-560b69a4-56554c9768-nz999" Jul 27 21:04:25.780000 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:04:25.779982 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4d643f68-5ab8-4159-acb0-cb615972b420-plugins-config-volume\") pod \"payload-processing-e2e-ait-560b69a4-79b4456494-cgt2c\" (UID: \"4d643f68-5ab8-4159-acb0-cb615972b420\") " pod="openshift-ingress/payload-processing-e2e-ait-560b69a4-79b4456494-cgt2c" Jul 27 21:04:25.780104 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:04:25.780087 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e04bdce7-96c6-4145-8963-87e40b1048e4-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-560b69a4-56554c9768-nz999\" (UID: \"e04bdce7-96c6-4145-8963-87e40b1048e4\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-560b69a4-56554c9768-nz999" Jul 27 21:04:25.787293 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:04:25.787264 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fw8tl\" (UniqueName: \"kubernetes.io/projected/4d643f68-5ab8-4159-acb0-cb615972b420-kube-api-access-fw8tl\") pod \"payload-processing-e2e-ait-560b69a4-79b4456494-cgt2c\" (UID: \"4d643f68-5ab8-4159-acb0-cb615972b420\") " pod="openshift-ingress/payload-processing-e2e-ait-560b69a4-79b4456494-cgt2c" Jul 27 21:04:25.787293 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:04:25.787269 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p9wf8\" (UniqueName: \"kubernetes.io/projected/e04bdce7-96c6-4145-8963-87e40b1048e4-kube-api-access-p9wf8\") pod \"payload-pre-processing-e2e-ait-560b69a4-56554c9768-nz999\" (UID: \"e04bdce7-96c6-4145-8963-87e40b1048e4\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-560b69a4-56554c9768-nz999" Jul 27 21:04:25.867220 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:04:25.867191 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-560b69a4-56554c9768-nz999" Jul 27 21:04:25.898738 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:04:25.898713 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-560b69a4-79b4456494-cgt2c" Jul 27 21:04:26.035390 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:04:26.035365 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-560b69a4-79b4456494-cgt2c"] Jul 27 21:04:26.037408 ip-10-0-139-2 kubenswrapper[2572]: W0727 21:04:26.037369 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4d643f68_5ab8_4159_acb0_cb615972b420.slice/crio-1805dd2fb7b1e5444b9b21cc6643f66d8324ff990223efa6a3d87ac658a0f39e WatchSource:0}: Error finding container 1805dd2fb7b1e5444b9b21cc6643f66d8324ff990223efa6a3d87ac658a0f39e: Status 404 returned error can't find the container with id 1805dd2fb7b1e5444b9b21cc6643f66d8324ff990223efa6a3d87ac658a0f39e Jul 27 21:04:26.213305 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:04:26.213279 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-560b69a4-56554c9768-nz999"] Jul 27 21:04:26.213444 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:04:26.213357 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-560b69a4-79b4456494-cgt2c" event={"ID":"4d643f68-5ab8-4159-acb0-cb615972b420","Type":"ContainerStarted","Data":"d6e8f7e354c6810f919a3e5ba51068fe1a1fb087b2dece6ee25b965979cf39dc"} Jul 27 21:04:26.213444 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:04:26.213387 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-560b69a4-79b4456494-cgt2c" event={"ID":"4d643f68-5ab8-4159-acb0-cb615972b420","Type":"ContainerStarted","Data":"1805dd2fb7b1e5444b9b21cc6643f66d8324ff990223efa6a3d87ac658a0f39e"} Jul 27 21:04:26.215259 ip-10-0-139-2 kubenswrapper[2572]: W0727 21:04:26.215235 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode04bdce7_96c6_4145_8963_87e40b1048e4.slice/crio-4f154667de26ea4ed0e676b3c81b7de36ad3d4660048b1ef0dfdd104f35b03cf WatchSource:0}: Error finding container 4f154667de26ea4ed0e676b3c81b7de36ad3d4660048b1ef0dfdd104f35b03cf: Status 404 returned error can't find the container with id 4f154667de26ea4ed0e676b3c81b7de36ad3d4660048b1ef0dfdd104f35b03cf Jul 27 21:04:26.228357 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:04:26.228301 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ait-560b69a4-79b4456494-cgt2c" podStartSLOduration=1.228286107 podStartE2EDuration="1.228286107s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 21:04:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 21:04:26.227718102 +0000 UTC m=+1799.697261112" watchObservedRunningTime="2026-07-27 21:04:26.228286107 +0000 UTC m=+1799.697829118" Jul 27 21:04:26.957094 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:04:26.957073 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-4d7f566d-gw-openshift-default-65f6c88dd-fgz69" Jul 27 21:04:27.092510 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:04:27.092490 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/261c79d1-3c9d-466b-b981-2d3c4127c115-workload-socket\") pod \"261c79d1-3c9d-466b-b981-2d3c4127c115\" (UID: \"261c79d1-3c9d-466b-b981-2d3c4127c115\") " Jul 27 21:04:27.092649 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:04:27.092528 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/261c79d1-3c9d-466b-b981-2d3c4127c115-istiod-ca-cert\") pod \"261c79d1-3c9d-466b-b981-2d3c4127c115\" (UID: \"261c79d1-3c9d-466b-b981-2d3c4127c115\") " Jul 27 21:04:27.092649 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:04:27.092550 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/261c79d1-3c9d-466b-b981-2d3c4127c115-workload-certs\") pod \"261c79d1-3c9d-466b-b981-2d3c4127c115\" (UID: \"261c79d1-3c9d-466b-b981-2d3c4127c115\") " Jul 27 21:04:27.092649 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:04:27.092578 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/261c79d1-3c9d-466b-b981-2d3c4127c115-credential-socket\") pod \"261c79d1-3c9d-466b-b981-2d3c4127c115\" (UID: \"261c79d1-3c9d-466b-b981-2d3c4127c115\") " Jul 27 21:04:27.092649 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:04:27.092632 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/261c79d1-3c9d-466b-b981-2d3c4127c115-istio-token\") pod \"261c79d1-3c9d-466b-b981-2d3c4127c115\" (UID: \"261c79d1-3c9d-466b-b981-2d3c4127c115\") " Jul 27 21:04:27.092871 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:04:27.092752 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/261c79d1-3c9d-466b-b981-2d3c4127c115-istio-data\") pod \"261c79d1-3c9d-466b-b981-2d3c4127c115\" (UID: \"261c79d1-3c9d-466b-b981-2d3c4127c115\") " Jul 27 21:04:27.092871 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:04:27.092765 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/261c79d1-3c9d-466b-b981-2d3c4127c115-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "261c79d1-3c9d-466b-b981-2d3c4127c115" (UID: "261c79d1-3c9d-466b-b981-2d3c4127c115"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 27 21:04:27.092871 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:04:27.092795 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/261c79d1-3c9d-466b-b981-2d3c4127c115-istio-podinfo\") pod \"261c79d1-3c9d-466b-b981-2d3c4127c115\" (UID: \"261c79d1-3c9d-466b-b981-2d3c4127c115\") " Jul 27 21:04:27.092871 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:04:27.092822 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zkkrv\" (UniqueName: \"kubernetes.io/projected/261c79d1-3c9d-466b-b981-2d3c4127c115-kube-api-access-zkkrv\") pod \"261c79d1-3c9d-466b-b981-2d3c4127c115\" (UID: \"261c79d1-3c9d-466b-b981-2d3c4127c115\") " Jul 27 21:04:27.092871 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:04:27.092871 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/261c79d1-3c9d-466b-b981-2d3c4127c115-istio-envoy\") pod \"261c79d1-3c9d-466b-b981-2d3c4127c115\" (UID: \"261c79d1-3c9d-466b-b981-2d3c4127c115\") " Jul 27 21:04:27.093117 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:04:27.092870 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/261c79d1-3c9d-466b-b981-2d3c4127c115-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "261c79d1-3c9d-466b-b981-2d3c4127c115" (UID: "261c79d1-3c9d-466b-b981-2d3c4127c115"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 27 21:04:27.093117 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:04:27.092880 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/261c79d1-3c9d-466b-b981-2d3c4127c115-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "261c79d1-3c9d-466b-b981-2d3c4127c115" (UID: "261c79d1-3c9d-466b-b981-2d3c4127c115"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 27 21:04:27.093117 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:04:27.093014 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/261c79d1-3c9d-466b-b981-2d3c4127c115-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "261c79d1-3c9d-466b-b981-2d3c4127c115" (UID: "261c79d1-3c9d-466b-b981-2d3c4127c115"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 27 21:04:27.093400 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:04:27.093279 2572 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/261c79d1-3c9d-466b-b981-2d3c4127c115-workload-socket\") on node \"ip-10-0-139-2.ec2.internal\" DevicePath \"\"" Jul 27 21:04:27.093400 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:04:27.093300 2572 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/261c79d1-3c9d-466b-b981-2d3c4127c115-istiod-ca-cert\") on node \"ip-10-0-139-2.ec2.internal\" DevicePath \"\"" Jul 27 21:04:27.093400 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:04:27.093314 2572 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/261c79d1-3c9d-466b-b981-2d3c4127c115-workload-certs\") on node \"ip-10-0-139-2.ec2.internal\" DevicePath \"\"" Jul 27 21:04:27.093400 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:04:27.093343 2572 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/261c79d1-3c9d-466b-b981-2d3c4127c115-credential-socket\") on node \"ip-10-0-139-2.ec2.internal\" DevicePath \"\"" Jul 27 21:04:27.093696 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:04:27.093670 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/261c79d1-3c9d-466b-b981-2d3c4127c115-istio-data" (OuterVolumeSpecName: "istio-data") pod "261c79d1-3c9d-466b-b981-2d3c4127c115" (UID: "261c79d1-3c9d-466b-b981-2d3c4127c115"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 27 21:04:27.094798 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:04:27.094773 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/261c79d1-3c9d-466b-b981-2d3c4127c115-istio-token" (OuterVolumeSpecName: "istio-token") pod "261c79d1-3c9d-466b-b981-2d3c4127c115" (UID: "261c79d1-3c9d-466b-b981-2d3c4127c115"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 27 21:04:27.094894 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:04:27.094848 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/261c79d1-3c9d-466b-b981-2d3c4127c115-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "261c79d1-3c9d-466b-b981-2d3c4127c115" (UID: "261c79d1-3c9d-466b-b981-2d3c4127c115"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 27 21:04:27.094894 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:04:27.094846 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/261c79d1-3c9d-466b-b981-2d3c4127c115-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "261c79d1-3c9d-466b-b981-2d3c4127c115" (UID: "261c79d1-3c9d-466b-b981-2d3c4127c115"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 27 21:04:27.094982 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:04:27.094931 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/261c79d1-3c9d-466b-b981-2d3c4127c115-kube-api-access-zkkrv" (OuterVolumeSpecName: "kube-api-access-zkkrv") pod "261c79d1-3c9d-466b-b981-2d3c4127c115" (UID: "261c79d1-3c9d-466b-b981-2d3c4127c115"). InnerVolumeSpecName "kube-api-access-zkkrv". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 27 21:04:27.194125 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:04:27.194099 2572 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/261c79d1-3c9d-466b-b981-2d3c4127c115-istio-data\") on node \"ip-10-0-139-2.ec2.internal\" DevicePath \"\"" Jul 27 21:04:27.194125 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:04:27.194125 2572 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/261c79d1-3c9d-466b-b981-2d3c4127c115-istio-podinfo\") on node \"ip-10-0-139-2.ec2.internal\" DevicePath \"\"" Jul 27 21:04:27.194281 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:04:27.194133 2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zkkrv\" (UniqueName: \"kubernetes.io/projected/261c79d1-3c9d-466b-b981-2d3c4127c115-kube-api-access-zkkrv\") on node \"ip-10-0-139-2.ec2.internal\" DevicePath \"\"" Jul 27 21:04:27.194281 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:04:27.194144 2572 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/261c79d1-3c9d-466b-b981-2d3c4127c115-istio-envoy\") on node \"ip-10-0-139-2.ec2.internal\" DevicePath \"\"" Jul 27 21:04:27.194281 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:04:27.194152 2572 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/261c79d1-3c9d-466b-b981-2d3c4127c115-istio-token\") on node \"ip-10-0-139-2.ec2.internal\" DevicePath \"\"" Jul 27 21:04:27.219911 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:04:27.219886 2572 generic.go:356] "Generic (PLEG): container finished" podID="261c79d1-3c9d-466b-b981-2d3c4127c115" containerID="c4e205ff3a5d07ac0dc5a60a32f615d34c1b12f5a7113a4df06cdb0e52ac2f72" exitCode=0 Jul 27 21:04:27.220048 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:04:27.219937 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-4d7f566d-gw-openshift-default-65f6c88dd-fgz69" Jul 27 21:04:27.220048 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:04:27.219976 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-4d7f566d-gw-openshift-default-65f6c88dd-fgz69" event={"ID":"261c79d1-3c9d-466b-b981-2d3c4127c115","Type":"ContainerDied","Data":"c4e205ff3a5d07ac0dc5a60a32f615d34c1b12f5a7113a4df06cdb0e52ac2f72"} Jul 27 21:04:27.220048 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:04:27.220034 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-4d7f566d-gw-openshift-default-65f6c88dd-fgz69" event={"ID":"261c79d1-3c9d-466b-b981-2d3c4127c115","Type":"ContainerDied","Data":"9c2798a3324a2c9361f74c8dd125a8b629f387d100b5a46c44179dac864249d9"} Jul 27 21:04:27.220185 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:04:27.220060 2572 scope.go:117] "RemoveContainer" containerID="c4e205ff3a5d07ac0dc5a60a32f615d34c1b12f5a7113a4df06cdb0e52ac2f72" Jul 27 21:04:27.221683 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:04:27.221637 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-560b69a4-56554c9768-nz999" event={"ID":"e04bdce7-96c6-4145-8963-87e40b1048e4","Type":"ContainerStarted","Data":"5e9465f996a2788e8856026636586068a5e98f6d8ebc68e3e1dbb84881485c7c"} Jul 27 21:04:27.221832 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:04:27.221802 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ait-560b69a4-56554c9768-nz999" Jul 27 21:04:27.221911 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:04:27.221853 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ait-560b69a4-79b4456494-cgt2c" Jul 27 21:04:27.221911 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:04:27.221880 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-560b69a4-56554c9768-nz999" event={"ID":"e04bdce7-96c6-4145-8963-87e40b1048e4","Type":"ContainerStarted","Data":"4f154667de26ea4ed0e676b3c81b7de36ad3d4660048b1ef0dfdd104f35b03cf"} Jul 27 21:04:27.228403 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:04:27.228272 2572 scope.go:117] "RemoveContainer" containerID="1d8408b81b317991a5817c35968dc329401f93c50cac43ea6d459686d5747f05" Jul 27 21:04:27.235903 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:04:27.235887 2572 scope.go:117] "RemoveContainer" containerID="c4e205ff3a5d07ac0dc5a60a32f615d34c1b12f5a7113a4df06cdb0e52ac2f72" Jul 27 21:04:27.236109 ip-10-0-139-2 kubenswrapper[2572]: E0727 21:04:27.236093 2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c4e205ff3a5d07ac0dc5a60a32f615d34c1b12f5a7113a4df06cdb0e52ac2f72\": container with ID starting with c4e205ff3a5d07ac0dc5a60a32f615d34c1b12f5a7113a4df06cdb0e52ac2f72 not found: ID does not exist" containerID="c4e205ff3a5d07ac0dc5a60a32f615d34c1b12f5a7113a4df06cdb0e52ac2f72" Jul 27 21:04:27.236144 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:04:27.236115 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c4e205ff3a5d07ac0dc5a60a32f615d34c1b12f5a7113a4df06cdb0e52ac2f72"} err="failed to get container status \"c4e205ff3a5d07ac0dc5a60a32f615d34c1b12f5a7113a4df06cdb0e52ac2f72\": rpc error: code = NotFound desc = could not find container \"c4e205ff3a5d07ac0dc5a60a32f615d34c1b12f5a7113a4df06cdb0e52ac2f72\": container with ID starting with c4e205ff3a5d07ac0dc5a60a32f615d34c1b12f5a7113a4df06cdb0e52ac2f72 not found: ID does not exist" Jul 27 21:04:27.236144 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:04:27.236129 2572 scope.go:117] "RemoveContainer" containerID="1d8408b81b317991a5817c35968dc329401f93c50cac43ea6d459686d5747f05" Jul 27 21:04:27.236367 ip-10-0-139-2 kubenswrapper[2572]: E0727 21:04:27.236346 2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1d8408b81b317991a5817c35968dc329401f93c50cac43ea6d459686d5747f05\": container with ID starting with 1d8408b81b317991a5817c35968dc329401f93c50cac43ea6d459686d5747f05 not found: ID does not exist" containerID="1d8408b81b317991a5817c35968dc329401f93c50cac43ea6d459686d5747f05" Jul 27 21:04:27.236443 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:04:27.236370 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1d8408b81b317991a5817c35968dc329401f93c50cac43ea6d459686d5747f05"} err="failed to get container status \"1d8408b81b317991a5817c35968dc329401f93c50cac43ea6d459686d5747f05\": rpc error: code = NotFound desc = could not find container \"1d8408b81b317991a5817c35968dc329401f93c50cac43ea6d459686d5747f05\": container with ID starting with 1d8408b81b317991a5817c35968dc329401f93c50cac43ea6d459686d5747f05 not found: ID does not exist" Jul 27 21:04:27.238114 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:04:27.238078 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ait-560b69a4-56554c9768-nz999" podStartSLOduration=2.238067952 podStartE2EDuration="2.238067952s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 21:04:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 21:04:27.237058413 +0000 UTC m=+1800.706601422" watchObservedRunningTime="2026-07-27 21:04:27.238067952 +0000 UTC m=+1800.707610993" Jul 27 21:04:27.254804 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:04:27.254780 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-migrate-4d7f566d-gw-openshift-default-65f6c88dd-fgz69"] Jul 27 21:04:27.258676 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:04:27.258658 2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-migrate-4d7f566d-gw-openshift-default-65f6c88dd-fgz69"] Jul 27 21:04:29.078381 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:04:29.078342 2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="261c79d1-3c9d-466b-b981-2d3c4127c115" path="/var/lib/kubelet/pods/261c79d1-3c9d-466b-b981-2d3c4127c115/volumes" Jul 27 21:04:38.228208 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:04:38.228173 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ait-560b69a4-56554c9768-nz999" Jul 27 21:04:38.228670 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:04:38.228576 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ait-560b69a4-79b4456494-cgt2c" Jul 27 21:04:40.205955 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:04:40.205919 2572 patch_prober.go:28] interesting pod/e2e-ait-560b69a4-openshift-default-5bb65467d6-tt87m container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.28:15021/healthz/ready\": dial tcp 10.133.0.28:15021: connect: connection refused" start-of-body= Jul 27 21:04:40.206377 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:04:40.206015 2572 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ait-560b69a4-openshift-default-5bb65467d6-tt87m" podUID="ed5fcbea-4993-4d15-bf09-834a79ab7e21" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.28:15021/healthz/ready\": dial tcp 10.133.0.28:15021: connect: connection refused" Jul 27 21:04:40.299477 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:04:40.299445 2572 generic.go:356] "Generic (PLEG): container finished" podID="ed5fcbea-4993-4d15-bf09-834a79ab7e21" containerID="bc4c855811fb182339c17aca0802de103bcda93e7b52e523e82150ec3e8dc041" exitCode=0 Jul 27 21:04:40.299635 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:04:40.299523 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-560b69a4-openshift-default-5bb65467d6-tt87m" event={"ID":"ed5fcbea-4993-4d15-bf09-834a79ab7e21","Type":"ContainerDied","Data":"bc4c855811fb182339c17aca0802de103bcda93e7b52e523e82150ec3e8dc041"} Jul 27 21:04:40.299928 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:04:40.299911 2572 scope.go:117] "RemoveContainer" containerID="bc4c855811fb182339c17aca0802de103bcda93e7b52e523e82150ec3e8dc041" Jul 27 21:04:40.301022 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:04:40.300990 2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 27 21:04:40.301078 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:04:40.301062 2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 27 21:04:40.301114 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:04:40.301094 2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 27 21:04:41.306072 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:04:41.306032 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-560b69a4-openshift-default-5bb65467d6-tt87m" event={"ID":"ed5fcbea-4993-4d15-bf09-834a79ab7e21","Type":"ContainerStarted","Data":"cad10ed8e6e21d0472b58e3816bff81c05b22849f907a007fdd010ea41b274d4"} Jul 27 21:04:41.822395 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:04:41.822363 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-560b69a4-openshift-default-5bb65467d6-tt87m" Jul 27 21:04:41.822629 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:04:41.822610 2572 patch_prober.go:28] interesting pod/e2e-ait-560b69a4-openshift-default-5bb65467d6-tt87m container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.28:15021/healthz/ready\": dial tcp 10.133.0.28:15021: connect: connection refused" start-of-body= Jul 27 21:04:41.822688 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:04:41.822655 2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-560b69a4-openshift-default-5bb65467d6-tt87m" podUID="ed5fcbea-4993-4d15-bf09-834a79ab7e21" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.28:15021/healthz/ready\": dial tcp 10.133.0.28:15021: connect: connection refused" Jul 27 21:04:42.822599 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:04:42.822561 2572 patch_prober.go:28] interesting pod/e2e-ait-560b69a4-openshift-default-5bb65467d6-tt87m container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.28:15021/healthz/ready\": dial tcp 10.133.0.28:15021: connect: connection refused" start-of-body= Jul 27 21:04:42.822984 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:04:42.822626 2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-560b69a4-openshift-default-5bb65467d6-tt87m" podUID="ed5fcbea-4993-4d15-bf09-834a79ab7e21" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.28:15021/healthz/ready\": dial tcp 10.133.0.28:15021: connect: connection refused" Jul 27 21:04:43.822386 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:04:43.822349 2572 patch_prober.go:28] interesting pod/e2e-ait-560b69a4-openshift-default-5bb65467d6-tt87m container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.28:15021/healthz/ready\": dial tcp 10.133.0.28:15021: connect: connection refused" start-of-body= Jul 27 21:04:43.822566 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:04:43.822404 2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-560b69a4-openshift-default-5bb65467d6-tt87m" podUID="ed5fcbea-4993-4d15-bf09-834a79ab7e21" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.28:15021/healthz/ready\": dial tcp 10.133.0.28:15021: connect: connection refused" Jul 27 21:04:44.822775 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:04:44.822735 2572 patch_prober.go:28] interesting pod/e2e-ait-560b69a4-openshift-default-5bb65467d6-tt87m container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.28:15021/healthz/ready\": dial tcp 10.133.0.28:15021: connect: connection refused" start-of-body= Jul 27 21:04:44.823192 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:04:44.822798 2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-560b69a4-openshift-default-5bb65467d6-tt87m" podUID="ed5fcbea-4993-4d15-bf09-834a79ab7e21" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.28:15021/healthz/ready\": dial tcp 10.133.0.28:15021: connect: connection refused" Jul 27 21:04:45.826809 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:04:45.826772 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-560b69a4-openshift-default-5bb65467d6-tt87m" Jul 27 21:04:45.827198 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:04:45.827150 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-560b69a4-openshift-default-5bb65467d6-tt87m" Jul 27 21:04:45.827844 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:04:45.827824 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-560b69a4-openshift-default-5bb65467d6-tt87m" Jul 27 21:05:01.106114 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:05:01.106079 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbpp5_e2759622-0ab6-46b7-b434-f0a0f8942dfe/konnectivity-agent/0.log" limit=1024 Jul 27 21:05:01.154751 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:05:01.154719 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-560b69a4-79b4456494-cgt2c"] Jul 27 21:05:01.155001 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:05:01.154972 2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ait-560b69a4-79b4456494-cgt2c" podUID="4d643f68-5ab8-4159-acb0-cb615972b420" containerName="payload-processing" containerID="cri-o://d6e8f7e354c6810f919a3e5ba51068fe1a1fb087b2dece6ee25b965979cf39dc" gracePeriod=30 Jul 27 21:05:01.172521 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:05:01.172052 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-560b69a4-56554c9768-nz999"] Jul 27 21:05:01.172521 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:05:01.172360 2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ait-560b69a4-56554c9768-nz999" podUID="e04bdce7-96c6-4145-8963-87e40b1048e4" containerName="payload-pre-processing" containerID="cri-o://5e9465f996a2788e8856026636586068a5e98f6d8ebc68e3e1dbb84881485c7c" gracePeriod=30 Jul 27 21:05:01.236068 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:05:01.236038 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbpp5_e2759622-0ab6-46b7-b434-f0a0f8942dfe/konnectivity-agent/0.log" limit=1024 Jul 27 21:05:01.327694 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:05:01.327657 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbpp5_e2759622-0ab6-46b7-b434-f0a0f8942dfe/konnectivity-agent/0.log" limit=1024 Jul 27 21:05:01.391216 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:05:01.391184 2572 generic.go:356] "Generic (PLEG): container finished" podID="4d643f68-5ab8-4159-acb0-cb615972b420" containerID="d6e8f7e354c6810f919a3e5ba51068fe1a1fb087b2dece6ee25b965979cf39dc" exitCode=0 Jul 27 21:05:01.391409 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:05:01.391256 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-560b69a4-79b4456494-cgt2c" event={"ID":"4d643f68-5ab8-4159-acb0-cb615972b420","Type":"ContainerDied","Data":"d6e8f7e354c6810f919a3e5ba51068fe1a1fb087b2dece6ee25b965979cf39dc"} Jul 27 21:05:01.393044 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:05:01.393016 2572 generic.go:356] "Generic (PLEG): container finished" podID="e04bdce7-96c6-4145-8963-87e40b1048e4" containerID="5e9465f996a2788e8856026636586068a5e98f6d8ebc68e3e1dbb84881485c7c" exitCode=0 Jul 27 21:05:01.393180 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:05:01.393093 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-560b69a4-56554c9768-nz999" event={"ID":"e04bdce7-96c6-4145-8963-87e40b1048e4","Type":"ContainerDied","Data":"5e9465f996a2788e8856026636586068a5e98f6d8ebc68e3e1dbb84881485c7c"} Jul 27 21:05:01.441370 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:05:01.441349 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-560b69a4-79b4456494-cgt2c" Jul 27 21:05:01.443899 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:05:01.443881 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-560b69a4-56554c9768-nz999" Jul 27 21:05:01.531005 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:05:01.530972 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fw8tl\" (UniqueName: \"kubernetes.io/projected/4d643f68-5ab8-4159-acb0-cb615972b420-kube-api-access-fw8tl\") pod \"4d643f68-5ab8-4159-acb0-cb615972b420\" (UID: \"4d643f68-5ab8-4159-acb0-cb615972b420\") " Jul 27 21:05:01.531173 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:05:01.531026 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-p9wf8\" (UniqueName: \"kubernetes.io/projected/e04bdce7-96c6-4145-8963-87e40b1048e4-kube-api-access-p9wf8\") pod \"e04bdce7-96c6-4145-8963-87e40b1048e4\" (UID: \"e04bdce7-96c6-4145-8963-87e40b1048e4\") " Jul 27 21:05:01.531173 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:05:01.531064 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e04bdce7-96c6-4145-8963-87e40b1048e4-plugins-config-volume\") pod \"e04bdce7-96c6-4145-8963-87e40b1048e4\" (UID: \"e04bdce7-96c6-4145-8963-87e40b1048e4\") " Jul 27 21:05:01.531173 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:05:01.531122 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4d643f68-5ab8-4159-acb0-cb615972b420-plugins-config-volume\") pod \"4d643f68-5ab8-4159-acb0-cb615972b420\" (UID: \"4d643f68-5ab8-4159-acb0-cb615972b420\") " Jul 27 21:05:01.531547 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:05:01.531523 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e04bdce7-96c6-4145-8963-87e40b1048e4-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "e04bdce7-96c6-4145-8963-87e40b1048e4" (UID: "e04bdce7-96c6-4145-8963-87e40b1048e4"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 27 21:05:01.531621 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:05:01.531561 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4d643f68-5ab8-4159-acb0-cb615972b420-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "4d643f68-5ab8-4159-acb0-cb615972b420" (UID: "4d643f68-5ab8-4159-acb0-cb615972b420"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 27 21:05:01.533079 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:05:01.533055 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4d643f68-5ab8-4159-acb0-cb615972b420-kube-api-access-fw8tl" (OuterVolumeSpecName: "kube-api-access-fw8tl") pod "4d643f68-5ab8-4159-acb0-cb615972b420" (UID: "4d643f68-5ab8-4159-acb0-cb615972b420"). InnerVolumeSpecName "kube-api-access-fw8tl". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 27 21:05:01.533177 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:05:01.533103 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e04bdce7-96c6-4145-8963-87e40b1048e4-kube-api-access-p9wf8" (OuterVolumeSpecName: "kube-api-access-p9wf8") pod "e04bdce7-96c6-4145-8963-87e40b1048e4" (UID: "e04bdce7-96c6-4145-8963-87e40b1048e4"). InnerVolumeSpecName "kube-api-access-p9wf8". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 27 21:05:01.631773 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:05:01.631685 2572 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4d643f68-5ab8-4159-acb0-cb615972b420-plugins-config-volume\") on node \"ip-10-0-139-2.ec2.internal\" DevicePath \"\"" Jul 27 21:05:01.631773 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:05:01.631716 2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fw8tl\" (UniqueName: \"kubernetes.io/projected/4d643f68-5ab8-4159-acb0-cb615972b420-kube-api-access-fw8tl\") on node \"ip-10-0-139-2.ec2.internal\" DevicePath \"\"" Jul 27 21:05:01.631773 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:05:01.631726 2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-p9wf8\" (UniqueName: \"kubernetes.io/projected/e04bdce7-96c6-4145-8963-87e40b1048e4-kube-api-access-p9wf8\") on node \"ip-10-0-139-2.ec2.internal\" DevicePath \"\"" Jul 27 21:05:01.631773 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:05:01.631737 2572 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e04bdce7-96c6-4145-8963-87e40b1048e4-plugins-config-volume\") on node \"ip-10-0-139-2.ec2.internal\" DevicePath \"\"" Jul 27 21:05:02.398945 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:05:02.398908 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-560b69a4-79b4456494-cgt2c" Jul 27 21:05:02.399423 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:05:02.398939 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-560b69a4-79b4456494-cgt2c" event={"ID":"4d643f68-5ab8-4159-acb0-cb615972b420","Type":"ContainerDied","Data":"1805dd2fb7b1e5444b9b21cc6643f66d8324ff990223efa6a3d87ac658a0f39e"} Jul 27 21:05:02.399423 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:05:02.399010 2572 scope.go:117] "RemoveContainer" containerID="d6e8f7e354c6810f919a3e5ba51068fe1a1fb087b2dece6ee25b965979cf39dc" Jul 27 21:05:02.400245 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:05:02.400177 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-560b69a4-56554c9768-nz999" event={"ID":"e04bdce7-96c6-4145-8963-87e40b1048e4","Type":"ContainerDied","Data":"4f154667de26ea4ed0e676b3c81b7de36ad3d4660048b1ef0dfdd104f35b03cf"} Jul 27 21:05:02.400245 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:05:02.400196 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-560b69a4-56554c9768-nz999" Jul 27 21:05:02.408546 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:05:02.408522 2572 scope.go:117] "RemoveContainer" containerID="5e9465f996a2788e8856026636586068a5e98f6d8ebc68e3e1dbb84881485c7c" Jul 27 21:05:02.419591 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:05:02.419545 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-560b69a4-79b4456494-cgt2c"] Jul 27 21:05:02.424024 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:05:02.424003 2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-560b69a4-79b4456494-cgt2c"] Jul 27 21:05:02.433433 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:05:02.433410 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-560b69a4-56554c9768-nz999"] Jul 27 21:05:02.437108 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:05:02.437086 2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-560b69a4-56554c9768-nz999"] Jul 27 21:05:03.078475 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:05:03.078445 2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4d643f68-5ab8-4159-acb0-cb615972b420" path="/var/lib/kubelet/pods/4d643f68-5ab8-4159-acb0-cb615972b420/volumes" Jul 27 21:05:03.078824 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:05:03.078811 2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e04bdce7-96c6-4145-8963-87e40b1048e4" path="/var/lib/kubelet/pods/e04bdce7-96c6-4145-8963-87e40b1048e4/volumes" Jul 27 21:05:05.552545 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:05:05.552488 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbpp5_e2759622-0ab6-46b7-b434-f0a0f8942dfe/konnectivity-agent/0.log" limit=1024 Jul 27 21:05:06.754558 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:05:06.754527 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-560b69a4-openshift-default-5bb65467d6-tt87m"] Jul 27 21:05:06.754960 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:05:06.754749 2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-560b69a4-openshift-default-5bb65467d6-tt87m" podUID="ed5fcbea-4993-4d15-bf09-834a79ab7e21" containerName="istio-proxy" containerID="cri-o://cad10ed8e6e21d0472b58e3816bff81c05b22849f907a007fdd010ea41b274d4" gracePeriod=30 Jul 27 21:05:06.779334 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:05:06.779296 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbpp5_e2759622-0ab6-46b7-b434-f0a0f8942dfe/konnectivity-agent/0.log" limit=1024 Jul 27 21:05:07.000343 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:05:07.000294 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbpp5_e2759622-0ab6-46b7-b434-f0a0f8942dfe/konnectivity-agent/0.log" limit=1024 Jul 27 21:05:07.246236 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:05:07.246207 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbpp5_e2759622-0ab6-46b7-b434-f0a0f8942dfe/konnectivity-agent/0.log" limit=1024 Jul 27 21:05:07.531062 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:05:07.531026 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-derive-93e2aa82-openshift-default-6545f447cb-2ws55"] Jul 27 21:05:07.531432 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:05:07.531416 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="261c79d1-3c9d-466b-b981-2d3c4127c115" containerName="istio-proxy" Jul 27 21:05:07.531476 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:05:07.531435 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="261c79d1-3c9d-466b-b981-2d3c4127c115" containerName="istio-proxy" Jul 27 21:05:07.531476 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:05:07.531450 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="261c79d1-3c9d-466b-b981-2d3c4127c115" containerName="istio-proxy" Jul 27 21:05:07.531476 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:05:07.531456 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="261c79d1-3c9d-466b-b981-2d3c4127c115" containerName="istio-proxy" Jul 27 21:05:07.531476 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:05:07.531465 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4d643f68-5ab8-4159-acb0-cb615972b420" containerName="payload-processing" Jul 27 21:05:07.531476 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:05:07.531475 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="4d643f68-5ab8-4159-acb0-cb615972b420" containerName="payload-processing" Jul 27 21:05:07.531635 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:05:07.531483 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e04bdce7-96c6-4145-8963-87e40b1048e4" containerName="payload-pre-processing" Jul 27 21:05:07.531635 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:05:07.531489 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="e04bdce7-96c6-4145-8963-87e40b1048e4" containerName="payload-pre-processing" Jul 27 21:05:07.531635 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:05:07.531572 2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="261c79d1-3c9d-466b-b981-2d3c4127c115" containerName="istio-proxy" Jul 27 21:05:07.531635 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:05:07.531580 2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="e04bdce7-96c6-4145-8963-87e40b1048e4" containerName="payload-pre-processing" Jul 27 21:05:07.531635 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:05:07.531586 2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="4d643f68-5ab8-4159-acb0-cb615972b420" containerName="payload-processing" Jul 27 21:05:07.531635 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:05:07.531591 2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="261c79d1-3c9d-466b-b981-2d3c4127c115" containerName="istio-proxy" Jul 27 21:05:07.536491 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:05:07.536470 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-93e2aa82-openshift-default-6545f447cb-2ws55" Jul 27 21:05:07.541123 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:05:07.541105 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-derive-93e2aa82-openshift-default-dockercfg-w4qr8\"" Jul 27 21:05:07.550992 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:05:07.550966 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-93e2aa82-openshift-default-6545f447cb-2ws55"] Jul 27 21:05:07.561169 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:05:07.561144 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbpp5_e2759622-0ab6-46b7-b434-f0a0f8942dfe/konnectivity-agent/0.log" limit=1024 Jul 27 21:05:07.585453 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:05:07.585414 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5960cc91-2efb-4f65-8189-530bf93f04b5-istiod-ca-cert\") pod \"e2e-derive-93e2aa82-openshift-default-6545f447cb-2ws55\" (UID: \"5960cc91-2efb-4f65-8189-530bf93f04b5\") " pod="openshift-ingress/e2e-derive-93e2aa82-openshift-default-6545f447cb-2ws55" Jul 27 21:05:07.585622 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:05:07.585473 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5960cc91-2efb-4f65-8189-530bf93f04b5-istio-token\") pod \"e2e-derive-93e2aa82-openshift-default-6545f447cb-2ws55\" (UID: \"5960cc91-2efb-4f65-8189-530bf93f04b5\") " pod="openshift-ingress/e2e-derive-93e2aa82-openshift-default-6545f447cb-2ws55" Jul 27 21:05:07.585622 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:05:07.585537 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5960cc91-2efb-4f65-8189-530bf93f04b5-workload-certs\") pod \"e2e-derive-93e2aa82-openshift-default-6545f447cb-2ws55\" (UID: \"5960cc91-2efb-4f65-8189-530bf93f04b5\") " pod="openshift-ingress/e2e-derive-93e2aa82-openshift-default-6545f447cb-2ws55" Jul 27 21:05:07.585622 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:05:07.585558 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5960cc91-2efb-4f65-8189-530bf93f04b5-istio-podinfo\") pod \"e2e-derive-93e2aa82-openshift-default-6545f447cb-2ws55\" (UID: \"5960cc91-2efb-4f65-8189-530bf93f04b5\") " pod="openshift-ingress/e2e-derive-93e2aa82-openshift-default-6545f447cb-2ws55" Jul 27 21:05:07.585622 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:05:07.585601 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5960cc91-2efb-4f65-8189-530bf93f04b5-workload-socket\") pod \"e2e-derive-93e2aa82-openshift-default-6545f447cb-2ws55\" (UID: \"5960cc91-2efb-4f65-8189-530bf93f04b5\") " pod="openshift-ingress/e2e-derive-93e2aa82-openshift-default-6545f447cb-2ws55" Jul 27 21:05:07.585797 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:05:07.585639 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j98td\" (UniqueName: \"kubernetes.io/projected/5960cc91-2efb-4f65-8189-530bf93f04b5-kube-api-access-j98td\") pod \"e2e-derive-93e2aa82-openshift-default-6545f447cb-2ws55\" (UID: \"5960cc91-2efb-4f65-8189-530bf93f04b5\") " pod="openshift-ingress/e2e-derive-93e2aa82-openshift-default-6545f447cb-2ws55" Jul 27 21:05:07.585797 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:05:07.585675 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5960cc91-2efb-4f65-8189-530bf93f04b5-istio-envoy\") pod \"e2e-derive-93e2aa82-openshift-default-6545f447cb-2ws55\" (UID: \"5960cc91-2efb-4f65-8189-530bf93f04b5\") " pod="openshift-ingress/e2e-derive-93e2aa82-openshift-default-6545f447cb-2ws55" Jul 27 21:05:07.585797 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:05:07.585728 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5960cc91-2efb-4f65-8189-530bf93f04b5-credential-socket\") pod \"e2e-derive-93e2aa82-openshift-default-6545f447cb-2ws55\" (UID: \"5960cc91-2efb-4f65-8189-530bf93f04b5\") " pod="openshift-ingress/e2e-derive-93e2aa82-openshift-default-6545f447cb-2ws55" Jul 27 21:05:07.585797 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:05:07.585753 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5960cc91-2efb-4f65-8189-530bf93f04b5-istio-data\") pod \"e2e-derive-93e2aa82-openshift-default-6545f447cb-2ws55\" (UID: \"5960cc91-2efb-4f65-8189-530bf93f04b5\") " pod="openshift-ingress/e2e-derive-93e2aa82-openshift-default-6545f447cb-2ws55" Jul 27 21:05:07.662871 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:05:07.662835 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbpp5_e2759622-0ab6-46b7-b434-f0a0f8942dfe/konnectivity-agent/0.log" limit=1024 Jul 27 21:05:07.686338 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:05:07.686285 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5960cc91-2efb-4f65-8189-530bf93f04b5-istio-envoy\") pod \"e2e-derive-93e2aa82-openshift-default-6545f447cb-2ws55\" (UID: \"5960cc91-2efb-4f65-8189-530bf93f04b5\") " pod="openshift-ingress/e2e-derive-93e2aa82-openshift-default-6545f447cb-2ws55" Jul 27 21:05:07.686533 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:05:07.686368 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5960cc91-2efb-4f65-8189-530bf93f04b5-credential-socket\") pod \"e2e-derive-93e2aa82-openshift-default-6545f447cb-2ws55\" (UID: \"5960cc91-2efb-4f65-8189-530bf93f04b5\") " pod="openshift-ingress/e2e-derive-93e2aa82-openshift-default-6545f447cb-2ws55" Jul 27 21:05:07.686533 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:05:07.686394 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5960cc91-2efb-4f65-8189-530bf93f04b5-istio-data\") pod \"e2e-derive-93e2aa82-openshift-default-6545f447cb-2ws55\" (UID: \"5960cc91-2efb-4f65-8189-530bf93f04b5\") " pod="openshift-ingress/e2e-derive-93e2aa82-openshift-default-6545f447cb-2ws55" Jul 27 21:05:07.686533 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:05:07.686433 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5960cc91-2efb-4f65-8189-530bf93f04b5-istiod-ca-cert\") pod \"e2e-derive-93e2aa82-openshift-default-6545f447cb-2ws55\" (UID: \"5960cc91-2efb-4f65-8189-530bf93f04b5\") " pod="openshift-ingress/e2e-derive-93e2aa82-openshift-default-6545f447cb-2ws55" Jul 27 21:05:07.686533 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:05:07.686485 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5960cc91-2efb-4f65-8189-530bf93f04b5-istio-token\") pod \"e2e-derive-93e2aa82-openshift-default-6545f447cb-2ws55\" (UID: \"5960cc91-2efb-4f65-8189-530bf93f04b5\") " pod="openshift-ingress/e2e-derive-93e2aa82-openshift-default-6545f447cb-2ws55" Jul 27 21:05:07.686752 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:05:07.686543 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5960cc91-2efb-4f65-8189-530bf93f04b5-workload-certs\") pod \"e2e-derive-93e2aa82-openshift-default-6545f447cb-2ws55\" (UID: \"5960cc91-2efb-4f65-8189-530bf93f04b5\") " pod="openshift-ingress/e2e-derive-93e2aa82-openshift-default-6545f447cb-2ws55" Jul 27 21:05:07.686752 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:05:07.686567 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5960cc91-2efb-4f65-8189-530bf93f04b5-istio-podinfo\") pod \"e2e-derive-93e2aa82-openshift-default-6545f447cb-2ws55\" (UID: \"5960cc91-2efb-4f65-8189-530bf93f04b5\") " pod="openshift-ingress/e2e-derive-93e2aa82-openshift-default-6545f447cb-2ws55" Jul 27 21:05:07.686752 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:05:07.686595 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5960cc91-2efb-4f65-8189-530bf93f04b5-workload-socket\") pod \"e2e-derive-93e2aa82-openshift-default-6545f447cb-2ws55\" (UID: \"5960cc91-2efb-4f65-8189-530bf93f04b5\") " pod="openshift-ingress/e2e-derive-93e2aa82-openshift-default-6545f447cb-2ws55" Jul 27 21:05:07.686752 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:05:07.686628 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j98td\" (UniqueName: \"kubernetes.io/projected/5960cc91-2efb-4f65-8189-530bf93f04b5-kube-api-access-j98td\") pod \"e2e-derive-93e2aa82-openshift-default-6545f447cb-2ws55\" (UID: \"5960cc91-2efb-4f65-8189-530bf93f04b5\") " pod="openshift-ingress/e2e-derive-93e2aa82-openshift-default-6545f447cb-2ws55" Jul 27 21:05:07.686949 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:05:07.686840 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5960cc91-2efb-4f65-8189-530bf93f04b5-istio-data\") pod \"e2e-derive-93e2aa82-openshift-default-6545f447cb-2ws55\" (UID: \"5960cc91-2efb-4f65-8189-530bf93f04b5\") " pod="openshift-ingress/e2e-derive-93e2aa82-openshift-default-6545f447cb-2ws55" Jul 27 21:05:07.687353 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:05:07.687125 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5960cc91-2efb-4f65-8189-530bf93f04b5-workload-certs\") pod \"e2e-derive-93e2aa82-openshift-default-6545f447cb-2ws55\" (UID: \"5960cc91-2efb-4f65-8189-530bf93f04b5\") " pod="openshift-ingress/e2e-derive-93e2aa82-openshift-default-6545f447cb-2ws55" Jul 27 21:05:07.687353 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:05:07.687275 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5960cc91-2efb-4f65-8189-530bf93f04b5-istiod-ca-cert\") pod \"e2e-derive-93e2aa82-openshift-default-6545f447cb-2ws55\" (UID: \"5960cc91-2efb-4f65-8189-530bf93f04b5\") " pod="openshift-ingress/e2e-derive-93e2aa82-openshift-default-6545f447cb-2ws55" Jul 27 21:05:07.687601 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:05:07.687401 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5960cc91-2efb-4f65-8189-530bf93f04b5-workload-socket\") pod \"e2e-derive-93e2aa82-openshift-default-6545f447cb-2ws55\" (UID: \"5960cc91-2efb-4f65-8189-530bf93f04b5\") " pod="openshift-ingress/e2e-derive-93e2aa82-openshift-default-6545f447cb-2ws55" Jul 27 21:05:07.688091 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:05:07.688067 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5960cc91-2efb-4f65-8189-530bf93f04b5-credential-socket\") pod \"e2e-derive-93e2aa82-openshift-default-6545f447cb-2ws55\" (UID: \"5960cc91-2efb-4f65-8189-530bf93f04b5\") " pod="openshift-ingress/e2e-derive-93e2aa82-openshift-default-6545f447cb-2ws55" Jul 27 21:05:07.688972 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:05:07.688949 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5960cc91-2efb-4f65-8189-530bf93f04b5-istio-envoy\") pod \"e2e-derive-93e2aa82-openshift-default-6545f447cb-2ws55\" (UID: \"5960cc91-2efb-4f65-8189-530bf93f04b5\") " pod="openshift-ingress/e2e-derive-93e2aa82-openshift-default-6545f447cb-2ws55" Jul 27 21:05:07.689949 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:05:07.689928 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5960cc91-2efb-4f65-8189-530bf93f04b5-istio-podinfo\") pod \"e2e-derive-93e2aa82-openshift-default-6545f447cb-2ws55\" (UID: \"5960cc91-2efb-4f65-8189-530bf93f04b5\") " pod="openshift-ingress/e2e-derive-93e2aa82-openshift-default-6545f447cb-2ws55" Jul 27 21:05:07.697174 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:05:07.697129 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j98td\" (UniqueName: \"kubernetes.io/projected/5960cc91-2efb-4f65-8189-530bf93f04b5-kube-api-access-j98td\") pod \"e2e-derive-93e2aa82-openshift-default-6545f447cb-2ws55\" (UID: \"5960cc91-2efb-4f65-8189-530bf93f04b5\") " pod="openshift-ingress/e2e-derive-93e2aa82-openshift-default-6545f447cb-2ws55" Jul 27 21:05:07.697865 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:05:07.697847 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5960cc91-2efb-4f65-8189-530bf93f04b5-istio-token\") pod \"e2e-derive-93e2aa82-openshift-default-6545f447cb-2ws55\" (UID: \"5960cc91-2efb-4f65-8189-530bf93f04b5\") " pod="openshift-ingress/e2e-derive-93e2aa82-openshift-default-6545f447cb-2ws55" Jul 27 21:05:07.846672 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:05:07.846581 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-93e2aa82-openshift-default-6545f447cb-2ws55" Jul 27 21:05:07.979219 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:05:07.979188 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-93e2aa82-openshift-default-6545f447cb-2ws55"] Jul 27 21:05:07.981889 ip-10-0-139-2 kubenswrapper[2572]: W0727 21:05:07.981858 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5960cc91_2efb_4f65_8189_530bf93f04b5.slice/crio-ac0b364b5f7628622ff919f1337a59dcd0bff44fbfd2118e21ec05677716cda4 WatchSource:0}: Error finding container ac0b364b5f7628622ff919f1337a59dcd0bff44fbfd2118e21ec05677716cda4: Status 404 returned error can't find the container with id ac0b364b5f7628622ff919f1337a59dcd0bff44fbfd2118e21ec05677716cda4 Jul 27 21:05:07.984028 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:05:07.983997 2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 27 21:05:07.984095 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:05:07.984059 2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 27 21:05:07.984095 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:05:07.984088 2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 27 21:05:08.433300 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:05:08.433263 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-93e2aa82-openshift-default-6545f447cb-2ws55" event={"ID":"5960cc91-2efb-4f65-8189-530bf93f04b5","Type":"ContainerStarted","Data":"289fee4961e5c821f0e53095fbed58f4dcd4cd2979b1a3c406bd0f2f64cd3a6f"} Jul 27 21:05:08.433495 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:05:08.433342 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-93e2aa82-openshift-default-6545f447cb-2ws55" event={"ID":"5960cc91-2efb-4f65-8189-530bf93f04b5","Type":"ContainerStarted","Data":"ac0b364b5f7628622ff919f1337a59dcd0bff44fbfd2118e21ec05677716cda4"} Jul 27 21:05:08.452587 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:05:08.452536 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-derive-93e2aa82-openshift-default-6545f447cb-2ws55" podStartSLOduration=1.452511643 podStartE2EDuration="1.452511643s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 21:05:07 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 21:05:08.45118014 +0000 UTC m=+1841.920723150" watchObservedRunningTime="2026-07-27 21:05:08.452511643 +0000 UTC m=+1841.922054652" Jul 27 21:05:08.847509 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:05:08.847455 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-93e2aa82-openshift-default-6545f447cb-2ws55" Jul 27 21:05:09.852460 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:05:09.852425 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-93e2aa82-openshift-default-6545f447cb-2ws55" Jul 27 21:05:09.951540 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:05:09.951503 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbpp5_e2759622-0ab6-46b7-b434-f0a0f8942dfe/konnectivity-agent/0.log" limit=1024 Jul 27 21:05:10.056256 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:05:10.056224 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbpp5_e2759622-0ab6-46b7-b434-f0a0f8942dfe/konnectivity-agent/0.log" limit=1024 Jul 27 21:05:10.443577 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:05:10.443545 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-93e2aa82-openshift-default-6545f447cb-2ws55" Jul 27 21:05:10.444485 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:05:10.444465 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-93e2aa82-openshift-default-6545f447cb-2ws55" Jul 27 21:05:10.476527 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:05:10.476478 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbpp5_e2759622-0ab6-46b7-b434-f0a0f8942dfe/konnectivity-agent/0.log" limit=1024 Jul 27 21:05:10.828184 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:05:10.828142 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbpp5_e2759622-0ab6-46b7-b434-f0a0f8942dfe/konnectivity-agent/0.log" limit=1024 Jul 27 21:05:10.957352 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:05:10.957302 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbpp5_e2759622-0ab6-46b7-b434-f0a0f8942dfe/konnectivity-agent/0.log" limit=1024 Jul 27 21:05:11.110928 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:05:11.110838 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbpp5_e2759622-0ab6-46b7-b434-f0a0f8942dfe/konnectivity-agent/0.log" limit=1024 Jul 27 21:05:11.176822 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:05:11.176787 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-93e2aa82-7cf4db5cb-dl9zb"] Jul 27 21:05:11.180298 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:05:11.180276 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-derive-93e2aa82-7cf4db5cb-dl9zb" Jul 27 21:05:11.182257 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:05:11.182233 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-derive-93e2aa82\"" Jul 27 21:05:11.182390 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:05:11.182373 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-derive-93e2aa82-dockercfg-b4d8t\"" Jul 27 21:05:11.190299 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:05:11.190273 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-93e2aa82-7cf4db5cb-dl9zb"] Jul 27 21:05:11.212571 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:05:11.212533 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wglkn\" (UniqueName: \"kubernetes.io/projected/e1101af0-4807-4b48-b273-d6818ef8bc2d-kube-api-access-wglkn\") pod \"payload-pre-processing-e2e-derive-93e2aa82-7cf4db5cb-dl9zb\" (UID: \"e1101af0-4807-4b48-b273-d6818ef8bc2d\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-93e2aa82-7cf4db5cb-dl9zb" Jul 27 21:05:11.212571 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:05:11.212574 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e1101af0-4807-4b48-b273-d6818ef8bc2d-plugins-config-volume\") pod \"payload-pre-processing-e2e-derive-93e2aa82-7cf4db5cb-dl9zb\" (UID: \"e1101af0-4807-4b48-b273-d6818ef8bc2d\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-93e2aa82-7cf4db5cb-dl9zb" Jul 27 21:05:11.273280 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:05:11.273249 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-93e2aa82-85cbd449cd-gdmh5"] Jul 27 21:05:11.277059 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:05:11.277035 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-derive-93e2aa82-85cbd449cd-gdmh5" Jul 27 21:05:11.286708 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:05:11.286680 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-93e2aa82-85cbd449cd-gdmh5"] Jul 27 21:05:11.313099 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:05:11.313062 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m9tlp\" (UniqueName: \"kubernetes.io/projected/68702e23-212e-4919-a92e-90bf73e6b7a8-kube-api-access-m9tlp\") pod \"payload-processing-e2e-derive-93e2aa82-85cbd449cd-gdmh5\" (UID: \"68702e23-212e-4919-a92e-90bf73e6b7a8\") " pod="openshift-ingress/payload-processing-e2e-derive-93e2aa82-85cbd449cd-gdmh5" Jul 27 21:05:11.313263 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:05:11.313152 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/68702e23-212e-4919-a92e-90bf73e6b7a8-plugins-config-volume\") pod \"payload-processing-e2e-derive-93e2aa82-85cbd449cd-gdmh5\" (UID: \"68702e23-212e-4919-a92e-90bf73e6b7a8\") " pod="openshift-ingress/payload-processing-e2e-derive-93e2aa82-85cbd449cd-gdmh5" Jul 27 21:05:11.313263 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:05:11.313203 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wglkn\" (UniqueName: \"kubernetes.io/projected/e1101af0-4807-4b48-b273-d6818ef8bc2d-kube-api-access-wglkn\") pod \"payload-pre-processing-e2e-derive-93e2aa82-7cf4db5cb-dl9zb\" (UID: \"e1101af0-4807-4b48-b273-d6818ef8bc2d\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-93e2aa82-7cf4db5cb-dl9zb" Jul 27 21:05:11.313263 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:05:11.313238 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e1101af0-4807-4b48-b273-d6818ef8bc2d-plugins-config-volume\") pod \"payload-pre-processing-e2e-derive-93e2aa82-7cf4db5cb-dl9zb\" (UID: \"e1101af0-4807-4b48-b273-d6818ef8bc2d\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-93e2aa82-7cf4db5cb-dl9zb" Jul 27 21:05:11.314138 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:05:11.314116 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e1101af0-4807-4b48-b273-d6818ef8bc2d-plugins-config-volume\") pod \"payload-pre-processing-e2e-derive-93e2aa82-7cf4db5cb-dl9zb\" (UID: \"e1101af0-4807-4b48-b273-d6818ef8bc2d\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-93e2aa82-7cf4db5cb-dl9zb" Jul 27 21:05:11.321045 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:05:11.321026 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wglkn\" (UniqueName: \"kubernetes.io/projected/e1101af0-4807-4b48-b273-d6818ef8bc2d-kube-api-access-wglkn\") pod \"payload-pre-processing-e2e-derive-93e2aa82-7cf4db5cb-dl9zb\" (UID: \"e1101af0-4807-4b48-b273-d6818ef8bc2d\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-93e2aa82-7cf4db5cb-dl9zb" Jul 27 21:05:11.414672 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:05:11.414563 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m9tlp\" (UniqueName: \"kubernetes.io/projected/68702e23-212e-4919-a92e-90bf73e6b7a8-kube-api-access-m9tlp\") pod \"payload-processing-e2e-derive-93e2aa82-85cbd449cd-gdmh5\" (UID: \"68702e23-212e-4919-a92e-90bf73e6b7a8\") " pod="openshift-ingress/payload-processing-e2e-derive-93e2aa82-85cbd449cd-gdmh5" Jul 27 21:05:11.414852 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:05:11.414709 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/68702e23-212e-4919-a92e-90bf73e6b7a8-plugins-config-volume\") pod \"payload-processing-e2e-derive-93e2aa82-85cbd449cd-gdmh5\" (UID: \"68702e23-212e-4919-a92e-90bf73e6b7a8\") " pod="openshift-ingress/payload-processing-e2e-derive-93e2aa82-85cbd449cd-gdmh5" Jul 27 21:05:11.415413 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:05:11.415394 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/68702e23-212e-4919-a92e-90bf73e6b7a8-plugins-config-volume\") pod \"payload-processing-e2e-derive-93e2aa82-85cbd449cd-gdmh5\" (UID: \"68702e23-212e-4919-a92e-90bf73e6b7a8\") " pod="openshift-ingress/payload-processing-e2e-derive-93e2aa82-85cbd449cd-gdmh5" Jul 27 21:05:11.422328 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:05:11.422285 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m9tlp\" (UniqueName: \"kubernetes.io/projected/68702e23-212e-4919-a92e-90bf73e6b7a8-kube-api-access-m9tlp\") pod \"payload-processing-e2e-derive-93e2aa82-85cbd449cd-gdmh5\" (UID: \"68702e23-212e-4919-a92e-90bf73e6b7a8\") " pod="openshift-ingress/payload-processing-e2e-derive-93e2aa82-85cbd449cd-gdmh5" Jul 27 21:05:11.491989 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:05:11.491947 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-derive-93e2aa82-7cf4db5cb-dl9zb" Jul 27 21:05:11.590746 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:05:11.590705 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-derive-93e2aa82-85cbd449cd-gdmh5" Jul 27 21:05:11.626562 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:05:11.626535 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-93e2aa82-7cf4db5cb-dl9zb"] Jul 27 21:05:11.629113 ip-10-0-139-2 kubenswrapper[2572]: W0727 21:05:11.629082 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode1101af0_4807_4b48_b273_d6818ef8bc2d.slice/crio-617ed06a7a28192a0704edb957ab3e05a9c06a01c46b14dd44c081c61d7a079e WatchSource:0}: Error finding container 617ed06a7a28192a0704edb957ab3e05a9c06a01c46b14dd44c081c61d7a079e: Status 404 returned error can't find the container with id 617ed06a7a28192a0704edb957ab3e05a9c06a01c46b14dd44c081c61d7a079e Jul 27 21:05:11.728351 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:05:11.728280 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-93e2aa82-85cbd449cd-gdmh5"] Jul 27 21:05:11.730558 ip-10-0-139-2 kubenswrapper[2572]: W0727 21:05:11.730532 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod68702e23_212e_4919_a92e_90bf73e6b7a8.slice/crio-9a5edc3b5d9bbff4c0b2d5d1c663401e76200029ba5eaf683bb7dd73684f75c1 WatchSource:0}: Error finding container 9a5edc3b5d9bbff4c0b2d5d1c663401e76200029ba5eaf683bb7dd73684f75c1: Status 404 returned error can't find the container with id 9a5edc3b5d9bbff4c0b2d5d1c663401e76200029ba5eaf683bb7dd73684f75c1 Jul 27 21:05:11.804754 ip-10-0-139-2 kubenswrapper[2572]: E0727 21:05:11.804707 2572 cadvisor_stats_provider.go:567] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poded5fcbea_4993_4d15_bf09_834a79ab7e21.slice/crio-cad10ed8e6e21d0472b58e3816bff81c05b22849f907a007fdd010ea41b274d4.scope\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poded5fcbea_4993_4d15_bf09_834a79ab7e21.slice/crio-conmon-cad10ed8e6e21d0472b58e3816bff81c05b22849f907a007fdd010ea41b274d4.scope\": RecentStats: unable to find data in memory cache]" Jul 27 21:05:12.001096 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:05:12.001066 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-560b69a4-openshift-default-5bb65467d6-tt87m" Jul 27 21:05:12.020619 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:05:12.020490 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ed5fcbea-4993-4d15-bf09-834a79ab7e21-workload-socket\") pod \"ed5fcbea-4993-4d15-bf09-834a79ab7e21\" (UID: \"ed5fcbea-4993-4d15-bf09-834a79ab7e21\") " Jul 27 21:05:12.020619 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:05:12.020540 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ed5fcbea-4993-4d15-bf09-834a79ab7e21-istio-data\") pod \"ed5fcbea-4993-4d15-bf09-834a79ab7e21\" (UID: \"ed5fcbea-4993-4d15-bf09-834a79ab7e21\") " Jul 27 21:05:12.020619 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:05:12.020600 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ed5fcbea-4993-4d15-bf09-834a79ab7e21-credential-socket\") pod \"ed5fcbea-4993-4d15-bf09-834a79ab7e21\" (UID: \"ed5fcbea-4993-4d15-bf09-834a79ab7e21\") " Jul 27 21:05:12.020877 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:05:12.020636 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ed5fcbea-4993-4d15-bf09-834a79ab7e21-istio-podinfo\") pod \"ed5fcbea-4993-4d15-bf09-834a79ab7e21\" (UID: \"ed5fcbea-4993-4d15-bf09-834a79ab7e21\") " Jul 27 21:05:12.020877 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:05:12.020661 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jtggq\" (UniqueName: \"kubernetes.io/projected/ed5fcbea-4993-4d15-bf09-834a79ab7e21-kube-api-access-jtggq\") pod \"ed5fcbea-4993-4d15-bf09-834a79ab7e21\" (UID: \"ed5fcbea-4993-4d15-bf09-834a79ab7e21\") " Jul 27 21:05:12.020877 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:05:12.020692 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ed5fcbea-4993-4d15-bf09-834a79ab7e21-istio-envoy\") pod \"ed5fcbea-4993-4d15-bf09-834a79ab7e21\" (UID: \"ed5fcbea-4993-4d15-bf09-834a79ab7e21\") " Jul 27 21:05:12.020877 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:05:12.020726 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ed5fcbea-4993-4d15-bf09-834a79ab7e21-istio-token\") pod \"ed5fcbea-4993-4d15-bf09-834a79ab7e21\" (UID: \"ed5fcbea-4993-4d15-bf09-834a79ab7e21\") " Jul 27 21:05:12.020877 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:05:12.020780 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ed5fcbea-4993-4d15-bf09-834a79ab7e21-istiod-ca-cert\") pod \"ed5fcbea-4993-4d15-bf09-834a79ab7e21\" (UID: \"ed5fcbea-4993-4d15-bf09-834a79ab7e21\") " Jul 27 21:05:12.020877 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:05:12.020820 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ed5fcbea-4993-4d15-bf09-834a79ab7e21-workload-certs\") pod \"ed5fcbea-4993-4d15-bf09-834a79ab7e21\" (UID: \"ed5fcbea-4993-4d15-bf09-834a79ab7e21\") " Jul 27 21:05:12.021491 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:05:12.021362 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ed5fcbea-4993-4d15-bf09-834a79ab7e21-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "ed5fcbea-4993-4d15-bf09-834a79ab7e21" (UID: "ed5fcbea-4993-4d15-bf09-834a79ab7e21"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 27 21:05:12.022030 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:05:12.021977 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ed5fcbea-4993-4d15-bf09-834a79ab7e21-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "ed5fcbea-4993-4d15-bf09-834a79ab7e21" (UID: "ed5fcbea-4993-4d15-bf09-834a79ab7e21"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 27 21:05:12.023013 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:05:12.022982 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ed5fcbea-4993-4d15-bf09-834a79ab7e21-istio-data" (OuterVolumeSpecName: "istio-data") pod "ed5fcbea-4993-4d15-bf09-834a79ab7e21" (UID: "ed5fcbea-4993-4d15-bf09-834a79ab7e21"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 27 21:05:12.023265 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:05:12.023244 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ed5fcbea-4993-4d15-bf09-834a79ab7e21-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "ed5fcbea-4993-4d15-bf09-834a79ab7e21" (UID: "ed5fcbea-4993-4d15-bf09-834a79ab7e21"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 27 21:05:12.023461 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:05:12.023442 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ed5fcbea-4993-4d15-bf09-834a79ab7e21-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "ed5fcbea-4993-4d15-bf09-834a79ab7e21" (UID: "ed5fcbea-4993-4d15-bf09-834a79ab7e21"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 27 21:05:12.024931 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:05:12.024902 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ed5fcbea-4993-4d15-bf09-834a79ab7e21-kube-api-access-jtggq" (OuterVolumeSpecName: "kube-api-access-jtggq") pod "ed5fcbea-4993-4d15-bf09-834a79ab7e21" (UID: "ed5fcbea-4993-4d15-bf09-834a79ab7e21"). InnerVolumeSpecName "kube-api-access-jtggq". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 27 21:05:12.025141 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:05:12.025118 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ed5fcbea-4993-4d15-bf09-834a79ab7e21-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "ed5fcbea-4993-4d15-bf09-834a79ab7e21" (UID: "ed5fcbea-4993-4d15-bf09-834a79ab7e21"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 27 21:05:12.025304 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:05:12.025288 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/ed5fcbea-4993-4d15-bf09-834a79ab7e21-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "ed5fcbea-4993-4d15-bf09-834a79ab7e21" (UID: "ed5fcbea-4993-4d15-bf09-834a79ab7e21"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 27 21:05:12.025980 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:05:12.025950 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ed5fcbea-4993-4d15-bf09-834a79ab7e21-istio-token" (OuterVolumeSpecName: "istio-token") pod "ed5fcbea-4993-4d15-bf09-834a79ab7e21" (UID: "ed5fcbea-4993-4d15-bf09-834a79ab7e21"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 27 21:05:12.122376 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:05:12.122312 2572 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ed5fcbea-4993-4d15-bf09-834a79ab7e21-istiod-ca-cert\") on node \"ip-10-0-139-2.ec2.internal\" DevicePath \"\"" Jul 27 21:05:12.122376 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:05:12.122367 2572 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ed5fcbea-4993-4d15-bf09-834a79ab7e21-workload-certs\") on node \"ip-10-0-139-2.ec2.internal\" DevicePath \"\"" Jul 27 21:05:12.122376 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:05:12.122376 2572 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ed5fcbea-4993-4d15-bf09-834a79ab7e21-workload-socket\") on node \"ip-10-0-139-2.ec2.internal\" DevicePath \"\"" Jul 27 21:05:12.122376 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:05:12.122384 2572 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ed5fcbea-4993-4d15-bf09-834a79ab7e21-istio-data\") on node \"ip-10-0-139-2.ec2.internal\" DevicePath \"\"" Jul 27 21:05:12.122644 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:05:12.122393 2572 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ed5fcbea-4993-4d15-bf09-834a79ab7e21-credential-socket\") on node \"ip-10-0-139-2.ec2.internal\" DevicePath \"\"" Jul 27 21:05:12.122644 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:05:12.122402 2572 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ed5fcbea-4993-4d15-bf09-834a79ab7e21-istio-podinfo\") on node \"ip-10-0-139-2.ec2.internal\" DevicePath \"\"" Jul 27 21:05:12.122644 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:05:12.122412 2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jtggq\" (UniqueName: \"kubernetes.io/projected/ed5fcbea-4993-4d15-bf09-834a79ab7e21-kube-api-access-jtggq\") on node \"ip-10-0-139-2.ec2.internal\" DevicePath \"\"" Jul 27 21:05:12.122644 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:05:12.122431 2572 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ed5fcbea-4993-4d15-bf09-834a79ab7e21-istio-envoy\") on node \"ip-10-0-139-2.ec2.internal\" DevicePath \"\"" Jul 27 21:05:12.122644 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:05:12.122439 2572 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ed5fcbea-4993-4d15-bf09-834a79ab7e21-istio-token\") on node \"ip-10-0-139-2.ec2.internal\" DevicePath \"\"" Jul 27 21:05:12.456263 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:05:12.456216 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-derive-93e2aa82-85cbd449cd-gdmh5" event={"ID":"68702e23-212e-4919-a92e-90bf73e6b7a8","Type":"ContainerStarted","Data":"c7f5329a09b40d8779e4c62721c7c11e49a1aafb984b3f69d56df98b0d92f7fe"} Jul 27 21:05:12.456462 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:05:12.456277 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-derive-93e2aa82-85cbd449cd-gdmh5" event={"ID":"68702e23-212e-4919-a92e-90bf73e6b7a8","Type":"ContainerStarted","Data":"9a5edc3b5d9bbff4c0b2d5d1c663401e76200029ba5eaf683bb7dd73684f75c1"} Jul 27 21:05:12.456462 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:05:12.456363 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-derive-93e2aa82-85cbd449cd-gdmh5" Jul 27 21:05:12.458088 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:05:12.458055 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-derive-93e2aa82-7cf4db5cb-dl9zb" event={"ID":"e1101af0-4807-4b48-b273-d6818ef8bc2d","Type":"ContainerStarted","Data":"cac1ea062b84ec9582a3281b17646d35984ce064fb4215ce7f6423b4392ad2fa"} Jul 27 21:05:12.458222 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:05:12.458112 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-derive-93e2aa82-7cf4db5cb-dl9zb" event={"ID":"e1101af0-4807-4b48-b273-d6818ef8bc2d","Type":"ContainerStarted","Data":"617ed06a7a28192a0704edb957ab3e05a9c06a01c46b14dd44c081c61d7a079e"} Jul 27 21:05:12.458222 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:05:12.458139 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-derive-93e2aa82-7cf4db5cb-dl9zb" Jul 27 21:05:12.459721 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:05:12.459694 2572 generic.go:356] "Generic (PLEG): container finished" podID="ed5fcbea-4993-4d15-bf09-834a79ab7e21" containerID="cad10ed8e6e21d0472b58e3816bff81c05b22849f907a007fdd010ea41b274d4" exitCode=0 Jul 27 21:05:12.459833 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:05:12.459726 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-560b69a4-openshift-default-5bb65467d6-tt87m" Jul 27 21:05:12.459833 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:05:12.459772 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-560b69a4-openshift-default-5bb65467d6-tt87m" event={"ID":"ed5fcbea-4993-4d15-bf09-834a79ab7e21","Type":"ContainerDied","Data":"cad10ed8e6e21d0472b58e3816bff81c05b22849f907a007fdd010ea41b274d4"} Jul 27 21:05:12.459833 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:05:12.459820 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-560b69a4-openshift-default-5bb65467d6-tt87m" event={"ID":"ed5fcbea-4993-4d15-bf09-834a79ab7e21","Type":"ContainerDied","Data":"49b5d1bf9d494663fc053872664fa864d92cbba335d70b91605756277f15f792"} Jul 27 21:05:12.459944 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:05:12.459846 2572 scope.go:117] "RemoveContainer" containerID="cad10ed8e6e21d0472b58e3816bff81c05b22849f907a007fdd010ea41b274d4" Jul 27 21:05:12.469531 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:05:12.469511 2572 scope.go:117] "RemoveContainer" containerID="bc4c855811fb182339c17aca0802de103bcda93e7b52e523e82150ec3e8dc041" Jul 27 21:05:12.470864 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:05:12.470469 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-derive-93e2aa82-85cbd449cd-gdmh5" podStartSLOduration=1.470453014 podStartE2EDuration="1.470453014s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 21:05:11 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 21:05:12.470387747 +0000 UTC m=+1845.939930758" watchObservedRunningTime="2026-07-27 21:05:12.470453014 +0000 UTC m=+1845.939996028" Jul 27 21:05:12.478112 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:05:12.478094 2572 scope.go:117] "RemoveContainer" containerID="cad10ed8e6e21d0472b58e3816bff81c05b22849f907a007fdd010ea41b274d4" Jul 27 21:05:12.478428 ip-10-0-139-2 kubenswrapper[2572]: E0727 21:05:12.478403 2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cad10ed8e6e21d0472b58e3816bff81c05b22849f907a007fdd010ea41b274d4\": container with ID starting with cad10ed8e6e21d0472b58e3816bff81c05b22849f907a007fdd010ea41b274d4 not found: ID does not exist" containerID="cad10ed8e6e21d0472b58e3816bff81c05b22849f907a007fdd010ea41b274d4" Jul 27 21:05:12.478490 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:05:12.478441 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cad10ed8e6e21d0472b58e3816bff81c05b22849f907a007fdd010ea41b274d4"} err="failed to get container status \"cad10ed8e6e21d0472b58e3816bff81c05b22849f907a007fdd010ea41b274d4\": rpc error: code = NotFound desc = could not find container \"cad10ed8e6e21d0472b58e3816bff81c05b22849f907a007fdd010ea41b274d4\": container with ID starting with cad10ed8e6e21d0472b58e3816bff81c05b22849f907a007fdd010ea41b274d4 not found: ID does not exist" Jul 27 21:05:12.478490 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:05:12.478465 2572 scope.go:117] "RemoveContainer" containerID="bc4c855811fb182339c17aca0802de103bcda93e7b52e523e82150ec3e8dc041" Jul 27 21:05:12.478723 ip-10-0-139-2 kubenswrapper[2572]: E0727 21:05:12.478703 2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bc4c855811fb182339c17aca0802de103bcda93e7b52e523e82150ec3e8dc041\": container with ID starting with bc4c855811fb182339c17aca0802de103bcda93e7b52e523e82150ec3e8dc041 not found: ID does not exist" containerID="bc4c855811fb182339c17aca0802de103bcda93e7b52e523e82150ec3e8dc041" Jul 27 21:05:12.478764 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:05:12.478730 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bc4c855811fb182339c17aca0802de103bcda93e7b52e523e82150ec3e8dc041"} err="failed to get container status \"bc4c855811fb182339c17aca0802de103bcda93e7b52e523e82150ec3e8dc041\": rpc error: code = NotFound desc = could not find container \"bc4c855811fb182339c17aca0802de103bcda93e7b52e523e82150ec3e8dc041\": container with ID starting with bc4c855811fb182339c17aca0802de103bcda93e7b52e523e82150ec3e8dc041 not found: ID does not exist" Jul 27 21:05:12.485072 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:05:12.485030 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-derive-93e2aa82-7cf4db5cb-dl9zb" podStartSLOduration=1.485017371 podStartE2EDuration="1.485017371s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 21:05:11 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 21:05:12.483270646 +0000 UTC m=+1845.952813657" watchObservedRunningTime="2026-07-27 21:05:12.485017371 +0000 UTC m=+1845.954560380" Jul 27 21:05:12.497861 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:05:12.497831 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-560b69a4-openshift-default-5bb65467d6-tt87m"] Jul 27 21:05:12.500976 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:05:12.500948 2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-560b69a4-openshift-default-5bb65467d6-tt87m"] Jul 27 21:05:13.079563 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:05:13.079525 2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ed5fcbea-4993-4d15-bf09-834a79ab7e21" path="/var/lib/kubelet/pods/ed5fcbea-4993-4d15-bf09-834a79ab7e21/volumes" Jul 27 21:05:23.468133 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:05:23.468094 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-derive-93e2aa82-85cbd449cd-gdmh5" Jul 27 21:05:23.468617 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:05:23.468176 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-derive-93e2aa82-7cf4db5cb-dl9zb" Jul 27 21:05:24.518938 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:05:24.518904 2572 generic.go:356] "Generic (PLEG): container finished" podID="5960cc91-2efb-4f65-8189-530bf93f04b5" containerID="289fee4961e5c821f0e53095fbed58f4dcd4cd2979b1a3c406bd0f2f64cd3a6f" exitCode=0 Jul 27 21:05:24.519408 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:05:24.518963 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-93e2aa82-openshift-default-6545f447cb-2ws55" event={"ID":"5960cc91-2efb-4f65-8189-530bf93f04b5","Type":"ContainerDied","Data":"289fee4961e5c821f0e53095fbed58f4dcd4cd2979b1a3c406bd0f2f64cd3a6f"} Jul 27 21:05:24.519408 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:05:24.519378 2572 scope.go:117] "RemoveContainer" containerID="289fee4961e5c821f0e53095fbed58f4dcd4cd2979b1a3c406bd0f2f64cd3a6f" Jul 27 21:05:24.520373 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:05:24.520337 2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 27 21:05:24.520511 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:05:24.520423 2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 27 21:05:24.520511 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:05:24.520471 2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 27 21:05:25.444040 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:05:25.443988 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-93e2aa82-openshift-default-6545f447cb-2ws55" Jul 27 21:05:25.525411 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:05:25.525373 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-93e2aa82-openshift-default-6545f447cb-2ws55" event={"ID":"5960cc91-2efb-4f65-8189-530bf93f04b5","Type":"ContainerStarted","Data":"f36008b901edacfc41b665718cb7f26a5d51b072423f25903ebf011d962ddaee"} Jul 27 21:05:25.847725 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:05:25.847687 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-93e2aa82-openshift-default-6545f447cb-2ws55" Jul 27 21:05:25.849735 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:05:25.849697 2572 patch_prober.go:28] interesting pod/e2e-derive-93e2aa82-openshift-default-6545f447cb-2ws55 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.31:15021/healthz/ready\": dial tcp 10.133.0.31:15021: connect: connection refused" start-of-body= Jul 27 21:05:25.849909 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:05:25.849771 2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-93e2aa82-openshift-default-6545f447cb-2ws55" podUID="5960cc91-2efb-4f65-8189-530bf93f04b5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.31:15021/healthz/ready\": dial tcp 10.133.0.31:15021: connect: connection refused" Jul 27 21:05:26.848033 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:05:26.847994 2572 patch_prober.go:28] interesting pod/e2e-derive-93e2aa82-openshift-default-6545f447cb-2ws55 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.31:15021/healthz/ready\": dial tcp 10.133.0.31:15021: connect: connection refused" start-of-body= Jul 27 21:05:26.848662 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:05:26.848627 2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-93e2aa82-openshift-default-6545f447cb-2ws55" podUID="5960cc91-2efb-4f65-8189-530bf93f04b5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.31:15021/healthz/ready\": dial tcp 10.133.0.31:15021: connect: connection refused" Jul 27 21:05:27.847637 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:05:27.847589 2572 patch_prober.go:28] interesting pod/e2e-derive-93e2aa82-openshift-default-6545f447cb-2ws55 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.31:15021/healthz/ready\": dial tcp 10.133.0.31:15021: connect: connection refused" start-of-body= Jul 27 21:05:27.847846 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:05:27.847660 2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-93e2aa82-openshift-default-6545f447cb-2ws55" podUID="5960cc91-2efb-4f65-8189-530bf93f04b5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.31:15021/healthz/ready\": dial tcp 10.133.0.31:15021: connect: connection refused" Jul 27 21:05:28.847481 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:05:28.847437 2572 patch_prober.go:28] interesting pod/e2e-derive-93e2aa82-openshift-default-6545f447cb-2ws55 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.31:15021/healthz/ready\": dial tcp 10.133.0.31:15021: connect: connection refused" start-of-body= Jul 27 21:05:28.847967 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:05:28.847525 2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-93e2aa82-openshift-default-6545f447cb-2ws55" podUID="5960cc91-2efb-4f65-8189-530bf93f04b5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.31:15021/healthz/ready\": dial tcp 10.133.0.31:15021: connect: connection refused" Jul 27 21:05:29.851380 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:05:29.851344 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-93e2aa82-openshift-default-6545f447cb-2ws55" Jul 27 21:05:29.851743 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:05:29.851625 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-93e2aa82-openshift-default-6545f447cb-2ws55" Jul 27 21:05:29.852273 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:05:29.852254 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-93e2aa82-openshift-default-6545f447cb-2ws55" Jul 27 21:05:30.221839 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:05:30.221756 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbpp5_e2759622-0ab6-46b7-b434-f0a0f8942dfe/konnectivity-agent/0.log" limit=1024 Jul 27 21:05:30.320333 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:05:30.320286 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-93e2aa82-85cbd449cd-gdmh5"] Jul 27 21:05:30.320572 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:05:30.320542 2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-derive-93e2aa82-85cbd449cd-gdmh5" podUID="68702e23-212e-4919-a92e-90bf73e6b7a8" containerName="payload-processing" containerID="cri-o://c7f5329a09b40d8779e4c62721c7c11e49a1aafb984b3f69d56df98b0d92f7fe" gracePeriod=30 Jul 27 21:05:30.329715 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:05:30.329685 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-93e2aa82-7cf4db5cb-dl9zb"] Jul 27 21:05:30.330113 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:05:30.330084 2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-derive-93e2aa82-7cf4db5cb-dl9zb" podUID="e1101af0-4807-4b48-b273-d6818ef8bc2d" containerName="payload-pre-processing" containerID="cri-o://cac1ea062b84ec9582a3281b17646d35984ce064fb4215ce7f6423b4392ad2fa" gracePeriod=30 Jul 27 21:05:30.362062 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:05:30.362032 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbpp5_e2759622-0ab6-46b7-b434-f0a0f8942dfe/konnectivity-agent/0.log" limit=1024 Jul 27 21:05:30.463023 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:05:30.462988 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbpp5_e2759622-0ab6-46b7-b434-f0a0f8942dfe/konnectivity-agent/0.log" limit=1024 Jul 27 21:05:30.554129 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:05:30.554098 2572 generic.go:356] "Generic (PLEG): container finished" podID="68702e23-212e-4919-a92e-90bf73e6b7a8" containerID="c7f5329a09b40d8779e4c62721c7c11e49a1aafb984b3f69d56df98b0d92f7fe" exitCode=0 Jul 27 21:05:30.554302 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:05:30.554177 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-derive-93e2aa82-85cbd449cd-gdmh5" event={"ID":"68702e23-212e-4919-a92e-90bf73e6b7a8","Type":"ContainerDied","Data":"c7f5329a09b40d8779e4c62721c7c11e49a1aafb984b3f69d56df98b0d92f7fe"} Jul 27 21:05:30.555879 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:05:30.555853 2572 generic.go:356] "Generic (PLEG): container finished" podID="e1101af0-4807-4b48-b273-d6818ef8bc2d" containerID="cac1ea062b84ec9582a3281b17646d35984ce064fb4215ce7f6423b4392ad2fa" exitCode=0 Jul 27 21:05:30.556088 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:05:30.556037 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-derive-93e2aa82-7cf4db5cb-dl9zb" event={"ID":"e1101af0-4807-4b48-b273-d6818ef8bc2d","Type":"ContainerDied","Data":"cac1ea062b84ec9582a3281b17646d35984ce064fb4215ce7f6423b4392ad2fa"} Jul 27 21:05:30.602661 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:05:30.602638 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-derive-93e2aa82-85cbd449cd-gdmh5" Jul 27 21:05:30.605518 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:05:30.605501 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-derive-93e2aa82-7cf4db5cb-dl9zb" Jul 27 21:05:30.696142 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:05:30.696107 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/68702e23-212e-4919-a92e-90bf73e6b7a8-plugins-config-volume\") pod \"68702e23-212e-4919-a92e-90bf73e6b7a8\" (UID: \"68702e23-212e-4919-a92e-90bf73e6b7a8\") " Jul 27 21:05:30.696307 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:05:30.696179 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wglkn\" (UniqueName: \"kubernetes.io/projected/e1101af0-4807-4b48-b273-d6818ef8bc2d-kube-api-access-wglkn\") pod \"e1101af0-4807-4b48-b273-d6818ef8bc2d\" (UID: \"e1101af0-4807-4b48-b273-d6818ef8bc2d\") " Jul 27 21:05:30.696307 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:05:30.696197 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-m9tlp\" (UniqueName: \"kubernetes.io/projected/68702e23-212e-4919-a92e-90bf73e6b7a8-kube-api-access-m9tlp\") pod \"68702e23-212e-4919-a92e-90bf73e6b7a8\" (UID: \"68702e23-212e-4919-a92e-90bf73e6b7a8\") " Jul 27 21:05:30.696307 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:05:30.696228 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e1101af0-4807-4b48-b273-d6818ef8bc2d-plugins-config-volume\") pod \"e1101af0-4807-4b48-b273-d6818ef8bc2d\" (UID: \"e1101af0-4807-4b48-b273-d6818ef8bc2d\") " Jul 27 21:05:30.696653 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:05:30.696527 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/68702e23-212e-4919-a92e-90bf73e6b7a8-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "68702e23-212e-4919-a92e-90bf73e6b7a8" (UID: "68702e23-212e-4919-a92e-90bf73e6b7a8"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 27 21:05:30.696795 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:05:30.696714 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e1101af0-4807-4b48-b273-d6818ef8bc2d-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "e1101af0-4807-4b48-b273-d6818ef8bc2d" (UID: "e1101af0-4807-4b48-b273-d6818ef8bc2d"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 27 21:05:30.698815 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:05:30.698790 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/68702e23-212e-4919-a92e-90bf73e6b7a8-kube-api-access-m9tlp" (OuterVolumeSpecName: "kube-api-access-m9tlp") pod "68702e23-212e-4919-a92e-90bf73e6b7a8" (UID: "68702e23-212e-4919-a92e-90bf73e6b7a8"). InnerVolumeSpecName "kube-api-access-m9tlp". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 27 21:05:30.698815 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:05:30.698796 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e1101af0-4807-4b48-b273-d6818ef8bc2d-kube-api-access-wglkn" (OuterVolumeSpecName: "kube-api-access-wglkn") pod "e1101af0-4807-4b48-b273-d6818ef8bc2d" (UID: "e1101af0-4807-4b48-b273-d6818ef8bc2d"). InnerVolumeSpecName "kube-api-access-wglkn". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 27 21:05:30.797961 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:05:30.797916 2572 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/68702e23-212e-4919-a92e-90bf73e6b7a8-plugins-config-volume\") on node \"ip-10-0-139-2.ec2.internal\" DevicePath \"\"" Jul 27 21:05:30.797961 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:05:30.797957 2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wglkn\" (UniqueName: \"kubernetes.io/projected/e1101af0-4807-4b48-b273-d6818ef8bc2d-kube-api-access-wglkn\") on node \"ip-10-0-139-2.ec2.internal\" DevicePath \"\"" Jul 27 21:05:30.797961 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:05:30.797970 2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-m9tlp\" (UniqueName: \"kubernetes.io/projected/68702e23-212e-4919-a92e-90bf73e6b7a8-kube-api-access-m9tlp\") on node \"ip-10-0-139-2.ec2.internal\" DevicePath \"\"" Jul 27 21:05:30.798191 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:05:30.797980 2572 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e1101af0-4807-4b48-b273-d6818ef8bc2d-plugins-config-volume\") on node \"ip-10-0-139-2.ec2.internal\" DevicePath \"\"" Jul 27 21:05:31.561020 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:05:31.560992 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-derive-93e2aa82-85cbd449cd-gdmh5" Jul 27 21:05:31.561020 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:05:31.561003 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-derive-93e2aa82-85cbd449cd-gdmh5" event={"ID":"68702e23-212e-4919-a92e-90bf73e6b7a8","Type":"ContainerDied","Data":"9a5edc3b5d9bbff4c0b2d5d1c663401e76200029ba5eaf683bb7dd73684f75c1"} Jul 27 21:05:31.561526 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:05:31.561069 2572 scope.go:117] "RemoveContainer" containerID="c7f5329a09b40d8779e4c62721c7c11e49a1aafb984b3f69d56df98b0d92f7fe" Jul 27 21:05:31.562455 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:05:31.562433 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-derive-93e2aa82-7cf4db5cb-dl9zb" Jul 27 21:05:31.562569 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:05:31.562486 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-derive-93e2aa82-7cf4db5cb-dl9zb" event={"ID":"e1101af0-4807-4b48-b273-d6818ef8bc2d","Type":"ContainerDied","Data":"617ed06a7a28192a0704edb957ab3e05a9c06a01c46b14dd44c081c61d7a079e"} Jul 27 21:05:31.569244 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:05:31.569227 2572 scope.go:117] "RemoveContainer" containerID="cac1ea062b84ec9582a3281b17646d35984ce064fb4215ce7f6423b4392ad2fa" Jul 27 21:05:31.581720 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:05:31.581698 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-93e2aa82-7cf4db5cb-dl9zb"] Jul 27 21:05:31.585759 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:05:31.585737 2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-93e2aa82-7cf4db5cb-dl9zb"] Jul 27 21:05:31.595534 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:05:31.595511 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-93e2aa82-85cbd449cd-gdmh5"] Jul 27 21:05:31.599415 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:05:31.599394 2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-93e2aa82-85cbd449cd-gdmh5"] Jul 27 21:05:33.078365 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:05:33.078312 2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="68702e23-212e-4919-a92e-90bf73e6b7a8" path="/var/lib/kubelet/pods/68702e23-212e-4919-a92e-90bf73e6b7a8/volumes" Jul 27 21:05:33.078799 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:05:33.078733 2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e1101af0-4807-4b48-b273-d6818ef8bc2d" path="/var/lib/kubelet/pods/e1101af0-4807-4b48-b273-d6818ef8bc2d/volumes" Jul 27 21:05:34.455122 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:05:34.455090 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbpp5_e2759622-0ab6-46b7-b434-f0a0f8942dfe/konnectivity-agent/0.log" limit=1024 Jul 27 21:05:34.603217 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:05:34.603185 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-93e2aa82-openshift-default-6545f447cb-2ws55"] Jul 27 21:05:34.603511 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:05:34.603482 2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-derive-93e2aa82-openshift-default-6545f447cb-2ws55" podUID="5960cc91-2efb-4f65-8189-530bf93f04b5" containerName="istio-proxy" containerID="cri-o://f36008b901edacfc41b665718cb7f26a5d51b072423f25903ebf011d962ddaee" gracePeriod=30 Jul 27 21:05:34.626511 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:05:34.626481 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbpp5_e2759622-0ab6-46b7-b434-f0a0f8942dfe/konnectivity-agent/0.log" limit=1024 Jul 27 21:05:34.852707 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:05:34.852662 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbpp5_e2759622-0ab6-46b7-b434-f0a0f8942dfe/konnectivity-agent/0.log" limit=1024 Jul 27 21:05:35.325924 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:05:35.325889 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbpp5_e2759622-0ab6-46b7-b434-f0a0f8942dfe/konnectivity-agent/0.log" limit=1024 Jul 27 21:05:35.424964 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:05:35.424933 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbpp5_e2759622-0ab6-46b7-b434-f0a0f8942dfe/konnectivity-agent/0.log" limit=1024 Jul 27 21:05:35.528427 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:05:35.528394 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbpp5_e2759622-0ab6-46b7-b434-f0a0f8942dfe/konnectivity-agent/0.log" limit=1024 Jul 27 21:05:36.956445 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:05:36.956407 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbpp5_e2759622-0ab6-46b7-b434-f0a0f8942dfe/konnectivity-agent/0.log" limit=1024 Jul 27 21:05:39.863650 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:05:39.863585 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-93e2aa82-openshift-default-6545f447cb-2ws55" Jul 27 21:05:39.981921 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:05:39.981886 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5960cc91-2efb-4f65-8189-530bf93f04b5-credential-socket\") pod \"5960cc91-2efb-4f65-8189-530bf93f04b5\" (UID: \"5960cc91-2efb-4f65-8189-530bf93f04b5\") " Jul 27 21:05:39.981921 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:05:39.981924 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5960cc91-2efb-4f65-8189-530bf93f04b5-workload-certs\") pod \"5960cc91-2efb-4f65-8189-530bf93f04b5\" (UID: \"5960cc91-2efb-4f65-8189-530bf93f04b5\") " Jul 27 21:05:39.982126 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:05:39.981948 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5960cc91-2efb-4f65-8189-530bf93f04b5-istiod-ca-cert\") pod \"5960cc91-2efb-4f65-8189-530bf93f04b5\" (UID: \"5960cc91-2efb-4f65-8189-530bf93f04b5\") " Jul 27 21:05:39.982126 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:05:39.982033 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5960cc91-2efb-4f65-8189-530bf93f04b5-istio-podinfo\") pod \"5960cc91-2efb-4f65-8189-530bf93f04b5\" (UID: \"5960cc91-2efb-4f65-8189-530bf93f04b5\") " Jul 27 21:05:39.982126 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:05:39.982069 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5960cc91-2efb-4f65-8189-530bf93f04b5-istio-token\") pod \"5960cc91-2efb-4f65-8189-530bf93f04b5\" (UID: \"5960cc91-2efb-4f65-8189-530bf93f04b5\") " Jul 27 21:05:39.982126 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:05:39.982103 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-j98td\" (UniqueName: \"kubernetes.io/projected/5960cc91-2efb-4f65-8189-530bf93f04b5-kube-api-access-j98td\") pod \"5960cc91-2efb-4f65-8189-530bf93f04b5\" (UID: \"5960cc91-2efb-4f65-8189-530bf93f04b5\") " Jul 27 21:05:39.982357 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:05:39.982157 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5960cc91-2efb-4f65-8189-530bf93f04b5-workload-socket\") pod \"5960cc91-2efb-4f65-8189-530bf93f04b5\" (UID: \"5960cc91-2efb-4f65-8189-530bf93f04b5\") " Jul 27 21:05:39.982357 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:05:39.982180 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5960cc91-2efb-4f65-8189-530bf93f04b5-istio-envoy\") pod \"5960cc91-2efb-4f65-8189-530bf93f04b5\" (UID: \"5960cc91-2efb-4f65-8189-530bf93f04b5\") " Jul 27 21:05:39.982357 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:05:39.982214 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5960cc91-2efb-4f65-8189-530bf93f04b5-istio-data\") pod \"5960cc91-2efb-4f65-8189-530bf93f04b5\" (UID: \"5960cc91-2efb-4f65-8189-530bf93f04b5\") " Jul 27 21:05:39.982357 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:05:39.982241 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5960cc91-2efb-4f65-8189-530bf93f04b5-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "5960cc91-2efb-4f65-8189-530bf93f04b5" (UID: "5960cc91-2efb-4f65-8189-530bf93f04b5"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 27 21:05:39.982357 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:05:39.982257 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5960cc91-2efb-4f65-8189-530bf93f04b5-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "5960cc91-2efb-4f65-8189-530bf93f04b5" (UID: "5960cc91-2efb-4f65-8189-530bf93f04b5"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 27 21:05:39.982618 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:05:39.982467 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5960cc91-2efb-4f65-8189-530bf93f04b5-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "5960cc91-2efb-4f65-8189-530bf93f04b5" (UID: "5960cc91-2efb-4f65-8189-530bf93f04b5"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 27 21:05:39.982618 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:05:39.982480 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5960cc91-2efb-4f65-8189-530bf93f04b5-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "5960cc91-2efb-4f65-8189-530bf93f04b5" (UID: "5960cc91-2efb-4f65-8189-530bf93f04b5"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 27 21:05:39.982618 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:05:39.982558 2572 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5960cc91-2efb-4f65-8189-530bf93f04b5-istiod-ca-cert\") on node \"ip-10-0-139-2.ec2.internal\" DevicePath \"\"" Jul 27 21:05:39.982618 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:05:39.982577 2572 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5960cc91-2efb-4f65-8189-530bf93f04b5-workload-socket\") on node \"ip-10-0-139-2.ec2.internal\" DevicePath \"\"" Jul 27 21:05:39.982618 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:05:39.982593 2572 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5960cc91-2efb-4f65-8189-530bf93f04b5-credential-socket\") on node \"ip-10-0-139-2.ec2.internal\" DevicePath \"\"" Jul 27 21:05:39.982618 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:05:39.982606 2572 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5960cc91-2efb-4f65-8189-530bf93f04b5-workload-certs\") on node \"ip-10-0-139-2.ec2.internal\" DevicePath \"\"" Jul 27 21:05:39.983130 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:05:39.983109 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5960cc91-2efb-4f65-8189-530bf93f04b5-istio-data" (OuterVolumeSpecName: "istio-data") pod "5960cc91-2efb-4f65-8189-530bf93f04b5" (UID: "5960cc91-2efb-4f65-8189-530bf93f04b5"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 27 21:05:39.984542 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:05:39.984494 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5960cc91-2efb-4f65-8189-530bf93f04b5-istio-token" (OuterVolumeSpecName: "istio-token") pod "5960cc91-2efb-4f65-8189-530bf93f04b5" (UID: "5960cc91-2efb-4f65-8189-530bf93f04b5"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 27 21:05:39.984542 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:05:39.984522 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/5960cc91-2efb-4f65-8189-530bf93f04b5-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "5960cc91-2efb-4f65-8189-530bf93f04b5" (UID: "5960cc91-2efb-4f65-8189-530bf93f04b5"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 27 21:05:39.984811 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:05:39.984787 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5960cc91-2efb-4f65-8189-530bf93f04b5-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "5960cc91-2efb-4f65-8189-530bf93f04b5" (UID: "5960cc91-2efb-4f65-8189-530bf93f04b5"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 27 21:05:39.984811 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:05:39.984797 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5960cc91-2efb-4f65-8189-530bf93f04b5-kube-api-access-j98td" (OuterVolumeSpecName: "kube-api-access-j98td") pod "5960cc91-2efb-4f65-8189-530bf93f04b5" (UID: "5960cc91-2efb-4f65-8189-530bf93f04b5"). InnerVolumeSpecName "kube-api-access-j98td". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 27 21:05:40.083397 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:05:40.083366 2572 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5960cc91-2efb-4f65-8189-530bf93f04b5-istio-podinfo\") on node \"ip-10-0-139-2.ec2.internal\" DevicePath \"\"" Jul 27 21:05:40.083397 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:05:40.083392 2572 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5960cc91-2efb-4f65-8189-530bf93f04b5-istio-token\") on node \"ip-10-0-139-2.ec2.internal\" DevicePath \"\"" Jul 27 21:05:40.083397 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:05:40.083400 2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-j98td\" (UniqueName: \"kubernetes.io/projected/5960cc91-2efb-4f65-8189-530bf93f04b5-kube-api-access-j98td\") on node \"ip-10-0-139-2.ec2.internal\" DevicePath \"\"" Jul 27 21:05:40.083397 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:05:40.083411 2572 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5960cc91-2efb-4f65-8189-530bf93f04b5-istio-envoy\") on node \"ip-10-0-139-2.ec2.internal\" DevicePath \"\"" Jul 27 21:05:40.083665 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:05:40.083419 2572 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5960cc91-2efb-4f65-8189-530bf93f04b5-istio-data\") on node \"ip-10-0-139-2.ec2.internal\" DevicePath \"\"" Jul 27 21:05:40.605830 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:05:40.605797 2572 generic.go:356] "Generic (PLEG): container finished" podID="5960cc91-2efb-4f65-8189-530bf93f04b5" containerID="f36008b901edacfc41b665718cb7f26a5d51b072423f25903ebf011d962ddaee" exitCode=0 Jul 27 21:05:40.606009 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:05:40.605848 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-93e2aa82-openshift-default-6545f447cb-2ws55" Jul 27 21:05:40.606009 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:05:40.605850 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-93e2aa82-openshift-default-6545f447cb-2ws55" event={"ID":"5960cc91-2efb-4f65-8189-530bf93f04b5","Type":"ContainerDied","Data":"f36008b901edacfc41b665718cb7f26a5d51b072423f25903ebf011d962ddaee"} Jul 27 21:05:40.606009 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:05:40.605958 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-93e2aa82-openshift-default-6545f447cb-2ws55" event={"ID":"5960cc91-2efb-4f65-8189-530bf93f04b5","Type":"ContainerDied","Data":"ac0b364b5f7628622ff919f1337a59dcd0bff44fbfd2118e21ec05677716cda4"} Jul 27 21:05:40.606009 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:05:40.605979 2572 scope.go:117] "RemoveContainer" containerID="f36008b901edacfc41b665718cb7f26a5d51b072423f25903ebf011d962ddaee" Jul 27 21:05:40.615128 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:05:40.615108 2572 scope.go:117] "RemoveContainer" containerID="289fee4961e5c821f0e53095fbed58f4dcd4cd2979b1a3c406bd0f2f64cd3a6f" Jul 27 21:05:40.622956 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:05:40.622939 2572 scope.go:117] "RemoveContainer" containerID="f36008b901edacfc41b665718cb7f26a5d51b072423f25903ebf011d962ddaee" Jul 27 21:05:40.623216 ip-10-0-139-2 kubenswrapper[2572]: E0727 21:05:40.623197 2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f36008b901edacfc41b665718cb7f26a5d51b072423f25903ebf011d962ddaee\": container with ID starting with f36008b901edacfc41b665718cb7f26a5d51b072423f25903ebf011d962ddaee not found: ID does not exist" containerID="f36008b901edacfc41b665718cb7f26a5d51b072423f25903ebf011d962ddaee" Jul 27 21:05:40.623265 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:05:40.623225 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f36008b901edacfc41b665718cb7f26a5d51b072423f25903ebf011d962ddaee"} err="failed to get container status \"f36008b901edacfc41b665718cb7f26a5d51b072423f25903ebf011d962ddaee\": rpc error: code = NotFound desc = could not find container \"f36008b901edacfc41b665718cb7f26a5d51b072423f25903ebf011d962ddaee\": container with ID starting with f36008b901edacfc41b665718cb7f26a5d51b072423f25903ebf011d962ddaee not found: ID does not exist" Jul 27 21:05:40.623265 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:05:40.623246 2572 scope.go:117] "RemoveContainer" containerID="289fee4961e5c821f0e53095fbed58f4dcd4cd2979b1a3c406bd0f2f64cd3a6f" Jul 27 21:05:40.623486 ip-10-0-139-2 kubenswrapper[2572]: E0727 21:05:40.623466 2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"289fee4961e5c821f0e53095fbed58f4dcd4cd2979b1a3c406bd0f2f64cd3a6f\": container with ID starting with 289fee4961e5c821f0e53095fbed58f4dcd4cd2979b1a3c406bd0f2f64cd3a6f not found: ID does not exist" containerID="289fee4961e5c821f0e53095fbed58f4dcd4cd2979b1a3c406bd0f2f64cd3a6f" Jul 27 21:05:40.623531 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:05:40.623492 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"289fee4961e5c821f0e53095fbed58f4dcd4cd2979b1a3c406bd0f2f64cd3a6f"} err="failed to get container status \"289fee4961e5c821f0e53095fbed58f4dcd4cd2979b1a3c406bd0f2f64cd3a6f\": rpc error: code = NotFound desc = could not find container \"289fee4961e5c821f0e53095fbed58f4dcd4cd2979b1a3c406bd0f2f64cd3a6f\": container with ID starting with 289fee4961e5c821f0e53095fbed58f4dcd4cd2979b1a3c406bd0f2f64cd3a6f not found: ID does not exist" Jul 27 21:05:40.627723 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:05:40.627697 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-93e2aa82-openshift-default-6545f447cb-2ws55"] Jul 27 21:05:40.632934 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:05:40.632912 2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-derive-93e2aa82-openshift-default-6545f447cb-2ws55"] Jul 27 21:05:41.078487 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:05:41.078455 2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5960cc91-2efb-4f65-8189-530bf93f04b5" path="/var/lib/kubelet/pods/5960cc91-2efb-4f65-8189-530bf93f04b5/volumes" Jul 27 21:05:43.341788 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:05:43.341751 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbpp5_e2759622-0ab6-46b7-b434-f0a0f8942dfe/konnectivity-agent/0.log" limit=1024 Jul 27 21:05:43.447046 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:05:43.447008 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbpp5_e2759622-0ab6-46b7-b434-f0a0f8942dfe/konnectivity-agent/0.log" limit=1024 Jul 27 21:05:43.546613 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:05:43.546579 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbpp5_e2759622-0ab6-46b7-b434-f0a0f8942dfe/konnectivity-agent/0.log" limit=1024 Jul 27 21:05:43.642435 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:05:43.642356 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbpp5_e2759622-0ab6-46b7-b434-f0a0f8942dfe/konnectivity-agent/0.log" limit=1024 Jul 27 21:05:44.161822 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:05:44.161786 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbpp5_e2759622-0ab6-46b7-b434-f0a0f8942dfe/konnectivity-agent/0.log" limit=1024 Jul 27 21:06:10.481722 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:06:10.481687 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbpp5_e2759622-0ab6-46b7-b434-f0a0f8942dfe/konnectivity-agent/0.log" limit=1024 Jul 27 21:06:16.784307 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:06:16.784265 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbpp5_e2759622-0ab6-46b7-b434-f0a0f8942dfe/konnectivity-agent/0.log" limit=1024 Jul 27 21:06:16.887843 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:06:16.887812 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbpp5_e2759622-0ab6-46b7-b434-f0a0f8942dfe/konnectivity-agent/0.log" limit=1024 Jul 27 21:06:17.013835 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:06:17.013795 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbpp5_e2759622-0ab6-46b7-b434-f0a0f8942dfe/konnectivity-agent/0.log" limit=1024 Jul 27 21:06:17.117349 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:06:17.117238 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbpp5_e2759622-0ab6-46b7-b434-f0a0f8942dfe/konnectivity-agent/0.log" limit=1024 Jul 27 21:06:33.071959 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:06:33.071925 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbpp5_e2759622-0ab6-46b7-b434-f0a0f8942dfe/konnectivity-agent/0.log" limit=1024 Jul 27 21:06:38.701025 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:06:38.700985 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbpp5_e2759622-0ab6-46b7-b434-f0a0f8942dfe/konnectivity-agent/0.log" limit=1024 Jul 27 21:06:38.764388 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:06:38.764352 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbpp5_e2759622-0ab6-46b7-b434-f0a0f8942dfe/konnectivity-agent/0.log" limit=1024 Jul 27 21:06:38.850088 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:06:38.850052 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbpp5_e2759622-0ab6-46b7-b434-f0a0f8942dfe/konnectivity-agent/0.log" limit=1024 Jul 27 21:06:38.945479 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:06:38.945448 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbpp5_e2759622-0ab6-46b7-b434-f0a0f8942dfe/konnectivity-agent/0.log" limit=1024 Jul 27 21:06:49.421111 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:06:49.421079 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbpp5_e2759622-0ab6-46b7-b434-f0a0f8942dfe/konnectivity-agent/0.log" limit=1024 Jul 27 21:06:50.250047 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:06:50.250004 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbpp5_e2759622-0ab6-46b7-b434-f0a0f8942dfe/konnectivity-agent/0.log" limit=1024 Jul 27 21:06:56.744658 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:06:56.744624 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbpp5_e2759622-0ab6-46b7-b434-f0a0f8942dfe/konnectivity-agent/0.log" limit=1024 Jul 27 21:06:56.856924 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:06:56.856890 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbpp5_e2759622-0ab6-46b7-b434-f0a0f8942dfe/konnectivity-agent/0.log" limit=1024 Jul 27 21:06:56.942019 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:06:56.941988 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbpp5_e2759622-0ab6-46b7-b434-f0a0f8942dfe/konnectivity-agent/0.log" limit=1024 Jul 27 21:06:57.044303 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:06:57.044264 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbpp5_e2759622-0ab6-46b7-b434-f0a0f8942dfe/konnectivity-agent/0.log" limit=1024 Jul 27 21:06:57.815343 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:06:57.815288 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbpp5_e2759622-0ab6-46b7-b434-f0a0f8942dfe/konnectivity-agent/0.log" limit=1024 Jul 27 21:06:57.911879 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:06:57.911849 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbpp5_e2759622-0ab6-46b7-b434-f0a0f8942dfe/konnectivity-agent/0.log" limit=1024 Jul 27 21:06:58.015717 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:06:58.015684 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbpp5_e2759622-0ab6-46b7-b434-f0a0f8942dfe/konnectivity-agent/0.log" limit=1024 Jul 27 21:06:59.575988 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:06:59.575957 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbpp5_e2759622-0ab6-46b7-b434-f0a0f8942dfe/konnectivity-agent/0.log" limit=1024 Jul 27 21:07:05.420355 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:07:05.420280 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbpp5_e2759622-0ab6-46b7-b434-f0a0f8942dfe/konnectivity-agent/0.log" limit=1024 Jul 27 21:07:05.520895 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:07:05.520845 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbpp5_e2759622-0ab6-46b7-b434-f0a0f8942dfe/konnectivity-agent/0.log" limit=1024 Jul 27 21:07:06.084254 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:07:06.084218 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbpp5_e2759622-0ab6-46b7-b434-f0a0f8942dfe/konnectivity-agent/0.log" limit=1024 Jul 27 21:07:12.100516 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:07:12.100480 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbpp5_e2759622-0ab6-46b7-b434-f0a0f8942dfe/konnectivity-agent/0.log" limit=1024 Jul 27 21:07:12.202208 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:07:12.202167 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbpp5_e2759622-0ab6-46b7-b434-f0a0f8942dfe/konnectivity-agent/0.log" limit=1024 Jul 27 21:07:12.316392 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:07:12.316358 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbpp5_e2759622-0ab6-46b7-b434-f0a0f8942dfe/konnectivity-agent/0.log" limit=1024 Jul 27 21:07:12.606887 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:07:12.606855 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-2f806b4e-openshift-default-65dbf4fb9b-xmwnb"] Jul 27 21:07:12.607189 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:07:12.607177 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5960cc91-2efb-4f65-8189-530bf93f04b5" containerName="istio-proxy" Jul 27 21:07:12.607240 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:07:12.607191 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="5960cc91-2efb-4f65-8189-530bf93f04b5" containerName="istio-proxy" Jul 27 21:07:12.607240 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:07:12.607202 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ed5fcbea-4993-4d15-bf09-834a79ab7e21" containerName="istio-proxy" Jul 27 21:07:12.607240 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:07:12.607208 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="ed5fcbea-4993-4d15-bf09-834a79ab7e21" containerName="istio-proxy" Jul 27 21:07:12.607240 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:07:12.607223 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ed5fcbea-4993-4d15-bf09-834a79ab7e21" containerName="istio-proxy" Jul 27 21:07:12.607240 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:07:12.607230 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="ed5fcbea-4993-4d15-bf09-834a79ab7e21" containerName="istio-proxy" Jul 27 21:07:12.607240 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:07:12.607236 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e1101af0-4807-4b48-b273-d6818ef8bc2d" containerName="payload-pre-processing" Jul 27 21:07:12.607240 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:07:12.607241 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="e1101af0-4807-4b48-b273-d6818ef8bc2d" containerName="payload-pre-processing" Jul 27 21:07:12.607483 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:07:12.607251 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="68702e23-212e-4919-a92e-90bf73e6b7a8" containerName="payload-processing" Jul 27 21:07:12.607483 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:07:12.607257 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="68702e23-212e-4919-a92e-90bf73e6b7a8" containerName="payload-processing" Jul 27 21:07:12.607483 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:07:12.607304 2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="5960cc91-2efb-4f65-8189-530bf93f04b5" containerName="istio-proxy" Jul 27 21:07:12.607483 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:07:12.607312 2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="ed5fcbea-4993-4d15-bf09-834a79ab7e21" containerName="istio-proxy" Jul 27 21:07:12.607483 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:07:12.607339 2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="68702e23-212e-4919-a92e-90bf73e6b7a8" containerName="payload-processing" Jul 27 21:07:12.607483 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:07:12.607348 2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="e1101af0-4807-4b48-b273-d6818ef8bc2d" containerName="payload-pre-processing" Jul 27 21:07:12.607483 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:07:12.607354 2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="ed5fcbea-4993-4d15-bf09-834a79ab7e21" containerName="istio-proxy" Jul 27 21:07:12.610334 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:07:12.610298 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-2f806b4e-openshift-default-65dbf4fb9b-xmwnb" Jul 27 21:07:12.612363 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:07:12.612345 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-2f806b4e-openshift-default-dockercfg-952fk\"" Jul 27 21:07:12.629063 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:07:12.629022 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbpp5_e2759622-0ab6-46b7-b434-f0a0f8942dfe/konnectivity-agent/0.log" limit=1024 Jul 27 21:07:12.629930 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:07:12.629910 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-2f806b4e-openshift-default-65dbf4fb9b-xmwnb"] Jul 27 21:07:12.691763 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:07:12.691736 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/cba95b49-bec8-4af0-8d36-f28e3516f78c-workload-socket\") pod \"e2e-mt-2f806b4e-openshift-default-65dbf4fb9b-xmwnb\" (UID: \"cba95b49-bec8-4af0-8d36-f28e3516f78c\") " pod="openshift-ingress/e2e-mt-2f806b4e-openshift-default-65dbf4fb9b-xmwnb" Jul 27 21:07:12.691910 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:07:12.691779 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/cba95b49-bec8-4af0-8d36-f28e3516f78c-istio-podinfo\") pod \"e2e-mt-2f806b4e-openshift-default-65dbf4fb9b-xmwnb\" (UID: \"cba95b49-bec8-4af0-8d36-f28e3516f78c\") " pod="openshift-ingress/e2e-mt-2f806b4e-openshift-default-65dbf4fb9b-xmwnb" Jul 27 21:07:12.691910 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:07:12.691850 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cba95b49-bec8-4af0-8d36-f28e3516f78c-istio-token\") pod \"e2e-mt-2f806b4e-openshift-default-65dbf4fb9b-xmwnb\" (UID: \"cba95b49-bec8-4af0-8d36-f28e3516f78c\") " pod="openshift-ingress/e2e-mt-2f806b4e-openshift-default-65dbf4fb9b-xmwnb" Jul 27 21:07:12.691910 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:07:12.691879 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xctjh\" (UniqueName: \"kubernetes.io/projected/cba95b49-bec8-4af0-8d36-f28e3516f78c-kube-api-access-xctjh\") pod \"e2e-mt-2f806b4e-openshift-default-65dbf4fb9b-xmwnb\" (UID: \"cba95b49-bec8-4af0-8d36-f28e3516f78c\") " pod="openshift-ingress/e2e-mt-2f806b4e-openshift-default-65dbf4fb9b-xmwnb" Jul 27 21:07:12.692074 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:07:12.691920 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/cba95b49-bec8-4af0-8d36-f28e3516f78c-istio-data\") pod \"e2e-mt-2f806b4e-openshift-default-65dbf4fb9b-xmwnb\" (UID: \"cba95b49-bec8-4af0-8d36-f28e3516f78c\") " pod="openshift-ingress/e2e-mt-2f806b4e-openshift-default-65dbf4fb9b-xmwnb" Jul 27 21:07:12.692074 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:07:12.691940 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/cba95b49-bec8-4af0-8d36-f28e3516f78c-workload-certs\") pod \"e2e-mt-2f806b4e-openshift-default-65dbf4fb9b-xmwnb\" (UID: \"cba95b49-bec8-4af0-8d36-f28e3516f78c\") " pod="openshift-ingress/e2e-mt-2f806b4e-openshift-default-65dbf4fb9b-xmwnb" Jul 27 21:07:12.692074 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:07:12.691984 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/cba95b49-bec8-4af0-8d36-f28e3516f78c-credential-socket\") pod \"e2e-mt-2f806b4e-openshift-default-65dbf4fb9b-xmwnb\" (UID: \"cba95b49-bec8-4af0-8d36-f28e3516f78c\") " pod="openshift-ingress/e2e-mt-2f806b4e-openshift-default-65dbf4fb9b-xmwnb" Jul 27 21:07:12.692074 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:07:12.692028 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/cba95b49-bec8-4af0-8d36-f28e3516f78c-istio-envoy\") pod \"e2e-mt-2f806b4e-openshift-default-65dbf4fb9b-xmwnb\" (UID: \"cba95b49-bec8-4af0-8d36-f28e3516f78c\") " pod="openshift-ingress/e2e-mt-2f806b4e-openshift-default-65dbf4fb9b-xmwnb" Jul 27 21:07:12.692205 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:07:12.692117 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/cba95b49-bec8-4af0-8d36-f28e3516f78c-istiod-ca-cert\") pod \"e2e-mt-2f806b4e-openshift-default-65dbf4fb9b-xmwnb\" (UID: \"cba95b49-bec8-4af0-8d36-f28e3516f78c\") " pod="openshift-ingress/e2e-mt-2f806b4e-openshift-default-65dbf4fb9b-xmwnb" Jul 27 21:07:12.793149 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:07:12.793118 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/cba95b49-bec8-4af0-8d36-f28e3516f78c-workload-certs\") pod \"e2e-mt-2f806b4e-openshift-default-65dbf4fb9b-xmwnb\" (UID: \"cba95b49-bec8-4af0-8d36-f28e3516f78c\") " pod="openshift-ingress/e2e-mt-2f806b4e-openshift-default-65dbf4fb9b-xmwnb" Jul 27 21:07:12.793149 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:07:12.793157 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/cba95b49-bec8-4af0-8d36-f28e3516f78c-credential-socket\") pod \"e2e-mt-2f806b4e-openshift-default-65dbf4fb9b-xmwnb\" (UID: \"cba95b49-bec8-4af0-8d36-f28e3516f78c\") " pod="openshift-ingress/e2e-mt-2f806b4e-openshift-default-65dbf4fb9b-xmwnb" Jul 27 21:07:12.793460 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:07:12.793174 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/cba95b49-bec8-4af0-8d36-f28e3516f78c-istio-envoy\") pod \"e2e-mt-2f806b4e-openshift-default-65dbf4fb9b-xmwnb\" (UID: \"cba95b49-bec8-4af0-8d36-f28e3516f78c\") " pod="openshift-ingress/e2e-mt-2f806b4e-openshift-default-65dbf4fb9b-xmwnb" Jul 27 21:07:12.793460 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:07:12.793207 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/cba95b49-bec8-4af0-8d36-f28e3516f78c-istiod-ca-cert\") pod \"e2e-mt-2f806b4e-openshift-default-65dbf4fb9b-xmwnb\" (UID: \"cba95b49-bec8-4af0-8d36-f28e3516f78c\") " pod="openshift-ingress/e2e-mt-2f806b4e-openshift-default-65dbf4fb9b-xmwnb" Jul 27 21:07:12.793460 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:07:12.793236 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/cba95b49-bec8-4af0-8d36-f28e3516f78c-workload-socket\") pod \"e2e-mt-2f806b4e-openshift-default-65dbf4fb9b-xmwnb\" (UID: \"cba95b49-bec8-4af0-8d36-f28e3516f78c\") " pod="openshift-ingress/e2e-mt-2f806b4e-openshift-default-65dbf4fb9b-xmwnb" Jul 27 21:07:12.793460 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:07:12.793367 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/cba95b49-bec8-4af0-8d36-f28e3516f78c-istio-podinfo\") pod \"e2e-mt-2f806b4e-openshift-default-65dbf4fb9b-xmwnb\" (UID: \"cba95b49-bec8-4af0-8d36-f28e3516f78c\") " pod="openshift-ingress/e2e-mt-2f806b4e-openshift-default-65dbf4fb9b-xmwnb" Jul 27 21:07:12.793460 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:07:12.793425 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cba95b49-bec8-4af0-8d36-f28e3516f78c-istio-token\") pod \"e2e-mt-2f806b4e-openshift-default-65dbf4fb9b-xmwnb\" (UID: \"cba95b49-bec8-4af0-8d36-f28e3516f78c\") " pod="openshift-ingress/e2e-mt-2f806b4e-openshift-default-65dbf4fb9b-xmwnb" Jul 27 21:07:12.793719 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:07:12.793625 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/cba95b49-bec8-4af0-8d36-f28e3516f78c-credential-socket\") pod \"e2e-mt-2f806b4e-openshift-default-65dbf4fb9b-xmwnb\" (UID: \"cba95b49-bec8-4af0-8d36-f28e3516f78c\") " pod="openshift-ingress/e2e-mt-2f806b4e-openshift-default-65dbf4fb9b-xmwnb" Jul 27 21:07:12.793719 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:07:12.793704 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xctjh\" (UniqueName: \"kubernetes.io/projected/cba95b49-bec8-4af0-8d36-f28e3516f78c-kube-api-access-xctjh\") pod \"e2e-mt-2f806b4e-openshift-default-65dbf4fb9b-xmwnb\" (UID: \"cba95b49-bec8-4af0-8d36-f28e3516f78c\") " pod="openshift-ingress/e2e-mt-2f806b4e-openshift-default-65dbf4fb9b-xmwnb" Jul 27 21:07:12.793825 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:07:12.793752 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/cba95b49-bec8-4af0-8d36-f28e3516f78c-istio-data\") pod \"e2e-mt-2f806b4e-openshift-default-65dbf4fb9b-xmwnb\" (UID: \"cba95b49-bec8-4af0-8d36-f28e3516f78c\") " pod="openshift-ingress/e2e-mt-2f806b4e-openshift-default-65dbf4fb9b-xmwnb" Jul 27 21:07:12.794015 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:07:12.793993 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/cba95b49-bec8-4af0-8d36-f28e3516f78c-workload-certs\") pod \"e2e-mt-2f806b4e-openshift-default-65dbf4fb9b-xmwnb\" (UID: \"cba95b49-bec8-4af0-8d36-f28e3516f78c\") " pod="openshift-ingress/e2e-mt-2f806b4e-openshift-default-65dbf4fb9b-xmwnb" Jul 27 21:07:12.794097 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:07:12.794001 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/cba95b49-bec8-4af0-8d36-f28e3516f78c-istiod-ca-cert\") pod \"e2e-mt-2f806b4e-openshift-default-65dbf4fb9b-xmwnb\" (UID: \"cba95b49-bec8-4af0-8d36-f28e3516f78c\") " pod="openshift-ingress/e2e-mt-2f806b4e-openshift-default-65dbf4fb9b-xmwnb" Jul 27 21:07:12.794097 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:07:12.794059 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/cba95b49-bec8-4af0-8d36-f28e3516f78c-workload-socket\") pod \"e2e-mt-2f806b4e-openshift-default-65dbf4fb9b-xmwnb\" (UID: \"cba95b49-bec8-4af0-8d36-f28e3516f78c\") " pod="openshift-ingress/e2e-mt-2f806b4e-openshift-default-65dbf4fb9b-xmwnb" Jul 27 21:07:12.794190 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:07:12.794162 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/cba95b49-bec8-4af0-8d36-f28e3516f78c-istio-data\") pod \"e2e-mt-2f806b4e-openshift-default-65dbf4fb9b-xmwnb\" (UID: \"cba95b49-bec8-4af0-8d36-f28e3516f78c\") " pod="openshift-ingress/e2e-mt-2f806b4e-openshift-default-65dbf4fb9b-xmwnb" Jul 27 21:07:12.795599 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:07:12.795579 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/cba95b49-bec8-4af0-8d36-f28e3516f78c-istio-envoy\") pod \"e2e-mt-2f806b4e-openshift-default-65dbf4fb9b-xmwnb\" (UID: \"cba95b49-bec8-4af0-8d36-f28e3516f78c\") " pod="openshift-ingress/e2e-mt-2f806b4e-openshift-default-65dbf4fb9b-xmwnb" Jul 27 21:07:12.795783 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:07:12.795766 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/cba95b49-bec8-4af0-8d36-f28e3516f78c-istio-podinfo\") pod \"e2e-mt-2f806b4e-openshift-default-65dbf4fb9b-xmwnb\" (UID: \"cba95b49-bec8-4af0-8d36-f28e3516f78c\") " pod="openshift-ingress/e2e-mt-2f806b4e-openshift-default-65dbf4fb9b-xmwnb" Jul 27 21:07:12.800769 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:07:12.800750 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cba95b49-bec8-4af0-8d36-f28e3516f78c-istio-token\") pod \"e2e-mt-2f806b4e-openshift-default-65dbf4fb9b-xmwnb\" (UID: \"cba95b49-bec8-4af0-8d36-f28e3516f78c\") " pod="openshift-ingress/e2e-mt-2f806b4e-openshift-default-65dbf4fb9b-xmwnb" Jul 27 21:07:12.800952 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:07:12.800936 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xctjh\" (UniqueName: \"kubernetes.io/projected/cba95b49-bec8-4af0-8d36-f28e3516f78c-kube-api-access-xctjh\") pod \"e2e-mt-2f806b4e-openshift-default-65dbf4fb9b-xmwnb\" (UID: \"cba95b49-bec8-4af0-8d36-f28e3516f78c\") " pod="openshift-ingress/e2e-mt-2f806b4e-openshift-default-65dbf4fb9b-xmwnb" Jul 27 21:07:12.920438 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:07:12.920351 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-2f806b4e-openshift-default-65dbf4fb9b-xmwnb" Jul 27 21:07:13.059242 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:07:13.059214 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-2f806b4e-openshift-default-65dbf4fb9b-xmwnb"] Jul 27 21:07:13.061700 ip-10-0-139-2 kubenswrapper[2572]: W0727 21:07:13.061673 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcba95b49_bec8_4af0_8d36_f28e3516f78c.slice/crio-702e81dbb6f7113394c362de5616a52471a8c17030240a02f5d6508273cc5672 WatchSource:0}: Error finding container 702e81dbb6f7113394c362de5616a52471a8c17030240a02f5d6508273cc5672: Status 404 returned error can't find the container with id 702e81dbb6f7113394c362de5616a52471a8c17030240a02f5d6508273cc5672 Jul 27 21:07:13.063823 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:07:13.063792 2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 27 21:07:13.063904 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:07:13.063855 2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 27 21:07:13.063904 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:07:13.063884 2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 27 21:07:13.178336 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:07:13.178243 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbpp5_e2759622-0ab6-46b7-b434-f0a0f8942dfe/konnectivity-agent/0.log" limit=1024 Jul 27 21:07:14.002525 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:07:14.002490 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-2f806b4e-openshift-default-65dbf4fb9b-xmwnb" event={"ID":"cba95b49-bec8-4af0-8d36-f28e3516f78c","Type":"ContainerStarted","Data":"a34ff37f7fd9ec29e8b1d63692f986f3da59d35d771420bbf59b8064d3d7dce8"} Jul 27 21:07:14.002711 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:07:14.002552 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-2f806b4e-openshift-default-65dbf4fb9b-xmwnb" event={"ID":"cba95b49-bec8-4af0-8d36-f28e3516f78c","Type":"ContainerStarted","Data":"702e81dbb6f7113394c362de5616a52471a8c17030240a02f5d6508273cc5672"} Jul 27 21:07:14.024214 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:07:14.024158 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-2f806b4e-openshift-default-65dbf4fb9b-xmwnb" podStartSLOduration=2.02414148 podStartE2EDuration="2.02414148s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 21:07:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 21:07:14.022716793 +0000 UTC m=+1967.492259839" watchObservedRunningTime="2026-07-27 21:07:14.02414148 +0000 UTC m=+1967.493684489" Jul 27 21:07:14.920691 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:07:14.920642 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-2f806b4e-openshift-default-65dbf4fb9b-xmwnb" Jul 27 21:07:14.925376 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:07:14.925351 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-2f806b4e-openshift-default-65dbf4fb9b-xmwnb" Jul 27 21:07:15.006967 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:07:15.006936 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-2f806b4e-openshift-default-65dbf4fb9b-xmwnb" Jul 27 21:07:15.007831 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:07:15.007809 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-2f806b4e-openshift-default-65dbf4fb9b-xmwnb" Jul 27 21:07:15.334961 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:07:15.334919 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbpp5_e2759622-0ab6-46b7-b434-f0a0f8942dfe/konnectivity-agent/0.log" limit=1024 Jul 27 21:07:15.394699 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:07:15.394659 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbpp5_e2759622-0ab6-46b7-b434-f0a0f8942dfe/konnectivity-agent/0.log" limit=1024 Jul 27 21:07:15.959147 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:07:15.959112 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbpp5_e2759622-0ab6-46b7-b434-f0a0f8942dfe/konnectivity-agent/0.log" limit=1024 Jul 27 21:07:16.059834 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:07:16.059800 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbpp5_e2759622-0ab6-46b7-b434-f0a0f8942dfe/konnectivity-agent/0.log" limit=1024 Jul 27 21:07:16.137015 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:07:16.136980 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbpp5_e2759622-0ab6-46b7-b434-f0a0f8942dfe/konnectivity-agent/0.log" limit=1024 Jul 27 21:07:16.369224 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:07:16.369196 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbpp5_e2759622-0ab6-46b7-b434-f0a0f8942dfe/konnectivity-agent/0.log" limit=1024 Jul 27 21:07:16.643878 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:07:16.643793 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbpp5_e2759622-0ab6-46b7-b434-f0a0f8942dfe/konnectivity-agent/0.log" limit=1024 Jul 27 21:07:16.755598 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:07:16.755566 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbpp5_e2759622-0ab6-46b7-b434-f0a0f8942dfe/konnectivity-agent/0.log" limit=1024 Jul 27 21:07:16.809285 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:07:16.809252 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-2f806b4e-d9bdcff4d-nms9t"] Jul 27 21:07:16.809583 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:07:16.809570 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5960cc91-2efb-4f65-8189-530bf93f04b5" containerName="istio-proxy" Jul 27 21:07:16.809644 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:07:16.809585 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="5960cc91-2efb-4f65-8189-530bf93f04b5" containerName="istio-proxy" Jul 27 21:07:16.809681 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:07:16.809656 2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="5960cc91-2efb-4f65-8189-530bf93f04b5" containerName="istio-proxy" Jul 27 21:07:16.812306 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:07:16.812290 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-2f806b4e-d9bdcff4d-nms9t" Jul 27 21:07:16.814350 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:07:16.814309 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-mt-2f806b4e\"" Jul 27 21:07:16.814655 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:07:16.814633 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-mt-2f806b4e-dockercfg-6r7fk\"" Jul 27 21:07:16.825597 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:07:16.825574 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-2f806b4e-d9bdcff4d-nms9t"] Jul 27 21:07:16.931389 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:07:16.931282 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a65ac587-3937-44c2-821e-000588bac7e3-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-2f806b4e-d9bdcff4d-nms9t\" (UID: \"a65ac587-3937-44c2-821e-000588bac7e3\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-2f806b4e-d9bdcff4d-nms9t" Jul 27 21:07:16.931540 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:07:16.931458 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5jhm9\" (UniqueName: \"kubernetes.io/projected/a65ac587-3937-44c2-821e-000588bac7e3-kube-api-access-5jhm9\") pod \"payload-pre-processing-e2e-mt-2f806b4e-d9bdcff4d-nms9t\" (UID: \"a65ac587-3937-44c2-821e-000588bac7e3\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-2f806b4e-d9bdcff4d-nms9t" Jul 27 21:07:16.945758 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:07:16.945729 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-2f806b4e-5f4d967b5d-ndkhq"] Jul 27 21:07:16.949049 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:07:16.949034 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-2f806b4e-5f4d967b5d-ndkhq" Jul 27 21:07:16.960620 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:07:16.960597 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-2f806b4e-5f4d967b5d-ndkhq"] Jul 27 21:07:17.031910 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:07:17.031876 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a65ac587-3937-44c2-821e-000588bac7e3-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-2f806b4e-d9bdcff4d-nms9t\" (UID: \"a65ac587-3937-44c2-821e-000588bac7e3\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-2f806b4e-d9bdcff4d-nms9t" Jul 27 21:07:17.032091 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:07:17.031955 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t2pd7\" (UniqueName: \"kubernetes.io/projected/a6bfb2f8-16b0-42ce-ab47-ce54959b4ab6-kube-api-access-t2pd7\") pod \"payload-processing-e2e-mt-2f806b4e-5f4d967b5d-ndkhq\" (UID: \"a6bfb2f8-16b0-42ce-ab47-ce54959b4ab6\") " pod="openshift-ingress/payload-processing-e2e-mt-2f806b4e-5f4d967b5d-ndkhq" Jul 27 21:07:17.032091 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:07:17.031982 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5jhm9\" (UniqueName: \"kubernetes.io/projected/a65ac587-3937-44c2-821e-000588bac7e3-kube-api-access-5jhm9\") pod \"payload-pre-processing-e2e-mt-2f806b4e-d9bdcff4d-nms9t\" (UID: \"a65ac587-3937-44c2-821e-000588bac7e3\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-2f806b4e-d9bdcff4d-nms9t" Jul 27 21:07:17.032091 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:07:17.032022 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a6bfb2f8-16b0-42ce-ab47-ce54959b4ab6-plugins-config-volume\") pod \"payload-processing-e2e-mt-2f806b4e-5f4d967b5d-ndkhq\" (UID: \"a6bfb2f8-16b0-42ce-ab47-ce54959b4ab6\") " pod="openshift-ingress/payload-processing-e2e-mt-2f806b4e-5f4d967b5d-ndkhq" Jul 27 21:07:17.032598 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:07:17.032580 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a65ac587-3937-44c2-821e-000588bac7e3-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-2f806b4e-d9bdcff4d-nms9t\" (UID: \"a65ac587-3937-44c2-821e-000588bac7e3\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-2f806b4e-d9bdcff4d-nms9t" Jul 27 21:07:17.040532 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:07:17.040503 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5jhm9\" (UniqueName: \"kubernetes.io/projected/a65ac587-3937-44c2-821e-000588bac7e3-kube-api-access-5jhm9\") pod \"payload-pre-processing-e2e-mt-2f806b4e-d9bdcff4d-nms9t\" (UID: \"a65ac587-3937-44c2-821e-000588bac7e3\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-2f806b4e-d9bdcff4d-nms9t" Jul 27 21:07:17.123015 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:07:17.122976 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-2f806b4e-d9bdcff4d-nms9t" Jul 27 21:07:17.133622 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:07:17.133583 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t2pd7\" (UniqueName: \"kubernetes.io/projected/a6bfb2f8-16b0-42ce-ab47-ce54959b4ab6-kube-api-access-t2pd7\") pod \"payload-processing-e2e-mt-2f806b4e-5f4d967b5d-ndkhq\" (UID: \"a6bfb2f8-16b0-42ce-ab47-ce54959b4ab6\") " pod="openshift-ingress/payload-processing-e2e-mt-2f806b4e-5f4d967b5d-ndkhq" Jul 27 21:07:17.133773 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:07:17.133657 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a6bfb2f8-16b0-42ce-ab47-ce54959b4ab6-plugins-config-volume\") pod \"payload-processing-e2e-mt-2f806b4e-5f4d967b5d-ndkhq\" (UID: \"a6bfb2f8-16b0-42ce-ab47-ce54959b4ab6\") " pod="openshift-ingress/payload-processing-e2e-mt-2f806b4e-5f4d967b5d-ndkhq" Jul 27 21:07:17.135749 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:07:17.134838 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a6bfb2f8-16b0-42ce-ab47-ce54959b4ab6-plugins-config-volume\") pod \"payload-processing-e2e-mt-2f806b4e-5f4d967b5d-ndkhq\" (UID: \"a6bfb2f8-16b0-42ce-ab47-ce54959b4ab6\") " pod="openshift-ingress/payload-processing-e2e-mt-2f806b4e-5f4d967b5d-ndkhq" Jul 27 21:07:17.142197 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:07:17.142169 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t2pd7\" (UniqueName: \"kubernetes.io/projected/a6bfb2f8-16b0-42ce-ab47-ce54959b4ab6-kube-api-access-t2pd7\") pod \"payload-processing-e2e-mt-2f806b4e-5f4d967b5d-ndkhq\" (UID: \"a6bfb2f8-16b0-42ce-ab47-ce54959b4ab6\") " pod="openshift-ingress/payload-processing-e2e-mt-2f806b4e-5f4d967b5d-ndkhq" Jul 27 21:07:17.259040 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:07:17.259007 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-2f806b4e-5f4d967b5d-ndkhq" Jul 27 21:07:17.263957 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:07:17.263919 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-2f806b4e-d9bdcff4d-nms9t"] Jul 27 21:07:17.269019 ip-10-0-139-2 kubenswrapper[2572]: W0727 21:07:17.268992 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda65ac587_3937_44c2_821e_000588bac7e3.slice/crio-456b7653c16f0ed433dda97197749fca80a24a011323d8fa36a4e3041a406207 WatchSource:0}: Error finding container 456b7653c16f0ed433dda97197749fca80a24a011323d8fa36a4e3041a406207: Status 404 returned error can't find the container with id 456b7653c16f0ed433dda97197749fca80a24a011323d8fa36a4e3041a406207 Jul 27 21:07:17.401489 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:07:17.401453 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-2f806b4e-5f4d967b5d-ndkhq"] Jul 27 21:07:17.405060 ip-10-0-139-2 kubenswrapper[2572]: W0727 21:07:17.405026 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda6bfb2f8_16b0_42ce_ab47_ce54959b4ab6.slice/crio-72445930c3f47cc8b6c78d87bba7a6c5b35a71225ee38a9c41f21c84943c7ff1 WatchSource:0}: Error finding container 72445930c3f47cc8b6c78d87bba7a6c5b35a71225ee38a9c41f21c84943c7ff1: Status 404 returned error can't find the container with id 72445930c3f47cc8b6c78d87bba7a6c5b35a71225ee38a9c41f21c84943c7ff1 Jul 27 21:07:18.022166 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:07:18.022127 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-2f806b4e-d9bdcff4d-nms9t" event={"ID":"a65ac587-3937-44c2-821e-000588bac7e3","Type":"ContainerStarted","Data":"02aea91b1d4a8e3f4d9078caabcaf6f7da71ab4ab67ef5efbe6627c9a811c515"} Jul 27 21:07:18.022631 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:07:18.022190 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-2f806b4e-d9bdcff4d-nms9t" event={"ID":"a65ac587-3937-44c2-821e-000588bac7e3","Type":"ContainerStarted","Data":"456b7653c16f0ed433dda97197749fca80a24a011323d8fa36a4e3041a406207"} Jul 27 21:07:18.022631 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:07:18.022221 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-mt-2f806b4e-d9bdcff4d-nms9t" Jul 27 21:07:18.023704 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:07:18.023671 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-2f806b4e-5f4d967b5d-ndkhq" event={"ID":"a6bfb2f8-16b0-42ce-ab47-ce54959b4ab6","Type":"ContainerStarted","Data":"fef28cae0c17b9eedf32374b68a4cdfc3da8614b91310f7887c41620fc956e2e"} Jul 27 21:07:18.023843 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:07:18.023716 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-2f806b4e-5f4d967b5d-ndkhq" event={"ID":"a6bfb2f8-16b0-42ce-ab47-ce54959b4ab6","Type":"ContainerStarted","Data":"72445930c3f47cc8b6c78d87bba7a6c5b35a71225ee38a9c41f21c84943c7ff1"} Jul 27 21:07:18.023843 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:07:18.023761 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-mt-2f806b4e-5f4d967b5d-ndkhq" Jul 27 21:07:18.039371 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:07:18.039305 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-mt-2f806b4e-d9bdcff4d-nms9t" podStartSLOduration=2.039287492 podStartE2EDuration="2.039287492s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 21:07:16 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 21:07:18.038689639 +0000 UTC m=+1971.508232649" watchObservedRunningTime="2026-07-27 21:07:18.039287492 +0000 UTC m=+1971.508830504" Jul 27 21:07:18.055013 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:07:18.054970 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-mt-2f806b4e-5f4d967b5d-ndkhq" podStartSLOduration=2.054954931 podStartE2EDuration="2.054954931s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 21:07:16 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 21:07:18.053568926 +0000 UTC m=+1971.523111936" watchObservedRunningTime="2026-07-27 21:07:18.054954931 +0000 UTC m=+1971.524497941" Jul 27 21:07:20.466150 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:07:20.466119 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbpp5_e2759622-0ab6-46b7-b434-f0a0f8942dfe/konnectivity-agent/0.log" limit=1024 Jul 27 21:07:21.120628 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:07:21.120595 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbpp5_e2759622-0ab6-46b7-b434-f0a0f8942dfe/konnectivity-agent/0.log" limit=1024 Jul 27 21:07:21.214007 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:07:21.213975 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbpp5_e2759622-0ab6-46b7-b434-f0a0f8942dfe/konnectivity-agent/0.log" limit=1024 Jul 27 21:07:21.606119 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:07:21.606085 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbpp5_e2759622-0ab6-46b7-b434-f0a0f8942dfe/konnectivity-agent/0.log" limit=1024 Jul 27 21:07:26.060457 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:07:26.060419 2572 generic.go:356] "Generic (PLEG): container finished" podID="cba95b49-bec8-4af0-8d36-f28e3516f78c" containerID="a34ff37f7fd9ec29e8b1d63692f986f3da59d35d771420bbf59b8064d3d7dce8" exitCode=0 Jul 27 21:07:26.061011 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:07:26.060482 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-2f806b4e-openshift-default-65dbf4fb9b-xmwnb" event={"ID":"cba95b49-bec8-4af0-8d36-f28e3516f78c","Type":"ContainerDied","Data":"a34ff37f7fd9ec29e8b1d63692f986f3da59d35d771420bbf59b8064d3d7dce8"} Jul 27 21:07:26.061011 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:07:26.060974 2572 scope.go:117] "RemoveContainer" containerID="a34ff37f7fd9ec29e8b1d63692f986f3da59d35d771420bbf59b8064d3d7dce8" Jul 27 21:07:26.062024 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:07:26.061992 2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 27 21:07:26.062135 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:07:26.062062 2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 27 21:07:26.062135 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:07:26.062090 2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 27 21:07:27.067641 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:07:27.067604 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-2f806b4e-openshift-default-65dbf4fb9b-xmwnb" event={"ID":"cba95b49-bec8-4af0-8d36-f28e3516f78c","Type":"ContainerStarted","Data":"43ea09cbd9f62c6e9e287ad73807ee1347281279c6e49ef09e2bf2779d4cfc6c"} Jul 27 21:07:27.234523 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:07:27.234477 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbpp5_e2759622-0ab6-46b7-b434-f0a0f8942dfe/konnectivity-agent/0.log" limit=1024 Jul 27 21:07:27.335346 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:07:27.335236 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbpp5_e2759622-0ab6-46b7-b434-f0a0f8942dfe/konnectivity-agent/0.log" limit=1024 Jul 27 21:07:27.921390 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:07:27.921351 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-2f806b4e-openshift-default-65dbf4fb9b-xmwnb" Jul 27 21:07:27.922678 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:07:27.922649 2572 patch_prober.go:28] interesting pod/e2e-mt-2f806b4e-openshift-default-65dbf4fb9b-xmwnb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.34:15021/healthz/ready\": dial tcp 10.133.0.34:15021: connect: connection refused" start-of-body= Jul 27 21:07:27.922807 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:07:27.922700 2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-2f806b4e-openshift-default-65dbf4fb9b-xmwnb" podUID="cba95b49-bec8-4af0-8d36-f28e3516f78c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.34:15021/healthz/ready\": dial tcp 10.133.0.34:15021: connect: connection refused" Jul 27 21:07:28.920866 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:07:28.920828 2572 patch_prober.go:28] interesting pod/e2e-mt-2f806b4e-openshift-default-65dbf4fb9b-xmwnb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.34:15021/healthz/ready\": dial tcp 10.133.0.34:15021: connect: connection refused" start-of-body= Jul 27 21:07:28.921279 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:07:28.920894 2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-2f806b4e-openshift-default-65dbf4fb9b-xmwnb" podUID="cba95b49-bec8-4af0-8d36-f28e3516f78c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.34:15021/healthz/ready\": dial tcp 10.133.0.34:15021: connect: connection refused" Jul 27 21:07:29.030034 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:07:29.030004 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-mt-2f806b4e-5f4d967b5d-ndkhq" Jul 27 21:07:29.030204 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:07:29.030073 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-mt-2f806b4e-d9bdcff4d-nms9t" Jul 27 21:07:29.921019 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:07:29.920979 2572 patch_prober.go:28] interesting pod/e2e-mt-2f806b4e-openshift-default-65dbf4fb9b-xmwnb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.34:15021/healthz/ready\": dial tcp 10.133.0.34:15021: connect: connection refused" start-of-body= Jul 27 21:07:29.921547 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:07:29.921043 2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-2f806b4e-openshift-default-65dbf4fb9b-xmwnb" podUID="cba95b49-bec8-4af0-8d36-f28e3516f78c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.34:15021/healthz/ready\": dial tcp 10.133.0.34:15021: connect: connection refused" Jul 27 21:07:30.007210 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:07:30.007171 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-2f806b4e-openshift-default-65dbf4fb9b-xmwnb" Jul 27 21:07:30.924989 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:07:30.924959 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-2f806b4e-openshift-default-65dbf4fb9b-xmwnb" Jul 27 21:07:30.925939 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:07:30.925921 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-2f806b4e-openshift-default-65dbf4fb9b-xmwnb" Jul 27 21:07:37.789424 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:07:37.789387 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbpp5_e2759622-0ab6-46b7-b434-f0a0f8942dfe/konnectivity-agent/0.log" limit=1024 Jul 27 21:07:37.807928 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:07:37.807899 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-2f806b4e-5f4d967b5d-ndkhq"] Jul 27 21:07:37.808129 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:07:37.808102 2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-mt-2f806b4e-5f4d967b5d-ndkhq" podUID="a6bfb2f8-16b0-42ce-ab47-ce54959b4ab6" containerName="payload-processing" containerID="cri-o://fef28cae0c17b9eedf32374b68a4cdfc3da8614b91310f7887c41620fc956e2e" gracePeriod=30 Jul 27 21:07:37.816735 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:07:37.816548 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-2f806b4e-d9bdcff4d-nms9t"] Jul 27 21:07:37.816860 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:07:37.816804 2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-mt-2f806b4e-d9bdcff4d-nms9t" podUID="a65ac587-3937-44c2-821e-000588bac7e3" containerName="payload-pre-processing" containerID="cri-o://02aea91b1d4a8e3f4d9078caabcaf6f7da71ab4ab67ef5efbe6627c9a811c515" gracePeriod=30 Jul 27 21:07:37.890230 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:07:37.890202 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbpp5_e2759622-0ab6-46b7-b434-f0a0f8942dfe/konnectivity-agent/0.log" limit=1024 Jul 27 21:07:37.993519 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:07:37.990888 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbpp5_e2759622-0ab6-46b7-b434-f0a0f8942dfe/konnectivity-agent/0.log" limit=1024 Jul 27 21:07:38.073411 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:07:38.073383 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-2f806b4e-5f4d967b5d-ndkhq" Jul 27 21:07:38.094480 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:07:38.094455 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-2f806b4e-d9bdcff4d-nms9t" Jul 27 21:07:38.116447 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:07:38.116415 2572 generic.go:356] "Generic (PLEG): container finished" podID="a65ac587-3937-44c2-821e-000588bac7e3" containerID="02aea91b1d4a8e3f4d9078caabcaf6f7da71ab4ab67ef5efbe6627c9a811c515" exitCode=0 Jul 27 21:07:38.116601 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:07:38.116448 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-2f806b4e-d9bdcff4d-nms9t" Jul 27 21:07:38.116601 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:07:38.116486 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-2f806b4e-d9bdcff4d-nms9t" event={"ID":"a65ac587-3937-44c2-821e-000588bac7e3","Type":"ContainerDied","Data":"02aea91b1d4a8e3f4d9078caabcaf6f7da71ab4ab67ef5efbe6627c9a811c515"} Jul 27 21:07:38.116601 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:07:38.116546 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-2f806b4e-d9bdcff4d-nms9t" event={"ID":"a65ac587-3937-44c2-821e-000588bac7e3","Type":"ContainerDied","Data":"456b7653c16f0ed433dda97197749fca80a24a011323d8fa36a4e3041a406207"} Jul 27 21:07:38.116601 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:07:38.116578 2572 scope.go:117] "RemoveContainer" containerID="02aea91b1d4a8e3f4d9078caabcaf6f7da71ab4ab67ef5efbe6627c9a811c515" Jul 27 21:07:38.117836 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:07:38.117811 2572 generic.go:356] "Generic (PLEG): container finished" podID="a6bfb2f8-16b0-42ce-ab47-ce54959b4ab6" containerID="fef28cae0c17b9eedf32374b68a4cdfc3da8614b91310f7887c41620fc956e2e" exitCode=0 Jul 27 21:07:38.117943 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:07:38.117847 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-2f806b4e-5f4d967b5d-ndkhq" event={"ID":"a6bfb2f8-16b0-42ce-ab47-ce54959b4ab6","Type":"ContainerDied","Data":"fef28cae0c17b9eedf32374b68a4cdfc3da8614b91310f7887c41620fc956e2e"} Jul 27 21:07:38.117943 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:07:38.117867 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-2f806b4e-5f4d967b5d-ndkhq" Jul 27 21:07:38.117943 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:07:38.117887 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-2f806b4e-5f4d967b5d-ndkhq" event={"ID":"a6bfb2f8-16b0-42ce-ab47-ce54959b4ab6","Type":"ContainerDied","Data":"72445930c3f47cc8b6c78d87bba7a6c5b35a71225ee38a9c41f21c84943c7ff1"} Jul 27 21:07:38.126395 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:07:38.126377 2572 scope.go:117] "RemoveContainer" containerID="02aea91b1d4a8e3f4d9078caabcaf6f7da71ab4ab67ef5efbe6627c9a811c515" Jul 27 21:07:38.126665 ip-10-0-139-2 kubenswrapper[2572]: E0727 21:07:38.126646 2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"02aea91b1d4a8e3f4d9078caabcaf6f7da71ab4ab67ef5efbe6627c9a811c515\": container with ID starting with 02aea91b1d4a8e3f4d9078caabcaf6f7da71ab4ab67ef5efbe6627c9a811c515 not found: ID does not exist" containerID="02aea91b1d4a8e3f4d9078caabcaf6f7da71ab4ab67ef5efbe6627c9a811c515" Jul 27 21:07:38.126739 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:07:38.126685 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"02aea91b1d4a8e3f4d9078caabcaf6f7da71ab4ab67ef5efbe6627c9a811c515"} err="failed to get container status \"02aea91b1d4a8e3f4d9078caabcaf6f7da71ab4ab67ef5efbe6627c9a811c515\": rpc error: code = NotFound desc = could not find container \"02aea91b1d4a8e3f4d9078caabcaf6f7da71ab4ab67ef5efbe6627c9a811c515\": container with ID starting with 02aea91b1d4a8e3f4d9078caabcaf6f7da71ab4ab67ef5efbe6627c9a811c515 not found: ID does not exist" Jul 27 21:07:38.126739 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:07:38.126708 2572 scope.go:117] "RemoveContainer" containerID="fef28cae0c17b9eedf32374b68a4cdfc3da8614b91310f7887c41620fc956e2e" Jul 27 21:07:38.131588 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:07:38.131560 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-t2pd7\" (UniqueName: \"kubernetes.io/projected/a6bfb2f8-16b0-42ce-ab47-ce54959b4ab6-kube-api-access-t2pd7\") pod \"a6bfb2f8-16b0-42ce-ab47-ce54959b4ab6\" (UID: \"a6bfb2f8-16b0-42ce-ab47-ce54959b4ab6\") " Jul 27 21:07:38.131686 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:07:38.131615 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a6bfb2f8-16b0-42ce-ab47-ce54959b4ab6-plugins-config-volume\") pod \"a6bfb2f8-16b0-42ce-ab47-ce54959b4ab6\" (UID: \"a6bfb2f8-16b0-42ce-ab47-ce54959b4ab6\") " Jul 27 21:07:38.131757 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:07:38.131738 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a65ac587-3937-44c2-821e-000588bac7e3-plugins-config-volume\") pod \"a65ac587-3937-44c2-821e-000588bac7e3\" (UID: \"a65ac587-3937-44c2-821e-000588bac7e3\") " Jul 27 21:07:38.131815 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:07:38.131773 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5jhm9\" (UniqueName: \"kubernetes.io/projected/a65ac587-3937-44c2-821e-000588bac7e3-kube-api-access-5jhm9\") pod \"a65ac587-3937-44c2-821e-000588bac7e3\" (UID: \"a65ac587-3937-44c2-821e-000588bac7e3\") " Jul 27 21:07:38.132009 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:07:38.131982 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a6bfb2f8-16b0-42ce-ab47-ce54959b4ab6-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "a6bfb2f8-16b0-42ce-ab47-ce54959b4ab6" (UID: "a6bfb2f8-16b0-42ce-ab47-ce54959b4ab6"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 27 21:07:38.132677 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:07:38.132650 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a65ac587-3937-44c2-821e-000588bac7e3-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "a65ac587-3937-44c2-821e-000588bac7e3" (UID: "a65ac587-3937-44c2-821e-000588bac7e3"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 27 21:07:38.134164 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:07:38.134139 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a65ac587-3937-44c2-821e-000588bac7e3-kube-api-access-5jhm9" (OuterVolumeSpecName: "kube-api-access-5jhm9") pod "a65ac587-3937-44c2-821e-000588bac7e3" (UID: "a65ac587-3937-44c2-821e-000588bac7e3"). InnerVolumeSpecName "kube-api-access-5jhm9". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 27 21:07:38.134241 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:07:38.134174 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a6bfb2f8-16b0-42ce-ab47-ce54959b4ab6-kube-api-access-t2pd7" (OuterVolumeSpecName: "kube-api-access-t2pd7") pod "a6bfb2f8-16b0-42ce-ab47-ce54959b4ab6" (UID: "a6bfb2f8-16b0-42ce-ab47-ce54959b4ab6"). InnerVolumeSpecName "kube-api-access-t2pd7". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 27 21:07:38.135773 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:07:38.135756 2572 scope.go:117] "RemoveContainer" containerID="fef28cae0c17b9eedf32374b68a4cdfc3da8614b91310f7887c41620fc956e2e" Jul 27 21:07:38.136058 ip-10-0-139-2 kubenswrapper[2572]: E0727 21:07:38.136039 2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fef28cae0c17b9eedf32374b68a4cdfc3da8614b91310f7887c41620fc956e2e\": container with ID starting with fef28cae0c17b9eedf32374b68a4cdfc3da8614b91310f7887c41620fc956e2e not found: ID does not exist" containerID="fef28cae0c17b9eedf32374b68a4cdfc3da8614b91310f7887c41620fc956e2e" Jul 27 21:07:38.136107 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:07:38.136066 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fef28cae0c17b9eedf32374b68a4cdfc3da8614b91310f7887c41620fc956e2e"} err="failed to get container status \"fef28cae0c17b9eedf32374b68a4cdfc3da8614b91310f7887c41620fc956e2e\": rpc error: code = NotFound desc = could not find container \"fef28cae0c17b9eedf32374b68a4cdfc3da8614b91310f7887c41620fc956e2e\": container with ID starting with fef28cae0c17b9eedf32374b68a4cdfc3da8614b91310f7887c41620fc956e2e not found: ID does not exist" Jul 27 21:07:38.233043 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:07:38.233013 2572 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a6bfb2f8-16b0-42ce-ab47-ce54959b4ab6-plugins-config-volume\") on node \"ip-10-0-139-2.ec2.internal\" DevicePath \"\"" Jul 27 21:07:38.233043 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:07:38.233037 2572 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a65ac587-3937-44c2-821e-000588bac7e3-plugins-config-volume\") on node \"ip-10-0-139-2.ec2.internal\" DevicePath \"\"" Jul 27 21:07:38.233043 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:07:38.233047 2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5jhm9\" (UniqueName: \"kubernetes.io/projected/a65ac587-3937-44c2-821e-000588bac7e3-kube-api-access-5jhm9\") on node \"ip-10-0-139-2.ec2.internal\" DevicePath \"\"" Jul 27 21:07:38.233241 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:07:38.233055 2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-t2pd7\" (UniqueName: \"kubernetes.io/projected/a6bfb2f8-16b0-42ce-ab47-ce54959b4ab6-kube-api-access-t2pd7\") on node \"ip-10-0-139-2.ec2.internal\" DevicePath \"\"" Jul 27 21:07:38.440096 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:07:38.440067 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-2f806b4e-d9bdcff4d-nms9t"] Jul 27 21:07:38.443559 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:07:38.443536 2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-2f806b4e-d9bdcff4d-nms9t"] Jul 27 21:07:38.456782 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:07:38.456755 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-2f806b4e-5f4d967b5d-ndkhq"] Jul 27 21:07:38.460549 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:07:38.460527 2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-2f806b4e-5f4d967b5d-ndkhq"] Jul 27 21:07:39.078893 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:07:39.078819 2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a65ac587-3937-44c2-821e-000588bac7e3" path="/var/lib/kubelet/pods/a65ac587-3937-44c2-821e-000588bac7e3/volumes" Jul 27 21:07:39.079219 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:07:39.079168 2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a6bfb2f8-16b0-42ce-ab47-ce54959b4ab6" path="/var/lib/kubelet/pods/a6bfb2f8-16b0-42ce-ab47-ce54959b4ab6/volumes" Jul 27 21:07:42.664556 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:07:42.664516 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbpp5_e2759622-0ab6-46b7-b434-f0a0f8942dfe/konnectivity-agent/0.log" limit=1024 Jul 27 21:07:43.090419 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:07:43.090389 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbpp5_e2759622-0ab6-46b7-b434-f0a0f8942dfe/konnectivity-agent/0.log" limit=1024 Jul 27 21:07:48.711381 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:07:48.711348 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbpp5_e2759622-0ab6-46b7-b434-f0a0f8942dfe/konnectivity-agent/0.log" limit=1024 Jul 27 21:07:48.776919 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:07:48.776884 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbpp5_e2759622-0ab6-46b7-b434-f0a0f8942dfe/konnectivity-agent/0.log" limit=1024 Jul 27 21:07:48.951385 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:07:48.951349 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-2f806b4e-openshift-default-65dbf4fb9b-xmwnb"] Jul 27 21:07:48.951609 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:07:48.951581 2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-2f806b4e-openshift-default-65dbf4fb9b-xmwnb" podUID="cba95b49-bec8-4af0-8d36-f28e3516f78c" containerName="istio-proxy" containerID="cri-o://43ea09cbd9f62c6e9e287ad73807ee1347281279c6e49ef09e2bf2779d4cfc6c" gracePeriod=30 Jul 27 21:07:48.978342 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:07:48.978264 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbpp5_e2759622-0ab6-46b7-b434-f0a0f8942dfe/konnectivity-agent/0.log" limit=1024 Jul 27 21:07:49.198854 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:07:49.198822 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbpp5_e2759622-0ab6-46b7-b434-f0a0f8942dfe/konnectivity-agent/0.log" limit=1024 Jul 27 21:07:49.330195 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:07:49.330162 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbpp5_e2759622-0ab6-46b7-b434-f0a0f8942dfe/konnectivity-agent/0.log" limit=1024 Jul 27 21:07:49.415939 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:07:49.415911 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbpp5_e2759622-0ab6-46b7-b434-f0a0f8942dfe/konnectivity-agent/0.log" limit=1024 Jul 27 21:07:49.525397 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:07:49.525364 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbpp5_e2759622-0ab6-46b7-b434-f0a0f8942dfe/konnectivity-agent/0.log" limit=1024 Jul 27 21:07:54.185646 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:07:54.185618 2572 generic.go:356] "Generic (PLEG): container finished" podID="cba95b49-bec8-4af0-8d36-f28e3516f78c" containerID="43ea09cbd9f62c6e9e287ad73807ee1347281279c6e49ef09e2bf2779d4cfc6c" exitCode=0 Jul 27 21:07:54.186019 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:07:54.185686 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-2f806b4e-openshift-default-65dbf4fb9b-xmwnb" event={"ID":"cba95b49-bec8-4af0-8d36-f28e3516f78c","Type":"ContainerDied","Data":"43ea09cbd9f62c6e9e287ad73807ee1347281279c6e49ef09e2bf2779d4cfc6c"} Jul 27 21:07:54.186019 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:07:54.185760 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-2f806b4e-openshift-default-65dbf4fb9b-xmwnb" event={"ID":"cba95b49-bec8-4af0-8d36-f28e3516f78c","Type":"ContainerDied","Data":"702e81dbb6f7113394c362de5616a52471a8c17030240a02f5d6508273cc5672"} Jul 27 21:07:54.186019 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:07:54.185778 2572 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="702e81dbb6f7113394c362de5616a52471a8c17030240a02f5d6508273cc5672" Jul 27 21:07:54.186019 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:07:54.185791 2572 scope.go:117] "RemoveContainer" containerID="a34ff37f7fd9ec29e8b1d63692f986f3da59d35d771420bbf59b8064d3d7dce8" Jul 27 21:07:54.190439 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:07:54.190419 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-2f806b4e-openshift-default-65dbf4fb9b-xmwnb" Jul 27 21:07:54.276607 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:07:54.276577 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/cba95b49-bec8-4af0-8d36-f28e3516f78c-istio-data\") pod \"cba95b49-bec8-4af0-8d36-f28e3516f78c\" (UID: \"cba95b49-bec8-4af0-8d36-f28e3516f78c\") " Jul 27 21:07:54.276791 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:07:54.276610 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/cba95b49-bec8-4af0-8d36-f28e3516f78c-istiod-ca-cert\") pod \"cba95b49-bec8-4af0-8d36-f28e3516f78c\" (UID: \"cba95b49-bec8-4af0-8d36-f28e3516f78c\") " Jul 27 21:07:54.276791 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:07:54.276644 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cba95b49-bec8-4af0-8d36-f28e3516f78c-istio-token\") pod \"cba95b49-bec8-4af0-8d36-f28e3516f78c\" (UID: \"cba95b49-bec8-4af0-8d36-f28e3516f78c\") " Jul 27 21:07:54.276791 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:07:54.276672 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/cba95b49-bec8-4af0-8d36-f28e3516f78c-istio-podinfo\") pod \"cba95b49-bec8-4af0-8d36-f28e3516f78c\" (UID: \"cba95b49-bec8-4af0-8d36-f28e3516f78c\") " Jul 27 21:07:54.276791 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:07:54.276700 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/cba95b49-bec8-4af0-8d36-f28e3516f78c-workload-socket\") pod \"cba95b49-bec8-4af0-8d36-f28e3516f78c\" (UID: \"cba95b49-bec8-4af0-8d36-f28e3516f78c\") " Jul 27 21:07:54.276791 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:07:54.276715 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/cba95b49-bec8-4af0-8d36-f28e3516f78c-credential-socket\") pod \"cba95b49-bec8-4af0-8d36-f28e3516f78c\" (UID: \"cba95b49-bec8-4af0-8d36-f28e3516f78c\") " Jul 27 21:07:54.276791 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:07:54.276752 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/cba95b49-bec8-4af0-8d36-f28e3516f78c-istio-envoy\") pod \"cba95b49-bec8-4af0-8d36-f28e3516f78c\" (UID: \"cba95b49-bec8-4af0-8d36-f28e3516f78c\") " Jul 27 21:07:54.277169 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:07:54.276802 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xctjh\" (UniqueName: \"kubernetes.io/projected/cba95b49-bec8-4af0-8d36-f28e3516f78c-kube-api-access-xctjh\") pod \"cba95b49-bec8-4af0-8d36-f28e3516f78c\" (UID: \"cba95b49-bec8-4af0-8d36-f28e3516f78c\") " Jul 27 21:07:54.277169 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:07:54.277057 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cba95b49-bec8-4af0-8d36-f28e3516f78c-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "cba95b49-bec8-4af0-8d36-f28e3516f78c" (UID: "cba95b49-bec8-4af0-8d36-f28e3516f78c"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 27 21:07:54.277169 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:07:54.277080 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cba95b49-bec8-4af0-8d36-f28e3516f78c-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "cba95b49-bec8-4af0-8d36-f28e3516f78c" (UID: "cba95b49-bec8-4af0-8d36-f28e3516f78c"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 27 21:07:54.277169 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:07:54.277076 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cba95b49-bec8-4af0-8d36-f28e3516f78c-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "cba95b49-bec8-4af0-8d36-f28e3516f78c" (UID: "cba95b49-bec8-4af0-8d36-f28e3516f78c"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 27 21:07:54.277408 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:07:54.277229 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/cba95b49-bec8-4af0-8d36-f28e3516f78c-workload-certs\") pod \"cba95b49-bec8-4af0-8d36-f28e3516f78c\" (UID: \"cba95b49-bec8-4af0-8d36-f28e3516f78c\") " Jul 27 21:07:54.277541 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:07:54.277516 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cba95b49-bec8-4af0-8d36-f28e3516f78c-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "cba95b49-bec8-4af0-8d36-f28e3516f78c" (UID: "cba95b49-bec8-4af0-8d36-f28e3516f78c"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 27 21:07:54.277617 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:07:54.277590 2572 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/cba95b49-bec8-4af0-8d36-f28e3516f78c-workload-certs\") on node \"ip-10-0-139-2.ec2.internal\" DevicePath \"\"" Jul 27 21:07:54.277617 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:07:54.277609 2572 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/cba95b49-bec8-4af0-8d36-f28e3516f78c-istiod-ca-cert\") on node \"ip-10-0-139-2.ec2.internal\" DevicePath \"\"" Jul 27 21:07:54.277721 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:07:54.277619 2572 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/cba95b49-bec8-4af0-8d36-f28e3516f78c-workload-socket\") on node \"ip-10-0-139-2.ec2.internal\" DevicePath \"\"" Jul 27 21:07:54.277721 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:07:54.277627 2572 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/cba95b49-bec8-4af0-8d36-f28e3516f78c-credential-socket\") on node \"ip-10-0-139-2.ec2.internal\" DevicePath \"\"" Jul 27 21:07:54.277721 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:07:54.277587 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cba95b49-bec8-4af0-8d36-f28e3516f78c-istio-data" (OuterVolumeSpecName: "istio-data") pod "cba95b49-bec8-4af0-8d36-f28e3516f78c" (UID: "cba95b49-bec8-4af0-8d36-f28e3516f78c"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 27 21:07:54.279146 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:07:54.279115 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cba95b49-bec8-4af0-8d36-f28e3516f78c-kube-api-access-xctjh" (OuterVolumeSpecName: "kube-api-access-xctjh") pod "cba95b49-bec8-4af0-8d36-f28e3516f78c" (UID: "cba95b49-bec8-4af0-8d36-f28e3516f78c"). InnerVolumeSpecName "kube-api-access-xctjh". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 27 21:07:54.279240 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:07:54.279144 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cba95b49-bec8-4af0-8d36-f28e3516f78c-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "cba95b49-bec8-4af0-8d36-f28e3516f78c" (UID: "cba95b49-bec8-4af0-8d36-f28e3516f78c"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 27 21:07:54.279426 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:07:54.279403 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/cba95b49-bec8-4af0-8d36-f28e3516f78c-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "cba95b49-bec8-4af0-8d36-f28e3516f78c" (UID: "cba95b49-bec8-4af0-8d36-f28e3516f78c"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 27 21:07:54.279496 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:07:54.279406 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cba95b49-bec8-4af0-8d36-f28e3516f78c-istio-token" (OuterVolumeSpecName: "istio-token") pod "cba95b49-bec8-4af0-8d36-f28e3516f78c" (UID: "cba95b49-bec8-4af0-8d36-f28e3516f78c"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 27 21:07:54.379017 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:07:54.378980 2572 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/cba95b49-bec8-4af0-8d36-f28e3516f78c-istio-data\") on node \"ip-10-0-139-2.ec2.internal\" DevicePath \"\"" Jul 27 21:07:54.379017 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:07:54.379011 2572 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cba95b49-bec8-4af0-8d36-f28e3516f78c-istio-token\") on node \"ip-10-0-139-2.ec2.internal\" DevicePath \"\"" Jul 27 21:07:54.379017 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:07:54.379020 2572 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/cba95b49-bec8-4af0-8d36-f28e3516f78c-istio-podinfo\") on node \"ip-10-0-139-2.ec2.internal\" DevicePath \"\"" Jul 27 21:07:54.379017 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:07:54.379028 2572 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/cba95b49-bec8-4af0-8d36-f28e3516f78c-istio-envoy\") on node \"ip-10-0-139-2.ec2.internal\" DevicePath \"\"" Jul 27 21:07:54.379280 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:07:54.379037 2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xctjh\" (UniqueName: \"kubernetes.io/projected/cba95b49-bec8-4af0-8d36-f28e3516f78c-kube-api-access-xctjh\") on node \"ip-10-0-139-2.ec2.internal\" DevicePath \"\"" Jul 27 21:07:55.190691 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:07:55.190661 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-2f806b4e-openshift-default-65dbf4fb9b-xmwnb" Jul 27 21:07:55.227476 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:07:55.227440 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-2f806b4e-openshift-default-65dbf4fb9b-xmwnb"] Jul 27 21:07:55.230188 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:07:55.230158 2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-2f806b4e-openshift-default-65dbf4fb9b-xmwnb"] Jul 27 21:07:55.242049 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:07:55.242020 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbpp5_e2759622-0ab6-46b7-b434-f0a0f8942dfe/konnectivity-agent/0.log" limit=1024 Jul 27 21:07:55.317234 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:07:55.317205 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbpp5_e2759622-0ab6-46b7-b434-f0a0f8942dfe/konnectivity-agent/0.log" limit=1024 Jul 27 21:07:55.416822 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:07:55.416739 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbpp5_e2759622-0ab6-46b7-b434-f0a0f8942dfe/konnectivity-agent/0.log" limit=1024 Jul 27 21:07:55.591945 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:07:55.591918 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbpp5_e2759622-0ab6-46b7-b434-f0a0f8942dfe/konnectivity-agent/0.log" limit=1024 Jul 27 21:07:57.077626 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:07:57.077593 2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cba95b49-bec8-4af0-8d36-f28e3516f78c" path="/var/lib/kubelet/pods/cba95b49-bec8-4af0-8d36-f28e3516f78c/volumes" Jul 27 21:08:01.502310 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:08:01.502277 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbpp5_e2759622-0ab6-46b7-b434-f0a0f8942dfe/konnectivity-agent/0.log" limit=1024 Jul 27 21:08:01.579308 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:08:01.579277 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbpp5_e2759622-0ab6-46b7-b434-f0a0f8942dfe/konnectivity-agent/0.log" limit=1024 Jul 27 21:08:08.859837 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:08:08.859808 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5767d7b464-tggsg_c177ef8d-6173-405a-a19e-5fcb03b66600/copy-manifests/0.log" Jul 27 21:08:08.870441 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:08:08.870413 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5767d7b464-tggsg_c177ef8d-6173-405a-a19e-5fcb03b66600/manager/0.log" Jul 27 21:08:12.044922 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:08:12.044892 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-68cf4d799czz2ql_44540294-2a54-4ae9-812f-e21ac4887037/istio-proxy/0.log" Jul 27 21:08:12.166899 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:08:12.166866 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-dt5js_2837bbdb-20ee-4aee-9977-c78c5c50fa4b/discovery/0.log" Jul 27 21:08:12.642364 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:08:12.642339 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-687dbb6cf6-5bwxq_ac462ac8-4588-4df4-b385-b913c760f392/payload-pre-processing/0.log" Jul 27 21:08:13.476557 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:08:13.476531 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-598466548d-zl2qb_d3b22090-76f1-4387-a89f-0909d15c7649/main/0.log" Jul 27 21:08:13.596793 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:08:13.596767 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fj2qzv_3f9de9c6-4066-4681-ae7e-c4551469ead0/main/0.log" Jul 27 21:08:13.702170 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:08:13.702135 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-74b68447df-dlglp_eb8f2c49-10b7-44c9-8f7c-eb79c6cb55aa/main/0.log" Jul 27 21:08:18.889734 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:08:18.889701 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbpp5_e2759622-0ab6-46b7-b434-f0a0f8942dfe/konnectivity-agent/0.log" limit=1024 Jul 27 21:08:18.987344 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:08:18.987286 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbpp5_e2759622-0ab6-46b7-b434-f0a0f8942dfe/konnectivity-agent/0.log" limit=1024 Jul 27 21:08:21.764000 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:08:21.763972 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-pkjs2_bc590c0d-cfda-4a50-b9b4-3b84a5791324/global-pull-secret-syncer/0.log" Jul 27 21:08:21.856074 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:08:21.856046 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-hbpp5_e2759622-0ab6-46b7-b434-f0a0f8942dfe/konnectivity-agent/0.log" Jul 27 21:08:22.008832 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:08:22.008795 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-139-2.ec2.internal_d7c69f721554e48d394aa7e5598261af/haproxy/0.log" Jul 27 21:08:29.756704 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:08:29.756675 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-ghqck_fec4efe4-fd6d-4f34-a256-e7322a07cef0/node-exporter/0.log" Jul 27 21:08:29.776742 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:08:29.776717 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-ghqck_fec4efe4-fd6d-4f34-a256-e7322a07cef0/kube-rbac-proxy/0.log" Jul 27 21:08:29.803716 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:08:29.803692 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-ghqck_fec4efe4-fd6d-4f34-a256-e7322a07cef0/init-textfile/0.log" Jul 27 21:08:30.163197 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:08:30.163169 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_2a47764b-610b-48b9-8e23-2b1eef779ea9/prometheus/0.log" Jul 27 21:08:30.187419 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:08:30.187396 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_2a47764b-610b-48b9-8e23-2b1eef779ea9/config-reloader/0.log" Jul 27 21:08:30.208038 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:08:30.208018 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_2a47764b-610b-48b9-8e23-2b1eef779ea9/thanos-sidecar/0.log" Jul 27 21:08:30.234948 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:08:30.234927 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_2a47764b-610b-48b9-8e23-2b1eef779ea9/kube-rbac-proxy-web/0.log" Jul 27 21:08:30.257977 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:08:30.257958 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_2a47764b-610b-48b9-8e23-2b1eef779ea9/kube-rbac-proxy/0.log" Jul 27 21:08:30.279160 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:08:30.279142 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_2a47764b-610b-48b9-8e23-2b1eef779ea9/kube-rbac-proxy-thanos/0.log" Jul 27 21:08:30.300752 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:08:30.300736 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_2a47764b-610b-48b9-8e23-2b1eef779ea9/init-config-reloader/0.log" Jul 27 21:08:32.044680 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:08:32.044642 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-mmb4n/perf-node-gather-daemonset-gklt4"] Jul 27 21:08:32.045056 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:08:32.044961 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cba95b49-bec8-4af0-8d36-f28e3516f78c" containerName="istio-proxy" Jul 27 21:08:32.045056 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:08:32.044972 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="cba95b49-bec8-4af0-8d36-f28e3516f78c" containerName="istio-proxy" Jul 27 21:08:32.045056 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:08:32.044996 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a65ac587-3937-44c2-821e-000588bac7e3" containerName="payload-pre-processing" Jul 27 21:08:32.045056 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:08:32.045002 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="a65ac587-3937-44c2-821e-000588bac7e3" containerName="payload-pre-processing" Jul 27 21:08:32.045056 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:08:32.045009 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a6bfb2f8-16b0-42ce-ab47-ce54959b4ab6" containerName="payload-processing" Jul 27 21:08:32.045056 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:08:32.045016 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="a6bfb2f8-16b0-42ce-ab47-ce54959b4ab6" containerName="payload-processing" Jul 27 21:08:32.045247 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:08:32.045067 2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="a65ac587-3937-44c2-821e-000588bac7e3" containerName="payload-pre-processing" Jul 27 21:08:32.045247 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:08:32.045079 2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="a6bfb2f8-16b0-42ce-ab47-ce54959b4ab6" containerName="payload-processing" Jul 27 21:08:32.045247 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:08:32.045087 2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="cba95b49-bec8-4af0-8d36-f28e3516f78c" containerName="istio-proxy" Jul 27 21:08:32.048031 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:08:32.048012 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-mmb4n/perf-node-gather-daemonset-gklt4" Jul 27 21:08:32.049918 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:08:32.049897 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-mmb4n\"/\"openshift-service-ca.crt\"" Jul 27 21:08:32.050023 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:08:32.049983 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-mmb4n\"/\"kube-root-ca.crt\"" Jul 27 21:08:32.050350 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:08:32.050311 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-mmb4n\"/\"default-dockercfg-xnqkl\"" Jul 27 21:08:32.055161 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:08:32.055131 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-mmb4n/perf-node-gather-daemonset-gklt4"] Jul 27 21:08:32.086497 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:08:32.086468 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/84a552cf-5e3c-42c9-8301-3aab046cb019-sys\") pod \"perf-node-gather-daemonset-gklt4\" (UID: \"84a552cf-5e3c-42c9-8301-3aab046cb019\") " pod="openshift-must-gather-mmb4n/perf-node-gather-daemonset-gklt4" Jul 27 21:08:32.086613 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:08:32.086501 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/84a552cf-5e3c-42c9-8301-3aab046cb019-proc\") pod \"perf-node-gather-daemonset-gklt4\" (UID: \"84a552cf-5e3c-42c9-8301-3aab046cb019\") " pod="openshift-must-gather-mmb4n/perf-node-gather-daemonset-gklt4" Jul 27 21:08:32.086664 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:08:32.086650 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/84a552cf-5e3c-42c9-8301-3aab046cb019-lib-modules\") pod \"perf-node-gather-daemonset-gklt4\" (UID: \"84a552cf-5e3c-42c9-8301-3aab046cb019\") " pod="openshift-must-gather-mmb4n/perf-node-gather-daemonset-gklt4" Jul 27 21:08:32.086704 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:08:32.086681 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dnqhz\" (UniqueName: \"kubernetes.io/projected/84a552cf-5e3c-42c9-8301-3aab046cb019-kube-api-access-dnqhz\") pod \"perf-node-gather-daemonset-gklt4\" (UID: \"84a552cf-5e3c-42c9-8301-3aab046cb019\") " pod="openshift-must-gather-mmb4n/perf-node-gather-daemonset-gklt4" Jul 27 21:08:32.086893 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:08:32.086871 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/84a552cf-5e3c-42c9-8301-3aab046cb019-podres\") pod \"perf-node-gather-daemonset-gklt4\" (UID: \"84a552cf-5e3c-42c9-8301-3aab046cb019\") " pod="openshift-must-gather-mmb4n/perf-node-gather-daemonset-gklt4" Jul 27 21:08:32.188135 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:08:32.188105 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/84a552cf-5e3c-42c9-8301-3aab046cb019-proc\") pod \"perf-node-gather-daemonset-gklt4\" (UID: \"84a552cf-5e3c-42c9-8301-3aab046cb019\") " pod="openshift-must-gather-mmb4n/perf-node-gather-daemonset-gklt4" Jul 27 21:08:32.188358 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:08:32.188192 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/84a552cf-5e3c-42c9-8301-3aab046cb019-lib-modules\") pod \"perf-node-gather-daemonset-gklt4\" (UID: \"84a552cf-5e3c-42c9-8301-3aab046cb019\") " pod="openshift-must-gather-mmb4n/perf-node-gather-daemonset-gklt4" Jul 27 21:08:32.188358 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:08:32.188217 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dnqhz\" (UniqueName: \"kubernetes.io/projected/84a552cf-5e3c-42c9-8301-3aab046cb019-kube-api-access-dnqhz\") pod \"perf-node-gather-daemonset-gklt4\" (UID: \"84a552cf-5e3c-42c9-8301-3aab046cb019\") " pod="openshift-must-gather-mmb4n/perf-node-gather-daemonset-gklt4" Jul 27 21:08:32.188358 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:08:32.188232 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/84a552cf-5e3c-42c9-8301-3aab046cb019-proc\") pod \"perf-node-gather-daemonset-gklt4\" (UID: \"84a552cf-5e3c-42c9-8301-3aab046cb019\") " pod="openshift-must-gather-mmb4n/perf-node-gather-daemonset-gklt4" Jul 27 21:08:32.188358 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:08:32.188249 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/84a552cf-5e3c-42c9-8301-3aab046cb019-podres\") pod \"perf-node-gather-daemonset-gklt4\" (UID: \"84a552cf-5e3c-42c9-8301-3aab046cb019\") " pod="openshift-must-gather-mmb4n/perf-node-gather-daemonset-gklt4" Jul 27 21:08:32.188358 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:08:32.188300 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/84a552cf-5e3c-42c9-8301-3aab046cb019-sys\") pod \"perf-node-gather-daemonset-gklt4\" (UID: \"84a552cf-5e3c-42c9-8301-3aab046cb019\") " pod="openshift-must-gather-mmb4n/perf-node-gather-daemonset-gklt4" Jul 27 21:08:32.188658 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:08:32.188362 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/84a552cf-5e3c-42c9-8301-3aab046cb019-podres\") pod \"perf-node-gather-daemonset-gklt4\" (UID: \"84a552cf-5e3c-42c9-8301-3aab046cb019\") " pod="openshift-must-gather-mmb4n/perf-node-gather-daemonset-gklt4" Jul 27 21:08:32.188658 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:08:32.188369 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/84a552cf-5e3c-42c9-8301-3aab046cb019-lib-modules\") pod \"perf-node-gather-daemonset-gklt4\" (UID: \"84a552cf-5e3c-42c9-8301-3aab046cb019\") " pod="openshift-must-gather-mmb4n/perf-node-gather-daemonset-gklt4" Jul 27 21:08:32.188658 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:08:32.188408 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/84a552cf-5e3c-42c9-8301-3aab046cb019-sys\") pod \"perf-node-gather-daemonset-gklt4\" (UID: \"84a552cf-5e3c-42c9-8301-3aab046cb019\") " pod="openshift-must-gather-mmb4n/perf-node-gather-daemonset-gklt4" Jul 27 21:08:32.197450 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:08:32.197423 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dnqhz\" (UniqueName: \"kubernetes.io/projected/84a552cf-5e3c-42c9-8301-3aab046cb019-kube-api-access-dnqhz\") pod \"perf-node-gather-daemonset-gklt4\" (UID: \"84a552cf-5e3c-42c9-8301-3aab046cb019\") " pod="openshift-must-gather-mmb4n/perf-node-gather-daemonset-gklt4" Jul 27 21:08:32.358844 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:08:32.358757 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-mmb4n/perf-node-gather-daemonset-gklt4" Jul 27 21:08:32.486084 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:08:32.486054 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-mmb4n/perf-node-gather-daemonset-gklt4"] Jul 27 21:08:32.489635 ip-10-0-139-2 kubenswrapper[2572]: W0727 21:08:32.489609 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod84a552cf_5e3c_42c9_8301_3aab046cb019.slice/crio-1163b46d2cffa2ecd0a4db038665aa284aa5563559a4c81736f68fcab89c4c60 WatchSource:0}: Error finding container 1163b46d2cffa2ecd0a4db038665aa284aa5563559a4c81736f68fcab89c4c60: Status 404 returned error can't find the container with id 1163b46d2cffa2ecd0a4db038665aa284aa5563559a4c81736f68fcab89c4c60 Jul 27 21:08:33.352576 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:08:33.352536 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-mmb4n/perf-node-gather-daemonset-gklt4" event={"ID":"84a552cf-5e3c-42c9-8301-3aab046cb019","Type":"ContainerStarted","Data":"a6932ba20e3079af3f916fa91efebf3b9d5d227f14db08a42e546bfc31eb3ced"} Jul 27 21:08:33.353023 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:08:33.352596 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-mmb4n/perf-node-gather-daemonset-gklt4" event={"ID":"84a552cf-5e3c-42c9-8301-3aab046cb019","Type":"ContainerStarted","Data":"1163b46d2cffa2ecd0a4db038665aa284aa5563559a4c81736f68fcab89c4c60"} Jul 27 21:08:33.353023 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:08:33.352619 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-mmb4n/perf-node-gather-daemonset-gklt4" Jul 27 21:08:33.370438 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:08:33.370388 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-mmb4n/perf-node-gather-daemonset-gklt4" podStartSLOduration=1.370373751 podStartE2EDuration="1.370373751s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 21:08:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 21:08:33.36893874 +0000 UTC m=+2046.838481750" watchObservedRunningTime="2026-07-27 21:08:33.370373751 +0000 UTC m=+2046.839916795" Jul 27 21:08:34.725363 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:08:34.725313 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-w5k72_020c2b0f-251f-48ce-b2bb-7f5006effa41/dns/0.log" Jul 27 21:08:34.745988 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:08:34.745967 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-w5k72_020c2b0f-251f-48ce-b2bb-7f5006effa41/kube-rbac-proxy/0.log" Jul 27 21:08:34.820012 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:08:34.819986 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-xrf29_7331b999-e372-4a69-854a-11042f5892c3/dns-node-resolver/0.log" Jul 27 21:08:35.348014 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:08:35.347973 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-7949c779f6-665wf_f8ea75ef-7df9-4274-8e01-134ce40330a2/registry/0.log" Jul 27 21:08:35.368091 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:08:35.368068 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-jrnhm_84e2598f-0da6-4f38-8dda-46b8c0fbd329/node-ca/0.log" Jul 27 21:08:36.150941 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:08:36.150910 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbpp5_e2759622-0ab6-46b7-b434-f0a0f8942dfe/konnectivity-agent/0.log" limit=1024 Jul 27 21:08:36.348426 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:08:36.348395 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-68cf4d799czz2ql_44540294-2a54-4ae9-812f-e21ac4887037/istio-proxy/0.log" Jul 27 21:08:36.429122 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:08:36.429046 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-dt5js_2837bbdb-20ee-4aee-9977-c78c5c50fa4b/discovery/0.log" Jul 27 21:08:36.583738 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:08:36.583704 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-687dbb6cf6-5bwxq_ac462ac8-4588-4df4-b385-b913c760f392/payload-pre-processing/0.log" Jul 27 21:08:37.356688 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:08:37.356661 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-8hg9x_90e4b45e-4cd9-4f54-bcd8-f3cc60b2ba83/serve-healthcheck-canary/0.log" Jul 27 21:08:37.836987 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:08:37.836948 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5885fdb759-hmsn4_5bf027b2-e887-41cd-a84c-7a027003ae96/insights-operator/0.log" Jul 27 21:08:37.860126 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:08:37.860095 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-59bwv_59206a62-e80f-4339-9698-16334b19fdba/kube-rbac-proxy/0.log" Jul 27 21:08:37.903944 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:08:37.903921 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-59bwv_59206a62-e80f-4339-9698-16334b19fdba/exporter/0.log" Jul 27 21:08:37.941889 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:08:37.941867 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-59bwv_59206a62-e80f-4339-9698-16334b19fdba/extractor/0.log" Jul 27 21:08:39.366931 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:08:39.366900 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-mmb4n/perf-node-gather-daemonset-gklt4" Jul 27 21:08:40.788335 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:08:40.788295 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5767d7b464-tggsg_c177ef8d-6173-405a-a19e-5fcb03b66600/manager/0.log" Jul 27 21:08:40.824139 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:08:40.824114 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5767d7b464-tggsg_c177ef8d-6173-405a-a19e-5fcb03b66600/copy-manifests/0.log" Jul 27 21:08:40.944127 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:08:40.944045 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbpp5_e2759622-0ab6-46b7-b434-f0a0f8942dfe/konnectivity-agent/0.log" limit=1024 Jul 27 21:08:40.998934 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:08:40.998905 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbpp5_e2759622-0ab6-46b7-b434-f0a0f8942dfe/konnectivity-agent/0.log" limit=1024 Jul 27 21:08:42.254069 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:08:42.254044 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-77cbdf6c7d-wfq2l_a187ed56-7f3d-4916-89cb-b703b75374fa/manager/0.log" Jul 27 21:08:42.714239 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:08:42.714212 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-68cf4d799czz2ql_44540294-2a54-4ae9-812f-e21ac4887037/istio-proxy/0.log" Jul 27 21:08:42.788521 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:08:42.788490 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-dt5js_2837bbdb-20ee-4aee-9977-c78c5c50fa4b/discovery/0.log" Jul 27 21:08:42.907694 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:08:42.907664 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-687dbb6cf6-5bwxq_ac462ac8-4588-4df4-b385-b913c760f392/payload-pre-processing/0.log" Jul 27 21:08:44.161501 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:08:44.161470 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-68cf4d799czz2ql_44540294-2a54-4ae9-812f-e21ac4887037/istio-proxy/0.log" Jul 27 21:08:44.226543 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:08:44.226515 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-dt5js_2837bbdb-20ee-4aee-9977-c78c5c50fa4b/discovery/0.log" Jul 27 21:08:44.354168 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:08:44.354138 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-687dbb6cf6-5bwxq_ac462ac8-4588-4df4-b385-b913c760f392/payload-pre-processing/0.log" Jul 27 21:08:47.204666 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:08:47.204639 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-6865c9967-kp6jj_2caee9ab-bf91-460d-b776-a163046deeb8/migrator/0.log" Jul 27 21:08:47.229628 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:08:47.229599 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-6865c9967-kp6jj_2caee9ab-bf91-460d-b776-a163046deeb8/graceful-termination/0.log" Jul 27 21:08:49.120143 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:08:49.120072 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-qsbl2_83536de2-e5d6-4f8b-9ad4-abe6165a1039/kube-multus-additional-cni-plugins/0.log" Jul 27 21:08:49.144634 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:08:49.144605 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-qsbl2_83536de2-e5d6-4f8b-9ad4-abe6165a1039/egress-router-binary-copy/0.log" Jul 27 21:08:49.168015 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:08:49.167993 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-qsbl2_83536de2-e5d6-4f8b-9ad4-abe6165a1039/cni-plugins/0.log" Jul 27 21:08:49.192107 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:08:49.192082 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-qsbl2_83536de2-e5d6-4f8b-9ad4-abe6165a1039/bond-cni-plugin/0.log" Jul 27 21:08:49.214761 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:08:49.214737 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-qsbl2_83536de2-e5d6-4f8b-9ad4-abe6165a1039/routeoverride-cni/0.log" Jul 27 21:08:49.237781 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:08:49.237759 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-qsbl2_83536de2-e5d6-4f8b-9ad4-abe6165a1039/whereabouts-cni-bincopy/0.log" Jul 27 21:08:49.259790 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:08:49.259766 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-qsbl2_83536de2-e5d6-4f8b-9ad4-abe6165a1039/whereabouts-cni/0.log" Jul 27 21:08:49.320010 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:08:49.319988 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-sm7zg_2950235c-cbe6-4602-a643-5ba127fd1125/kube-multus/0.log" Jul 27 21:08:49.342350 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:08:49.342315 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-87fvc_d2fb5de3-00ca-444a-a828-e3938289b62d/network-metrics-daemon/0.log" Jul 27 21:08:49.365711 ip-10-0-139-2 kubenswrapper[2572]: I0727 21:08:49.365688 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-87fvc_d2fb5de3-00ca-444a-a828-e3938289b62d/kube-rbac-proxy/0.log"